BIG DATA DEVELOPER

  • Luxoft
  • Zürich, Switzerland
  • 03/09/2018
Full time Data Science Data Engineering Data Analytics Big Data Data Management Statistics Software Engineering

Job Description

Analytics lab is a Big Data platform that provides critical functionality for investment bank data analytics. Analytics lab is being used to explore and define new datasets, these are then released to the Analysis factory as either new data models or updates to existing models with associated flows from the data lake.

Responsibilities

- Implement data transformation pipelines in Big Data Platform (Spark, Scala, Python)
- Code and design review
- Data science including data querying in SQL
- Query, process and analyse large data sets

Skills

Core skills:
- 2+ years of experience working in data and big data projects
- Hadoop inc. Cloudera hands on experience
- Python
- Scala
- Spark
- Ability to write complex SQL queries

Nice to have:
- Impala
- Hive
- Oozie
- Sentry

Language

  • English: Upper-intermediate