Big Data Engineer

  • Cross-Systems
  • Regus Genève Carouge les Acacias, Avenue Industrielle, Geneva, Switzerland
  • 09/10/2019
Full time Data Science Data Analytics Big Data Statistics

Job Description

CROSS is a consulting and engineering company, a subsidiary of the Micropole group, specialized in the fields of Digital Transformation, Performance Management and Data Governance. Present in French-speaking Switzerland since 1987, the 200 employees who make up the company support its customers from strategic thinking to the implementation of the solution and its support.

In order to strengthen our teams, we are looking for one of our clients in Geneva for an:

Big Data Engineer


Localisation: Geneva

Daily Rate: 100%


Mission's Description:

  • This mission is for a big data engineer to reinforce our data engineering chapter within our data science team. You will turn raw data sources into exploitable streams ready for in-depth analysis by our data scientists.
  • You will be in constant communication with data vendors in order to integrate different data sources into our data repositories. You will evaluate providers of structured and unstructured datasets, and design integration solutions. You will architect and implement high performance batch and streaming data pipelines for our data scientists and internal business users by using our big data stack (on-premise kubernetes, AWS stack with lambda, lake S3, Glue catalogue, RDS, Spark).

Role:

  • Data scouting : identify and contact various data providers (alternative and classic data providers)
  • Data crawling: create crawlers for structure/unstructured data providers.
  • Maintain up to date data scout framework
  • Data acquisition: create data pipeline (on-premise and cloud based)
  • Data structuring: structure raw data

Skills:

  • Excellent command of Python programming
  • Communication
  • Databases: SQL, noSQL, Graph (Neo4J)
  • Deployment: Kubernetese and AWS data stack (lambda, lake S3, Glue catalogue, RDS, …)

Languages: French and English are required