Big Data DevOps

  • Luxoft
  • Zürich, ZH, Switzerland
  • 01/12/2021
Full time Data Science Big Data Data Management Biostatistics

Job Description

Project Description

Strategic Data Platform is the major Big Data platform that provides critical functionality for investment bank data analytics-driven compliance and risk management functions. The main objective of the project is to support infrastructure capabilities for the Data Platform, including CI/CD processes, security matters and programming support.
The role is in the middle of developers and infrastructure responsibilities - you will be able to apply your python coding skills for taking care of data transformation pipelines, as well as accelerating bank's digital transformation with configuration setup of Cloudera clusters. Additionally you'll have opportunity to dig into more detailed infrastructure levels and explore security concepts used underneath.

Responsibilities

    • Building and improving CI / CD environment across the toolset
    • Develop ETL processes to integrate with internal back-end systems
    • Linux / UNIX configuration for DevOps processes
    • Writing scripts in Python/Shell/Bash
    • Development support of BigData software solutions

Skills

Must have

    • Hands-on experience with Cloudera
    • Experience with one or more major Hadoop distributions and various ecosystem components (e.g. HDFS, Spark, Sqoop, Impala, Flume, Kafka, Nifi, Elastic, Kibana etc.) is a must while experience with Data Concepts (ETL, near-/real-time streaming, data structures, metadata and workflow management) would be a big strength
    • Prior hands on Big Data platform development experience in large projects with ability to translate technical designs into working solutions and to build and maintain positive relationships with Architect and Big Data Project teams to work out platform features
    • Good Programming / Scripting Skills (Python, Bash, Korn Shell)
    • Understanding of DevOps Tools (Chef, Docker, Puppet, Bamboo, Jenkins)
    • You are dedicated and results-oriented with proficient verbal and written communication skills in English with the ability to communicate effectively
    • You have a bachelor degree in Computer Science or an equivalent education in related disciplines

Nice to have

    • Information Security knowledge is an advantage
    • Banking knowledge
    • Experience in large projects, large systems, with large throughput, high performance, lots of data
    • Work in Agile methodologies, Scrum

Languages

English: C1 Advanced

Seniority

Senior

Relocation package

If needed, we can help you with relocation process.

Vacancy Specialization

DevOps

Ref Number

VR-67932