Your opportunity:
Are you an experienced Data Engineer who confidently manages and optimizes complex data landscapes on Azure Databricks? Are you passionate about building high-performance data pipelines with PySpark and developing innovative pro-code AI solutions (e.g., with Langchain and Python)? Then you've come to the right place! As a Data & AI Engineer in our Data & AI team, you will lay the technical foundation for our data strategy. You will be responsible for robust data integration, the performance of our Databricks platform, and the implementation of sophisticated AI/ML applications.

• • Core Data Platform Engineering & Performance (Azure Databricks, PySpark):
    Design, development, and optimization of scalable ingestion and core data pipelines (batch/streaming) using PySpark on Azure Databricks. Ensuring stability and performance up to the Silver Layer.

• • Data Integration & Basic Transformations (dbt):
    Robust integration of data from diverse source systems and implementation of core data transformations (harmonization, consolidation up to the Silver Layer or initial Gold Layer) within our medallion architecture, primarily with dbt.

• • Pro-Code AI/ML Development & Implementation:
    Design and development of customized AI/ML solutions (e.g. for anomaly detection, NLP applications) using Python, specialized libraries and frameworks such as Langchain.

• • MLOps & Operationalization of AI Models:
    Implementation and support of MLOps processes for deployment, monitoring and continuous improvement of AI models (e.g. with MLflow).

• • Infrastructure Automation & Core DevOps (IaC, CI/CD):
    Design and maintenance of our data infrastructure using Infrastructure as Code (Terraform/Bicep) as well as development of CI/CD pipelines for core data and AI workloads.

• • Technical conception & platform architecture:
    Support in the technical conception of complex data projects and significant participation in the definition and further development of the platform architecture.

• Platform monitoring, optimization & cost management:
  Continuous monitoring of system performance, identification of bottlenecks, implementation of optimization measures and ensuring cost efficiency.

• • Several years of professional experience (at least 3-5 years) in data engineering, especially in the setup and operation of data platforms in cloud environments (ideally Azure).

• • Solid knowledge of development with PySpark and experience with Azure Databricks (performance tuning, optimization).

• • Proven experience in the development and productive use of pro-code AI/ML models (Python, common ML libraries, ideally experience with LLMs/Langchain).

• • Excellent SQL skills and experience with dbt for data transformations.

• • Experienced in using Git, CI/CD processes and Infrastructure as Code (Terraform/Bicep).

• • Analytical thinking, systematic problem-solving, and high quality standards.

• • Team-oriented, strong communicator and willing to share knowledge.

• Fluent German and English skills.

For further information about the position, please contact our HR team at +41 58 400 24 42.