Data Engineer (m/f/d) Azure & Databricks | Cloud & Streaming

Job Description

Your mission Want to work with modern data platforms instead of maintaining legacy systems? Then join us in designing powerful data solutions for analytics and machine learning in an innovative cloud environment. With us, you'll find an experienced team, the latest technologies, and real opportunities to shape the future. As a Data Engineer (m/f/d) with a focus on Databricks, you will be responsible for: Developing and optimizing data pipelines for batch and real-time processing (Databricks, Spark, Kafka) Building and operating scalable data architectures on the Azure Cloud Implementing MLOps workflows for machine learning projects Integration and processing of large amounts of data from different sources Ensuring data quality, performance, and security Close collaboration with data scientists and analysts Support and further development of streaming applications (e.g., Flink, Spark Streaming) Monitoring and continuous improvement of the data infrastructure Your profile Ideally, you will have: A degree in computer science, data science, or a comparable qualification Experience with Databricks (e.g., MLflow, Unity Catalog, Delta Lake) Very good knowledge of Apache Spark, Kafka, and Flink Sound programming skills in Python or Scala, confident in using SQL Practical experience with Azure Cloud; AWS or GCP is an advantage Experience with CI/CD, Infrastructure-as-Code (e.g., Terraform), Kubernetes, or Docker is a plus Structured, independent way of working & team orientation Very good German and English skills A career change is also possible if you have the relevant practical experience. Your benefits Competitive remuneration, flexible working hours, working time account, and part-time models for maximum work-life balance. High-end tools of your choice: iPhone, MacBook, or ThinkPad. Hours within the Steadforce “Campus” and the “Center of Competence” at your disposal for your individual further training, as well as participation in summits, conferences, etc. Central office in Munich's Westend district with modern equipment and good transport connections. Motivated, collegial, and dynamic team that works together on exciting projects and supports each other. An annual contribution to the company pension scheme and private accident insurance. Company events, such as the annual kick-off party, cooking events, Oktoberfest, etc., which strengthen team spirit and create unforgettable moments. We are proud to have been recognized as a “family-friendly company” and support our employees in various life situations, e.g., through our Family Office. Workation – work from another EU country. Enjoy the sun while still staying connected to the team. A wide range of additional benefits on top, such as the Deutschland Ticket, e-gym Wellpass membership, Edenred prepaid card, corporate benefits, Job Rad, gaming room, and much more...