Data Integration Engineer – Focus on Streaming & Confluent (m/f/d)

-> Connection of data sources to Confluent Cloud: You connect source systems to our central data hub – primarily via Change Data Capture (CDC) and, where technically reasonable, case-based via a custom connector you are developing. The connection also includes the appropriate preparation, such as the cataloging of the source data together with the Data Owners, to ensure a clean, comprehensible integration. -> Process design, standardization and automation: You design the integration processes around these connections in such a way that You are standardized and automated from the start – from reusable, configuration-driven patterns to enterprise-specific packages that enable the connection of new sources and topics efficiently and without code intervention. You establish best practices in the field of Data Engineering and DataOps. -> Operation of integration routes: You enter the integration paths and processes you have built up in operational operation, motivates stability and reliability, analyzes sources of errors and develops sustainable solutions. -> Security, Privacy & Compliance You are responsible for the relevant security inspections in the context of your integrations, including, in particular, the implementation of data protection requirements (GDPR), the safe handling of sensitive data and topics such as access and secret management. -> Reporting & Monitoring as a platform component: You build the reporting and monitoring for the integration artefacts as your own platform component – from consumer load and pipeline monitoring to data quality testing to end-to-end traceability – and thus create transparency about the state of the integration lines. -> Data modelling & further processing: You support the transfer of the integrated (event) data to our Lakehouse and the modelling according to the Data-Vault approach and work closely with the further processing areas of the team. ->Cooperation, DevOps-Reviews & Knowledge Transfer: You work closely with the team and the stakeholders, share your knowledge and support the team across all platform components during DevOps reviews – not only in the Confluent context.

We do not seek all-rounders: women with decades of professional experience, but people with enthusiasm and curiosity approach new tasks. If you're motivated to work into new tools and technologies, you're right with us. Lack of knowledge is not an obstacle – we support you with training and enable you to develop professionally and personally. Your willingness to learn, your commitment and the desire to move together in the team are crucial for us. You have a completed training / a completed study in the field of (economic) informatics, mathematics, natural sciences or a comparable qualification. You have experience in the integration and processing of real-time or Streaming data – ideally with Apache Kafka (Confluent Cloud) and in the environment of Change Data Capture (CDC). Knowledge about topics such as Schema Registry, Avro, Debezium or the development of connectors is a plus. You think in processes: You are delighted to design, standardize and automate integration routes instead of building individual solutions. You have an awareness of security and data protection issues (e.g. GDPR) in dealing with data. You have practical experience in data integration, ideally in the environment of Data Warehousing, Data Lakehousing or comparable platforms. You have knowledge of the development of ELT processes – experience with Azure Databricks and Python (PySpark) are a plus. You have ideally experience in data modeling according to the data default approach. You are safe in handling common database and cloud technologies (ideally Azure) and have a good understanding of the challenges and opportunities of modern data platforms. You work structured, solution-oriented and independent. You are a team-ready, strong communication and you like to introduce new ideas. We require good knowledge of German that enables secure communication in everyday work. Since we work internationally, very good English skills in word and writing are also a must.

The ability to actively participate in the construction of a forward-looking data and integration platform – and to significantly shape one of its first central integration points. A young, motivated, interdisciplinary team with plenty of design space and short decision-making paths. Various possibilities for professional and personal development, e.g. through trainings, certifications (e.g. in the Confluent/Kafka or Databricks environment) and exchange with experts. Holiday and Christmas money, wealth-effective services Aid for occupational pension schemes 30 days holiday and flexible working time and sliding time regulations Staff canteen and free staff parking Cooperation with gyms, including Hansefit Advantages of an owner-managed large company, such as short decision-making, independent and independent work Bike leasing with attractive conditions Corporate Benefits: Employee discounts for well-known brands and suppliers (e.g. discounts for travel) Perfectly connected by Veloroute 10, own railway station and direct highway trainer direct mall access with over 80 stores, medical center and employee discount for shopping in the CITTI market We sponsor your work path with the NAH.SH Job Ticket or Germany Ticket. .