Data Engineer - Streaming & Vehicle Data (m/f/d)

You support the further development of telematics processing processes via Spark Structured Streaming. The technical connection of Object Stores to the streaming platform for enrichment and aggregation of telematics data is ensured and continuously optimized. You can refine raw data across several quality levels (Bronze, Silver, Gold) and transfer complex structures into flat formats to enable precise and efficient data analysis. In addition, you will accompany us in technological development and bring openness to address the components of the overall architecture such as Cloud Streaming Architecture, AWS IoT Core, MQTT, Datalakes and Databricks in the future.

Your studies in computer science, business information technology or comparable training are the technical basis. You have well-founded knowledge of data processing with data platforms such as databricks and practical experience in handling Apache Spark and streaming concepts. In daily work, use Python (PySpark) and SQL routined to make efficient data pipelines and implement transformations. You bring experience with cloud-native architectures, for example in the Microsoft Azure environment and in the handling of Blob Storage solutions. You are ready to extend your knowledge to new areas such as Cloud Streaming Architecture in the AWS IoT environment in a perspective manner as needed. It gives you the pleasure to direct complex data flows into structured paths and to develop technologically together with us. Secure appearance in the team and communication strength - in good German or English - complete your profile.

.