Intern for AI Evaluation for LLM-based Systems in the Field of Data and AI Research & Development

Life is always about becoming... In life it is about going on a journey to become the best version of our future self. As we discover new things, we face challenges, master them and grow beyond us.

Apply to Mercedes-Benz and find the area where you can develop your talents individually. You will be supported by visionary colleagues who share your pioneering spirit. Joining us means becoming part of a global team whose goal is to build the most desirable cars in the world. Together for excellence.

Number: MER00043BW Mercedes-Benz Group AG is one of the most successful automotive companies in the world. With Mercedes-Benz AG, the vehicle manufacturer is one of the largest providers of premium and luxury cars and vans. Being part of Mercedes-Benz means finding the area where you can develop your talents individually. It means in a global automotive company that the goal has to build the most desirable cars in the world to give its best. You will be supported by visionary colleagues who share their pioneering spirit. Together for excellence. Our team Data & AI for RD (Research & Development) Digitization at Mercedes-Benz is driving the digital transformation in research and development. We use state-of-the-art technologies and innovative approaches to analyse large amounts of data and develop intelligent solutions. These challenges include: LLM Evaluation & Metrics Development: Development and scientific research findings of evaluation approaches for LLM-based agents

Conception and operationalisation of quality criteria that meet the requirements of a productive AI approach

Analysis of agentic decision-making processes and outputs for deriving manageable quality standards

Statistical analysis & experiment design: Design and implementation of experiments to validate and calibrate automated evaluation procedures

Application of statistical methods to quantify the resilience, stability and meaningfulness of evaluation scores

Identification and analysis of systematic distortions in automated assessment systems

deriving stressful, statistically secure conclusions from complex model and system comparisons

Data & Pipeline Engineering: Conception and implementation of scalable analysis pipelines in Python

Processing and structured evaluation of large amounts of evaluation data from the R&D environment

Integration of modern frameworks for automation and reproducibility of the entire evaluation cycle

Visualization & documentation: Preparation of complex results in clear, decision-relevant visualizations and interactive dashboards

Development of comprehensible reports as the basis for data-driven model and system decisions

Active contribution to building a company-wide quality standard for AI systems in vehicle development

The activity can begin from July 2026.

Studies of statistics, data science, psychology, social sciences or a comparable study programme with a quantitative focus

Secure knowledge of German and English in word and writing

Knowledge of programming in Python

Confidence with experiment tracking and evaluation logging systems (e.g. MLflow, Weights & Biases or comparable) of advantage

Ideally practical experience in Agentic AI

Interest in the basics and limitations of modern AI systems

Commitment and team skills

Enthusiasm for innovative technologies and the willingness to work independently on new topics

Analytical, structured thinking with the claim to not only calculate results, but to penetrate

Additional information: We are looking forward to your online application with CV, lettering, certificates, current enrollment certificate with a specification of the semester, if necessary. Compulsory internship certificate and proof of the regular study period. Please do not forget to mark your documents as ''relevant for this application' in the online form and note the maximum file size of 5 MB. Further information on the setting criteria can be found here. Disabled and equalized applicants are welcome! The severely disabled representative (sbv-sindelfingen@mercedes-benz.com) is happy to support you in the application process. HR Services will be happy to help you with questions about the application process. You can reach us by email via myhrservice@mercedes-benz.com or by phone at 0711/17-99000 (Mo-Fr 10-12am & 13-15am).

Food supplements Employee handy possible Employee discounts possible Employee participation possible Staff Events Coaching Flexible working time possible Hybrid work possible Health measures Employment Mobility offers Parking space Business doctor Good connection Accessibility Child care Kantine, Café