NTT DATA Deutschland SE: Lead Private AI Architect (w/m/x) - GenAI, LLM & Enterprise AI Platforms

We are part of NTT DATA, a leading provider of corporate and technology services, AI and digital infrastructure with a turnover of over $30 billion. As a Global Top Employer, NTT DATA manages 75% of Fortune Global 100 companies and develops innovative solutions together with experts in over 70 countries that inspire new ventures and make success visible. We are represented in the DACH region at 15 locations in Germany, Austria and Switzerland.

Make this the place where you grow

Enterprise AI needs more than powerful models – it needs a secure, scalable and sovereign architecture. As a private AI Architect (w/m/x), you are building this foundation: from strategic architecture to private AI and GenAI platforms to productive implementation. In doing so, you combine technological depth with consulting expertise and develop AI solutions together with our customers, where innovation, data protection and governance come together.

LI-DS1

Your Benefits

• Flexible working hours with sliding time regulation and travel time is working time
• Home-Office possibility and agreement with compensation grant incl. Workstation possible
• 30 days holiday, in addition are the 24.12. and 31.12. unemployed days
• Sabbatical up to one year possible
• Remote work as well as mobile work possible in EU countries
• Attractive benefits and pay optimization programs: occupational retirement, JobRad, Jobticket, exclusive corporate benefits discounts and much more
• Extensive health and precautionary offers: lengthened payment in case of illness, occupational health care, accident insurance also for leisure accidents worldwide, family service
• Internal and external training opportunities in the NTT DATA Academy with professional training, certification offers, soft-skill training, Udemy access
• Various communities and initiatives (to diversity, equity & inclusion, ESG and more) with knowledge sharing at eye level
• Team-oriented corporate culture with a lot of design space

Your mission

• You design Enterprise Private AI and GenAI platforms and develop high-level and low-level designs, blueprints and reference architectures for on-premises, private cloud, hybrid and sovereign AI environments.
• You develop powerful LLM, RAG and Agentic AI architectures based on open source and self-hosted technologies and create scalable inference architectures for enterprise AI workloads.
• You bring AI platforms into production with Kubernetes, Containerization and MLOps/LLMOps and shape the entire lifecycle from deployment and evaluation to monitoring and governance.
• You support our customers as a trusted advisor in AI strategy, platform modernisation, infrastructure readiness and AI operating models and drive POCs, MVPs and Enterprise AI initiatives.
• You connect AI, infrastructure, cloud, security and data engineering and take responsibility for RFPs, offers and effort estimates as well as reusable private AI frameworks and accelerators.

Your skill set

• You have over 15+ years of IT experience, of which at least 5 years in AI/ML architecture, and have successfully implemented Enterprise AI/GenAI solutions in private cloud, on-premises or hybrid environments.
• You have deep expertise in LLMs, RAG, Vector Databases, Prompt Engineering and Agentic AI and know frameworks such as LangChain, LlamaIndex, Haystack or Semantic Kernel as well as open source models such as Llama, Mistral, DeepSeek or Qwen.
• You master Kubernetes, Docker/OpenShift as well as MLOps/LLMOps and know technologies such as MLflow, Kubeflow, KServe, Ray, vLLM or Ollama as well as the requirements for evaluation, tracing, monitoring, drift detection and productive AI operation.
• You understand GPU and AI infrastructures including NVIDIA Stack, CUDA, MIG, Model Serving, Quantization, Batching, Autoscaling, Distributed Inference/Training as well as Capacity Planning, and can optimize performance, latency and availability in a targeted manner.
• You combine architecture expertise with a strong understanding of security, privacy and sovereign AI – from Zero Trust, IAM/RBAC and encryption to Data Residency and Regulatory Compliance – and convince with strong stakeholder and consulting skills and German knowledge on at least C1 levels.

With us you have countless possibilities to think big, to act bravely and take responsibility. Create your future in a culture that lives belonging and gives you space for learning and networking.

Diversity is an indispensable part of our success and our corporate culture. We look forward to meeting you, free of prejudices regarding gender, gender orientation, age, ethnic and social origin, religion or disability. People with severe disabilities are preferred with the same suitability.

Interested? We look forward to your online application!

Tags: Technical Consulting, frontend, frontend, DevOps, service management, service management, network management, database, designer, AI, network, AI, AI, data security, graphic designer, data protection, software design, wireless, webdesigner, web designer, recommendation association Source/Application via: [https://www.commsbund.de/jobs/308773/lead-private-ai-architect-w-strich-m-strich-x-genai-llm-und-enterprise-ai-platforms](https://www.commsbund.de/jobs/308773/lead-private-ai-architect-w-strich-m-strich-x

Short information about the company

At NTT DATA we are working on a future where technology makes our world easier, better and more liveable: the human-centered connected future. It takes people who are willing to enter unknown paths. They are ready to take the digital future into their hands: professionals with pioneering spirit – people like you!

NTT DATA – part of the NTT Group – is Trusted Global Innovator of Business and IT solutions headquartered in Tokyo. We support our customers in their transformation through consulting, industry solutions, business process services, digital and IT-modernization and managed services. With NTT DATA, customers and society can confidently go to the digital future. We are committed to the long-term success of our customers and combine global presence with local customer support in over 50 countries.

NTT DATA offers you many opportunities to develop yourself and go your career path. Values such as equality, community and quality of life are firmly anchored in our culture and are constantly evolving.

Joblocations:

60487 Frankfurt am Main, HESSEN, GERMANY

38440 Wolfsburg, NETHERLANDS, GERMANY

76275 Ettlingen, BADEN_WUERTTEMBERG, GERMANY

10117 Berlin, BERLIN, GERMANY

83026 Rosenheim, Oberbayern, BAYERN, GERMANY

80807 Munich, BAYERN, GERMANY

51103 Cologne, NORDRHEIN_WESTFALEN, GERMANY

99091 Erfurt, THUERINGEN, GERMANY

70567 Stuttgart, BADEN_WUERTTEMBERG, GERMANY

20457 Hamburg, HAMBURG, GERMANY