Principal Agentic AI Engineer / Architect at AI CoE (f/m/d)

Principal Agentic AI Engineer / Architect at AI CoE (f/m/d)

We help the world run better

At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We are builders across 20+ industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What we offer: constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What you’ll do

Summary: We are looking for a Principal AI Engineer / AI Architect who can drive enterprise‑grade Agentic‑AI development and lead our engineering scrum teams as technical artifact owner overseeing multiple development streams as well as foundational agentic‑AI solution‑ and software architecture decisions. The candidate will have proven and industry‑leading skills in data science, data engineering, software engineering and solution architecture, with an entrepreneurial spirit to join our diverse team and work on innovation projects as well as exceptional leadership and people skills.

Role: In this role you drive, oversee and are responsible for the entire development lifecycle of multiple (agentic) AI services, from data science PoC to productisation and production operations. You own and evolve best practices to impact AI software quality of many teams, quickly abstract and evolve concepts around AI software productisation that play a pivot role across multiple development scrum teams. This requires technical people leadership and the ability to properly explain highly complex AI best practices to a team of practitioners and developers.

What you bring: You are very experienced with general software engineering best practices and enterprise‑grade code development applied to an AI space. Concretely this means that next to having profound AI modeling expertise, you are exceptional at working with vast amounts of data in a Big Data setup, professional data engineering pipeline development as well as model deployment/serving and CI/CD setup. You have solid business acumen and can motivate and guide a scrum team through complex tasks with tight deadlines.

Responsibilities / Core Tasks

• Lead develop AI services from PoC to Production
• Lead the development of a best practice framework for AI development (both narrow and GenAI) for all dev streams and teams
• Lead the definition, evolution and drive the setup of infrastructure architecture for the AI applications we are building
• Setup and develop new Big Data pipelines to productise data ETL workloads for different AI services
• Develop AI/ML models to solve real life business problems (this includes Data Science exploration phase as well as model productisation)
• Work with stakeholders throughout the organization to identify opportunities for leveraging company data to drive business solutions
• Productionise AI PoCs with good software engineering by incorporating CI/CD pipelines, deployment and MLOps
• Take ownership over AI services in development and production
• Lead, guide and mentor junior colleagues and evolve their AI engineering skillset

What you bring

• Bachelor's or master's degree in machine learning, computer science, engineering, or related technical fields
• Vast coding knowledge of at least one programming language such as Python or Java
• Deep knowledge of Distributed Computing Systems for Big Data Engineering such as Databricks (PySpark/Scala)
• Exceptional understanding of AI/ML concepts
• Good understanding and hands on experience in agentic AI communication technologies such as MCP and A2A
• Exceptional understanding of AIOps and LLMOps/AgentOps concepts (e.g. MLflow 3.0)
• Deep Infrastructure knowledge around AI solution design on Hyperscalar clouds such as Azure/AWS/GCP
• Extensive coding experience in applying ML frameworks such as TensorFlow, PyTorch, Langchain, OpenAI, Huggingface, Crew
• Very deep experience in applying AgenticAI frameworks such as Langgraph, CrewAI, Microsoft agent framework or google-adk
• Industry leading general software engineering best‑practices (e.g. Object‑Oriented Programming) and experience working in a scrum‑like software engineering unit
• Productization technologies and tools such as Docker, K8s, GitHub, VSCode, Linux etc.
• CI/CD and ML Ops frameworks such as Jenkins, GitHub Actions, MLFlow, etc.
• Cloud‑deployment offerings such as Azure ML, Databricks, AKS, Event Hubs, Azure Data Factory, Azure Functions or similar in AWS / GCP
• Some form of code ownership and scrum team leadership experience
• Curiosity to learn about different AI applications and new technologies in general
• Excellent spoken and written knowledge of English as well as collaborative mindset; good German language skills
• Experience with SAP AI offerings e.g. AI Core, AI Business Services, Joule etc. is a plus
• Understanding of Agile / Scaled Agile (SAFe) methodologies is a plus

Employment details

Expected Travel: 0‑10%

Employment Type: Part Time or Regular Full Time

Equal Employment Opportunity

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e‑mail with your request to Recruiting Operations Team: