(Senior) (agentic) AI Engineer at AI CoE (f/m/d)

Job description

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you.

We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next.

The work is challenging – but it matters.

You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong.

What's in it for you?

Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What you`ll do 

Summary:

We are seeking a (Senior) AI Engineer to drive the development, deployment, and evolution of advanced autonomous AI agent systems.

You will serve as the technical and architectural owner within our agile engineering teams, leading code and solution design for agent-based AI innovation projects.

The ideal candidate combines deep expertise in LLM Orchestration, Big Data Engineering, Data Science and full-stack Software Engineering, with a proven ability to deliver real-world agentic AI solutions.

Bring your entrepreneurial spirit to a diverse and innovative team and help shape our next-generation enterprise AI product landscape.

Role:

In this role, you will architect, build, and oversee AgenticAI systems across the full lifecycle—from research/PoC to robust production platforms.

You bring strong experience in agent frameworks, orchestration of LLMs and AI services, and deploying scalable AI agents in production environments.

Beyond advanced AI modeling skills, you excel at developing large-scale, distributed data and agent pipelines, enabling interaction, autonomy, and coordination among agents, and integrating AI solutions into business-critical workflows.

You understand MLOps and AIOps practices for agent systems and have the business acumen to translate stakeholder needs into impactful agentic AI flow patterns.

As a technical leader, you will guide scrum teams, mentor colleagues, and drive quality under tight deadlines.

Responsibilities / Core Tasks:

• Lead the design, development, and deployment of agentic AI services, from PoC to production
• Architect and build agent flows, LLM orchestration, and multi-agent systems leveraging frameworks such as LangChain, CrewAI, AutoGen, Google-ADK etc.
• Develop, evaluate, and optimize agent strategies for real-world business challenges
• Collaborate with stakeholders to identify key opportunities for autonomous agent solutions across the organization
• Implement CI/CD, AgentOps pipelines for agent lifecycle management, monitoring, evaluation and continuous improvement using LLMJudge concepts and AgentOps frameworks such as MLFlow 3.0, LangFuse, etc.
• Own the full lifecycle and operational excellence of deployed agentic AI systems
• Lead, inspire, and mentor junior engineers in the field of agent-based AI development
• Stay at the forefront of emerging agentic AI frameworks, LLM APIs, and orchestration trends

What you bring

• Bachelor’s or master’s in computer science, machine learning, engineering, or a closely related domain
• Advanced coding skills in Python (preferred) or Java, with expertise in agentic/LLM frameworks
• Experience with multi-agent and LLM orchestration toolkits (e.g. LangChain, CrewAI, Haystack, AutoGen, etc.)
• Deep understanding of autonomous systems, agent architectures, and distributed computing for Big Data and AI
• Ability to integrate and scale AI agent services leveraging cloud (Azure/AWS/GCP) and containerization (Docker, K8s)
• Strong background in software engineering best practices in agile/scrum settings
• Proficiency with CI/CD, MLOps, AIOps (Jenkins, GitHub Actions, MLFlow, prompt and agent evaluation frameworks)
• Hands-on experience in developing/serving LLMs and agentic backends (Flask, FastAPI, Django, Quart)
• Stakeholder-focused mindset; excellent spoken/written English / good German and collaborative spirit
• Experience with SAP AI (e.g. AI Core, AI Business Services, Joule) and Scaled Agile (SAFe) is a plus
• Demonstrated leadership in code ownership, technical direction, and team mentoring
• Curiosity for emerging AI paradigms and technologies

Meet your team 

SAP Intelligent Enterprise Solutions (IES) department has the purpose to “Deliver and Run the Intelligent Enterprise”.

IES is SAP’s technology backbone and most compelling reference customer, and as such, we influence product development and strategy, with our customer experience at heart.

Within IES, our “Artificial Intelligence CoE” team has the purpose to help SAP to transform into a data-driven intelligent enterprise, by empowering SAP employees to simplify processes, leveraging AI technologies.

Our vision is to be an advocate and enabler of best-in-class AI within SAP.

Our mission is to deliver business value through AI in SAP’s processes and be recognized as AI Thought Leader in the market.

We implement both standard SAP AI and custom built solutions across all LoBs. We are customer zero of SAP standard AI solutions and provide continuous feedback to standard development for product improvement.

We provide an AI Platform and Infrastructure to entire SAP AI practitioners for building their own ML solutions in the entire ML lifecycle following MLOps methodology.

Furthermore, we build and operate a central chatbot platform based on SAP Conversational AI with the aim to provide capabilities from all lines of business through a single digital assistant.

We also build those capabilities (individual chatbots) as well as support other teams in building further ones.

Within our team, we practice a trust-based working model with emphasis on great collaboration, agility and transparency.

We offer a lot of room for creativity and freedom to experiment.

Our operating model is based on autonomous/agile team concept (SAFe) and SAP New Work practice where we put people at the center of everything we do.

​

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively.

Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management.

As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development.

Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves.

At SAP, you can bring out your best.

 

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best.

At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential.

We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities.

If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the , according to the eligibility rules set in the SAP Referral Policy.

Specific conditions may apply for roles in Vocational Training.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our .

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 432851  | Work Area: Software-Design and Development  | Location: Walldorf or Munich  | Expected Travel: 0 - 10%  | Career Status: Professional  | Employment Type: Part Time or Regular Full Time   | #LI-Hybrid

Required Skill Profession

Computer Occupations