Validation Engineer - Multi-Agent AI Systems (f/m/x)

INNOVATION IS IMAGINING WHAT NO ONE ELSE CAN.

At the BMW Group, everything starts with passion. It turns a profession into a vocation. It drives us to keep reinventing mobility and bring innovative ideas onto the roads. Enthusiasm for joint projects turns a team into a strong unit where every opinion is valued. It is only when expertise, highly professional processes and enjoyment of work unite that we can shape the future together.

What awaits you?

• You build and operate cloud-based validation environments for a multi-agent system that operates across ADAS, Infotainment and backend-service domains - defining test architectures, scenario pipelines, behavioural oracles and regression suites.
• Also, you design AI-assisted exploration strategies to navigate the semantic search space of the system under test: agent-based probing of behavioural boundaries, adaptive test strategies, and optimization techniques to surface edge cases and failure modes.
• It is your responsibility to develop coverage models and metrics for non-deterministic multi-agent systems and use them to steer test generation and assess release readiness.
• You establish validation methodologies suited to stochastic AI behaviour: metamorphic testing, property-based testing, adversarial probing and acceptance criteria grounded in confidence intervals rather than binary pass/fail.
• You build observability and diagnostics tooling for validation runs - distributed tracing, trajectory replay, automated failure clustering and root-cause triage - so that discovered issues can be rapidly understood and communicated to the design team.
• Furthermore, you evaluate and select the LLMs/SLMs that power your validation agents and test-generation systems, balancing latency, cost and accuracy for large-scale test campaigns.
• You close the feedback loop between validation findings and system improvement by structuring discovered failures, coverage gaps and behavioural anomalies into actionable knowledge for the design and context-engineering teams.

What should you bring along?

• University degree in Computer Science, AI/ML, Systems Engineering, or a related field.
• 3-5 years of hands‑on experience in validation, verification or quality engineering for complex AI, ML or software‑intensive systems.
• Expert‑level programming skills in at least one high‑level language (C++, Java, Kotlin or Python).
• Proficiency in AI‑assisted development using coding agents such as Claude Code, GitHub Copilot or OpenCode.
• Understanding of agentic AI architectures, agent patterns and multi‑agent interaction.
• Ability to apply optimization, search or operational‑research techniques (genetic/evolutionary algorithms, Bayesian optimisation, Monte Carlo methods) to testing or exploration problems.
• Experience with automotive software quality processes (e.g. ASPICE, ISO 26262) is a plus.

What do we offer?

• Challenging projects with which we are shaping the mobility of tomorrow together.
• Wide range of personal and professional development opportunities.
• Attractive, fair and performance‑related remuneration.
• High level of job security.
• Annual special payments such as vacation pay, Christmas bonus, and profit sharing.
• Flexible working hours including 6 weeks annual leave and overtime compensation.
• Discounted BMW & MINI conditions.
• Many other benefits at bmw.jobs/benefits .

Start date: from now on

Type of employment: unlimited

Working hours: Full-time

At the BMW Group, we place great importance on equal treatment and equal opportunities. Our recruiting decisions are based on the personality, experience, and skills of the applicants.