Senior Cloud Engineer – AI Platform (LLM) (f|m|x)

At idealo, we’re building the platform layer that powers real AI features for millions of users. Our mission is to connect Large Language Models (LLMs) with e-commerce intelligence and make them secure, observable, scalable, and cost-efficient in production .

A central piece of our generative AI infrastructure is the MCP Server – a new interface bridging idealo’s product data with LLM-based applications. Your work will lay the foundation of infrastructure, tooling, and guardrails that enable product and ML teams to ship trusted AI features quickly.

About your new role

• Build and operate Infrastructure as Code (CDK/Terraform/CloudFormation) for reproducible environments.

• Provide platform primitives : model/endpoint gateway, prompt/agent registry, configuration & feature flags, rollout strategies (canary, A/B), rate limiting & quotas.

• Create and maintain RAG infrastructure (vector stores, indexing pipelines, retrieval services) with observability & SLOs.

• Define and monitor SLOs and implement latency/cost controls (caching, batching, routing).

• Integrate Foundation Model providers (AWS Bedrock, OpenAI, Azure AI) and manage versioning/rollbacks.

• Enable evaluation gates (with MLEs): wire up eval pipelines and quality signals (judges, test sets) into CI/CD.

• Drive security, compliance, and monitoring (logs, traces, metrics, alerts, incident response).

Skills & Requirements

• 5+ years of experience in cloud/platform engineering running production systems at scale.

• Proven ability to design, build, and operate secure, observable, and cost-efficient infrastructure .

• Expertise in AWS (or equivalent), IaC (CDK/Terraform), CI/CD , networking, security, and observability .

• Practical experience integrating LLM services and building RAG systems (retrieval, embeddings, vector DBs).

• Knowledge of TypeScript (Node.js) and Python (tooling, pipelines).

• Comfortable with containerization , automation & orchestration (Airflow, Step Functions, SageMaker Pipelines or similar).

• Mindset: evaluation-aware, data-driven, cost- & latency-conscious , up-to-date with fast-moving AI tech.

• Nice to have: exposure to prompt/agent frameworks and e-commerce systems.

At idealo you can expect

• You need vacation? We offer you 30 days of vacation. Not enough? You can "buy" an additional 15 days every year by converting your salary and it's seen as a positive thing.

• You want to further your education? We take your personal development goals seriously and, in addition to our idealo Learning Hub, eLearning offerings (e.g., Udemy), coaching & mediation, we also offer you the opportunity to benefit individually from additional learning and development budget.

• And what about the office? Our office in the heart of Berlin offers excellent free lunch, as well as free coffee, lemonades and after-work beer, in addition to the "standard foosball". It also has a fabulous rooftop terrace with view of the whole of berlin where you can network with colleagues from our group of companies.

• You want full flexibility on your way to work and beyond? No problem with a job bike or Deutschlandticket- and it's environmentally friendly, too!

• You don't live in Germany yet? We support you in the visa process and with your relocation.

• Want to keep yourself fit? We offer many different fitness and sports options, such as an Urban Sports or Gympass membership, to suit your personal needs.

#LI-MW1