(Senior)Cloud Engineer – AI Platform (LLM) (f|m|x)

• On-site
• Berlin , Berlin , Germany

At idealo , we’re building the platform layer that powers real AI features for millions of users. Our mission is to connect Large Language Models (LLMs) with e-commerce intelligence and make them secure, observable, scalable, and cost-efficient in production .

A central piece of our generative AI infrastructure is the MCP Server – a new interface bridging idealo’s product data with LLM-based applications. Your work will lay the foundation of infrastructure, tooling, and guardrails that enable product and ML teams to ship trusted AI features quickly.

About your new role

Provide platform primitives : model/endpoint gateway, prompt/agent registry, configuration & feature flags, rollout strategies (canary, A/B), rate limiting & quotas.

Create and maintain RAG infrastructure (vector stores, indexing pipelines, retrieval services) with observability & SLOs.

Define and monitor SLOs and implement latency/cost controls (caching, batching, routing).

Integrate Foundation Model providers (AWS Bedrock, OpenAI, Azure AI) and manage versioning/rollbacks.

Enable evaluation gates (with MLEs): wire up eval pipelines and quality signals (judges, test sets) into CI/CD.

Drive security, compliance, and monitoring (logs, traces, metrics, alerts, incident response).

Skills & Requirements

5+ years of experience in cloud/platform engineering running production systems at scale.

Proven ability to design, build, and operate secure, observable, and cost-efficient infrastructure.

Expertise in AWS (or equivalent), IaC (CDK/Terraform), CI/CD , networking, security, and observability.

Practical experience integrating LLM services and building RAG systems (retrieval, embeddings, vector DBs).

Knowledge of TypeScript (Node.js) and Python (tooling, pipelines).

Comfortable with containerization , automation & orchestration (Airflow, Step Functions, SageMaker Pipelines or similar).

Mindset: evaluation-aware, data-driven, cost- & latency-conscious , up-to-date with fast-moving AI tech.

Nice to have: exposure to prompt/agent frameworks and e-commerce systems.

You want to further your education? We take your personal development goals seriously and, in addition to our idealo Learning Hub, eLearning offerings (e.g., Udemy), coaching & mediation, we also offer you the opportunity to benefit individually from additional learning and development budget.

And what about the office? Our office in the heart of Berlin offers excellent free lunch, as well as free coffee, lemonades and after-work beer, in addition to the "standard foosball". It also has a fabulous rooftop terrace with view of the whole of berlin where you can network with colleagues from our group of companies.

You want full flexibility on your way to work and beyond? No problem with a job bike or Deutschlandticket- and it's environmentally friendly, too!

You don't live in Germany yet? We support you in the visa process and with your relocation.

Want to keep yourself fit? We offer many different fitness and sports options, such as an Urban Sports or Gympass membership, to suit your personal needs.

About idealo

idealo is one of Europe's leading online comparison platforms for products. With more than 2.5 million page views per day, over 600 million product offers from around 50,000 merchants for the comparison platform, we are one of the largest e-commerce websites in Germany! In 2000, we started out with the mission of helping consumers make the best purchasing decisions. Right in the heart of Berlin, about 700 employees from almost 60 nations are supporting our users to find the best deal. idealo is majority-owned by the transatlantic media company Axel Springer SE.

Information for applicants with severe disabilities

As an applicant with a severe disability, you can get advice from our Representative Body forSeverely Disabled People (SBV) during the application process. Please inform us regarding this topic. For the inclusion of people with disabilities, our office is accessible without steps. When you start with us, we will see what else is needed!