Senior Cloud Engineer – AI Platform (LLM) (f|m|x)

About your new role

At idealo, we’re building the platform layer that powers real AI features for millions of users. Our mission is to connect Large Language Models (LLMs) with e-commerce intelligence and make them secure, observable, scalable, and cost-efficient in production .

A central piece of our generative AI infrastructure is the MCP Server – a new interface bridging idealo’s product data with LLM-based applications. Your work will lay the foundation of infrastructure, tooling, and guardrails that enable product and ML teams to ship trusted AI features quickly.

Responsibilities

• Build and operate Infrastructure as Code (CDK/Terraform/CloudFormation) for reproducible environments.
• Provide platform primitives : model/endpoint gateway, prompt/agent registry, configuration & feature flags, rollout strategies (canary, A/B), rate limiting & quotas.
• Create and maintain RAG infrastructure (vector stores, indexing pipelines, retrieval services) with observability & SLOs.
• Define and monitor SLOs and implement latency/cost controls (caching, batching, routing).
• Integrate Foundation Model providers (AWS Bedrock, OpenAI, Azure AI) and manage versioning/rollbacks.
• Enable evaluation gates (with MLEs): wire up eval pipelines and quality signals (judges, test sets) into CI/CD.
• Drive security, compliance, and monitoring (logs, traces, metrics, alerts, incident response).

Skills & Requirements

• 5+ years of experience in cloud/platform engineering running production systems at scale.
• Proven ability to design, build, and operate secure, observable, and cost-efficient infrastructure .
• Expertise in AWS (or equivalent), IaC (CDK/Terraform), CI/CD , networking, security, and observability .
• Practical experience integrating LLM services and building RAG systems (retrieval, embeddings, vector DBs).
• Knowledge of TypeScript (Node.js) and Python (tooling, pipelines).
• Comfortable with containerization , automation & orchestration (Airflow, Step Functions, SageMaker Pipelines or similar).
• Mindset: evaluation-aware, data-driven, cost- & latency-conscious , up-to-date with fast-moving AI tech.
• Nice to have: exposure to prompt/agent frameworks and e-commerce systems.

At idealo you can expect

• You need vacation? We offer 30 days of vacation . Not enough? You can buy an additional 15 days every year by converting your salary and it’s seen as a positive thing.
• You want to further your education? We support personal development goals with the idealo Learning Hub, eLearning offerings (e.g., Udemy), coaching & mediation, and an additional learning and development budget.
• Office in Berlin offers free lunch, coffee, lemonades, and after-work beer, plus a rooftop terrace with a view of Berlin for networking.
• Full flexibility on commuting and beyond with a job bike or Deutschlandticket.
• Not in Germany yet? We support visa processes and relocation.
• Fitness options such as Urban Sports or Gympass memberships.

About idealo

idealo is a Berlin success story: since 2000 we help consumers make informed purchasing decisions. We are active in six countries and host ~2.5 million visits per day with ~50,000 shops and ~500 million product offers. We value diversity and inclusion and welcome applicants from all backgrounds. Information for applicants with severe disabilities is available, and our office is accessible without steps. We will discuss any additional accommodations during onboarding.

#LI-MW1

#J-18808-Ljbffr