(Senior) Data Scientist – AI Booster Team (f|m|d)

Job Description

At idealo, Generative AI (GenAI) is becoming a multiplier across every team. The AI Booster Team is our internal technical competence center: we pair with product teams, build reusable GenAI building blocks and share best practices company-wide. We validate AI business cases through data and ship evaluation frameworks that turn pilots into production. As a Data Scientist you will translate ideas into evidence: designing experiments, measuring LLM quality, and unlocking the full value of idealo’s data assets to guide today’s and tomorrow’s GenAI initiatives.

This position is available full-time or part-time.

About Your New Role

• Quantify opportunities & run experiments - perform causal analyses using experiments and observational methods to evaluate the business impact of GenAI features.
• Own model evaluation pipelines - create metrics dashboards and human / AI-assisted reviews that benchmark LLM quality, cost and safety.
• Guide model selection - compare foundation models, fine-tunes and RAG setups, recommending the right balance of performance vs. cost.
• Champion data strategy - surface high-value datasets (product, pricing, behaviour) and advocate their use in current and future AI products.
• Pair & coach - work embedded with engineers and analysts, sharing best practices in experimentation, metrics, and GenAI evaluation.
• Harvest patterns - document reusable evaluation playbooks so every team can measure GenAI success consistently.

Skills & Requirements

• 3 + years in data science / analytics, including A/B testing or causal inference at scale.
• Expert SQL and Python (pandas, StatsModels / SciPy, scikit-learn); comfortable with notebooks and BI tools for storytelling.
• Hands-on with LLM assessment - prompt / temperature sweeps, embedding similarity metrics, human-in-the-loop studies, and LLM-as-a-judge tools (e.g. Bedrock model evaluation, OpenAI Evals).
• Familiar with Generative AI stacks (Hugging Face, LangChain/LlamaIndex, vector DBs like Pinecone/Qdrant) and retrieval-augmented generation concepts.
• Proficiency in AWS analytics & MLOps: SageMaker Experiments / Pipelines, Bedrock, Athena, Lambda, Step Functions; able to automate evaluation workflows and cost dashboards.
• Strong communication: can turn complex findings into clear, actionable insights and coach cross-functional teams.
• We’re keen to see evidence of exceptional achievement - perhaps you’ve scaled a personal project to thousands of users, published influential research, ranked highly in competitive arenas (e.g. sports, Kaggle, hackathons) or maintain widely-used open-source libraries. Tell us what makes you stand out!

You don’t tick every single box? No worries! We hire people, not checklists, and value motivation to grow.

At idealo you can expect

• You want to further your education? We take your personal development goals seriously and, in addition to our idealo Learning Hub, eLearning offerings (e.g., Udemy), coaching & mediation, we also offer you the opportunity to benefit individually from additional learning and development budget.
• And what about the office? Our office in the heart of Berlin offers free organic breakfast, excellent free lunch (vegan and vegetarian), as well as free coffee, lemonades and after-work beer, in addition to the "standard foosball". It also has a fabulous rooftop terrace with view of the whole of Berlin where you can network with colleagues from our group of companies.
• In need of additional support in any areas of your life? We offer free counseling and support in all areas of life (professional, private, family, health, etc.) in cooperation with the pme-Familienservice.
• You want full flexibility on your way to work and beyond? No problem with a job bike or Deutschlandticket - and it's environmentally friendly, too!
• Want to keep yourself fit? We offer many different fitness and sports options, such as an Urban Sports or Gympass membership, to suit your personal needs.
• And what else is there? Of course, success must be celebrated! In addition to team events, you can also expect big company events and other moments of organized connection with others in the company and your team throughout the year!