AI Data Engineer (RAG & Lakehouse Specialist)

Overview

Recruiting on behalf of a leading data consultancy specializing in logistics solutions for Germany's Mittelstand firms. Help build trustworthy AI pipelines powering predictive maintenance, supply chain optimization, and GenAI apps compliant with EU AI Act standards.

Responsibilities

• Design and productionise Retrieval-Augmented Generation (RAG) pipelines to eliminate AI hallucinations by grounding LLMs in enterprise data. Implement vector databases and governed data products using Unity Catalog, Delta Lake vectors, and observability tools for scalable, audit-ready lakehouses on Azure Databricks.
• Proven experience building end-to-end RAG systems: data chunking, embedding generation (Hugging Face), hybrid search, and orchestration with LangChain/LlamaIndex.
• Expertise in vector databases (Pinecone, Weaviate, or Databricks Vector Search) integrated with PySpark/SQL ETL pipelines.
• Strong governance skills: Unity Catalog volumes, data lineage, quality gates (Great Expectations), and MLflow for model/data product deployment.

Qualifications

• 3+ years in data engineering, with Databricks Certified Data Engineer Associate/Professional.
• Proficiency in Python, Delta Live Tables, streaming (Kafka), and cloud (Azure/AWS).
• Experience in regulated German sectors (manufacturing, energy, finance) a plus.

Location & Compensation

Munich (hybrid). €100 per hour contract rate.

Seniority level

• Entry level

Employment type

• Full-time

Job function

• Information Technology

Industries

• Data Infrastructure and Analytics

Referrals increase your chances of interviewing at iO Associates by 2x

Sign in to set job alerts for “Data Engineer” roles.

Frankfurt am Main, Hesse, Germany 1 month ago

Data Operations Engineer (Snowflake & Power BI)

Frankfurt am Main, Hesse, Germany 6 months ago

Frankfurt Rhine-Main Metropolitan Area 13 hours ago

Frankfurt am Main, Hesse, Germany 4 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.