Data & AI Platform Engineer – Professional (Azure Data Engineering)

As a Data & AI Platform Engineer – Professional you independently design and implement scalable data pipelines on Azure. Use Microsoft Fabric/OneLake, Azure Databricks and Delta Lake technologies to provide reliable data for analytics and AI.

Tasks:

• Design, development, and maintenance of complex pipelines (batch & streaming) with Data Factory, Databricks, and Delta Lake

• Integration of new Azure features such as mirroring (zero-ETL replication) for continuous synchronization of operational databases with OneLake and Microsoft Fabric for a unified lakehouse architecture.

• Implementation of DataOps: CI/CD pipelines with Azure DevOps/GitHub, monitoring via Azure Monitor, and automation with Delta Live Tables or Lakeflow.

• Ensuring data quality, governance, and access control (Azure Purview, Unity Catalog).

• Collaboration with cross-functional teams and optimization of the platform in terms of performance and costs.

A hybrid/remote setup is possible in Germany (primary residence required)

• Several years of experience in developing data platforms on Azure (Data Factory, Databricks, Microsoft Fabric)

• In-depth knowledge of SQL, Python/Spark, and Delta Lake technologies.

• Familiarity with Azure Monitoring, data catalogs (Purview), and CI/CD in DevOps.

• Strong problem-solving and communication skills; ability to work independently.

• Very good German and English skills