Senior Databricks Engineer

We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.Avanade website; Privacy policyThis role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).

Position:

As Senior Databricks Engineer, you will be working in projects for various domains and industries, focused mostly around Databricks and Azure cloud.

Among your tasks there will be:

• Designing, building, and maintaining scalable, efficient, and reliable data pipelines
• End-to-end development of data architectures and ETL processes
• Collaborating with data scientists, analysts, and other engineering teams to ensure data integration and optimization
• Implementing best engineering practices across data systems
• Optimizing performance of data workflows and ensuring the reliability of data solutions
• Staying up-to-date with the latest developments in data engineering world
• Acting as a Team Lead in the project if needed
• Possibility to develop yourself in AI engineering

Required skills:

• commercial experience with: Databricks Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks)
• Python and PySpark
• SQL
• Data Engineering concepts such as ETL, data modeling, data warehousing, data governance
• Docker and Kubernetes
• English (B2)

Nice to have:

• Knowledge of OCR and corresponding libraries (e.g. easyOCR)
• Any experience in data science area

If you want to ask any questions before applying, feel free to reach out via LinkedIn!