platform engineer Azure Databricks

Stellenbeschreibung:

Описание: EPAM provides enterprise software products, open source solutions, and accelerators.

Administer and manage Azure Databricks and Data Lake Storage Gen2 workspaces
Implement and enforce access control using RBAC and Entra ID
Apply Databricks governance concepts, including Unity Catalog, data lineage, and access policies
Develop automation scripts and REST API integrations for environment configuration and monitoring
Monitor platform health, ensure operational reliability, and handle incident response
Collaborate with stakeholders to align platform standards and governance practices
Troubleshoot and resolve platform issues, optimizing performance and efficiency
Document processes and maintain platform best practices

Strong experience with Microsoft Azure services, particularly Azure Databricks and Data Lake Storage
Proficiency in Azure access management with RBAC and Entra ID
Knowledge of Databricks governance, including Unity Catalog for security and data lineage
Hands-on experience using Terraform for deploying and managing Databricks infrastructure
Basic Python programming skills for automation and scripting
Familiarity with REST APIs for system configuration
Understanding of DevOps principles, including observability, monitoring, and incident response
Experience working in enterprise environments, ideally global organizations
Strong analytical and problem-solving abilities
Nice to have: familiarity with Agile methodologies (Scrum, SAFe), experience in Databricks administration such as job orchestration and cluster policy design, contributions to shared automation or governance frameworks, knowledge of infrastructure-as-code tools such as Terraform and ARM templates, exposure to CI/CD pipelines and DevOps toolchains.