Cloud Infrastructure & Platform Specialist, Databricks, AWS, Azure – Mid-Level

Stellenbeschreibung:

Provision, configure, and manage AWS and Azure cloud infrastructure supporting Irth’s Databricks-based data estate
Manage VPCs/VNets, subnets, route tables, storage, compute resources, private endpoints, and related networking services
Establish and maintain secure DEV, QA, and PROD environments with isolation and platform guardrails
Support cloud landing-zone implementation and enforce security, governance, and cost policies
Version, review, test, and deploy infrastructure changes through controlled workflows
Troubleshoot infrastructure, networking, and cloud-service issues affecting data and ML workloads
Manage IAM roles, service principals, managed identities, groups, access policies, RBAC, identity federation, and access reviews
Create and administer Databricks workspaces, Unity Catalog metastores, catalogs, schemas, storage credentials, external locations, and permissions
Onboard Data Engineering, Data Science, and MLOps projects with appropriate platform resources and access
Define and maintain Databricks cluster policies and workspace-level guardrails
Act as the primary escalation point for Databricks platform and infrastructure issues
Implement private connectivity, network segmentation, encryption, key management, audit logging, and compliance controls
Monitor spend, enforce tagging and resource policies, support showback/chargeback, and optimize cloud and Databricks costs
Automate workspace provisioning, catalog and schema setup, IAM assignment, access provisioning, environment configuration, and platform onboarding
Monitor platform health, respond to incidents, troubleshoot production issues, and maintain runbooks and technical documentation

Requirements

3-5 years of experience in cloud infrastructure, platform engineering, cloud administration, or a closely related role
Hands-on experience with both AWS and Microsoft Azure, including IAM and role provisioning, cloud networking, storage services, and compute and platform resources
Hands-on experience administering Databricks, including workspace provisioning and configuration, Unity Catalog, catalogs and schemas, metastores, cluster policies, and workspace and data-access controls
Working knowledge of Infrastructure-as-Code (IaC) tools; Terraform preferred
Experience with Azure ARM/Bicep or AWS CloudFormation is valuable
Strong understanding of IAM concepts, including RBAC, least-privilege access, service principals, managed identities, SSO, SCIM, and SAML
Familiarity with VPC/VNet architecture, subnets and routing, private connectivity, network segmentation, secrets management, encryption, and key management
Ability to quickly troubleshoot infrastructure, networking, identity, permission, and platform-access issues
Strong communication skills for explaining infrastructure and access issues to technical teams
Familiarity with SOC 2, ISO 27001, and GDPR
Understanding of audit logging, access reviews, administrative activity tracking, and evidence collection
Preferred: Experience supporting Data Engineering, Data Science, and MLOps teams
Preferred: Experience with CI/CD, GitHub Actions, Databricks Asset Bundles, infrastructure deployment automation, and DEV QA PROD promotion
Preferred: FinOps and cloud cost-management practices
Preferred: Experience implementing cloud and Databricks policies
Preferred: Relevant industry certifications such as AWS Solutions Architect, Microsoft Azure Solutions Architect, Azure Administrator, or Databricks Platform Administrator
Nice to have: Asset Integrity Pipeline, utility, energy, oil & gas, pipeline, GIS, geospatial, regulatory, compliance, data residency, auditability, and controlled-access experience

Core Competencies

Demonstrates expertise in managing AWS and Azure cloud infrastructure, with a strong focus on Databricks administration, IAM management, and Infrastructure-as-Code practices. Proficient in troubleshooting and optimizing cloud environments while ensuring compliance and security standards are met.

Highest-signal resume keywords