Senior DevOps Engineer

TL;DR
We’re hiring a Senior DevOps Engineer to build and scale the infrastructure behind the deepset AI Platform. You’ll own CI/CD, automate deployments, and improve performance across both cloud and on-prem environments. You’ll work closely with engineering teams on reliability, monitoring, security, and debugging to ensure the platform is fast, stable, and ready for real-world enterprise use.

Why deepset
At deepset, we’re on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We’re remote-first, flexible, and built on a culture of trust and ownership. You’ll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.

What you will do

• Solve performance and scalability challenges for LLM-powered enterprise apps
• Own and evolve CI/CD pipelines and automation for smooth deployments
• Define and maintain monitoring and alerting strategies for production health
• Work cross-functionally on firefighting, GitHub workflows, and system debugging
• Configure infrastructure for both SaaS and on-prem enterprise deployments
• Collaborate with customer infrastructure teams and internal stakeholders
• Drive best practices for security, scalability, and system reliability

Requirements

• 5+ years managing large-scale production infrastructure
• Strong experience with service-oriented architecture design
• Proficient in AWS, Kubernetes, GitOps (ArgoCD), and CI/CD practices
• Hands-on with Infrastructure as Code (Terraform, Crossplane preferred)
• Experience supporting customer-hosted deployments (private cloud/on-prem)
• Solid troubleshooting skills, ownership mindset, and pragmatic approach
• Interest in Machine Learning / LLMs—or motivation to learn quickly

Nice to have

• Exposure to multi-region infrastructure or high-security environments
• Experience in AI/ML platforms, or data-heavy backend systems
• Contributions to DevOps tooling or open-source infrastructure projects
• Background supporting B2B SaaS or enterprise products

Benefits

• Remote-first setup with flexible hours & tech of your choice
• 30 days vacation + extra days for family sick leave
• Competitive salary & stock options for every team member
• Monthly sports & mental health support allowance with Oliva
• Annual learning & development budget
• Monthly team socials & in-person meetups
• Dog-friendly Berlin HQ

About us
Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the deepset AI Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI – with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong.
Visit us to learn more: deepset Website | Haystack Website | GitHub | Linkedin | X deepset (Twitter) | X haystack (Twitter)