Senior Product Engineer (Backend)

TL;DR
We're hiring a Senior Product Engineer (Backend) to help scale the deepset AI Platform, our LLM-powered enterprise product. You'll own features end to end, build systems that process millions of documents, and contribute to our open-source framework, Haystack. If you enjoy solving complex challenges with real impact, this role's for you.
Why deepset
At deepset, we're on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We're remote-first, flexible, and built on a culture of trust and ownership. You'll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.
What you will do

• Design and build a scalable AI platform that helps users solve real business problems with LLMs
• Develop infrastructure to support thousands of LLM applications, processing millions of documents and handling 100s of user requests per second
• Own backend features end to end-from architecture and CI/CD to testing, monitoring, and customer feedback
• Collaborate with the Open Source team to improve and contribute to Haystack
• Partner with the infrastructure team on performance, observability, and debugging
• Help resolve high-priority production issues with customer-facing impact
• Improve reliability by maintaining strong debugging tools and processes
• Mentor other engineers and support their technical growth

Requirements

• 5+ years of backend development experience, ideally in Python
• Strong knowledge of REST APIs, SQL databases, CI/CD, Kubernetes, and cloud services
• Experience with Infrastructure-as-Code tools (e.g., Terraform or Crossplane)
• Proven ability to write clean, testable, observable, and maintainable code
• Skilled at fast troubleshooting in high-pressure, cross-functional settings
• Comfortable dealing with customer-facing production issues
• Proactive, collaborative, and aligned with team-wide decisions

Nice to have

• Experience in early-stage or high-growth startups
• Familiarity with open-source development
• Background in NLP, machine learning, or LLM technologies
• Exposure to building or scaling B2B SaaS products

Benefits

• Remote-first setup with flexible hours & tech of your choice
• 30 days vacation + extra days for family sick leave
• Competitive salary & stock options for every team member
• Monthly sports & mental health support allowance with Oliva
• Annual learning & development budget
• Monthly team socials & in-person meetups
• Dog-friendly Berlin HQ

#J-18808-Ljbffr