Senior Product Engineer (Backend)

TL;DR

We’re hiring a Senior Product Engineer (Backend) to help scale the deepset AI Platform, our LLM-powered enterprise product. You’ll own features end to end, build systems that process millions of documents, and contribute to our open-source framework, Haystack. If you enjoy solving complex challenges with real impact, this role’s for you.

Why deepset

At deepset, we’re on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We’re remote-first, flexible, and built on a culture of trust and ownership. You’ll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.

What you will do

• Design and build a scalable AI platform that helps users solve real business problems with LLMs
• Develop infrastructure to support thousands of LLM applications, processing millions of documents and handling 100s of user requests per second
• Own backend features end to end—from architecture and CI / CD to testing, monitoring, and customer feedback
• Collaborate with the Open Source team to improve and contribute to Haystack
• Partner with the infrastructure team on performance, observability, and debugging
• Help resolve high-priority production issues with customer-facing impact
• Improve reliability by maintaining strong debugging tools and processes
• Mentor other engineers and support their technical growth

Requirements

5+ years of backend development experience, ideally in Python

Strong knowledge of REST APIs, SQL databases, CI / CD, Kubernetes, and cloud services

Experience with Infrastructure-as-Code tools (e.g., Terraform or Crossplane)

Proven ability to write clean, testable, observable, and maintainable code

Skilled at fast troubleshooting in high-pressure, cross-functional settings

Comfortable dealing with customer-facing production issues

Proactive, collaborative, and aligned with team-wide decisions

Nice to have

Experience in early-stage or high-growth startups

Familiarity with open-source development

Background in NLP, machine learning, or LLM technologies

Exposure to building or scaling B2B SaaS products

Benefits

Remote-first setup with flexible hours & tech of your choice

30 days vacation + extra days for family sick leave

Competitive salary & stock options for every team member

Monthly sports & mental health support allowance with Oliva

Annual learning & development budget

Monthly team socials & in-person meetups

Dog-friendly Berlin HQ

About us

Founded in 2018, deepset builds open and enterprise-grade tools that help teams turn language into action. From Haystack, our open-source framework, to the deepset AI Platform, we give developers and organizations the building blocks to solve real problems with LLMs. Backed by GV and Balderton, we’re trusted by startups and global enterprises alike.

Visit us to learn more : Website | GitHub | Linkedin | X (Twitter)

#J-18808-Ljbffr