AI/ML Engineer – LLM Systems (m/f/d)

Be Yourself - Because that´s how we want You to be

We can, we want and we are also entitled to - because we are a team of highly motivated and qualified employees who are as passionate about inspiring customers as we are about working on technical solutions. And that makes us unique! If you want to take yourself and our products further, then come to us and shape the future of netcup!

as of now | Full-time | Vienna, Graz, Klagenfurt, Karlsruhe, Remote

You are passionate about artificial intelligence and enjoy working with cutting-edge LLM technologies? You work in a structured and independent manner and love building intelligent systems that create real value? You are a communicative team player who thrives on implementing innovative AI solutions? Then this position is perfect for you!

#PROFILE

• You will drive forward the development and deployment of AI/ML systems, particularly focusing on Large Language Models (LLMs) and intelligent agent frameworks
• You implement and operate LLM inference solutions using runtimes like Ollama, vLLM, and TensorRT-LLM
• You develop agentic applications with frameworks such as Dify, LangFlow, Haystack, LlamaIndex, LangChain, LangGraph or Pydantic AI
• You integrate AI capabilities fromvarious providers (like OpenAI, Anthropic, Groq, and Cerebras) into production systems
• You implement LLMOps practices using tools like LangFuse and LangSmith for monitoring, tracing, and observability
• You build and optimize ML pipelines using Python, TensorFlow, PyTorch, and scikit-learn for various AI applications
• You containerize and deploy AI applications using Docker and Podman
• You work with SQL databases and implement evaluation frameworks like DeepEval to ensure model quality
• You work closely with cross-functional teams and enjoy presenting and continuously improving your AI solutions

#WANTED

• Experience with RAG (Retrieval-Augmented Generation), prompt engineering or multi-agent systems is highly valued
• Strong understanding of Large Language Models and experience with HuggingFace ecosystem
• Hands-on experience with at least one agentic framework (LangChain, LangGraph, Haystack, LlamaIndex, Dify, LangFlow, or Pydantic AI)
• Experience with Python and modern ML frameworks (TensorFlow, PyTorch, scikit-learn)
• Proficiency with LLM inference runtimes such as Ollama, vLLM, or TensorRT-LLM
• Experience with LLM APIs (OpenAI, Anthropic, or similar providers)
• Strong knowledge of SQL and database operations
• Understanding of LLMOps practices and model evaluation methodologies
• Experience with containerization (Docker/Podman) and orchestration tools
• Experience with version control systems and CI/CD tools is an advantage
• Knowledge of DevOps practices (Ansible) is a plus
• Very good written and spoken German and English skills

#WHAT WE OFFER

We are more than just a workplace. Therefore, we offer our employees many benefits (which partly depend on your position and location): good transport connections and flexible working hours. Period. Not to mention further training, a mentoring program, free parking, a mobile phone and notebook, snacks and drinks, company cars, employee events, a fun corner, ...

Have we sparked your interest?

We look forward to your expressive application!

Founded in 2008, the company has been part of the international Anexia Group since 2016 and, as an Internet Service Provider, serves over 75,000 business and residential customers worldwide. Our main strength lies in the provision of web hosting, virtual and dedicated servers, and support of the same through management services. We also offer our customers a large selection of Top Level Domains.

Worldwide, we serve over 200,000 satisfied customers with 400,000 domains.

Our quality has won several awards - picking up a 'Very good' from CHIP computer magazine.

Part of the Anexia Group with over 400 employees and 6 office locations worldwide.