ML/MLOps Engineer in Germany

Andersen is hiring an ML/MLOps Engineer in Germany for a project building a cloud-native AI platform and delivering scalable machine learning solutions for the healthcare industry. Our customer is a European service provider operating in the healthcare sector. The company delivers consulting, digital solutions, data-driven services, and operational support that help healthcare organizations improve efficiency, optimize processes, and enhance service quality. Combining industry expertise with modern technologies, it enables organizations to streamline operations, manage resources effectively, and adapt to evolving healthcare needs. The project is focused on building a cloud-native MLOps platform for the healthcare sector to support large-scale machine learning and AI workloads. It includes developing ML infrastructure based on Kubeflow, enabling LLM fine-tuning, traditional machine learning, and scalable data processing in a secure, zero-trust environment.

Responsibilities

• Building and orchestrating ML pipelines using Kubeflow Pipelines (KFP v2).
• Training models on GPUs, including GPU resource management within Kubernetes.
• Fine-tuning transformers/LLMs, tracking experiments and models via MLflow.
• Building classic ML models (XGBoost, CatBoost).
• Working with data using SQL Server and DuckDB as a lightweight OLAP solution for efficient in-cluster processing of large datasets.
• Developing in Python (pipelines, integrations, tooling based on uv).
• Ensuring code quality: testing, CI/CD (GitLab CI).
• Working within a zero-trust / secure-by-default environment (network policies, restrictive container rights).

Must-haves

• Experience as a MLOps Engineer / ML Engineer for 5+ years.
• Hands-on experience with Kubeflow Pipelines (KFP v2).
• Experience training models on GPUs.
• Experience fine-tuning LLMs/transformers.
• Experience with MLflow (model tracking).
• Experience with boosting models (XGBoost, CatBoost).
• Deep proficiency in the Python ecosystem and modern engineering practices.
• Experience working in regulated/enterprise cloud-native environments.
• Experience with SQL and large-scale data processing.
• CI/CD experience (GitLab CI preferred), clean code and testing practices.
• Level of English – from Intermediate+ or above.

Nice-to-haves

• Pre-training experience for LLMs (beyond fine-tuning).
• Experience with GPU orchestration in Kubernetes.
• Experience in zero-trust environments (network policies, restrictive container rights).
• Knowledge of DuckDB.
• Experience with modern Python tooling (uv).

Reasons why this job would be interesting to you: Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc. The opportunity to change the project and/or develop expertise in an interesting business domain.

Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant. Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee. The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities. Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated. Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies). Certification compensation (AWS, PMP, etc). Referral program. Private health insurance and compensation for sports activities. Your personal data is protected in accordance with GDPR regulations. Learn more: us!