Senior ML Engineer

We are looking for an experienced We are looking for an experienced ML Engineer / MLOps Engineer to join a cloud-native project for a German customer.

The role is strongly engineering-focused and involves building production-grade ML infrastructure, working with GPU workloads, ML pipelines, LLMs and large-scale data processing.

📍 Location: Germany
🗣 German: B2+ - must-have
🗣 English: B1+
📅 Estimated start: September 30, 2026

What you'll be working on

• Build and orchestrate ML pipelines using Kubeflow Pipelines (KFP v2)
• Train ML models on GPUs and manage GPU resources within Kubernetes
• Fine-tune transformers and LLMs
• Track experiments and models using MLflow
• Build classical ML models with XGBoost and CatBoost
• Process large datasets using SQL Server and DuckDB
• Develop Python-based pipelines, integrations and tooling
• Maintain high engineering standards through testing, clean code and CI/CD with GitLab CI
• Work in a secure, zero-trust / secure-by-default environment with network policies and restrictive container permissions

Requirements

What we're looking for

• Hands-on experience with Kubeflow Pipelines, ideally KFP v2
• Experience training models on GPUs
• Practical experience with LLM / transformer fine-tuning
• Experience with MLflow
• Strong knowledge of XGBoost, CatBoost or similar boosting models
• Strong Python engineering skills
• Solid SQL experience and understanding of large-scale data processing
• Experience with CI/CD, clean code and automated testing
• Production-grade ML/MLOps experience beyond notebook-based experimentation
• Experience working in enterprise or regulated cloud-native environments

Nice to have

• Experience with LLM pre-training, beyond fine-tuning
• GPU orchestration in Kubernetes
• Experience with zero-trust environments, network policies and restrictive container rights
• Knowledge of DuckDB
• Experience with modern Python tooling such as uv

Previous healthcare or billing domain experience is not required, but you should be comfortable quickly getting up to speed with a new domain.

Find more English Speaking Jobs in Germany on Arbeitnow