Jobiglo

No results.

LLM Inference Platform Architect

QuTwo · Helsinki

Senior 🇬🇧 English
Kubernetes GPU workloads vLLM SGLang TensorRT-LLM Terraform CI/CD Observability CUDA ROCm

Job description

About the role

QuTwo, a European private Quantum AI Lab based in Helsinki, is looking for an LLM Inference Platform Architect. The Infrastructure Architect designs and leads a secure, internal LLM serving platform on fully controlled GPU hardware, ensuring complete data privacy and independence from external model providers. The role manages the full serving stack, including GPU clusters, inference engines, access control and capacity planning, and sets platform standards while partnering with security, operations and LLM scientists.

Key responsibilities

  • Design and lead a secure, internal LLM serving platform on fully controlled GPU hardware
  • Manage the full serving stack: GPU clusters, inference engines, access control and capacity planning
  • Set platform standards and ensure strict regulatory compliance such as DORA
  • Partner with security, operations and LLM scientists to deploy optimized models

Required profile

  • Experience designing and running large-scale infrastructure on Kubernetes, including GPU workloads
  • Hands-on experience with LLM inference engines (vLLM, SGLang, TensorRT-LLM or similar)
  • Infrastructure as code (Terraform or similar), CI/CD and observability tooling
  • Understanding of security, identity and network design in enterprise environments
  • Experience writing architecture guidelines and working with enterprise architecture teams

What is a plus

  • Experience configuring and managing enterprise-grade GPUs (NVIDIA or AMD Instinct) and their acceleration stacks (CUDA or ROCm)
  • Background in banking or other highly regulated industries, with familiarity with DORA or equivalent compliance frameworks

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec QuTwo.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:teamtailor

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 1 week ago

Expires 1 month from now

26 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

QuTwo

Helsinki