LLM Inference Platform Architect
QuTwo · Helsinki
Job description
About the role
QuTwo, a European private Quantum AI Lab based in Helsinki, is looking for an LLM Inference Platform Architect. The Infrastructure Architect designs and leads a secure, internal LLM serving platform on fully controlled GPU hardware, ensuring complete data privacy and independence from external model providers. The role manages the full serving stack, including GPU clusters, inference engines, access control and capacity planning, and sets platform standards while partnering with security, operations and LLM scientists.
Key responsibilities
- Design and lead a secure, internal LLM serving platform on fully controlled GPU hardware
- Manage the full serving stack: GPU clusters, inference engines, access control and capacity planning
- Set platform standards and ensure strict regulatory compliance such as DORA
- Partner with security, operations and LLM scientists to deploy optimized models
Required profile
- Experience designing and running large-scale infrastructure on Kubernetes, including GPU workloads
- Hands-on experience with LLM inference engines (vLLM, SGLang, TensorRT-LLM or similar)
- Infrastructure as code (Terraform or similar), CI/CD and observability tooling
- Understanding of security, identity and network design in enterprise environments
- Experience writing architecture guidelines and working with enterprise architecture teams
What is a plus
- Experience configuring and managing enterprise-grade GPUs (NVIDIA or AMD Instinct) and their acceleration stacks (CUDA or ROCm)
- Background in banking or other highly regulated industries, with familiarity with DORA or equivalent compliance frameworks
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Finland.
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 week ago
Expires 1 month from now
26 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
QuTwo
Helsinki
Related job offers
-
Development Manager, Financial Management Services
Newsec Suomessa Helsinki -
Software Design Engineer - Embedded Linux
abb Helsinki -
Portfolio & Project Excellence Lead, Motion IS
abb Helsinki -
Programmeur·euse compétitif·ve – Benchmarks IA (Remote)
Vettedlance -
Enregistreur de flux de travail pour outils de développement (éditeurs de code, IDE, clients API)
Vettedlance