Job
Senior Site Reliability Engineer — Token Factory (Inference Platform)
Nebius
About
We are building an inference platform that makes every kind of foundation model fast, reliable, and effortless to deploy at massive scale.
Requirements
- Deep fluency with Kubernetes, Prometheus, Grafana, Terraform, and the craft of infrastructure-as-code
- Script comfortably in Python or Bash
- Understand the nuances of alert design and SLOs for high-throughput APIs
- Experience shepherding GPU-heavy workloads (vLLM, Triton, Ray, or another accelerator stack)
- Background in MLOps or model-hosting platforms
Responsibilities
- Own the reliability, performance, and observability of the entire inference stack
- Design and refine telemetry pipelines
- Tune Kubernetes autoscalers
- Craft Terraform modules
- Harden request-routing and retry logic
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
More jobs you might like
Product Manager - Security
Nebius
Security Product Manager is responsible for conveying the company’s security strengths to customers, partners and the market at large.
Berlin
Senior Backend Engineer
Nebius
We’re looking for a Senior Backend Software Engineer to help develop our hyperscaling platform.
Prague, Amsterdam, London, Tel Aviv or Berlin
Senior Software Engineer (Storage Virtualization Team)
Nebius
We’re looking for a Senior Backend Engineer to join our Storage Virtualization Team, building a distributed, fault-tolerant storage system for Nebius’ hyperscaler cloud.
Berlin
Administrative Associate / Executive Associate
Medcube Health
Medcube Health is seeking an entry-level Administrative Associate / Executive Associate for a full-time remote role in the IT & Software sector.
Remote