We consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected.

Requirements

- 3+ years of experience in backend, infrastructure, or systems engineering

- Strong proficiency in Go and Python

- Experience building or operating a model serving platform or ML platform

- Solid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput

- Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar)

- Understanding of security fundamentals - network isolation, authentication, encryption, multi-tenancy

Nice to have

- Experience with NVIDIA Dynamo or similar inference orchestration/routing frameworks

- Hands-on experience with GPU serving infrastructure (vLLM, Triton, TensorRT-LLM)

- Experience with Kubernetes in a production environment (deployment, networking, resource management)

- Experience operating at scale (10k+ RPS, multi-region, multi-cluster)

- Comfortable working on-call or in incident response when things break

Member of Technical Staff – AI Inference platform

Your application!

Documents