Member of Technical Staff - Infrastructure
San Francisco, CA
$150k–$390k a yearOn-siteLead & above
Job details
- San Francisco, CA
- On-site
- $150k–$390k a year (posted by the company)
- Full-time · Lead & above
- Research & Development
- Posted 5 months ago
Sponsorship history
Past filings by Gimlet Labs in public government data. Not a promise of sponsorship.
- Filed 1 H-1B LCA in FY2025
Full job description
About us
Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference.
We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it.
We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware.
About the role
As an Infrastructure Platform Engineer, you will build the systems that turn heterogeneous accelerator hardware into reliable production infrastructure for Gimlet's AI cloud.
Gimlet's fleet spans hardware with different architectures, software stacks, operational characteristics, and failure modes. Your work will determine how new hardware is brought online, how clusters are provisioned and operated, and how production inference systems remain reliable as the fleet scales.
You will work across bare metal, Linux, Kubernetes, cluster scheduling, observability, and automation. You will build systems that abstract differences between accelerator architectures, make new hardware production-ready, and improve the reliability and operability of Gimlet’s infrastructure.
What success looks like
In your first 12–18 months, you will:
- Deploy and operate production clusters across different accelerator architectures
- Automate hardware provisioning, validation, upgrades, and fleet lifecycle management
- Improve cluster scheduling, resource utilization, isolation, and capacity management
- Build observable infrastructure that enables faster debugging, incident response, and recovery
- Partner across distributed systems, runtime, compiler, networking, and hardware teams to bring new accelerators into production
You may be a good fit if you have
- Experience in infrastructure, cluster engineering, platform engineering, SRE, or HPC
- Strong Linux systems knowledge and production debugging experience
- Experience operating Kubernetes, Slurm, Nomad, or similar orchestration systems
- Experience automating infrastructure with Python, Go, Terraform, Ansible, or similar tools
- Experience with GPU or accelerator infrastructure, including drivers, firmware, or CUDA/ROCm
- The ability to build systems that are observable, recoverable, and reliable in production
