Proficiency with profiling tools (Nsight Systems/Compute, PyTorch Profiler, HTA, or similar) and ability to translate traces into concrete optimizations.
Solid grasp of collective communication (NCCL) and modern networking concepts (RDMA, NVLink, InfiniBand/RoCE, topology-aware placement).
Strong Python and CUDA/C++ skills; comfortable reading and modifying framework internals.
Experience debugging performance regressions and instability at scale (stragglers, hangs, OOMs, numerical divergence).
Experience defining and reasoning about hardware-efficiency metrics (MFU/HFU) and using them to drive optimization priorities.
Bonus Qualifications:
Experience with heterogeneous or multi-datacenter training setups and cross-cluster orchestration.
Contributions to open-source ML systems projects (PyTorch, Megatron-LM, vLLM, DeepSpeed, JAX, etc.).
Exposure to non-NVIDIA accelerators (AMD GPUs, TPU/Trainium/Inferentia, or custom silicon) and heterogeneous fleet management.
The US base salary range for this full-time position is $200,000 to $400,000 per year.
The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.
Sponsorship data shows employers' past filings in public US government records (DOL, USCIS, E-Verify) and is not a promise that any job will be sponsored. Immigration rules change. Verify your situation with your DSO or an immigration attorney.