At Philo, we’re a group of technology and product people who set out to build the future of television, marrying the best in modern technology with the most compelling medium ever invented — in short, we’re building the TV experience that we’ve always wanted for ourselves. In practice this means leveraging cloud delivery, modern tech stacks, machine learning, and hand-crafted native app experiences on all of our platforms. We aim to deliver a rock solid experience on the streaming basics, while cooking up next generation multi-screen and multi-user playback experiences.
The infrastructure team at Philo builds the foundation for a 24/7 live and on-demand streaming product serving video to our growing subscriber base. It provides a platform that enables groups across the company – such as video delivery, product, support, and analytics – to do their best work easily and smoothly. Our systems are highly distributed, horizontally scalable and run in the cloud on Kubernetes. We continuously test and deploy our code and closely monitor the health and performance of our production environment.
We are seeking an enthusiastic Infrastructure MLOps Software Engineer to help us build and improve the ML infrastructure at Philo. We are building out ML and LLM infrastructure and this role will be pivotal in setting direction, adopting best practices, and shipping infrastructure that will be used across the company.
As a sample, the ML infrastructure supports teams like Discovery in building content recommendation models that will help our users find more favorite shows from the large Philo catalog. The engineering team is designing and developing our own agent harnesses to support coding and empowering everyone at the company to get answers across our code bases, analytics, logs, and communication tools. The video player team is using LLMs to classify ads and label our video catalog so that users have a better experience. You’ll build the serving, evaluation and platform infrastructure that these workloads depend on.
Responsibilities:
Manage the core infrastructure at Philo with a focus on supporting ML and LLM workloads. This infrastructure is relied on by a large subscriber base of Philo’s product as well as internal stakeholders across the company.
Design, build, and maintain cloud infrastructure components (AWS and Kubernetes) using a combination of in-house technology and open source software.
Build and scale model serving and inference infrastructure for both real-time recommendation models and LLM workloads — including model servers (e.g. NVIDIA Triton), LLM inference engines (e.g. vLLM, TGI, TensorRT-LLM), autoscaling, and latency/throughput optimization.
Manage GPU and accelerator infrastructure on Kubernetes — scheduling, capacity and quota management, and cost optimization across on-demand and spot capacity.
Design, build, and maintain monitoring and observability systems — spanning both system health and model quality (drift, evaluation, and online performance) — that enable Philo engineers and the support team to gain insight and to discover and debug issues.
Build and operate model evaluation infrastructure: offline and online eval pipelines, golden/regression datasets, LLM-as-judge harnesses, A/B testing and experimentation, and feedback/ground-truth loops
Design, build, and maintain CI/CD systems enabling Philo engineers to create pipelines to test and deploy their code.
Establish tools, methods and best practices for other Philo engineers interfacing with the Philo ML infrastructure. Ensure reliability, security, and scalability of the Philo platform. Promote Infrastructure as Code.
Work closely with other Philo engineers to deploy and instrument software systems.
Drive evaluation, selection, and integration of third-party vendor systems and work closely with vendors to configure and manage them.
Qualifications:
8+ years of software development and infrastructure management experience.
4+ years of experience developing and deploying ML systems at scale across training and inference
Experience working with distributed systems and an understanding of microservices architecture principles.
Experience with Linux and containerized (i.e. Docker) environments.
Experience managing cloud computing environments (AWS or GCP) and configuring cloud services e.g. CloudWatch, Route 53, RDS, ElastiCache, SQS, ALB/NLB/ELB, VPC networking, IAM security.
Experience with container orchestration platforms (i.e. Kubernetes), and familiarity with running GPU/accelerated workloads on them (e.g. NVIDIA device plugin, MIG, timeslicing).
Strong understanding of networking and internet application protocols including, but not limited to TCP/IP, DNS, and HTTP.
Strong understanding of network and application security principles and best practices.
Familiarity or hands-on experience with configuration management systems and Infrastructure as Code (e.g. Terraform, CloudFormation).
Familiarity or hands-on experience with Monitoring/Observability systems (e.g. Prometheus, Grafana, TICK/InfluxDB, Fluentd, ELK, Datadog).
Familiarity or hands-on experience with CI/CD automation systems e.g. Jenkins, Gitlab.
Experience with relational and non-relational databases and familiarity with modern data warehousing and querying.
Proficient in writing, testing, and profiling software in Golang, JavaScript/TypeScript, C++, Ruby, Python or similar programming languages.
Experience and aptitude for collaborating and communicating with internal and external stakeholders in both business and technical roles.
A strong candidate may also have one or more of these:
Hands-on experience optimizing inference — dynamic/continuous batching, quantization, KV-cache management, or GPU memory tuning — for low-latency or highthroughput serving.
Sponsorship data shows employers' past filings in public US government records (DOL, USCIS, E-Verify) and is not a promise that any job will be sponsored. Immigration rules change. Verify your situation with your DSO or an immigration attorney.