At Microsoft AI, we build the frontier models and products that reach millions of people, from pretraining through post-training, evaluation, and launch. The infrastructure behind this work operates at massive scale, and its reliability, availability, and operational readiness are critical to keeping researchers and engineers productive.
We are looking for a Technical Program Manager, HPC to drive the operational health and reliability of the high-performance computing infrastructure supporting Microsoft AI. You will partner closely with HPC engineering, platform, networking, storage, capacity, datacenter, and Azure teams to ensure production clusters are healthy, available, and ready to support demanding AI workloads.
This role sits at the intersection of HPC infrastructure, production operations, reliability, and technical program management. You will establish the operating mechanisms that identify problems early, coordinate rapid recovery when incidents occur, drive systemic fixes, and ensure service commitments are consistently met.
You will need enough technical depth to engage credibly on cluster health, compute, networking, storage, schedulers and infrastructure dependencies, combined with the program leadership needed to coordinate complex issues across organizational boundaries.
What You'll Do
As the HPC Production Support TPM, you will own the operating rhythm and cross-functional execution required to maintain healthy, reliable HPC clusters.
You will drive a comprehensive view of fleet and cluster health, bringing together operational signals, incidents, Nodes-In-Service and Racks-In-Service, infrastructure risks, dependencies, and service-level objectives to help teams prioritize the issues that have the greatest impact on production.
When critical incidents occur, you will help drive coordinated response across HPC and Azure teams, ensuring clear ownership, rapid escalation, effective stakeholder communication, and follow-through from mitigation through root-cause analysis and corrective actions.
Beyond individual incidents, you will identify recurring reliability patterns and translate them into durable engineering and operational improvements. You will build a strong network across Azure’s HPC, networking, storage, capacity, datacenter, and other partner teams so that dependencies are understood, escalation paths are established, and SLAs and SLOs can be consistently met.
Responsibilities
- Own end-to-end programs for HPC production health and operational readiness, driving cluster availability, reliability, and service performance.
- Establish operating mechanisms for cluster health, including SLA/SLO reviews, NIS/RIS tracking, incident trends, risks, dependencies, and corrective actions.
- Drive critical incident management, coordinating triage, escalation, mitigation, stakeholder communication, root-cause analysis, and follow-through across HPC and Azure teams.
- Identify systemic reliability issues using operational signals and incident patterns, and partner with engineering teams to drive durable improvements.
- Build strong cross-functional partnerships across Azure compute, networking, storage, capacity, datacenter, and platform teams to resolve dependencies and establish effective escalation paths.
- Define and track operational metrics and dashboards that provide actionable visibility into cluster health, availability, incidents, risks, and SLA/SLO performance.
- Proactively manage production risks and dependencies, surfacing issues to engineering and leadership before they become critical blockers.
- Drive alignment without formal authority, connecting engineering and service owners around shared reliability goals and accountable execution.
- Communicate production health, major incidents, risks, and trade-offs to leadership with clear ownership and action plans.
Qualifications
- Significant experience in technical program management, infrastructure engineering, production operations, site reliability, or large-scale distributed systems.
- Demonstrated experience delivering complex, cross-functional programs spanning multiple engineering organizations.
- Technical fluency in large-scale infrastructure, including areas such as HPC, compute, accelerators, networking, storage, schedulers, capacity, telemetry, or distributed systems.
- Experience driving production incident management, including escalation, mitigation, root-cause analysis, and corrective actions.
- Experience working with SLAs, SLOs, availability metrics, and production-health indicators.
- Ability to use operational data and incident trends to identify systemic problems and drive reliability improvements.
- Strong ability to build relationships and influence engineering teams across organizational boundaries.
- Excellent written and verbal communication skills, with the ability to translate complex technical issues into clear risks, decisions, and actions.
Preferred Qualifications
- Experience supporting GPU or accelerator-based HPC/AI infrastructure at scale.
- Experience with cloud infrastructure spanning compute, networking, storage, capacity, or datacenter operations.
- Experience establishing reliability programs, operational scorecards, health dashboards, or incident-management mechanisms for large infrastructure environments.
Technical Program Management IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.