Mountain View, United States

Compute Orchestration & Scheduling

Location
Mountain View, United States
Job Number
200053174
City
Mountain View
Team
Microsoft AI
Country
United States
Discipline

 

Overview

Microsoft AI is looking for a Member of Technical Staff, Compute Orchestration & Scheduling, to help build the next generation of AI infrastructure powering frontier model development. The Compute Orchestration & Scheduling team own cluster orchestration, workload scheduling, resource allocation, quota management, and the systems that enable fast initialization and reliable fault recovery for Ray and Kubernetes workloads running on next-generation GPU supercomputers. 

Our team develops the systems required to make AI infrastructure ready for the next generation of distributed training and inference workloads, spanning multiple locations with a massive and rapidly growing fleet of advanced accelerators across multiple hardware generations, including NVIDIA Grace Blackwell, Vera Rubin, and/or AMD GPU platforms, as well as accompanying CPU, Network and Storage infrastructure. 

Key challenges include topology-aware placement, large-scale distributed training, fast and reliable initialization of Ray and Kubernetes environments, rapid fault recovery for long-running AI jobs, deep observability into cluster behavior, and continuously improving utilization across increasingly large accelerator fleets. Every improvement in scheduling efficiency, platform reliability, and cluster utilization directly increases the effective compute available for frontier AI research and product development. 

You'll wear multiple hats and partner closely with researchers, model engineers, hardware architects, and infrastructure teams to translate the needs of frontier model development into scalable platform capabilities.  You'll be expected to find paths around roadblocks, get solutions into users' hands quickly and iteratively, and thrive in a fast-paced, design-driven product development environment. We are looking for engineers who are excited by challenging systems problems, comfortable operating in ambiguous environments, and motivated by building infrastructure that directly accelerates frontier AI model development.  

MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location. This expectation is subject to local law and may vary by jurisdiction. 

Responsibilities

  • Develop and tune the pretraining scalable software for Nvidia Grace-Blackwell (GB), Vera-Rubin (VR) and AMD MIxxx architectures
  • Scale GB, VR and AMD MIxxx GPU clusters beyond thousands of GPUs 
  • Gather data and insights to develop the GPU & CPU compute roadmap suitable for large-scale AI labs 
  • Actively contribute to the development of AI models that are powering our innovative products    
  • Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively  
  • Enjoy working in a fast-paced, design-driven, product development cycle  
  • Embody our Culture and Values  

Qualifications

Required Minimum Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, Python, Go or JavaScript  
    • OR equivalent experience.
Additional Preferred Qualifications
  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, Python, Go or JavaScript  
    • OR equivalent experience.
  • Expertise in one of Ray, Kubernetes, Kueue, Volcano, or any other AI-focused systems for scheduling / scaling / fault-tolerance. 

 

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. 


 

 

 

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

 

Apply for this job

Fields marked * are required.

PDF, Word, TXT or RTF — 10 MB max.

Or type/paste it instead

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 07/31/2029

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans' Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Voluntary Self-Identification


For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Microsoft Corporation’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

English (United States)
Your Privacy Choices Opt-Out Icon Your Privacy Choices
Consumer Health Privacy Sitemap Contact Microsoft Privacy Manage cookies Terms of use Trademarks Safety & eco Recycling About our ads