Job Number
1970324837015672-en-3
Overview
At Microsoft AI, we are on a mission to develop the most cutting-edge algorithms for post-training large language models (LLMs) and ship those models to millions of users using Copilot every day.
The AI Post-Training team at Microsoft AI is responsible for all aspects of post-training and improving our pre-trained models to advance the state-of-the-art on a wide variety of internal and external benchmarks. Our goal is to push our models’ capabilities in reasoning and instruction following, math, code, and tool use and agentic tasks, among many other areas.
This role involves contributions to all stages of the post-training process: driving data collection and acquisition, building evaluations of model capabilities, and applying advanced reward modeling and RL techniques to develop and improve the post-training recipe. We work on the bleeding edge and leverage the most powerful pretrained models and algorithms for our needs. We are an interdisciplinary team of engineers and scientists, learning from each other and collaborating to create the best models.
We are looking for outstanding individuals excited about contributing to the next generation of models that will transform the field. We are looking for candidates who:
- Are passionate about advancing the state of post-training research;
- Have experience with reward modeling, RL, or other post-training techniques;
- Will thrive in a highly collaborative, fast-paced environment;
- Have a high degree of craftsmanship and pay close attention to details, consistently striving for engineering excellence.;
- Are willing to contribute meaningfully as individuals and take end-to-end ownership of projects
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Develop data collection, evaluation, and post-training methods for models.
- Design hypotheses and experiment plans for rapidly iterating on model performance.
- Embody our culture and values.
Qualifications
Required Qualifications
- Bachelor’s Degree in Computer Science, Machine Learning, Mathematics, or related technical discipline AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Have experience with reward modeling, RL, or other post-training techniques.
Preferred Qualifications
- Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Master’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Demonstrated experience in large-scale AI.
- Passionate about conversational AI and its deployment.
- Demonstrated written and verbal communication skills with the ability to work closely with cross-functional teams, including product managers, designers, and other engineers.
- Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in AI.
- Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.
Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $117,200 – $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 – $250,200 per year.
Software Engineering IC5 – The typical base pay range for this role across the U.S. is USD $137,600 – $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 – $294,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft will accept applications and processes offers for these roles on an ongoing basis.
#MicrosoftAI #Copilot
Job Number
1970324837018176-en-3
Overview
As a Member of Technical Staff – Machine Learning, AI Safety, you will work on the Technical Safety Squad to ensure that Copilot’s messages comply with content policies and the larger values of the organization. You may be responsible for developing new methods to evaluate LLMs, experimenting with data collection techniques for safety post-training, or training content classifiers to support the Copilot experience. We’re looking for someone with experience in artificial intelligence, but also a strong communicator and great teammate. The right candidate takes the initiative and enjoys building world-class consumer experiences and products in a fast-paced environment.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Leverage subject matter expertise to uncover and mitigate safety issues in consumer Copilot.
- Oversee data acquisition or generation efforts, ensuring that the data meets product needs.
- Generalize machine learning (ML) solutions into repeatable frameworks.
- Conduct thorough review of data analysis and techniques used to summarize the process review and highlight areas that have been missed or need reexamining.
- Track advances in industry and academia, identify relevant state-of-the-art research, and adapt algorithms and/or techniques to drive innovation and develop new solutions.
- Independently write efficient, readable, extensible code and model pipelines.
- Contribute to defining the safety roadmap for Copilot, keeping in mind business and product goals.
- Commit to a customer-oriented focus by acknowledging customer needs and perspectives, validating customer perspectives, focusing on broader customer context, and serving as a trusted advisor.
- Embody our culture and values.
Qualifications
Required Qualifications
- Bachelor’s Degree in Computer Science, or related technical discipline AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Experience prompting and working with large language models.
- Experience writing production-quality Python code.
Preferred Qualifications
- Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Master’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Demonstrated interest in Responsible AI.
Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.
Software Engineering IC5 – The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 – $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft will accept applications and processes offers for these roles on an ongoing basis.
Job Number
1970324837007744-en-1
Overview
As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.
Help us push the frontiers of metrics and measurement. Our team focuses on building insights into Microsoft’s AI products. We’re looking for a talented Machine Learning (ML) Engineer to build inference infrastructure to help us understand and improve how people interact with Microsoft’s AI products. Our team is seeking people with deep technical talent, a drive to deliver, and a creative/entrepreneurial spirit.
The ideal candidate has experience in High-Performance Computing (HPC), distributed (batch) inference in machine learning, and/or working with cloud infrastructure.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
By applying to this U.S. New York, New York OR Mountain View, CA OR Redmond, WA , OR Boulder, CO position, you are required to be local to the New York OR San Francisco OR Seattle OR Denver area and in office 3 days a week.
Responsibilities
- Creates pipelines for machine learning, inclusive of data preparation, inference, and integration with downstream systems.
- Comfortable with large scale data processing pipelines to extract business value from user logs.
- Learning about, understanding, and experimenting with the latest LLM capabilities that keep up with your customers.
- Partnering with engineering, product, and leadership teams to create robust client libraries that facilitate large scale inference on user data.
- Driving design and technical strategy decisions based on product needs, customer feedback and best development practices.
- Providing technical leadership and subject matter expertise as you establish and grow best practices for the integration of emerging technology.
- Embodying Microsoft’s culture and values.
- Embody our Culture and Values.
Qualifications
Required Qualifications:
- Bachelor’s Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Python
- OR equivalent experience.
- Experience with Python, SQL, and/or Spark.
Preferred Qualifications:
- Bachelor’s Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Python
- OR Master’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Python
- OR equivalent experience
- Experience with Azure Machine Learning or similar systems, including deployment and monitoring of large-scale pipelines.
- Experience with Python package development.
- Experience with LLMs and prompt engineering.
- Experience with ML and data science libraries such as sklearn, PySpark, pandas, and transformers.
Software Engineering IC5 – The typical base pay range for this role across the U.S. is USD $137,600 – $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 – $294,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft will accept applications and processes offers for these roles on an ongoing basis.