Skip to main content

Suzhou, China

Senior Software Engineer Senior Software Engineer

Location
Suzhou, China
Job Number
200013022-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Software Engineering
Overview

Are you an experienced backend engineer with a passion for building large scale distributed systems to enable more innovations on the search, recommendation, and AI services and products. Are you passionate about working on drive and deliver the cutting-edge techniques such as LLM, AIGC by collaborating with AI data scientists? Bing IndexServe platform team have a Senior Software Engineer position to meet your technical expertise. 


Bing Fundamentals team focuses on providing a search and recommendation platform for Microsoft internal partners using the documentation recall and reranking backend service suite. As a team, we manage one of the world’s largest distributed systems and have experienced great success in building efficient large scale distributed systems for search. Bing Fundamentals has a per decade rare opportunity to simplify the serving stack, to serve the biggest index with the most efficient way, and to drive up the relevance innovations with advanced deep learning and large language model techniques. The agility of engineering and deployment also presents as a big challenge when handling such a complex system. As Bing embraces the latest LLM innovations, the need for a platform to build up AI intelligence is becoming bigger. 


Within Bing Fundamentals, we are the IndexServe reranking platform team and we have the exciting responsibility of trying to tackle these challenges. As a team, we are trying to build the most agile, performant, stable, experientable yet efficient index serving platform. On this platform, relevance techniques can be quickly implemented, iterated, qualified and flighted to evaluate their customer impacts with convenient while full-funnel debuggability. The same platform also provides all the cutting edged techniques and utilities, like deep learning, machine learning, LLM, JavaScript, C# rankers. It has the most advanced AI toolset for our scientists to innovate, and for our products to serve most relevant documents.



Responsibilities
  • Conduct timely code reviews to ensure standards, security, test coverage, and maintainability; provide feedback and coaching to improve team skills while leveraging automated tools and best practices.
  • Design clear test strategies and architecture proposals that ensure scalability, performance, resiliency, and compliance; collaborate across teams to manage dependencies and validate security.
  • Drive engineering excellence through automation, secure design principles, compliance processes, and continuous learning; apply best practices for coding, testing, and deployment.
  • Plan and implement secure, efficient deployments with rollback strategies; monitor dependencies, follow safe change practices, and ensure disaster recovery readiness.
  • Ensure reliability and supportability by integrating telemetry, responding to live-site issues, reducing incidents, and incorporating customer insights into future designs and solutions. 


Qualifications
  • Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • 5+ years industrial experiences on an Object-Oriented Language, such as C++, C#, or Java

Additional or preferred qualifications:

  • Master’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Experience on high-performance computing (e.g., cache/memory optimization, high-performance GPU programming, compiler-based optimization, fine-grained parallel library, and runtime) or distributed systems (e.g., communication optimization, network architecture design, network programming) is a plus.
  • Capable of quantitatively implementing and qualifying a solution in a distributed environment with DevOps model
  • Experiences on building Machine Learning/Deep Learning systems is a plus.
  • Experience on performance analysis and optimization for both CPUs and GPUs, as well as good understanding on software-hardware codesign, is a plus.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Applied Scientist 2 Applied Scientist 2

Location
Suzhou, China
Job Number
200015320-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Applied Sciences
Overview

We’re building the next-generation Grounding Service that powers the latest AI applications—chat assistants, copilots, and autonomous agents—with factual, cited, and trustworthy responses. Our platform stitches together retrieval, reasoning, and real-time data so that large language models stay anchored to enterprise knowledge, the public web, and proprietary tools.

We’re looking for a Principal Applied Scientist to lead end-to-end science for grounding: inventing retrieval and attribution methods, defining factuality/faithfulness metrics, and shipping production models and APIs that scale to billions of queries. You’ll partner closely with engineering, product, research, and customers to deliver fast, reliable, and explainable answers with source citations across a diverse set of domains and modalities.

As a team, we value curiosity, pragmatic rigor, and inclusive collaboration. We believe great systems emerge when scientists and engineers co-design metrics, models, and infrastructure—and when we obsess over customer impact, privacy, and safety.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Owns the science roadmap for grounding—including retrieval, re-ranking, attribution, and reasoning—driving initiatives from problem framing to production impact. Designs and evolves state-of-the-art retrieval and RAG orchestration across documents, tables, code, and images.
  • Builds citation and provenance systems (e.g., passage highlighting, quote-level alignment, confidence scoring) to reduce hallucinations and increase user trust. Leads experimentation and evaluation using A/B testing, interleaving, NDCG, MRR, precision/recall, and calibration curves to guide measurable trade-offs.
  • Advances tool-augmented grounding through schema-aware retrieval, function calling, knowledge graph joins, and real-time connectors to databases, cloud object stores, search indexes, and the web. Partners with platform engineering to productionize models with scalable inference, embedding services, feature stores, caching, and privacy-compliant multi-tenant systems.
  • Nurtures collaborative relationships with product and business leaders across Microsoft, influencing strategic decisions and driving business impact through technology. Authors white papers, contributes to internal tools and services, and may publish research to generate intellectual property.
  • Bridges the gap between researchers (e.g., Microsoft Research) and development teams, applying long-term research to solve immediate product needs. Leads high-stakes negotiations to ensure cutting-edge technologies are applied practically and effectively.
  • Identifies and solves significant business problems using novel, scalable, and data-driven solutions. Shapes the direction of Microsoft and the broader industry through pioneering product and tooling work.
  • Mentors applied scientists and data scientists, establishing best practices in experimentation, error analysis, and incident review. Collaborates cross-functionally with PMs, research, infrastructure, and security teams to align on milestones, SLAs, and safety protocols.
  • Communicates clearly through design documentation, progress updates, and presentations to executives and customers. Contributes to ethics and privacy policies, identifies bias in product development, and proposes mitigation strategies.


Qualifications

Required Qualifications:

  • Bachelor’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field
    • OR equivalent experience.
  • Minimum of 2 years of hands-on experience designing and building search, retrieval, or ranking systems.
  • Proven track record of shipping LLM-powered or Retrieval-Augmented Generation (RAG) systems into production environments.
  • Solid coding skills and solid foundation in machine learning, with the ability to implement and optimize models effectively.
  • Demonstrated ability to lead through ambiguity, make principled trade-offs, and deliver measurable impact in cross-functional, fast-paced settings.


Preferred Qualifications:

  • Bachelor’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 5+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) 
    • OR equivalent experience.
  • Minimum of 4 years of hands-on experience designing and building search, retrieval, or ranking systems.
  • Demonstrated expertise in information retrieval, with publications in top-tier conferences or journals such as NeurIPS, ICML, ICLR, SIGIR, or ACL.
  • Hands-on experience in large language model (LLM) development, including pretraining, supervised fine-tuning (SFT), and reinforcement learning (RL).
  • Proven track record in optimizing LLM inference, or active contributions to open-source frameworks like vLLM, SGLang, or related projects.


#MicrosoftAI 


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Principal Applied Scientist Principal Applied Scientist

Location
Suzhou, China
Job Number
200015017-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Applied Sciences
Overview

Microsoft AI Organization aims to the best user experience for Web Search, Advertisement, Cloud, and Enterprise services. The Search Experience Group in Microsoft AI has more than 400 scientists and engineers, working on various NLP/Multi-modal techniques and applications.
We’re looking for passionate and experienced engineers and scientists to help us on our mission of employing deep learning to understand all the data on the web – the largest store of information in human history. With this understanding we power end-user experiences across a variety of NLP/Multi-modal related areas, especiallyBuild up the world-class AI systems with novel NLP techniques and engineering excellence.Explore cutting-edge AI technology and deliver both research and production impact.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Drive core technologies and E2E production delivery by leveraging State-of-Art AI technologies (especially LLMs).
  • Address challenges in products through Deep Learning and Reinforcement Learning approaches and transfer novel ideas to production applications.
  • Develop deep learning models for Microsoft AI scenarios, including generative search and answers, knowledge experience, et al.
  • Push the envelope on deep learning by:
    • Defining problems and establishing metrics
    • Gathering training data at scale
    • Exploring model design and architecture
    • Exploring learning objectives and tasks.


Qualifications

Required Qualifications:

  • Bachelor’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
    • OR equivalent experience.
  • Experiences in applying deep learning, LLM, RAG techniques and drive E2E AI product development.
  • 4+ years of working experience in NLP/search related areas.
  • Passionate and self-motivated.
  • Good communication skills, both verbal and written.

Preferred Qualifications:

  • Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 9+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
    • OR equivalent experience.
  • 5+ years of working experience in NLP/search related areas.
  • Good experience in LLM post-train, finetuning.
  • Experience in RAG system.
  • Solid problem-solving skills, and ability to work independently.

 

#MicrosoftAI


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Principal Software Engineer (GPU inference) Principal Software Engineer (GPU inference)

Location
Suzhou, China
Job Number
200015989-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Software Engineering
Overview

Online Advertising is one of the fastest‑growing businesses on the Internet. Microsoft Ads powers large‑scale deep learning workloads across Search, Recommendations, Click Prediction, and Relevance. Deep learning sits at the core of how Ads drives business performance and delivers high‑quality user experiences. We are building a unified, high‑performance GPU inference platform to serve all Ads deep learning models at extreme scale. This platform serves billions of requests daily, with strict requirements on latency, throughput, reliability, and cost.

We are seeking a Principal Software Engineer with deep expertise in GPU inference systems, kernel-level optimizations, and large‑scale distributed serving. You will be a senior technical leader driving the architecture, performance, and reliability of the next‑generation GPU serving stack for Ads.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Design and build a unified GPU inference platform for Ads, ensuring scalability, reliability, efficiency.
  • Optimize model inference via batching, quantization, scheduling, memory management, runtime optimization, kernel-level improvements and other performance improvements
  • Develop, optimize, and maintain CUDA kernels and GPU operators for high-throughput, low-latency production inference.
  • Collaborate with algorithm/model teams to co-design serving‑aware model architectures and optimizations.
  • Profile and improve end‑to‑end system performance: GPU utilization, concurrency, memory footprint, throughput and latency.
  • Provide senior technical leadership across teams; elevate engineering best practices and influence long‑term technical strategy.


Qualifications

Required Qualifications:

  • Bachelor’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • 6+ years’ experience in high-performance systems, distributed systems, or ML infrastructure.
  • Hands-on experience with GPU inference runtimes such as TensorRT, ONNX Runtime, Triton, TRT‑LLM, vLLM.
  • Experience building and optimizing performance‑critical production systems.

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

  • Master’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR Bachelor’s Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • Expertise in CUDA kernel development and GPU performance engineering.
  • Familiarity with LLM/Transformer inference optimizations:
    • sharding, tensor/kv‑cache parallelism, paged attention, continuous batching, quantization (FP8/AWQ), hybrid CPU–GPU orchestration.

 

#MicrosoftAI


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Software Engineer 2 Software Engineer 2

Location
Suzhou, China
Job Number
200014998-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Software Engineering
Overview

As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.

Our Platform Infrastructure team is responsible for building and scaling the backend platform at the core of Microsoft consumer products, the integrations with our AI models and the tools that our engineers use. We collaborate closely with cross-functional engineering, product management, and AI research, empowering all Microsoft Copilot teams to more effectively bring cutting-edge AI research to production. 

We’re seeking experienced Platform Infrastructure Engineers who are passionate about AI, are deeply proficient in scaling backend technologies, and possess a mastery of templating to architect solutions that stand the test of time. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Design, develop, and maintain performant and secure AI Platform services that power Copilot.
  • Work collaboratively with platform, infrastructure, application engineers, and AI researchers to build next generation AI products and services.
  • Ship high-quality and maintainable code, and ensure the reliability, scalability, and performance of platform components.
  • Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
  • Enjoy working in a fast-paced, design-driven, product development cycle.
  • Embody our Culture and Values.


Qualifications

Required Qualifications:

  • Bachelor’s Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • 2+ years’ experience building scalable platforms on public cloud infrastructure like Azure, AWS, or GCP with extensive use of technologies like Docker, Kubernetes, nginx, RDBMS, key-value stores, etc. 
  • 2+ years’ experience in building and releasing production software at the platform level.
  • Solid knowledge of APIs, data flows, systems, and services. 

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.


Preferred Qualifications:

  • Master’s Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR Bachelor’s Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • 4+ years’ experience building scalable platforms on public cloud infrastructure like Azure, AWS, or GCP with extensive use of technologies like Docker, Kubernetes, nginx, RDBMS, key-value stores, etc. 
  • 4+ years’ experience in building and releasing production software at the platform level. 
  • Experience managing high scale, multi-region, production environments on Kubernetes in cloud environments 
  • Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience. 
  • Dedication to writing clean, maintainable, and well-documented code with a focus on reliability, security and ease of use. 
  • Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, and other engineers. 
  • Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders. 
  • Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines. 
  • Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in web development and AI. 
  • Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team. 

#MicrosoftAI #Copilot


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Senior Software Engineer Senior Software Engineer

Location
Suzhou, China
Job Number
200013940-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Software Engineering
Overview

As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.

Our Platform Infrastructure team is responsible for building and scaling the backend platform at the core of Microsoft consumer products, the integrations with our AI models and the tools that our engineers use. We collaborate closely with cross-functional engineering, product management, and AI research, empowering all Microsoft Copilot teams to more effectively bring cutting-edge AI research to production. 

We’re seeking experienced Platform Infrastructure Engineers who are passionate about AI, are deeply proficient in scaling backend technologies, and possess a mastery of templating to architect solutions that stand the test of time. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Design, develop, and maintain performant and secure AI Platform services that power Copilot.
  • Work collaboratively with platform, infrastructure, application engineers, and AI researchers to build next generation AI products and services.
  • Ship high-quality and maintainable code, and ensure the reliability, scalability, and performance of platform components.
  • Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
  • Enjoy working in a fast-paced, design-driven, product development cycle.
  • Embody our Culture and Values.


Qualifications

Required Qualifications:

  • Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.

4+ years’ experience building scalable platforms on public cloud infrastructure like Azure, AWS, or GCP with extensive use of technologies like Docker, Kubernetes, nginx, RDBMS, key-value stores, etc.

  • 4+ years’ experience in building and releasing production software at the platform level.
  • Solid knowledge of APIs, data flows, systems, and services. 

Preferred Qualifications:

  • Master’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • 5+ years’ experience building scalable platforms on public cloud infrastructure like Azure, AWS, or GCP with extensive use of technologies like Docker, Kubernetes, nginx, RDBMS, key-value stores, etc.
  • 5+ years’ experience in building and releasing production software at the platform level.
  • Experience managing high scale, multi-region, production environments on Kubernetes in cloud environments
  • Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience.
  • Dedication to writing clean, maintainable, and well-documented code with a focus on reliability, security and ease of use.
  • Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, and other engineers.
  • Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders.
  • Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.
  • Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in web development and AI.
  • Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.

 

#MicrosoftAI #Copilot


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Principal Software Engineer Principal Software Engineer

Location
Suzhou, China
Job Number
200013632-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Software Engineering
Overview

The Publisher Marketplace is a next-generation platform that enables LLM clients (such as Copilot) to discover, access, and pay for premium content from trusted publishers. As a Principal Software Engineer, you will lead the design and development of backend systems and data pipelines that power this marketplace. You will make key architectural decisions, ensure scalability and security, and mentor other engineers to deliver a world-class product.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Architects and builds scalable core services, including APIs and microservices for publisher onboarding, content catalog management, entitlement, and billing, ensuring secure integration with LLM clients for seamless content consumption.
  • Designs and implements robust testing and analytics systems, developing ingestion pipelines for premium content, enabling real-time usage tracking, billing insights, and performance monitoring, while leveraging AI tools for test automation.
  • Leads architecture and infrastructure design, creating systems that support subscription models, pay-per-use billing, and licensing compliance, while optimizing backend performance for high availability and low latency in AI-driven environments.
  • Drives engineering excellence, applying secure coding practices, automation in deployment, and compliance validation, while continuously improving code quality, maintainability, and performance through metrics and best practices.
  • Guides implementation and release planning, breaking down work into manageable tasks, estimating timelines, and ensuring disaster recovery, rollback strategies, and secure deployment processes are in place.
  • Champions reliability and supportability, integrating telemetry and monitoring for live site operations, conducting incident retrospectives, and improving observability to reduce downtime and enhance system resilience. 


Qualifications

Required Qualifications:

  • Bachelor’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • Minimum of 5 years of experience in backend development and distributed systems.
  • Solid knowledge of data processing frameworks (e.g., Spark, Kafka) and streaming systems.
  • Experience with cloud platforms (Azure preferred), container orchestration (Kubernetes), and CI/CD pipelines.
  • Familiarity with secure payment systems, API gateway patterns, and identity management.
  • Proven ability to design high-scale systems for AI and LLM integration.

Preferred Qualifications:

  • Master’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR Bachelor’s Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • Experience with marketplace platforms, digital content monetization, or AI ecosystems.
  • Knowledge of data privacy regulations (e.g., GDPR, CCPA) and intellectual property protection strategies.
  • Understanding of LLM workflows and content licensing models.  

#MicrosoftAI


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Principal Software Engineer Principal Software Engineer

Location
Suzhou, China
Job Number
200013929-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Software Engineering
Overview

As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.

Our Platform Infrastructure team is responsible for building and scaling the backend platform at the core of Microsoft consumer products, the integrations with our AI models and the tools that our engineers use. We collaborate closely with cross-functional engineering, product management, and AI research, empowering all Microsoft Copilot teams to more effectively bring cutting-edge AI research to production. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.

 



Responsibilities
  • Design, develop, and maintain performant and secure AI Platform services that power Copilot.
  • Work collaboratively with platform, infrastructure, application engineers, and AI researchers to build next generation AI products and services.
  • Ship high-quality and maintainable code, and ensure the reliability, scalability, and performance of platform components.
  • Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
  • Enjoy working in a fast-paced, design-driven, product development cycle.
  • Embody our Culture and Values.


Qualifications

Required Qualifications:

  • Bachelor’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • 6+ years’ experience building scalable platforms on public cloud infrastructure like Azure, AWS, or GCP with extensive use of technologies like Docker, Kubernetes, nginx, RDBMS, key-value stores, etc. 
  • 6+ years’ experience in building and releasing production software at the platform level. 
  • Solid knowledge of APIs, data flows, systems, and services. 

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.


Preferred Qualifications:

  • Experience managing high scale, multi-region, production environments on Kubernetes in cloud environments 
  • Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience. 
  • Dedication to writing clean, maintainable, and well-documented code with a focus on reliability, security and ease of use. 
  • Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, and other engineers. 
  • Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders. 
  • Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines. 
  • Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in web development and AI. 
  • Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team. 

#MicrosoftAI #Copilot


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Senior Applied Scientist Senior Applied Scientist

Location
Suzhou, China
Job Number
200013148-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Applied Sciences
Overview

We’re building the next-generation Grounding Service that powers the latest AI applications—chat assistants, copilots, and autonomous agents—with factual, cited, and trustworthy responses. Our platform stitches together retrieval, reasoning, and real-time data so that large language models stay anchored to enterprise knowledge, the public web, and proprietary tools.

We’re looking for a Senior Applied Scientist to lead end-to-end science for grounding: inventing retrieval and attribution methods, defining factuality/faithfulness metrics, and shipping production models and APIs that scale to billions of queries. You’ll partner closely with engineering, product, research, and customers to deliver fast, reliable, and explainable answers with source citations across a diverse set of domains and modalities.

As a team, we value curiosity, pragmatic rigor, and inclusive collaboration. We believe great systems emerge when scientists and engineers co-design metrics, models, and infrastructure—and when we obsess over customer impact, privacy, and safety.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Owns the science roadmap for grounding—including retrieval, re-ranking, attribution, and reasoning—driving initiatives from problem framing to production impact. Designs and evolves state-of-the-art retrieval and RAG orchestration across documents, tables, code, and images.
  • Builds citation and provenance systems (e.g., passage highlighting, quote-level alignment, confidence scoring) to reduce hallucinations and increase user trust. Leads experimentation and evaluation using A/B testing, interleaving, NDCG, MRR, precision/recall, and calibration curves to guide measurable trade-offs.
  • Advances tool-augmented grounding through schema-aware retrieval, function calling, knowledge graph joins, and real-time connectors to databases, cloud object stores, search indexes, and the web. Partners with platform engineering to productionize models with scalable inference, embedding services, feature stores, caching, and privacy-compliant multi-tenant systems.
  • Nurtures collaborative relationships with product and business leaders across Microsoft, influencing strategic decisions and driving business impact through technology. Authors white papers, contributes to internal tools and services, and may publish research to generate intellectual property.
  • Bridges the gap between researchers (e.g., Microsoft Research) and development teams, applying long-term research to solve immediate product needs. Leads high-stakes negotiations to ensure cutting-edge technologies are applied practically and effectively.
  • Identifies and solves significant business problems using novel, scalable, and data-driven solutions. Shapes the direction of Microsoft and the broader industry through pioneering product and tooling work.
  • Mentors applied scientists and data scientists, establishing best practices in experimentation, error analysis, and incident review. Collaborates cross-functionally with PMs, research, infrastructure, and security teams to align on milestones, SLAs, and safety protocols.
  • Communicates clearly through design documentation, progress updates, and presentations to executives and customers. Contributes to ethics and privacy policies, identifies bias in product development, and proposes mitigation strategies.


Qualifications

Required Qualifications:

  • Bachelor’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)
    • OR Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) 
    • OR equivalent experience.
  • Minimum of 4 years of hands-on experience designing and building search, retrieval, or ranking systems.
  • Proven track record of shipping LLM-powered or Retrieval-Augmented Generation (RAG) systems into production environments.
  • Solid coding skills and solid foundation in machine learning, with the ability to implement and optimize models effectively.
  • Demonstrated ability to lead through ambiguity, make principled trade-offs, and deliver measurable impact in cross-functional, fast-paced settings.


Preferred Qualifications:

  • Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
    • OR equivalent experience.
  • Demonstrated expertise in information retrieval, with publications in top-tier conferences or journals such as NeurIPS, ICML, ICLR, SIGIR, or ACL.
  • Hands-on experience in large language model (LLM) development, including pretraining, supervised fine-tuning (SFT), and reinforcement learning (RL).
  • Proven track record in optimizing LLM inference, or active contributions to open-source frameworks like vLLM, SGLang, or related projects.


#MicrosoftAI #BING


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences

Suzhou, China

Principal Applied Scientist Principal Applied Scientist

Location
Suzhou, China
Job Number
200012992-en-2
City
Suzhou
Team
Other
Country
China
Discipline
Applied Sciences
Overview

MSN Whole Page Optimization (WPO) team is responsible for delivering best whole page experience for a variety of news and interest homepages that Microsoft provides through different products (e.g., Edge browser, Windows, MSN.com). We are a team full of talented, passionate developers from different regions around world. The team optimizes for global maxima over engagement, revenue, and retention by organizing homepage components to an optimal prominence and placement using available context, intent, and past behavior. By leveraging personalized ranking and recommendation techniques, we are building the framework to provide the best personalized homepage experience that match users’ interests.  

We are looking for an experienced applied scientist to drive a cross-functional v-team to design and implement personalized and efficient solutions, ensuring optimal system performance and user satisfaction. Working at Microsoft, a company driven by innovation, you will have the opportunity to continuously improve your technical skills and leadership abilities, achieving greater breakthroughs in your career.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Technical Design: Develop and execute technical roadmaps to ensure the product’s quality and growth.

  • Project Management: Manage the entire development lifecycle, including requirements analysis, design, development, testing, and deployment, to ensure projects are delivered on time and to quality standards.

  • Ownership Mindset: Actively identify the problem, then lead the design and implementation process to effectively integrate the solution into the final product.

  • Cross-Team Collaboration: Work closely with product managers, UX designers, and other team members to understand business requirements and translate them into technical solutions.

  • Technical Innovation: Stay attuned to industry trends and new technologies, actively promoting innovation and the adoption of best practices.

  • Quality Assurance: Establish and enforce standards for code reviews, unit testing, and integration testing to ensure high code quality and system reliability.



Qualifications

Required Qualifications:

  • Bachelor’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
    • OR equivalent experience.
  • At least 5 years of software development experience and over 2 years of project management experience.
  • Good English communication skills, with the ability to effectively engage in technical and business discussions with global teams.
  • Solid project management abilities, familiar with Agile development processes, and capable of working effectively in a multitasking environment.
  • Excellent leadership and team collaboration skills, with the ability to motivate team members and communicate effectively with cross-functional teams.
  • Solid analytical and problem-solving skills, capable of quickly responding to and handling system failures.
  • Solid interest in technological innovation and the ability to lead a team in a fast-changing technical environment.


Preferred Qualifications:

  • A background in recommendation systems or algorithms, with the ability to provide professional guidance and innovative ideas in personalized content recommendations.

#MicrosoftAI 


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar jobs

Software Engineering IC3

Hyderabad, In
Software Engineering

Senior Applied Scientist

Beijing, Cn
Applied Sciences

Senior Applied Scientist

Suzhou, China
Applied Sciences