Member of Technical Staff, Software Co-Design AI HPC Systems – MAI Superintelligence Team
Member of Technical Staff, Software Co-Design AI HPC Systems – MAI Superintelligence Team
- Location
- Job Number
- City
- Team
- Country
- Discipline
Our team’s mission is to architect, co-design, and productionize next-generation AI systems at datacenter scale. We operate at the intersection of models, systems software, networking, storage, and AI hardware, optimizing end-to-end performance, efficiency, reliability, and cost. Our work spans today’s frontier AI workloads and directly shapes the next generation of accelerators, system architectures, and large-scale AI platforms. We pursue this mission through deep hardware–software co-design, combining rigorous systems thinking with hands-on engineering. The team invests heavily in understanding real production workloads large-scale training, inference, and emerging multimodal models and translating those insights into concrete improvements across the stack: from kernels, runtimes, and distributed systems, all the way down to silicon-level trade-offs and datacenter-scale architectures.
This role sits at the boundary between exploration and production. You will work closely with internal infrastructure, hardware, compiler, and product teams, as well as external partners across the hardware and systems ecosystem. Our operating model emphasizes rapid ideation and prototyping, followed by disciplined execution to drive high-leverage ideas into production systems that operate at massive scale.
In addition to delivering real-world impact on large-scale AI platforms, the team actively contributes to the broader research and engineering community. Our work aligns closely with leading communities in ML systems, distributed systems, computer architecture, and high-performance computing, and we regularly publish, prototype, and open-source impactful technologies where appropriate.
Responsibilities
Lead the co-design of AI systems across hardware and software boundaries, spanning accelerators, interconnects, memory systems, storage, runtimes, and distributed training/inference frameworks.
Drive architectural decisions by analyzing real workloads, identifying bottlenecks across compute, communication, and data movement, and translating findings into actionable system and hardware requirements.
Co-design and optimize parallelism strategies, execution models, and distributed algorithms to improve scalability, utilization, reliability, and cost efficiency of large-scale AI systems.
Develop and evaluate what-if performance models to project system behavior under future workloads, model architectures, and hardware generations, providing early guidance to hardware and platform roadmaps.
Partner with compiler, kernel, and runtime teams to unlock the full performance of current and next-generation accelerators, including custom kernels, scheduling strategies, and memory optimizations.
Influence and guide AI hardware design at system and silicon levels, including accelerator microarchitecture, interconnect topology, memory hierarchy, and system integration trade-offs.
Lead cross-functional efforts to prototype, validate, and productionize high-impact co-design ideas, working across infrastructure, hardware, and product teams.
Mentor senior engineers and researchers, set technical direction, and raise the overall bar for systems rigor, performance engineering, and co-design thinking across the organization.
Qualifications
Required/Minimum Qualifications
- Bachelor’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Master’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor’s Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Strong background in one or more of the following areas:
- AI accelerator or GPU architectures
- Distributed systems and large-scale AI training/inference
- High-performance computing (HPC) and collective communications
- ML systems, runtimes, or compilers
- Performance modeling, benchmarking, and systems analysis
- Hardware–software co-design for AI workloads
- Proficiency in systems-level programming (e.g., C/C++, CUDA, Python) and performance-critical software development.
- Proven ability to work across organizational boundaries and influence technical decisions involving multiple stakeholders.
- Experience designing or operating large-scale AI clusters for training or inference.
- Deep familiarity with LLMs, multimodal models, or recommendation systems, and their systems-level implications.
- Experience with accelerator interconnects and communication stacks (e.g., NCCL, MPI, RDMA, high-speed Ethernet or InfiniBand).
- Background in performance modeling and capacity planning for future hardware generations.
- Prior experience contributing to or leading hardware roadmaps, silicon bring-up, or platform architecture reviews.
- Publications, patents, or open-source contributions in systems, architecture, or ML systems are a plus.
Software Engineering IC5 – The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 – $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
Software Engineering IC6 – The typical base pay range for this role across the U.S. is USD $163,000 – $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 – $331,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Principal Software Engineer
Principal Software Engineer
- Location
- Job Number
- City
- Team
- Country
- Discipline
Do you enjoy solving complex technical problems on a global scale? Microsoft AI Monetization is building the next generation of privacy‑preserving measurement and data collaboration systems. As digital advertising evolves, advertisers need accurate, privacy‑safe ways to understand performance and optimize spend. The Measurement & Data Collaboration Engineering team delivers secure, compliant technology that enables data collaboration without compromising user trust. As Principal Software Engineer, Microsoft AI Monetization, you will architect and build the most impactful systems to achieve this mission while demonstrating excellence to elevate your team as a technical leader.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Architect and build highly scalable backend services and data pipelines that support privacy‑preserving measurement and analytics scenarios using C# or Java.
- Design secure data collaboration workflows across multiple parties using modern privacy technologies, governance controls, and minimum‑aggregation protections.
- Lead engineering direction for high‑reliability ingestion and processing systems with clear SLOs, solid resiliency, and top‑tier operational excellence.
- Drive integrations with external data and measurement partners, designing stable interfaces, schema governance patterns, and robust validation.
- Champion engineering quality: design reviews, automated testing, monitoring/alerting, and production readiness.
- Mentor and guide engineers across the team, strengthening system design depth, architectural thinking, and execution rigor.
- Collaborate closely with product, data science, privacy, and security teams to translate measurement needs into scalable platform capabilities.
- Guide the ENG team with best practices leveraging AI dev tools across the software development lifecycle (SDLC).
Qualifications
Required:
- Bachelor’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
- Master’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor’s Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- 7+ years of experience building and operating large‑scale distributed systems, backend services, or data platforms.
- Expertise in cloud infrastructure (Azure, AWS, or GCP), including service design, storage, compute, networking, application and network security, and CI/CD pipelines.
- Demonstrated leadership driving technical architecture, cross‑team execution, and mentoring senior engineers.
- Experience with secure data processing, privacy‑preserving techniques, access control, or data governance.
- Background in advertising, marketing technology, attribution, or large‑scale analytics.
- Familiarity with privacy‑enhancing technologies such as differential privacy, minimum aggregation, or secure computation patterns.
- Experience integrating third‑party (vendor/partner) platforms, identity systems, or data collaboration technologies.
#MicrosoftAI
Software Engineering IC5 – The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 – $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Senior Software Engineer
Senior Software Engineer
- Location
- Job Number
- City
- Team
- Country
- Discipline
Do you enjoy solving complex technical problems on a global scale? Microsoft AI Monetization enables advertisers to measure impact and optimize spend through secure, privacy‑preserving data collaboration. The Measurement and Data Collaboration Engineering team is responsible for building the next generation of privacy‑safe measurement systems that allow advertisers and partners to work with data in highly secure environments. Our platform integrates Microsoft’s Azure Confidential Compute Clean Room (ACCR) with third‑party clean room partners to deliver a unified, compliant, and scalable measurement ecosystem.
We are looking for a Senior Software Engineer who is passionate about distributed systems, privacy‑enhancing technologies, secure data processing, and building reliable production services with global impact.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Design and build highly scalable backend services and data pipelines that support privacy‑preserving measurement and analytics scenarios using C# or Java.
- Design secure data collaboration workflows across multiple parties using modern privacy technologies, governance controls, and minimum‑aggregation protections.
- Drive integrations with external data and measurement partners, designing stable interfaces, schema governance patterns, and robust validation.
- Lead initiatives to make delivery of high-quality software routine and efficient through the entire software development lifecycle, from inception and technical design through testing and excellence in production operations.
- Collaborate closely with product, data science, privacy, and security teams to translate measurement needs into scalable platform capabilities.
- Contribute to engineering team best practices leveraging AI dev tools across the software development lifecycle (SDLC).
Qualifications
Required:
- Bachelor’s degree in computer science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred:
- Master’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- 5+ years of experience building and operating large‑scale distributed systems, backend services, or data platforms.
- Experience with large‑scale data processing frameworks (e.g. Spark, SQL‑based pipelines) and cloud platforms.
- Understanding of secure data processing, encryption, identity, and access control.
- Experience building and operating services with strict SLAs.
- Experience with Azure.
- Background in advertising, marketing technology, attribution, or large‑scale analytics.
- Experience integrating third‑party (vendor/partner) platforms, identity systems, or data collaboration technologies.
- Solid problem‑solving skills with a focus on reliability, observability, and system design.
#MicrosoftAI
Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Member of Technical Staff – Senior ML Engineer – MAI Super Intelligence Team
Member of Technical Staff – Senior ML Engineer – MAI Super Intelligence Team
- Location
- Job Number
- City
- Team
- Country
- Discipline
We are seeking a Senior Machine Learning Engineer to bridge the gap between advanced Vision-Language Model (VLM) research and high-performance production serving. Unlike standard data science and engineering roles, this position requires a dual competency: you must be capable of designing novel VLM architectures (including dataset curation and multilingual alignment) AND optimizing the inference stack (kernel optimization, distillation, and memory management) to run these models on specific hardware constraints (NVIDIA H100 and AMD MI300x).
The successful candidate will own the entire vertical slice: from reading the latest arXiv papers and improving training sets, to writing the C++/CUDA kernels that serve the final model in production.
Responsibilities
1. VLM Research & Architecture Design
Continuously evaluate and implement the latest research trends in Vision-Language Models, specifically focusing on Referring Expression Comprehension (REC), Document Understanding (Pix2Struct), and Visual Question Answering (VQA).Design and build massive-scale training and evaluation datasets, ensuring multilingual compatibility and broad visual understanding for European market requirements.Lead the model co-design process, creating architectures that are natively optimized for accelerator capabilities (compute-bound vs. memory-bound operations).
2. Advanced Inference Optimization & Serving
Architect high-throughput serving layers using SGLang and vLLM, optimizing for non-standard decoding strategies.
Implement scientific experiments to find the Pareto-optimal frontier between serving latency and generation quality.Execute Knowledge Distillation (KD), unstructured pruning, and quantization techniques to fit large-scale VLM architectures onto single-node GPU setups (specifically H100 or MI300x) without compromising model quality.
3. Systems Engineering & Kernel Development
Write and optimize custom kernels (CUDA/HIP) to accelerate serving latency, identifying bottlenecks at the operator level.
Manage the full pre-training and post-training tech stack, ensuring seamless integration between model weights and inference engines.Take ownership of landing the serving-efficient model in a production environment, ensuring reliability and scalability.
Qualifications
Mandatory Requirements (Must Have)
- Education: Master’s or PhD in Computer Science, Artificial Intelligence, or High-Performance Computing.
- Experience: Minimum 4+ years of experience in Machine Learning, with a mandatory split focus between Model Architecture and Systems Optimization.
- VLM Expertise: Proven experience building and shipping Vision-Language Models (e.g., architectures similar to CLIP, Flamingo, Pix2Struct). Must have experience creating custom evaluation sets for tasks like Document Understanding.
- Serving Stack Proficiency: Expert-level knowledge of SGLang and vLLM for optimized serving.
- Hardware Specifics: Demonstrable experience optimizing models for both NVIDIA (H100) and AMD (MI300x) accelerators.
- Optimization Techniques: Hands-on experience with Knowledge Distillation and Pruning to reduce model latency for target serving sizes.
- Production Engineering: A track record of taking complex multi-modal models from research code to a deployed, user-facing production product.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Principal Applied Scientist
Principal Applied Scientist
- Location
- Job Number
- City
- Team
- Country
- Discipline
Responsibilities
- Define north-star metrics and guardrails; build measurement plans, offline scorecards, and online A/B tests; interpret results and drive clear ship/iterate decisions.
- Build, train, and adapt LLM/SLM solutions for sports scenarios (prompting, supervised fine-tuning, distillation, and domain adaptation), using disciplined evaluation and error analysis to improve quality, latency, and cost.
- Improve relevance and user satisfaction via applied NLP/IR: query intent, disambiguation, ranking, summarization, multilingual support, and robust entity/event understanding for sports.
- Partner with engineering and PM to translate prototypes into shippable systems (data/feature pipelines, training workflows, inference services, monitoring), and to iterate quickly based on experiment outcomes.
- Own end-to-end DS/ML delivery: data strategy (instrumentation, labeling), modeling approach, evaluation, rollout/holdbacks, and long-term iteration plans.
- Mentor and unblock other data scientists and engineers through technical leadership, design reviews, and best practices, while remaining hands-on on critical paths.
- Establish ongoing health signals: KPI dashboards, model/data monitoring, regression gates, and incident playbooks to keep quality high during peak sports moments.
- Ensure Responsible AI and compliance (privacy, security, policy, and regional requirements): evaluate for safety issues (hallucinations, bias, sensitive content), implement mitigations, and document decisions.
Qualifications
Required Qualifications:
- Bachelor’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research).
- OR Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research).
- OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research).
- OR equivalent experience.
- 6+ years of industry experience delivering production ML/DS solutions; 5+ years building deep learning/NLP/IR systems (sports domain experience is a plus).
- Demonstrated ability to lead through influence as a senior IC: independently define strategy, drive execution across teams, and deliver measurable impact.
- Strong foundations in statistics and applied experimentation (metric design, A/B testing, guardrails, causal thinking), and ML evaluation (error analysis and model assessment).
- Experience integrating models into production services: data pipelines, feature stores, CI/CD for ML, monitoring, and on-call/operational practices.
- Experience with modern generative AI stacks: LLM/SLM fine-tuning and/or adaptation, prompt evaluation, distillation, RAG, and systematic quality/safety evaluation.
- Proven experience building, deploying, and improving large-scale ML systems in customer-facing products, including data quality, performance, reliability, and cost optimization.
- Proficiency in Python (and one of C++/C#/Java preferred) and deep learning frameworks (e.g., PyTorch, TensorFlow); experience with distributed training/inference is a plus.
- Publications, patents, or open-source contributions in ML/NLP/IR are a plus (not required).
Preferred Qualifications:
- Master’s Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 9+ years related experience (e.g., statistics, predictive analytics, research).
- OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research).
- OR equivalent experience.
- 5+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers).
- 2+ years experience presenting at conferences or other events in the outside research/industry community as an invited speaker.
- 5+ years experience conducting research as part of a research program (in academic or industry settings).
- 3+ years experience developing and deploying live production systems, as part of a product team.
- 3+ years experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping.
#MicrosoftAI
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Senior Software Engineer
Senior Software Engineer
- Location
- Job Number
- City
- Team
- Country
- Discipline
The MAI-A Fundamentals team is dedicated to building one of the world’s largest distributed systems to power Bing Search, Copilot Search, Grounding APIs, and drive advancements in relevance through cutting-edge deep learning techniques. We are currently developing the next generation of grounding APIs and their hosting platform services, with the goal of creating the fastest and most modern search API business.
Our efforts focus on constructing a system with a tens-of-billions-level index, an orchestration engine capable of operating within hundreds of milliseconds, and an online GPU inference system. These innovations will enable rapid, scalable, and intelligent search capabilities for a wide range of applications.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Understand User Requirements
- Collaborates with appropriate stakeholders (e.g., relevance customers teams, project manager, other team members, and all other service owners) to determine user requirements for each scenario on the service gaps based on their scenarios. Well understands detailed asks in different scenarios and make sure to build efficient functionalities and services to fulfill their requirement.
- Design, coding and implementation
- Takes part in the discussions for the architecture of products/solutions and creates proposals for architecture by testing design hypotheses and helping to refine code plans. Provides reactions, proposed solutions, and inputs to architects.
- Independently creates a clear plan for testing and assuring quality of solutions, and defines success for outcomes of tests (e.g., unit tests).
- Writes extensible and maintainable code. Optimizes, debugs, refactors, and reuses code to improve performance and maintainability, effectiveness, and ROI. Reviews the code from other team members to assure it meets the team’s and Microsoft’s quality standards.
- Scenario onboarding and online supporting
- Collaborates closely with scenario owners to facilitate their onboarding process and offers essential support to ensure their business success.
- Delivers efficient toolsets designed to enhance the platform’s usability, debugging capabilities, and monitoring functionalities.
Qualifications
Required Qualifications:
- Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- At least 4 years of experience in designing, developing and maintaining distributed information management systems.
- Familiar with cloud computing platforms such as Azure, K8s.
- Good communication, collaboration and problem solving skills, fluent English speaking and writing.
Preferred Qualifications:
- Master’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- 6+ years experience in designing, developing and maintaining distributed computing platform. Experience in writing high quality code and conducting code reviews.
- Experiences in Bing search or other search engine platform services, or other large scale platform services.
- Nice to have knowledges for deep learning techniques and frameworks and experiences in LLM prompt engineering.
#MicrosoftAI
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Senior Software Engineer
Senior Software Engineer
- Location
- Job Number
- City
- Team
- Country
- Discipline
Do you enjoy solving complex technical problems on a global scale? Microsoft AI Monetization enables advertisers to measure impact and optimize spend through secure, privacy‑preserving data collaboration. The Measurement and Data Collaboration Engineering team is responsible for building the next generation of privacy‑safe measurement systems that allow advertisers and partners to work with data in highly secure environments. Our platform integrates Microsoft’s Azure Confidential Compute Clean Room (ACCR) with third‑party clean room partners to deliver a unified, compliant, and scalable measurement ecosystem.
We are looking for a Senior Software Engineer who is passionate about distributed systems, privacy‑enhancing technologies, secure data processing, and building reliable production services with global impact.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Design and build highly scalable backend services and data pipelines that support privacy‑preserving measurement and analytics scenarios using C# or Java.
- Design secure data collaboration workflows across multiple parties using modern privacy technologies, governance controls, and minimum‑aggregation protections.
- Drive integrations with external data and measurement partners, designing stable interfaces, schema governance patterns, and robust validation.
- Lead initiatives to make delivery of high-quality software routine and efficient through the entire software development lifecycle, from inception and technical design through testing and excellence in production operations.
- Collaborate closely with product, data science, privacy, and security teams to translate measurement needs into scalable platform capabilities.
- Contribute to engineering team best practices leveraging AI dev tools across the software development lifecycle (SDLC).
Qualifications
Required:
- Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred:
- Master’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- 5+ years of experience building and operating large‑scale distributed systems, backend services, or data platforms.
- Experience with large‑scale data processing frameworks (e.g. Spark, SQL‑based pipelines) and cloud platforms.
- Understanding of secure data processing, encryption, identity, and access control.
- Experience building and operating services with strict SLAs.
- Experience with Azure.
- Background in advertising, marketing technology, attribution, or large‑scale analytics.
- Experience integrating third‑party (vendor/partner) platforms, identity systems, or data collaboration technologies.
- Solid problem‑solving skills with a focus on reliability, observability, and system design.
#MicrosoftAI
Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Director of Security
Director of Security
- Location
- Job Number
- City
- Team
- Country
- Discipline
We are seeking an experienced operational and infrastructure security leader to manage the security posture of Microsoft AI’s production estate. This role is responsible for protecting some of Microsoft’s largest consumer services, including Bing, Copilot, Edge, MSN, and Microsoft Advertising, by driving secure-by-default infrastructure, rigorous operational security practices, and high-confidence vulnerability and configuration management at scale.
As the manager of the team, you will lead a group of security engineers and program managers who partner directly with product engineering, SRE, and platform teams. You will scale your expertise through them, ensuring that secure patterns, baselines, and controls are consistently implemented across diverse, high-volume systems. You will own the Infrastructure and Operational Security assurance functions and be accountable for continuous monitoring, risk reduction, and the overall security health of the division.
Why Join Us:
- Shape the security posture of Microsoft’s most widely used consumer products.
- Lead a team operating at the intersection of scale, complexity, and real-world impact.
- Work in a collaborative environment that values clarity, accountability, and technical excellence.
- Play a critical role in protecting Microsoft’s digital ecosystem and earning customer trust.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Infrastructure and Operational Security Execution: Assist in the development and implementation of comprehensive security strategies aligned with the Secure Future Initiative (SFI) and beyond. Manage a team to deliver technical execution with engineering, set policy and build tooling and automation to enforce Security by Default baselines within Microsoft AI environments. Identify opportunities to continuously improve controls and monitoring for Secure Operations. Lead direction on the assurance programs that align with Microsoft’s Security Development Lifecycle, evolving the existing programs in a more modern security direction.
- Security Project Orchestration: Oversee large-scale security project rollouts across the organization. Coordinate with various teams to ensure seamless execution of security initiatives. You will own management of security baseline design and execution, providing direct technical support and advice to engineering, providing reporting and summaries to leadership and generally delivering on projects to identify and mitigate security risks.
- Cybersecurity and Operational Program: Adopt and oversee cybersecurity guidelines and standards, coordinate with compliance teams, and execute attestations. Ensuring the adoption of Implementation Guidance issued through the Regulatory Governance program, as well as other compliance guidance, Council decisions, and applicable standards and controls. Including oversight of and coordination with compliance teams, and execution of necessary attestations and related records.
Qualifications
Required:
- Bachelor’s Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development
- OR equivalent experience.
Preferred:
- Bachelor’s Degree AND 12+ years experience engineering, product/technical program management, data analysis, or product development
- OR equivalent experience.
- Minimum of 8 years of experience in cybersecurity, with a focus on planning and execution of security assurance programs (application and operational).
- 3+ years of experience managing cross-functional and/or cross-team projects.
- Certified Information Systems Security Professional (CISSP) Certification, Security+ Certification, or relevant certification.
- Experience managing large scale cybersecurity assurance and operational security programs preferably including online service development.
- Experience with defining and tracking OKRs and KPIs to measure program performance.
- Proficient communication and collaboration skills, with the ability to effectively interact with stakeholders at all levels of the organization.
- Experience with application security standards such as OWASP ASVS/Top 10, CWE 25.
- Experience with common security libraries, security controls, and common security flaws.
- Outstanding collaboration and partnership skills, with proven ability to drive results across teams.
- Coding skills in one or more general purpose scripting languages.
- Proven experience in establishing security baselines for infrastructure, identifying and mitigating operational security risk and hands on implementation, coding, scripting and automating Azure (or equivalent) cloud infrastructure and services.
#MicrosoftAI #Security #CyberSecurity #SecurityEngineering
Technical Program Management M5 – The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 – $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Director of Security
Director of Security
- Location
- Job Number
- City
- Team
- Country
- Discipline
We are seeking an experienced operational and infrastructure security leader to manage the security posture of Microsoft AI’s production estate. This role is responsible for protecting some of Microsoft’s largest consumer services, including Bing, Copilot, Edge, MSN, and Microsoft Advertising, by driving secure-by-default infrastructure, rigorous operational security practices, and high-confidence vulnerability and configuration management at scale.
As the manager of the team, you will lead a group of security engineers and program managers who partner directly with product engineering, SRE, and platform teams. You will scale your expertise through them, ensuring that secure patterns, baselines, and controls are consistently implemented across diverse, high-volume systems. You will own the Infrastructure and Operational Security assurance functions and be accountable for continuous monitoring, risk reduction, and the overall security health of the division.
Why Join Us:
- Shape the security posture of Microsoft’s most widely used consumer products.
- Lead a team operating at the intersection of scale, complexity, and real-world impact.
- Work in a collaborative environment that values clarity, accountability, and technical excellence.
- Play a critical role in protecting Microsoft’s digital ecosystem and earning customer trust.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Infrastructure and Operational Security Execution: Assist in the development and implementation of comprehensive security strategies aligned with the Secure Future Initiative (SFI) and beyond. Manage a team to deliver technical execution with engineering, set policy and build tooling and automation to enforce Security by Default baselines within Microsoft AI environments. Identify opportunities to continuously improve controls and monitoring for Secure Operations. Lead direction on the assurance programs that align with Microsoft’s Security Development Lifecycle, evolving the existing programs in a more modern security direction.
- Security Project Orchestration: Oversee large-scale security project rollouts across the organization. Coordinate with various teams to ensure seamless execution of security initiatives. You will own management of security baseline design and execution, providing direct technical support and advice to engineering, providing reporting and summaries to leadership and generally delivering on projects to identify and mitigate security risks.
- Cybersecurity and Operational Program: Adopt and oversee cybersecurity guidelines and standards, coordinate with compliance teams, and execute attestations. Ensuring the adoption of Implementation Guidance issued through the Regulatory Governance program, as well as other compliance guidance, Council decisions, and applicable standards and controls. Including oversight of and coordination with compliance teams, and execution of necessary attestations and related records.
Qualifications
Required:
- Bachelor’s Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development
- OR equivalent experience.
Preferred:
- Bachelor’s Degree AND 12+ years experience engineering, product/technical program management, data analysis, or product development
- OR equivalent experience.
- Minimum of 8 years of experience in cybersecurity, with a focus on planning and execution of security assurance programs (application and operational).
- 3+ years of experience managing cross-functional and/or cross-team projects.
- Certified Information Systems Security Professional (CISSP) Certification, Security+ Certification, or relevant certification.
- Experience managing large scale cybersecurity assurance and operational security programs preferably including online service development.
- Experience with defining and tracking OKRs and KPIs to measure program performance.
- Proficient communication and collaboration skills, with the ability to effectively interact with stakeholders at all levels of the organization.
- Experience with application security standards such as OWASP ASVS/Top 10, CWE 25.
- Experience with common security libraries, security controls, and common security flaws.
- Outstanding collaboration and partnership skills, with proven ability to drive results across teams.
- Coding skills in one or more general purpose scripting languages.
- Proven experience in establishing security baselines for infrastructure, identifying and mitigating operational security risk and hands on implementation, coding, scripting and automating Azure (or equivalent) cloud infrastructure and services.
#MicrosoftAI #Security #CyberSecurity #SecurityEngineering
Technical Program Management M5 – The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 – $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer
Member of Technical Staff – Machine Learning Engineer
Member of Technical Staff – Machine Learning Engineer
- Location
- Job Number
- City
- Team
- Country
- Discipline
About the Team
Copilot Security is at the core of Microsoft’s mission to deliver trusted, human‑centered AI experiences. We make security and resilience intrinsic to every Copilot interaction—across devices, platforms, and ecosystems. Our work spans secure identity flows, defenses against emerging threats such as prompt injection, and privacy‑first systems that scale globally across Microsoft Copilot surfaces.
As Copilot enters a new era of agentic AI, where systems reason, plan, and act on behalf of users, security can no longer be static or rules‑based. We are building adaptive, learning‑driven defenses that bring judgment, context, and “security common sense” directly into model behavior and agentic workflows.
About the Role
We are seeking a Senior Machine Learning Engineer to tackle some of the hardest problems at the intersection of applied ML, AI security, and agentic systems. This is a hands‑on role focused on designing, training, evaluating, and shipping ML‑powered defenses that protect Copilot users from threats such as prompt injection, adversarial manipulation, unsafe delegation, and abuse of agentic workflows.
You will work closely with security engineers, applied scientists, and product teams to translate emerging threat patterns into production ML systems—from detection models and policy learners to evaluation frameworks that measure real‑world robustness. Your work will directly shape how Copilot reasons safely, applies guardrails, and earns user trust at global scale.
Why This Role Matters
Agentic AI introduces fundamentally new security risks: indirect prompt injection, cross‑tool privilege escalation, unsafe reasoning chains, and subtle information‑flow failures. Your work will help define how AI systems develop and apply security judgment, enabling Copilot to act safely and responsibly while still unlocking powerful new capabilities for hundreds of millions of users worldwide.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Design, train, and deploy ML‑based defenses for threats such as prompt injection, adversarial inputs, and abuse of agentic workflows.
- Develop adaptive detection and policy models that learn from evolving attacker behavior rather than relying solely on static rules or signatures.
- Build and own evaluation frameworks for AI security, including adversarial testing, red‑teaming support, and continuous robustness measurement across real Copilot scenarios.
- Partner with security and engineering teams to integrate ML defenses into secure orchestration frameworks that govern agent delegation, tool calling, and action execution.
- Apply ML to encode security “common sense” and judgment into AI responses, balancing usefulness, safety, and user intent.
- Monitor and analyze telemetry to improve model performance, reduce false positives/negatives, and guide iterative defense improvements.
- Collaborate cross‑functionally with product, privacy, and AI platform teams to land agentic security patterns across Copilot and MAI.
- Document and share applied ML security techniques, helping establish best practices for secure agentic AI across Microsoft.
Qualifications
Required Qualifications:
- Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
Preferred Qualifications:
- Master’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- 4+ years of hands‑on experience building and shipping machine learning systems in production.
- Solid foundation in ML fundamentals, including classification, anomaly detection, representation learning, and model evaluation.
- Proficiency in Python and experience with modern ML frameworks (e.g., PyTorch, JAX, TensorFlow).
- Experience designing end‑to‑end ML pipelines: data collection, training, evaluation, deployment, and monitoring.
- Ability to reason about adversarial behavior, threat models, and failure modes in AI/ML systems.
- Experience working on AI safety, trust, or security‑adjacent ML problems, including prompt injection, abuse detection, or adversarial ML.
- Familiarity with agentic or LLM‑based systems, including tool calling, multi‑step reasoning, or orchestration flows.
- Experience building ML evaluation and observability systems for real‑world AI behavior (e.g., adversarial testing, red‑team loops, robustness metrics).
- Exposure to distributed ML systems, large‑scale data processing, or model serving in cloud environments.
- Ability to clearly communicate complex ML and security concepts to engineering and non‑ML stakeholders.
#MicrosoftAI #MAIDPS
Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar jobs
Sr Account Executive(Advertising)
Principal Software Engineer
Member of Technical Staff, AI Product, Android Engineer