Member of Technical Staff - Data Flywheel Infra, Frontier Models
- Location
- Job Number
- City
- Team
- Country
- Discipline
Overview
We are looking for a Data Flywheel Infrastructure Engineer to build the infrastructure that continuously turns 1P data, 3P data, model signals, evaluation results, and synthetic data into high-quality training data for frontier LLM and multimodal models.
This role owns the systems connecting:
Data Acquisition → Governance & Compliance → Curation → Training → Evaluation → Failure Mining → Data Improvement
A critical part of the role is enabling aggressive data iteration while ensuring that every dataset is secure, policy-compliant, rights-aware, traceable, and auditable.
This role is part of Microsoft AI's Superintelligence Team. The MAIST is a startup-like team inside Microsoft AI, created to push the boundaries of AI toward Humanist Superintelligence—ultra-capable systems that remain controllable, safety-aligned, and anchored to human values. Our mission is to create AI that amplifies human potential while ensuring humanity remains firmly in control. We aim to deliver breakthroughs that benefit society—advancing science, education, and global well-being. We’re also fortunate to partner with incredible product teams giving our models the chance to reach billions of users and create immense positive impact. If you’re a brilliant, highly-ambitious and low ego individual, you’ll fit right in—come and join us as we work on our next generation of models!
Responsibilities
Build 1P & 3P Data Flywheel Infrastructure
Build scalable systems for ingesting, processing, curating, versioning, and serving first-party and third-party data for pre-training and post-training. Connect model failures, evaluations, and product signals back into targeted data acquisition, generation, and improvement workflows.
Own Data Governance, Security & Compliance Infrastructure
Build governance and policy enforcement directly into the data platform, including:
- Usage rights, licensing, and consent metadata
- PII / sensitive-data detection and protection
- Access control and data isolation
- Retention and deletion enforcement
- Geographic and regulatory restrictions
- Dataset approval and audit workflows
- Training eligibility and purpose-based usage controls
- Data provenance and lineage
Build Policy-Aware Data Acquisition & Curation Systems
Develop automated pipelines for 1P and 3P data ingestion, classification, filtering, deduplication, quality scoring, semantic enrichment, and dataset construction.
Make governance policies machine-enforceable so that data can automatically be included, excluded, quarantined, or restricted based on its origin, license, sensitivity, consent, geography, and intended model use.
Build Evaluation-to-Data Feedback Loops
Convert model evaluations and real-world failure signals into actionable data tasks through failure clustering, hard-example mining, long-tail discovery, capability-gap detection, and targeted dataset generation.
Enable rapid iteration from:
Model Failure → Data Gap → Data Intervention → Training → Evaluation
Build Synthetic & AI-Native Data Pipelines
Use LLMs, VLMs, and Agents to automate data generation, labeling, filtering, quality validation, enrichment, and transformation.
Maintain clear provenance between human-created, first-party, third-party, model-generated, and derived data, and enforce appropriate policies across each category.
Build Data Quality, Attribution & Observability
Develop metrics and infrastructure to measure dataset quality, coverage, diversity, contamination, duplication, policy compliance, and contribution to model capability improvements.
Enable researchers to understand which data improves which capabilities and under what governance constraints.
Qualifications
Required
• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
• Software Engineering experience using Python,SQL, Spark/Flink/Ray
Preferred
- Experience building AI training-data governance platforms, including provenance, licensing/rights metadata, consent management, PII handling, policy enforcement, or auditable lineage.
- Experience managing third-party datasets, data partnerships, licensed content, or externally sourced data with complex contractual and usage restrictions.
- Experience building privacy- and security-aware systems for first-party product or user data, including isolation, access controls, retention/deletion, and purpose limitation.
- Experience with data clean rooms, privacy-preserving processing, de-identification, confidential computing, or secure data collaboration.
- Experience building evaluation → failure mining → data generation → training feedback loops.
- Experience with synthetic data, model graders, reward signals, hard-example mining, active learning, or data-mixture optimization.
- Experience with multimodal or agentic datasets including text, image, video, audio, web, GUI, tool-use, or interaction trajectories.
- Understanding of Modern LLM training workflows including Pre-training, SFT, RL/post-training, evaluation, and synthetic data.
- Strong understanding of data governance, security, privacy, provenance, access control, and data lifecycle management.
Data Engineering IC4 - The typical base pay range for this role across United Kingdom is £ 74,700.00 - £ 122,600.00 per year. Certain roles may be eligible for benefits and other compensation. IC5 - The typical base pay range for this role across United Kingdom is £ 93,500.00 - £ 161,800.00 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.