Skip to content
NEXTMOVEFDE careers · United States

Data Scientist, Preparedness

AI summary of the role

Builds and evaluates AI harm mitigation systems for OpenAI's Preparedness team to prevent extreme harms from AI.

What you’ll do

  • Evaluate and improve mitigation systems including classifiers and detection pipelines.
  • Diagnose false positives and negatives with deep error analysis.
  • Build monitoring frameworks to track mitigation effectiveness over time.

What you’ll bring

  • Significant experience in data science or applied analytics in high-stakes domains.
  • Fluency in SQL and Python or equivalent for analysis and monitoring.
  • Strong foundations in experimentation, causal thinking, or observational inference.

Technologies

SQL · Python · classifier evaluation · calibration · thresholding · detection pipelines · monitoring frameworks · threat modeling · security telemetry

About OpenAI

Builds frontier AI models (GPT series) and ships them as ChatGPT consumer/enterprise products plus a developer API for the broader AI ecosystem.

Private Late

Source and classification

Internal deployment & tooling · Evidence for this classification:

connects capability assessment, evaluations, and internal red teaming, and mitigations for frontier models, as well as overall coordination on AGI preparedness. This is fast paced, exciting work that has far reaching importance for the company and for society. About the Role We’re hiring a Data Scientist to help build, evaluate, and continuously improve mitigations that prevent extreme harms from AI systems. This role is for an experienced, highly autonomous individual contributor who can take ambiguous problem statements, structure rigorous analyses, and translate findings into actionable product and policy changes. This position goes beyond “running evals.” You’ll help create mitigation intelligence and monitoring systems that enable OpenAI to detect issues early, measure effectiveness over time, and reduce both over-blocking (unnecessary friction) and under-blocking (missed harm).
More from the job description

About the Team The Preparedness team is an important part of the Safety Systems org at OpenAI, and is guided by OpenAI’s Preparedness Framework. Frontier AI models have the potential to benefit all of humanity, but also pose increasingly severe risks. To ensure that AI promotes positive change, the Preparedness team helps us prepare for the development of increasingly capable frontier AI models. This team is tasked with identifying, tracking, and preparing for catastrophic risks related to frontier AI models. The mission of the Preparedness team is to: Closely monitor and predict the evolving capabilities of frontier AI systems, with an eye towards misuse risks whose impact could be catastrophic to our society Ensure we have concrete procedures, infrastructure and partnerships to mitigate these risks and to safely handle the development of powerful AI systems Preparedness tightly connects capability assessment, evaluations, and internal red teaming, and mitigations for frontier models, as well as overall coordination on AGI preparedness. This is fast paced, exciting work that has far reaching importance for the company and for society. About the Role We’re hiring a Data Scientist to help build, evaluate, and continuously improve mitigations that prevent extreme harms from AI systems. This role is for an experienced, highly autonomous individual contributor who can take [... source excerpt omitted ...] oring and measurement frameworks to track mitigation effectiveness over time and across user segments and use cases. Identify trends in over-blocking vs. under-blocking, quantify customer impact, and propose prioritized interventions. Develop insights from customer feedback, complaints, and usage patterns to detect shifts in adversarial behavior and system failure modes. Expand risk monitoring into new areas, including cybersecurity threats and model loss-of-control or sabotage scenarios, in partnership with domain experts. Communicate results to technical and executive stakeholders with crisp narratives, decision-ready metrics, and clear tradeoffs. You might thrive in this [... source excerpt omitted ...] on: concise, clear, and outcome-oriented. Skilled in turning analysis into productable changes: you’re comfortable influencing across functions to drive mitigation improvements. Qualifications Significant experience in data science or applied analytics in high-stakes domains (e.g., security, trust & safety, abuse prevention, fraud, platform integrity, or reliability). Strong foundations in experimentation, causal thinking, and/or observational inference; ability to design robust measurement under imperfect data. Fluency in SQL and Python (or equivalent) for analysis, modeling, and building monitoring workflows. Experience building metrics, dashboards, and operational monitoring t

How jobs are selected

Employer postings · Data from · Sources