Human Data Quality Engineer (Founding Team) 

Human Data Quality Engineer (Founding Team) Prolific Prolific isn’t just enabling AI innovation – we’re redefining it. While foundational AI technologies are becoming commoditized, Prolific’s human data infrastructure provides the high-quality, diverse data required to train the next generation of AI models. Through our platform, we empower researchers and companies to access a global, ethically curated participant base, ensuring cutting-edge AI research and training grounded in inclusivity and precision. The Role As one of the founding members of Prolific's newly formed AI Data Services team, you'll help build the quality systems behind some of the world's most advanced AI models. Data quality is a strategic priority for Prolific, so this is a high-visibility role with direct exposure to senior stakeholders. This isn't a traditional QA role. We are not looking for someone to review data against a predefined checklist. We are looking for an innovative thinker that can leverage their expertise to define what good means where no definition exists yet. Acting as a strategic thought partner, you’ll work at the intersection of human data, machine learning, evaluation across frontier use-cases that define what high-quality human data looks like for the next generation of advanced AI. This means that much of the work involves novel problems with no established answer, so you’ll b [... source excerpt omitted ...] clients and alongside frontier AI labs, translating what their models need into robust human data and evaluation strategies. Rather than checking quality at the end of a project, you'll engineer quality into every stage of the lifecycle, from study design and participant strategy through to evaluation, launch readiness and client delivery.You will also work alongside our product engineering, and supply teams to define and build the quality infrastructure that will enable us to deliver high quality human data at scale. Much of the work you'll tackle won't have an existing playbook. You'll help create it. What You’ll Be Doing Design the quality frameworks that underpin comple [... source excerpt omitted ...] o interact with stakeholders at frontier labs and act as a partner. The ability to leverage your experience and expertise to influence and guide stakeholders at every level, both client side and internally. in The ability to turn your own data analysis and quality methodology into requirements that product and engineering can build into systems. The ability to explain yout data analysis and findings clearly to non-technical stakeholders, so they can act on them. A proactive, builder's mindset -you enjoy creating new systems, navigating ambiguity and improving how things work. Even Better if you have: Experience with LLM evaluation, RLHF, AI safety or red teaming. Experie