Staff AI Scientist
AI summary of the role
Lead applied research and development for the models and datasets at the core of Fiddler's Trust Service and guardrail classifiers, ensuring LLM and agentic applications are safe, accurate, and compliant in production.
No longer in the current catalog. Last included 2026-09-09. Check the employer’s posting for availability.
What you’ll do
- Lead applied research and development for models and datasets powering Fiddler's Trust Service and guardrail classifiers.
- Design, train, and ship production classifiers for safety, security, and quality detection under strict latency and cost constraints.
- Lead development of synthetic and adversarial dataset pipelines to expose failure modes.
- Drive technical direction of generative insights for diagnosing AI application issues.
What you’ll bring
- 7+ years of applied AI experience with a track record of taking models from research to production.
- Experience in LLM or Agentic Evals and Guardrailing.
- Deep expertise training and fine-tuning classifier models (BERT-family, ModernBERT, LLM-as-classifier).
- Hands-on experience with dataset development as a first-class engineering discipline.
Technologies
PyTorch · Hugging Face · BERT · ModernBERT · LLM · RLHF · RLAIF · Python · NeurIPS · ICML · ICLR · ACL
About Fiddler AI
Enterprise platform for evaluating, monitoring, securing, and governing AI agents, LLM apps, and ML models with in-environment trust models and lifecycle-wide observability.
Series C
Source and classification
Internal deployment & tooling · Evidence for this classification:
another through complex challenges, and take pride in helping our customers achieve real-world impact with Fiddler’s AI Observability platform. Every project is a team effort, and every win is shared. If you love working alongside smart, driven peers who genuinely care about both customer success and each other’s growth, you’ll feel right at home here. 🚀 What You’ll Do: Lead applied research and development. Lead applied research and development for the models and datasets at the core of Fiddler's Trust Service and suite of guardrail classifiers and evaluators that customers depend on to keep their LLM and agentic applications safe, accurate, and compliant in production. Partner closely with other engineering teams, Product, and Customer Success. You’ll build strong relationships with customer data science and ML engineering teams, supporting their AI observability journey and
More from the job description
Our Purpose At Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. The rise of Generative AI and Agents has unlocked generalized intelligence but also widened the risk aperture and made it harder to ensure that AI applications are working well. Fiddler enables organizations to get ahead of these issues by helping deploy trustworthy, and transparent AI solutions. Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices, which, in turn, builds trust with their user base. AI Engineers, Data Science, and business teams use Fiddler AI to monitor, evaluate, secure, analyze, and improve their AI solutions to drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the "what", “why”, and "how" behind AI outcomes. Our Founders Fiddler AI is founded by Krishna Gade (engineering leader at Facebook, Pinterest, Twitter, and Microsoft) and Amit Paka (product leader at Microsoft, Samsung, Paypal and two-time founder). We are backed by Insight Partners, Lightspeed Venture Partners, and Lux Capital. Why Join Us Our team is motivated to help build trust into AI to enable society harness the power of AI. Joining us means you get to make an impact by ensuring that AI applications at produc [... source excerpt omitted ...] orbes AI 50 most promising startups of 2020, and a 2019 Gartner Cool Vendor in Enterprise AI Governance and Ethical Response. By joining our brilliant (at least we think so) team, you will help pave the way in the AI Observability space. 🪐 About The Team: You’ll join a tight-knit, highly collaborative AI Science team that partners closely with some of the world’s leading enterprise AI organizations. We operate in a hybrid capacity, but stay deeply connected through constant communication, collaboration, and shared purpose. Our team thrives on knowledge sharing, peer learning, and collective problem solving – no one works in a silo. We celebrate each other’s successes, support [... source excerpt omitted ...] with Fiddler’s AI Observability platform. Every project is a team effort, and every win is shared. If you love working alongside smart, driven peers who genuinely care about both customer success and each other’s growth, you’ll feel right at home here. 🚀 What You’ll Do: Lead applied research and development. Lead applied research and development for the models and datasets at the core of Fiddler's Trust Service and suite of guardrail classifiers and evaluators that customers depend on to keep their LLM and agentic applications safe, accurate, and compliant in production. Partner closely with other engineering teams, Product, and Customer Success. You’ll build strong relations
Employer postings · Data from · Sources