Senior Frontier Agents Engineer (Applied AI)
AI summary of the role
Senior-level applied AI engineer role at Scale AI, focused on designing, evaluating, and deploying production-grade frontier AI agents for enterprise customers across diverse industries.
What you’ll do
- Design and deploy production AI agents using frontier LLMs, reasoning, retrieval, memory, and tool use.
- Architect systems combining LLMs, traditional ML, structured knowledge, and enterprise data into reliable workflows.
- Own the full experimentation lifecycle: design evaluation frameworks (offline benchmarks, A/B tests, LLM-as-a-Judge), run ablation studies, and measure success via business outcomes.
- Build production-quality AI systems with focus on reliability, observability, latency, safety, and cost; implement guardrails, fallbacks, tracing, and human-in-the-loop workflows.
What you’ll bring
- 5+ years of software engineering, machine learning, or applied AI experience.
- Strong Python programming skills.
- Experience building production AI systems using LLMs.
- Experience with modern AI tooling: OpenAI, Claude, MCP, agent frameworks, vector databases, or retrieval systems.
Technologies
LLM · OpenAI · Claude · MCP · agent frameworks · vector databases · retrieval systems · RAG · semantic search · knowledge graphs · fine-tuning · distillation
About Scale AI
Data, evals, and GenAI platform for frontier labs, enterprises, and governments — the picks-and-shovels layer for production AI.
Series G
Source and classification
Production engineering · Evidence for this classification:
bridge the gap between cutting-edge AI research and production deployment. You'll work directly with enterprise customers to design, evaluate, and deploy intelligent systems that combine frontier models with structured knowledge, retrieval, traditional machine learning, and enterprise software. Unlike traditional ML roles that focus on a single model or product, you'll work across a diverse portfolio of AI challenges spanning multiple industries and use cases. You may build a multi-agent research system and then participate in designing a customer intelligence platform, a healthcare copilot, or an autonomous workflow for a Fortune 100 company. If you enjoy reading new AI papers, experimenting with the latest models, and shipping production systems that create measurable business impact, you'll fit right in. What You'll Build Frontier AI Systems Design and deploy production AIHow jobs are selected
Employer postings · Data from · Sources