Senior Engineer, Applied AI
AI summary of the role
Senior Engineer, Applied AI at Ro, joining a new team building LLM-powered products across patient experience, clinical operations, and internal tooling.
What you’ll do
- Design, build, and ship production LLM-powered features end-to-end.
- Build the AI application layer including prompt orchestration, tool calling, retrieval (RAG), embeddings, agent workflows, and structured outputs.
- Develop evaluation infrastructure with regression suites, LLM-as-a-judge, synthetic datasets, and human review workflows.
- Design observability systems for accuracy, latency, cost, hallucination rates, and model behavior.
What you’ll bring
- 5+ years building production software, with at least 1–2 years building and deploying LLM-powered applications in production.
- Strong Python engineer with backend services and modern AI APIs/frameworks.
- Comfortable using AI-assisted development tools throughout the SDLC.
- Shipped AI features for real users and can articulate quality, reliability, latency, cost, and business impact.
Technologies
LLM · Python · RAG · LangChain · LangGraph · AgentCore · LangSmith · Braintrust · Arize Phoenix · vector databases
About Ro (Modern Fertility)
Direct-to-patient telehealth + pharmacy + at-home labs/diagnostics; makes money on prescriptions, subscriptions, and at-home test kits (including Modern Fertility hormone testing).
Series D · 700–900 people
Employer postings · Data from · Sources