Senior Backend Engineer, LangSmith Deployments
AI summary of the role
Senior Backend Engineer on the LangSmith Deployments team, building the purpose-built runtime that runs AI agents in production.
What you’ll do
- Design distributed queue and worker systems for concurrent agent execution and multi-agent coordination
- Own core data infrastructure — state persistence, atomic job claiming, connection management, and schema evolution
- Ship resumable streaming infrastructure for disconnect/reconnect mid-execution
- Instrument and monitor production systems with tracing, metrics, and alerting
What you’ll bring
- 4+ years of professional backend engineering experience
- Strong proficiency in Go and/or Python
- Experience with distributed systems — consensus mechanisms, queueing, state machines, or workflow orchestration
- Experience with scaling and sharding databases in high throughput environments
Technologies
Go · Python · Kubernetes · Terraform · distributed systems · queueing · state machines · workflow orchestration · database scaling · sharding
About LangChain
Open-source and commercial platform for building, evaluating, deploying, and operating AI agents at scale.
Series B
Source and classification
Internal deployment & tooling · Evidence for this classification:
(LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater. About the Team The Deployment team builds the platform that runs AI agents in production. We design and scale the core durable execution runtime to power reliable long-running agents with resumable streaming and inter-agent protocol support. We work closely with open source and other product teams to make it easy to bring any agent from prototype to production. About the role We're building purpose-built infrastructure for running AI agents. Unlike traditional web
More from the job description
About Us At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale. With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world. Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater. About the Team The Deployment team builds the platform that runs AI agents in p [... source excerpt omitted ...] ing agents with resumable streaming and inter-agent protocol support. We work closely with open source and other product teams to make it easy to bring any agent from prototype to production. About the role We're building purpose-built infrastructure for running AI agents. Unlike traditional web apps, agents run for long durations, collaborate asynchronously with humans and other agents, and need to survive failures mid-execution. LangSmith Deployments is the runtime that makes this work, with durable checkpointing, fault-tolerant orchestration, and horizontal scaling, deployed across cloud and self-hosted environments. What You'll Do We're looking for a Senior Backend Engineer [... source excerpt omitted ...] iming, connection management, and schema evolution Collaborate on architectural decisions, ensuring solutions are scalable and robust. Ship resumable streaming infrastructure so clients can disconnect and reconnect mid-execution without losing state Instrument and monitor production systems — tracing, metrics, and alerting to keep the platform healthy Participate in on-call rotations and own incident response for the runtime Create and maintain technical documentation, including system design and operational runbooks. Contribute to and extend open-source LangGraph, which is used by thousands of developers to build agent applications What You'll Bring 4+ years of profess
Employer postings · Data from · Sources