Staff+ Software Engineer, Backend and Infra
AI summary of the role
Foundational backend and infrastructure engineering role at a seed-stage AI reliability startup.
What you’ll do
- Design and build scalable infrastructure and systems to orchestrate tens of thousands of LLM calls per second, powering functionality like model evaluations, red team attacks, runtime guardrails, and more
- Collaborate closely with the research team and deploy innovative new models to build industry-leading AI reliability tooling
- Interface directly with customers to understand and address their pain points, design intuitive new user workflows that streamline their journey, and guide them on the evaluation methodology Haize has pioneered
- Act as a technical leader across the organization, mentoring top talent and helping set technical direction and vision for the company
What you’ll bring
- 7+ years of industry experience, including 3+ years leading large initiatives as an engineer or manager
- Proven track record of designing, building, and scaling complex distributed systems that solve critical business problems
- Strong proficiency in one or more backend programming languages (e.g. Python, Go, Rust)
- Deep knowledge of modern cloud infrastructure, including Kubernetes, Terraform, and platforms like AWS, GCP, and Azure
Technologies
Python · Go · Rust · Kubernetes · Terraform · AWS · GCP · Azure · Postgres · MongoDB · Redis · LLM
About Haize Labs
Continuously fuzz-tests and red-teams LLM-based apps so frontier labs and enterprises can ship AI to production reliably.
Seed · 1–10 people
Source and classification
Internal deployment & tooling · Evidence for this classification:
Staff+ Software Engineer, Backend and Infra Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by haizing them – i.e. rigorously, proactively, and continuously fuzz-testing them. We are looking for a talented and experienced backend + infrastructure engineer to help build out our AI reliability platform. You will play a foundational role in designing and driving forward the core technology that puts our cutting-edge AI research in the hands of customers, empowering them to build AI applications that are trustworthy, robust, and ready for production. This is an opportunity to directly influence how AI applications are tested, verified, and deployed by everyone from frontier AI labs to massive enterprises across a wide range of industries. In this role, you will: Design and build scalable
More from the job description
Staff+ Software Engineer, Backend and Infra Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by haizing them – i.e. rigorously, proactively, and continuously fuzz-testing them. We are looking for a talented and experienced backend + infrastructure engineer to help build out our AI reliability platform. You will play a foundational role in designing and driving forward the core technology that puts our cutting-edge AI research in the hands of customers, empowering them to build AI applications that are trustworthy, robust, and ready for production. This is an opportunity to directly influence how AI applications are tested, verified, and deployed by everyone from frontier AI labs to massive enterprises across a wide range of industries. In this role, you will: Design and build scalable infrastructure and systems to orchestrate tens of thousands of LLM calls per second, powering functionality like model evaluations, red team attacks, runtime guardrails, and more Collaborate closely with the research team and deploy innovative new models to build industry-leading AI reliability tooling Interface directly with customers to understand and address their pain points, design intuitive new user workflows that streamline their journey, and guide them on the evaluation methodology Hai [... source excerpt omitted ...] enefits About us At Haize, we're not here to write GPT wrappers or get rich quick off the AI bubble. We're here to solve the hardest problem in AI: making it safe, reliable, and production-ready. Since our company's inception in 2024, we've amassed amazing customers including OpenAI, Anthropic, AI21, and more. We've developed best-in-class tooling for evaluation, dynamic testing, red-teaming, observability, and continuous “robustification” of AI applications. And we’re backed + advised by the founders of Cognition, Hugging Face, Weights and Biases, Nous, Etched, Okta, and Replit, as well as C-suite execs from Google, Stripe, Databricks, Robinhood, and more. Our core team is exc
Employer postings · Data from · Sources