Staff AI Product Engineer
AI summary of the role
Staff AI Product Engineer at Nscale, a vertically integrated GenAI cloud platform, setting technical direction across 2-4 teams for the AI services platform.
What you’ll do
- Set technical direction for the AI product platform domain across multiple teams
- Drive cross-team architectural decisions: service boundaries, API contracts, data models, and platform standards
- Identify and lead systemic improvements in performance, reliability, cost, or developer experience
- Resolve ambiguous, open-ended technical problems where the solution space is undefined
What you’ll bring
- 8–12 years of software engineering experience
- Deep expertise in API design, platform engineering, and large-scale distributed systems
- Experience designing cloud services with control plane/data plane separation and cell-based architecture
- Proven ability to define provisioning contracts and dependency-ordered composition across services
Technologies
API design · platform engineering · distributed systems · control plane · data plane · cell-based architecture · Terraform · SDK · SLO · error-budget · GPU cloud · ML workloads
Source and classification
Internal deployment & tooling · Evidence for this classification:
leverage that accelerates the entire product organization. As a Staff engineer, you define how Nscale’s AI services platform is built — establishing the patterns, APIs, and systems that other engineers rely on to deliver reliably and at speed. Your scope spans the full platform layer: AI service capabilities, API gateway, developer experience, billing, identity, and the extensibility surfaces that enterprise and developer customers build on. Your decisions will have meaningful, lasting impact on platform scalability, developer experience, and product velocity. Responsibilities Set technical direction for the AI product platform domain across multiple teams Drive cross-team architectural decisions: service boundaries, API contracts, data models, and platform standards Identify and lead systemic improvements — performance, reliability, cost, or developer experience — that create
More from the job description
About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centers, software, and applications that power today’s AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As a Nscaler, you’ll build trust through openness and transparency, where everyone is inspired to do their best work. Collaboration is key, and we work together swiftly and respectfully, embracing adaptability and resilience in all we do. About the Role Nscale is looking for a Staff AI Product Engineer to drive technical direction across the AI product domain. Working across 2–4 teams, you’ll set architectural standards, resolve complex cross-cutting concerns, and create engineering leverage that accelerates the entire product organization. As a Staff engineer, you define how Nscale’s AI services platform is built — establishing the patterns, APIs, and systems that other engineers rely on to deliver reliably and at speed. Your scope spans the full platform layer: AI service capabilities, API gateway, developer experience, billing, identity, and the extensibility surfaces that enterprise and developer customers build on. Your decisions will have meaningful, lasting impact on platfo [... source excerpt omitted ...] aluate build-vs-buy decisions for key platform capabilities and drive them to clear conclusions Represent the product engineering domain in cross-functional architecture reviews Requirements 8–12 years of software engineering experience Proven ability to set technical direction for a product domain, including cross-team architectural patterns Deep expertise in API design, platform engineering, and large-scale distributed systems Experience designing cloud services with clear control plane / data plane separation and cell-based architecture for horizontal scalability and blast-radius isolation Experience building and operating developer-facing platforms used by large numbers of [... source excerpt omitted ...] wned by different teams — readiness gating, eventual consistency, and deciding what may be provisioned in parallel Track record of setting versioning and compatibility policy for customer-facing configuration surfaces, and of sequencing change across the schema, controller, packaging, and deployment layers that must land in order Sustained hands-on production ownership at scale — has carried on-call for systems they designed and fed that operational experience back into the architecture Track record of raising stability across a domain: SLO and error-budget policy, incident review that produces systemic fixes, and reliability tracked as a measurable trend rather than per-incid
Employer postings · Data from · Sources