Software Engineer, GPT Infrastructure
Technologies
GPU clusters · distributed systems · performance benchmarking · model porting · observability · infrastructure integration · tokenomics · workload management · automation · monitoring systems
About OpenAI
Builds frontier AI models (GPT series) and ships them as ChatGPT consumer/enterprise products plus a developer API for the broader AI ecosystem.
Private Late
Job description
The full responsibilities and requirements are on the employer’s site.
Open application page ↗Source and classification
Internal deployment & tooling · Evidence for this classification:
About the Team The GPT Infrastructure team builds systems that turn advances in model inference and optimization into reliable production capabilities. We enable OpenAI workloads to be qualified and optimized across new accelerator platforms without requiring a one-off port and tuning effort for every hardware target. Our work spans distributed systems, model execution, compilers and runtimes, performance engineering, secure partner integrations, evaluation systems, and developer tooling. We build the infrastructure that makes optimization workflows automated, reproducible, and trustworthy. About the Role We are seeking a software engineer to help build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop both OpenAI-hosted services and secure partner-side software for running long-lived optimization workflows.
More from the job description
About the Team The GPT Infrastructure team builds systems that turn advances in model inference and optimization into reliable production capabilities. We enable OpenAI workloads to be qualified and optimized across new accelerator platforms without requiring a one-off port and tuning effort for every hardware target. Our work spans distributed systems, model execution, compilers and runtimes, performance engineering, secure partner integrations, evaluation systems, and developer tooling. We build the infrastructure that makes optimization workflows automated, reproducible, and trustworthy. About the Role We are seeking a software engineer to help build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop both OpenAI-hosted services and secure partner-side software for running long-lived optimization workflows. These workflows generate candidate kernels, runtime configurations, and serving-stack changes; compile and execute them on target hardware; verify their correctness; measure their performance; and use the results to guide further optimization. You will work across model architecture, distributed execution, compilers, runtimes, networking, and accelerator systems. A central part of the role is turning research prototypes and one-off hardware bring-up efforts into reliable, reusable infrastructure w [... source excerpt omitted ...] nerships to onboard and optimize new compute platforms. Drive technical architecture and execution across ambiguous initiatives spanning OpenAI systems and partner environments. Qualifications Strong software engineering experience building distributed systems, infrastructure platforms, production services, developer platforms, or orchestration systems. Proficiency in one or more systems-oriented languages such as Python, C++, Go, or Rust. Experience designing and operating APIs, job orchestration systems, durable workflows, or large-scale backend services. Strong understanding of Linux, networking, storage, containers, distributed execution, and modern infrastructure architectur
Employer postings · Data from · Sources