Skip to content
NEXTMOVEFDE careers · United States

Software Engineer, GPT Infrastructure

Technologies

GPU clusters · distributed systems · performance benchmarking · model porting · observability · infrastructure integration · tokenomics · workload management · automation · monitoring systems

About OpenAI

Builds frontier AI models (GPT series) and ships them as ChatGPT consumer/enterprise products plus a developer API for the broader AI ecosystem.

Private Late

Job description

The full responsibilities and requirements are on the employer’s site.

Open application page
Source and classification

Internal deployment & tooling · Evidence for this classification:

About the Team The GPT Infrastructure team builds systems that turn advances in model inference and optimization into reliable production capabilities. We enable OpenAI workloads to be qualified and optimized across new accelerator platforms without requiring a one-off port and tuning effort for every hardware target. Our work spans distributed systems, model execution, compilers and runtimes, performance engineering, secure partner integrations, evaluation systems, and developer tooling. We build the infrastructure that makes optimization workflows automated, reproducible, and trustworthy. About the Role We are seeking a software engineer to help build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop both OpenAI-hosted services and secure partner-side software for running long-lived optimization workflows.
More from the job description

About the Team The GPT Infrastructure team builds systems that turn advances in model inference and optimization into reliable production capabilities. We enable OpenAI workloads to be qualified and optimized across new accelerator platforms without requiring a one-off port and tuning effort for every hardware target. Our work spans distributed systems, model execution, compilers and runtimes, performance engineering, secure partner integrations, evaluation systems, and developer tooling. We build the infrastructure that makes optimization workflows automated, reproducible, and trustworthy. About the Role We are seeking a software engineer to help build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop both OpenAI-hosted services and secure partner-side software for running long-lived optimization workflows. These workflows generate candidate kernels, runtime configurations, and serving-stack changes; compile and execute them on target hardware; verify their correctness; measure their performance; and use the results to guide further optimization. You will work across model architecture, distributed execution, compilers, runtimes, networking, and accelerator systems. A central part of the role is turning research prototypes and one-off hardware bring-up efforts into reliable, reusable infrastructure w [... source excerpt omitted ...] nerships to onboard and optimize new compute platforms. Drive technical architecture and execution across ambiguous initiatives spanning OpenAI systems and partner environments. Qualifications Strong software engineering experience building distributed systems, infrastructure platforms, production services, developer platforms, or orchestration systems. Proficiency in one or more systems-oriented languages such as Python, C++, Go, or Rust. Experience designing and operating APIs, job orchestration systems, durable workflows, or large-scale backend services. Strong understanding of Linux, networking, storage, containers, distributed execution, and modern infrastructure architectur

How jobs are selected

Employer postings · Data from · Sources