Staff Software Engineer , Anywhere Cloud - AI Systems & Runtimes
AI summary of the role
Staff Software Engineer on Cloudera's Anywhere Cloud team, leading architecture and delivery of a cloud-native AI platform.
No longer in the current catalog. Last included 2026-09-09. Check the employer’s posting for availability.
What you’ll do
- Design and implement scalable application services (Go/Node.js) wrapping AI capabilities for enterprise use.
- Lead deployment of inference servers (vLLM, Triton) using KServe, KubeRay, or Knative for serverless AI workload scaling.
- Build internal tooling, SDKs, and AI Gateways to simplify Foundation Model integration.
- Architect Retrieval-Augmented Generation (RAG) pipelines and prompt management services with vector databases.
What you’ll bring
- Bachelor's degree with 6+ years software engineering experience, including 2+ years focused on AI/ML systems.
- Expert proficiency in Python and strong competence in Go or Rust/C++.
- Deep understanding of LLM deployment challenges and runtimes (vLLM, ONNX, TorchServe, Triton).
- Experience building complex workflows with LangChain or LlamaIndex on Docker/Kubernetes.
Technologies
Kubernetes · Go · Node.js · Python · vLLM · Triton · KServe · KubeRay · Knative · LangChain · LlamaIndex · Docker
About Cloudera
Hybrid data-and-AI platform letting the world's largest enterprises store, govern and run analytics plus GenAI on-prem and across clouds, built on open-source big-data tech.
Private Late · 2000–5000 people
Source and classification
Internal deployment & tooling · Evidence for this classification:
Kubernetes, our hybrid architecture separates compute and storage to maximize flexibility and optimize infrastructure usage. This isn’t just cloud management — it’s about building a consistent, secure, and compliant cloud experience that gives organizations full access to all their data, anywhere. With the acquisition of Taikun, we’re simplifying Kubernetes and cloud management even further, creating a unified, scalable, future-ready platform. If you’re passionate about Kubernetes — not just using it, but building it at the core, managing workloads across hybrid clouds and data centers, and obsessing over performance and DevOps — this is where you belong. We are seeking a Staff Software Engineer to lead the architecture and delivery of our cloud‑native AI platform. In this high‑impact role, you will bridge the gap between cutting‑edge AI research and production‑grade Kubernetes
More from the job description
Business Area: Engineering Seniority Level: Mid-Senior level Job Description: At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. Ready to take cloud innovation to the next level? Join Cloudera’s Anywhere Cloud team and help deliver a true “build your own pipeline, bring your own engine” experience — enabling data and AI workloads to run anywhere, without friction or vendor lock-in. We bring the best of public cloud — cost efficiency, scalability, elasticity, and agility — to wherever data lives: public clouds, private data centers, and the edge. Powered by Kubernetes, our hybrid architecture separates compute and storage to maximize flexibility and optimize infrastructure usage. This isn’t just cloud management — it’s about building a consistent, secure, and compliant cloud experience that gives organizations full access to all their data, anywhere. With the acquisition of Taikun, we’re simplifying Kubernetes and cloud management even further, creating a unified, scalable, future-ready platform. If you’re passionate about Kubernetes — not just using it, [... source excerpt omitted ...] e and DevOps — this is where you belong. We are seeking a Staff Software Engineer to lead the architecture and delivery of our cloud‑native AI platform. In this high‑impact role, you will bridge the gap between cutting‑edge AI research and production‑grade Kubernetes environments. You will build the “nervous system” of our AI stack—optimizing how we run and manage open‑source models (Llama, Qwen, etc.) using K8s‑native patterns like Custom Resources (CRDs) and Operators, enabling agentic AI to thrive, and designing integration patterns that let our product teams and customers consume AI capabilities seamlessly. As a Staff Software Engineer, you will: Enterprise AI Services: De
Employer postings · Data from · Sources