AI Engineer, AIOps & Infrastructure

Meet Eloquent AI At Eloquent AI, we’re building the next generation of AI Operators—multimodal, autonomous systems that execute complex workflows across fragmented tools with human-level precision. Our technology goes far beyond chat: it sees, reads, clicks, types, and makes decisions—transforming how work gets done in regulated, high-stakes environments. We’re already powering some of the world’s leading financial institutions and insurers, fundamentally changing how millions of people manage their finances every day. From automating compliance reviews to handling customer operations, our Operators are quietly replacing repetitive, manual tasks with intelligent, end-to-end execution. Headquartered in San Francisco with a global footprint, Eloquent AI is a fast-growing company backed by top-tier investors. Join us to work alongside world-class talent in AI, engineering, and product as we redefine the future of financial services. Your Role As a Senior Software Engineer, AIOps & Infrastructure at Eloquent AI, you will be responsible for designing, building, and optimizing scalable, high-performance AI infrastructure to support the deployment and operation of our enterprise AI agents. Your work will enable machine learning engineers and AI teams to train, fine-tune, and deploy LLMs efficiently while ensuring stability, observability, and performance at scale. You’ll play a [... source excerpt omitted ...] oyment pipelines. If you’re passionate about scalable AI systems and optimizing ML models for real-world applications, this is your opportunity to work at the frontier of LLMOps. You will: Design and build scalable ML infrastructure for deploying and maintaining AI agents in production. Automate LLMOps and MLOps workflows, ensuring seamless model training, fine-tuning, deployment, and monitoring. Optimize GPU and cloud compute workloads, improving efficiency and reducing latency for large-scale AI systems. Develop Kubernetes-based solutions, including custom operators for ML model orchestration. Improve system observability and reliability, implementing logging, monitoring, [... source excerpt omitted ...] pliance, and reliability in AI infrastructure, maintaining high availability and scalability. Participate in on-call rotations, ensuring 24/7 reliability of critical AI systems. Requirements 5+ years of experience in software engineering, MLOps, or infrastructure development. Strong expertise in Kubernetes and experience managing containerized ML workloads. Deep understanding of cloud platforms (AWS, GCP, Azure) and distributed computing. Proficiency in Python, with experience developing services for ML/AI applications. Experience with ML model deployment pipelines, including model serving, inference optimization, and monitoring. Familiarity with vector databases, retrieval s