Generative AI Cloud Operations Engineer - Evinova
AI summary of the role
This role leads the development and management of AI operations systems for a clinical trial SaaS product within Evinova, a health-tech subsidiary of AstraZeneca.
No longer in the current catalog. Last included 2026-09-09. Check the employer’s posting for availability.
What you’ll do
- Develop and manage GenAI Ops systems for clinical trial design, planning and operational optimization.
- Design and implement resilient cloud GenAI agent operational capabilities to maximize scalability, reliability, and performance.
- Integrate LLM proxies/routers (e.g., LiteLLM) and ensure proper RAG pipeline optimization and scaling.
- Partner with AI Engineers and data scientists to shepherd projects from research into production-grade agentic GenAI capabilities.
What you’ll bring
- Minimum of 2 years deploying and maintaining Generative AI agents or GenAI-based workflows/applications in production.
- Expert in AWS services and containerization technologies like Docker and Kubernetes.
- Expert in CDK for Python and/or TypeScript, with strong software engineering abilities in Python/TypeScript.
- Expert in evals tools for LLMs (e.g., Arize Phoenix, Langfuse, Braintrust, Freeplay).
Technologies
Generative AI · LLM · AWS · Docker · Kubernetes · LangChain · LangGraph · Arize Phoenix · LiteLLM · CDK
About AstraZeneca
Science-led biopharma developing and commercializing prescription medicines across oncology, chronic disease, respiratory/immunology, infectious disease, and rare disease, with AI-enabled R&D and global launch scale.
Public · 5000+ people
Source and classification
Internal deployment & tooling · Evidence for this classification:
that improve the patients’ experience and deliver better health outcomes. Together, we have the opportunity to combine deep scientific expertise with digital and artificial intelligence to serve the wider healthcare community and create new standards across the sector. Introduction to Role: The Machine Learning and Artificial Intelligence Operations team (ML/AI Ops) is a newly formed platform team that will spearhead the design, creation, and operational excellence of our LLM-based agent deployments, multi-agent orchestration, and conversational AI systems pipelines to catalyze and accelerate science led innovations. This team is responsible and accountable for the design, implementation, deployment, health and performance of all LLM-based applications. We manage ML/AI and broader cloud resources, automating operations through infrastructure-as-code and CI/CD pipelines, and ensure
More from the job description
Job Title: Generative AI Cloud Operations Engineer - Evinova Location: Gaithersburg, MD At AstraZeneca, we pride ourselves on crafting a collaborative culture that champions knowledge-sharing, ambitious thinking and innovation – ultimately providing employees with the opportunity to work across teams, functions and even the globe. Recognizing the importance of individualized flexibility, our ways of working allow employees to balance personal and work commitments while ensuring we continue to create a strong culture of collaboration and teamwork by engaging face-to-face in our offices 3 days a week. Our head office is purposely designed with collaboration in mind, providing space where teams can come together to strategize, brainstorm and connect on key projects. Comprehensive relocation packages available for qualified candidates. Are you ready to be part of the future of healthcare? Can you think big, be bold, and harness the power of digital and AI to tackle longstanding life sciences challenges? Then Evinova, a global health tech business might be for you! Transform patients’ lives through technology, data, and innovative ways of working. You’re disruptive, decisive, and transformative. Someone excited to use technology to improve patients’ health. We’re building a new Health-tech business – Evinova, a fully-owned subsidiary of AstraZeneca Group. Evinova delivers mark [... source excerpt omitted ...] tices (GCP) and Good Machine Learning Practice (GMLP). As a Generative AI Cloud Operations Engineer for clinical trial design, planning, and operational optimization on our team, you will lead the development and management of AI operations systems for our trial management and optimization SaaS product. You will collaborate closely with our AI Engineers to transition projects from embryonic research into production-grade AI capabilities, utilizing advanced tools and frameworks to optimize model deployment, governance, and infrastructure performance. This position requires a deep understanding of cloud-native agentic Generative AI deployment methodologies and technologies, AWS i [... source excerpt omitted ...] nse quality, and hallucination detection tools at a platform level. Partner closely with AI Engineers and data scientists to shepherd projects from embryonic research stages into production-grade agentic Generative AI capabilities. Leverage and teach modern tools, libraries, frameworks and best practices to design, validate, deploy and monitor Generative AI agents in production (including LangChain, LangGraph, Google ADK, Langfuse, DSPy, Arize Phoenix, Pinecone, Weaviate, Splunk, Grafana, Prometheus, Xray, and more) Enhance system scalability, reliability, and performance through effective infrastructure and process management. Ensure that any prediction we make is backed by de
Employer postings · Data from · Sources