Engineer Lead (FDE) - AI Assurance and Evaluations
AI summary of the role
This role is an Engineer Lead (Forward Deployment Engineer) focused on AI assurance and evaluations at Elevance Health.
What you’ll do
- Lead requirements gathering meetings and review designs with the business.
- Own the change request process and coordinate with other teams as necessary.
- Perform technical design reviews and code reviews.
- Ensure unit testing, system testing, and implementation meet plan requirements.
What you’ll bring
- BA/BS in IT, Computer Science, or related field and 7+ years related experience, or equivalent combination.
- Proficiency with Python for building evaluation utilities, test harnesses, data pipelines, and automation scripts.
- Experience with API testing (REST/JSON), including authentication patterns, contract validation, negative testing, and performance/smoke testing.
- Hands-on test automation experience (unit/integration/end-to-end) and integrating tests into CI pipelines.
Technologies
Python · API testing · REST/JSON · CI pipelines · LLM · RAG · SQL · test automation · prompting frameworks · evaluation frameworks
About Elevance Health
Runs U.S. health benefits plus Carelon pharmacy, behavioral, clinical, home-health, and value-based care services for employers, governments, providers, and consumers.
Public · 5000+ people
Source and classification
Internal deployment & tooling · Evidence for this classification:
responsible for full delivery of end to end system development and maintenance on medium Enterprise wide technology platforms. How you will make an impact: Maintains active relationships with customers to determine business requirements and leads requirements gathering meetings. Primary duties may include, but are not limited to. Leads requirements gathering meetings and reviews designs with the business. Leads efforts with Web and marketing team to increase the presence of web products. May implement improvements in stability, performance, and scalability across major business-critical systems. May implement process to reduce barriers and roadblocks in projects, services, and processes in order to operate more efficiently. Owns the change request process and coordinates with other teams as necessary. Develops and owns list of final enhancements. Develops and defines
More from the job description
Anticipated End Date: 2026-09-14 Position Title: Engineer Lead (FDE) - AI Assurance and Evaluations Job Description: Engineer Lead (FDE) – AI Assurance and Evaluations FDE – Forward Deployment Engineer Location: This role requires associates to be in-office 1 - 2 days per week, fostering collaboration and connectivity, while providing flexibility to support productivity and work-life balance. This approach combines structured office engagement with the autonomy of virtual work, promoting a dynamic and adaptable workplace. Alternate locations may be considered if candidates reside within a commuting distance from an office. Please note that per our policy on hybrid/virtual work, candidates not within a reasonable commuting distance from the posting location(s) will not be considered for employment, unless an accommodation is granted as required by law. The Engineer Lead will be responsible for full delivery of end to end system development and maintenance on medium Enterprise wide technology platforms. How you will make an impact: Maintains active relationships with customers to determine business requirements and leads requirements gathering meetings. Primary duties may include, but are not limited to. Leads requirements gathering meetings and reviews designs with the business. Leads efforts with Web and marketing team to increase the presence of web products. May [... source excerpt omitted ...] l and/or functional specifications from with programs will be written. Performs technical design reviews and code reviews. Ensures unit test is completed and meets the test plan requirements, system testing is completed and system is implemented according to plan. Responsible for delivery of application technology solutions and data information planning effort. Coordinates and manages on-call support and owns the system monitoring process. Owns the technical development environment and works on the Enterprise team. Leads multiple or large projects and facilitates large group JAD sessions for requirements, modeling in several disciplines. Leads vendor evaluation and analysis. [... source excerpt omitted ...] as primarily virtual by the hiring manager, associates are required to work at an Elevance Health location at least once per week, and potentially several times per week. Specific requirements and expectations for time onsite will be discussed as part of the hiring process. The health of our associates and communities is a top priority for Elevance Health. We require all new candidates in certain patient/member-facing roles to become vaccinated against COVID-19 and Influenza. If you are not vaccinated, your offer will be rescinded unless you provide an acceptable explanation. Elevance Health will also follow all relevant federal, state and local laws. Elevance Health is an Equal Em
Employer postings · Data from · Sources