Manager, Multi-Modal Language Action Models
AI summary of the role
Lead a team of ML engineers applying large multi-modal language models (MLLMs) to offline autonomy problems at Zoox, an autonomous robotaxi company.
What you’ll do
- Lead and manage a team of Machine Learning Engineers specializing in MLLMs for concrete autonomy applications.
- Oversee the full lifecycle of MLLM development, focusing on post-training methodologies (fine-tuning, RLHF, context engineering).
- Drive deployment of MLLM solutions to internal customers solving offline autonomy problems.
- Collaborate with peer managers across Perception, Prediction, Planning, and Validation to ensure alignment.
What you’ll bring
- 5+ years of professional experience in Machine Learning or Deep Learning with focus on large-scale model applications.
- 3+ years of experience leading and managing engineering or research teams focused on AI/ML.
- Direct experience leading teams training Multi-Modal Large Language Models (MLLMs) with deep expertise in post-training techniques.
- Proven track record of deploying ML/MLLM models to production or internal customers, ideally in autonomy or robotics.
Technologies
MLLM · Large Multi-Modal Models · fine-tuning · RLHF · context engineering · instruction tuning · domain adaptation · autonomous driving · robotics
About Zoox
Builds and operates an all-electric, purpose-built autonomous robotaxi service, controlling the full stack from vehicle design to fleet operations.
Growth
Source and classification
Deployment team leadership · Evidence for this classification:
Zoox is developing the first fully autonomous, purpose-built electric vehicle designed for autonomous ride-hailing. We are a passionate, collaborative, and fast-moving team working to build a revolutionary new mobility experience. This role offers the opportunity to make critical contributions to a challenging and groundbreaking product. Zoox is seeking an experienced Manager of Multi-Modal Language Action Models to lead a team focused on applying cutting-edge Large Multi-Modal Models (MLLMs) to solve concrete, offline autonomy problems. This role is crucial for deploying state-of-the-art AI into our autonomous driving platform, directly impacting the safety and performance of our technology. In this role, you will: Leadership: Lead and manage a team of talented Machine Learning Engineers specializing MLLMs for concrete applications. Model Development & Deployment: Oversee the full
More from the job description
Zoox is developing the first fully autonomous, purpose-built electric vehicle designed for autonomous ride-hailing. We are a passionate, collaborative, and fast-moving team working to build a revolutionary new mobility experience. This role offers the opportunity to make critical contributions to a challenging and groundbreaking product. Zoox is seeking an experienced Manager of Multi-Modal Language Action Models to lead a team focused on applying cutting-edge Large Multi-Modal Models (MLLMs) to solve concrete, offline autonomy problems. This role is crucial for deploying state-of-the-art AI into our autonomous driving platform, directly impacting the safety and performance of our technology. In this role, you will: Leadership: Lead and manage a team of talented Machine Learning Engineers specializing MLLMs for concrete applications. Model Development & Deployment: Oversee the full lifecycle of MLLM development, with a specific focus on post-training methodologies (e.g., fine-tuning, RLHF, context engineering) to optimize models for autonomy tasks. Internal Customer Focus: Drive the deployment of complex MLLM solutions to internal customers, specifically solving tangible offline autonomy problems within the Zoox ecosystem. Cross-Functional Strategy: Understand and identify dependencies between your team's work and other engineering teams and domains (e.g., Perception, Pre [... source excerpt omitted ...] analysis of situations or data to inform strategy and decisions. Accountability & Influence: Your decisions will have a lasting impact on the success of the team and department. You will be responsible for managing special projects and initiatives and will frequently conduct presentations of key information to gain the cooperation of others. Strategic Influence: Leverage broad knowledge of the specialized field/discipline to analyze complex information. Recommend and collaborate with senior management to resolve strategic issues. This role may involve leading a medium-to-large team, including direct reports who are also managers. Qualifications 5+ years of professional exper [... source excerpt omitted ...] guage Models (MLLMs), with deep expertise in post-training techniques (e.g., instruction tuning, alignment, domain adaptation). Proven track record of deploying ML/MLLM models to production or internal customers to solve complex, real-world problems, ideally within the autonomy or robotics domain. Strong organizational skills to manage complex project schedules, staffing needs, and priorities effectively. A passion for mentoring and developing high-performing team members. About Zoox Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine le
Employer postings · Data from · Sources