Forward Deployed Engineer - LLM Post-training
AI summary of the role
Core member of Reflection's Applied AI team driving model fine-tuning and evaluations for enterprise customers.
What you’ll do
- Fine-tune Reflection's open-weight models for customer-specific use cases using SFT, preference optimization, and reinforcement fine-tuning.
- Build and maintain evaluation infrastructure: design eval suites, curate test sets, establish baselines.
- Prepare training data from raw customer inputs: inspect data quality, clean and format datasets, build reproducible data pipelines.
- Debug and diagnose training and inference issues: interpret loss curves, catch data quality problems.
What you’ll bring
- Applied ML experience with hands-on fine-tuning of language models (SFT, DPO, RLHF, or similar).
- Understanding of evaluation methodology: design evals, interpret training graphs, avoid overfitting.
- Comfort with training infrastructure: GPUs, compute management, debugging training failures.
- Strong software engineering fundamentals (Python) with experience in data pipelines and version control.
Technologies
SFT · DPO · RLHF · preference optimization · reinforcement fine-tuning · Python · GPUs · VPC · on-premises
About reflection.ai
Frontier AI lab building open-weight superintelligence models for individuals, enterprises and nation states, positioned as the US open-source answer to DeepSeek.
Private Late · 100–200 people
Source and classification
Production engineering · Evidence for this classification:
Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all. Role Overview We're looking for a core member of Reflection's Applied AI team to drive model fine-tuning and evaluations for enterprise customers. This team takes Reflection's open-weight models and adapts them for specific customer domains, tasks, and constraints. As a ML Engineer, you will work hands-on with customer data, run fine-tuning workflows, build evaluation harnesses, and deploy adapted models to production. You'll work directly with customers to understand what they need and with research teams to push what's possible. What You'll Do Fine-tune Reflection's open-weight models for
More from the job description
Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all. Role Overview We're looking for a core member of Reflection's Applied AI team to drive model fine-tuning and evaluations for enterprise customers. This team takes Reflection's open-weight models and adapts them for specific customer domains, tasks, and constraints. As a ML Engineer, you will work hands-on with customer data, run fine-tuning workflows, build evaluation harnesses, and deploy adapted models to production. You'll work directly with customers to understand what they need and with research teams to push what's possible. What You'll Do Fine-tune Reflection's open-weight models for customer-specific use cases: prepare datasets, configure training runs (SFT, preference optimization, reinforcement fine-tuning), and iterate based on evals. Build and maintain evaluation infrastructure: design eval suites, curate test sets, establish baselines, and measure whether fine-tuned models actually improve on the tasks customers care about. Prepare training data from raw customer inputs: inspect data quality, clean and format datasets, identify adversarial or noisy samples, and build reproducible [... source excerpt omitted ...] rong. Support end-to-end deployments of fine-tuned models across hybrid environments (public cloud, VPC, and on-premises), helping ensure inference performance and reliability in production. Contribute to evolving playbooks, evaluation benchmarks, and best practices as part of a growing fine-tuning and evals practice. What We're Looking For Applied ML experience with hands-on fine-tuning of language models. You have prepared datasets, run training loops, evaluated results, and shipped a fine-tuned model. Familiarity with SFT, DPO, RLHF, or similar techniques. Understanding of evaluation methodology: how to design evals, interpret training graphs, and tell whether a model is ac [... source excerpt omitted ...] s and experiments. 3+ years of engineering experience with meaningful exposure to applied ML or ML engineering (e.g., MLE, Applied Scientist, Data Scientist who shipped models to production, or ML-focused SWE). Demonstrated ability and interest to work in customer-facing environments, understanding user needs and translating domain requirements into training strategies. Self-starter with high agency and ownership, excelling in fast-paced startup environments where playbooks are still being written. What We Offer: We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of
Employer postings · Data from · Sources