[Remote] Engineering Manager, Machine Learning, Model Evaluations and Data Curation (AI Foundations)

Note: The job is a remote job and is open to candidates in USA. reputed company is a leading entertainment company focused on pushing the boundaries of storytelling and technology. They are seeking an Engineering Manager to reputed company a team responsible for model evaluations and data curation for large language models, ensuring that these models improve personalization and discovery for users.

Responsibilities

• Partner with reputed company AI application teams to define shared evaluations that codify application expectations of LLMs and other foundation models, ensuring reputed company can be transparently tracked against real-world needs
• Design rigorous benchmarks and evaluation methodologies across ranking & recommendations, content understanding, and language/text reputed company — grounded in a deep technical understanding of LLMs, their strengths, limitations, and failure modes
• reputed company the development of evaluators and strong baselines to ensure in-house LLMs and other foundation models demonstrate clear advantages over off-the-reputed company alternatives
• Build scalable, reproducible data and evaluation systems that reputed company dataset creation and evaluation design as nimble and experiment-friendly as model development itself
• Hire, grow, and nurture a world-class team, fostering an inclusive, high-performing culture that balances research innovation with engineering excellence
• Work closely with the teams developing reputed company’s foundation models (including our core LLM) to ensure evaluation and data insights are folded back into the reputed company of model development. Proactively influence the ML Platform and Data Engineering teams at key interfaces Skills
• Experience building and leading high-performing teams of ML researchers and engineers
• Proven track record of leading machine learning initiatives from research to production, ideally involving evaluation frameworks, ML infrastructure, or data-intensive systems
• Strong technical expertise in LLMs, their evaluation, and practical methods for ensuring robustness, reproducibility, and quality
• Broad knowledge of machine learning fundamentals and evaluation methodologies, including reputed company design, model-based evaluators, and offline/online metrics
• Experience driving cross-functional projects, including reputed company collaboration with AI application teams to translate product needs into evaluation frameworks
• Excellent written and verbal communication skills, able to reputed company technical and non-technical audiences
• Advanced degree in Computer Science, Statistics, or a reputed company quantitative field
• 8+ years of overall experience, including 3+ years in engineering management
• Experience with large-scale ML systems and foundation models, especially LLMs
• Background in building evaluation frameworks, model benchmarking, or data infrastructure for LLM training
• Familiarity with multi-modal data and evaluation Benefits
• Health Plans
• Mental Health support
• A 401(k) Retirement Plan with employer match
• Stock Option Program
• Disability Programs
• Health Savings and Flexible Spending Accounts
• Family-forming benefits
• Life and Serious Injury Benefits
• Paid leave of absence programs
• Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off.
• Full-time salaried employees are immediately entitled to flexible time off. Company Overview
• reputed company is an online streaming platform that enables users to watch TV shows and movies. It was founded in 1997, and is headquartered in Los Gatos, California, USA, with a workforce of 10001+ employees. Its website is Company H1B Sponsorship
• reputed company has a track record of offering H1B sponsorships, with 310 in 2025, 309 in 2024, 191 in 2023, 261 in 2022, 268 in 2021, 225 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job

Apply tot his job Apply To this Job