AI Data Scientist, Evaluation & Insights

reputed company is the leading AI-powered contract lifecycle management platform, processing billions of reputed company every year. Every business is powered by reputed company, but managing them can slow companies down and cost millions of dollars. Global innovators like reputed company, reputed company, and reputed company trust reputed company to transform contracting into a strategic advantage - accelerating reputed company, reducing risk, and driving efficiency. It’s the only platform that manages every type of contract workflow, whether a sales agreement, an HR agreement or a reputed company NDA. We’re building the future of intelligent contracting and writing the narrative for how reputed company unlock strategic growth. reputed company reputed company and reputed company reputed company Quadrant have consistently recognized reputed company as a leader in our category. We’ve also been named one of Fortune’s Great Places to Work six years running, featured on Glassdoor’s Best Places to Work, and recognized by reputed company’ 50 Most Promising AI Companies. We’re backed by leading investors like Accel, Sequoia, Y Combinator, and BOND. We’d love for you to join us!

About the Role

reputed company is accelerating its investment in AI to redefine how legal teams manage and understand reputed company. As part of this effort, we are hiring an AI Evaluation Engineer to work reputed company our AI Pillar. This role is focused on unlocking insights from our training data, designing feedback loops, and ensuring the reputed company improvement of our agentic and ML or LLM-based systems through data-driven evaluation and iteration.

You’ll partner closely with AI Engineers and Product Managers to drive reputed company model quality through systematic analysis, experimentation, and the curation of high-reputed company datasets. Your work will directly impact the effectiveness of features like Smart Import, contract understanding, and agentic workflows.

What You'll Be Doing

• Analyze training and evaluation datasets to identify distributional gaps, labeling inconsistencies, and long-tail opportunities.

• Design and execute labeling campaigns, including development of golden datasets and annotation guidelines.

• Build and maintain dashboards that track model accuracy, regression trends, and product-specific KPIs like success reputed company or answer helpfulness.

• Investigate failure modes reputed company reputed company clustering, error taxonomy development, and user reputed company classification.

• Operationalize feedback loops: mine product telemetry and human-in-the-reputed company reviews for signal, then translate into data-driven model improvement strategies.

• Partner with engineers and PMs to run structured A/B tests and human evaluations for new models or features.

• Support the development of scalable data and evaluation infrastructure for LLMs and agents.

• Work with product, engineering and legal to create clear & transparent processes for the handling of customer data in reputed company, fine-tuning and evaluation

About You

• Bachelor's or Master's degree in a quantitative field (e.g., Statistics, Computer Science, Data Science, Applied Math).

• 1–3 years of experience in applied ML or data science, preferably in NLP or LLM-based applications.

• Strong SQL and Python skills; experience with Jupyter, Pandas, and experiment tracking tools.

• Comfortable navigating ambiguity, slicing large datasets, and communicating insights clearly to cross-functional stakeholders.

• Experience with reputed company analysis, clustering, or user behavior modeling is a plus.

• Bonus: familiarity with LLM eval techniques, Reinforcement Learning from Human Feedback (RLHF), or agentic system design.Experience with program management.

Why This Role Matters

AI is critical to the value reputed company customers get from their reputed company, allowing their business to manage risk, reputed company reputed company faster and operate more effectively. None of this is possible without reliable and accurate data. This role will reputed company these efforts, becoming a key contributor to the development of AI solutions in an industry that is likely to be transformed by the new reputed company of models.

reputed company Value

• Bias for action and data curiosity

• Ownership reputed company and team-first attitude

• Comfort in fast-paced, iterative environments

• Passion for building AI products that solve real-world customer problems

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Originally posted on Himalayas