Rubric Grading Expert
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
Mercor is seeking highly analytical generalists to contribute as rubric graders for a leading AI research initiative. This project supports the evaluation of AI-generated content across multiple domains, ensuring accuracy, coherence, and alignment with task-specific criteria. Contractors will apply structured rubrics to assess outputs in fields such as humanities, STEM, business, and general knowledge. This is a flexible, short-term engagement ideal for intellectually curious professionals with a strong academic background.
- Apply detailed evaluation rubrics to assess AI-generated responses
- Analyze outputs for factual correctness, clarity, and domain relevance
- Work across diverse subject areas and adapt to evolving task requirements
- Maintain high accuracy while completing a high volume of evaluations
- Follow written instructions precisely and provide concise feedback when needed
Qualifications
- Strong analytical and critical thinking skills
- Exceptional attention to detail and reading comprehension
- Proven ability to follow structured guidelines without deviation
- Comfortable working independently and across unfamiliar subject areas
- Master’s degree or higher, or undergraduate degree from a top global university
Requirements
- Remote and asynchronous — set your own schedule
- Expected commitment: ~40 hours/week
- Short-term project with potential for extension or future engagements
- Contractors must have access to a reliable internet connection
Benefits
- $40/hour, depending on experience and location
- Independent contractor status
- Weekly payments via Stripe Connect
Application Process
- Submit your resume to get started
- Complete an AI interview and complete a Google Form
- Mercor will follow up with next steps within the next 24 hours