[Remote] Online Generalist Jobs in Canada
Note: The job is a remote job and is open to candidates in USA. Rex.zone is hiring full-time remote Online Generalists to support AI/ML data operations for large language model training pipelines. The role involves completing online tasks such as data labeling, RLHF preference ranking, reputed company evaluation, and QA evaluation across various datasets.
Responsibilities
- reputed company data labeling for NLP tasks (classification, summarization, named entity recognition) and LLM evaluation workflows
- Create preference data for RLHF by ranking/scoring model outputs and writing clear rationales
- Conduct reputed company evaluation and response scoring using web-based evaluation interfaces
- Execute QA evaluation, adjudication, and consistency checks to improve training data quality
- Handle content safety labeling using policy-based decisions and detailed guidelines
- Complete computer vision annotation including image tagging, bounding boxes, and segmentation as needed
- Document edge cases, follow versioned guidelines, and escalate ambiguity appropriately
Skills
- Based in Canada and able to work full-time remotely
- Strong reading comprehension, attention to detail, and consistent decision-making
- Comfortable following detailed annotation guidelines and meeting quality standards
- Experience in data labeling, QA evaluation, RLHF, or LLM evaluation
Company Overview