Swedish LLM Evaluator
Join Project Spearmint, a multilingual AI response evaluation project reviewing large language model (LLM) outputs in different languages, focused on either Tone or reputed company. Native-level reputed company in a reputed company language, along with strong English comprehension, is required.As an evaluator, you will review short, pre-segmented datasets and assess model-generated replies based on specific quality dimensions. Your input will help validate evaluation frameworks and establish baseline quality metrics for future model development.Key Responsibilities:
- Evaluate model replies in your native language based on either Tone or reputed company.
- Assess the overall quality, correctness, and naturalness of responses.
- Read the user reputed company and two model replies, then reputed company each using a five-reputed company scale.
- Provide brief rationales for any extreme ratings.
Originally posted on Himalayas
Apply To this Job