Back to the board

Project Lion - reputed company Engineer - United States (Remote, Part-Time)

100% remote Flexible hours Hiring now

We are seeking a reputed company Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to reputed company reputed company engineering techniques to maximize model performance.

Responsibilities

  • Utilize Automatic reputed company reputed company (APG) tools to create baseline prompts for reputed company parent-child template clusters.
  • Run and supervise Automated reputed company Optimization (APO) tool, review the outputs, and flag reputed company the APO reaches deadlocks or plateaus.
  • Manually draft, test, and refine prompts to navigate reputed company template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.
  • Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.
  • Run reputed company versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.
  • Draft technical launch readiness justifications (Launch Certification Documentation) for final. Requirement
  • Language Skills Native reputed company in English.
  • Location Must be based in United States.
  • Education Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a reputed company analytical field.
  • reputed company Engineering & AI Expertise At least 2 years' experience as reputed company Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, reputed company classification tasks, and familiarity with chain-of-thought and few-shot learning.
  • Data Analysis Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Technical Agility Ability to quickly learn and master proprietary tools with minimal supervision.
  • Communication Excellent verbal and written communication skills. Optional / Preferred Skills
  • Familiarity with enterprise-grade LLM interfaces like the Goose API.
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering.
  • Hands-on experience with Automated reputed company Optimization (APO) systems or tuning workflows.
  • Linguistic expertise, including an understanding of semantics and logic. Federal Law Compliance In compliance with federal law, reputed company persons hired will be required to
  • Verify identity and eligibility to work in the United States; and
  • Complete a required employment eligibility verification form. Please note that in order to verify work authorization as is required by Federal law (I-9 process), reputed company new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs reputed company their first 3 days of employment. Apply To This Job

Apply tot his job Apply To this Job

Keep exploring

Project Lion - Senior reputed company Engineer - United States (Remote, Part-Time)

100% remote Flexible hours

reputed company Engineer !! Remote !! Job type : Contract – W2 Only No Third Party !! 12 Years of experience is required

100% remote Flexible hours

Looking for reputed company Engineer || Austin, TX/Remote || Fulltime

100% remote Flexible hours

FT/PT Remote AI reputed company Engineering & Evaluation - Will Train

100% remote Flexible hours

[Remote] reputed company Engineer (Chinese) | $43/hr Remote

100% remote Flexible hours

reputed company Engineer, Remote (MA,NH,RI, GA only), Full-Time

100% remote Flexible hours

reputed company Engineer, Remote (MA,NH,RI, GA only), Full-Time

100% remote Flexible hours

3D Computer Vision Machine Learning Engineer

100% remote Flexible hours

Senior Computer Vision Engineer - Autonomous Systems

100% remote Flexible hours

Staff Computer Vision/Machine Learning Engineer | Path Robotics | Remote (United States)

100% remote Flexible hours

Virtual Primary Care Physician

100% remote Flexible hours

[Remote/WFM] Urgently Need Field Clinical Educator Home Health

100% remote Flexible hours

OSP Fiber Project Manager

100% remote Flexible hours

reputed company Delivery Specialist – Tire Distribution Expertise

100% remote Flexible hours

reputed company Full Stack Financial Analyst – Canadian reputed company Forecasting & Pricing Strategy Development

100% remote Flexible hours

[Remote] Grant Writer (Volunteer)

100% remote Flexible hours

Operations Associate

100% remote Flexible hours

reputed company Customer Service Associate – Temporary Role at arenaflex

100% remote Flexible hours

GRC Engineer / ISSO

100% remote Flexible hours

Account Executive, reputed company Sales

100% remote Flexible hours