Rubric Expert - Fully Remote

Mercor
Contract
Software Development
Canada
Hiring from: Canada
Company Introduction

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position: Human Data Project Expert – Contract, Remote
  • Commitment: Flexible hours
  • This role focuses on enhancing AI models' ability to generate effective responses to user-generated images and prompts.

Responsibilities

  • Develop detailed rubrics that thoroughly describe AI-generated responses to user-uploaded images.
  • Evaluate the effectiveness of AI model outputs in interpreting and responding to visual prompts.
  • Collaborate with AI research teams to refine and improve the quality of AI-generated content.
  • Work independently and asynchronously to meet project goals and contribute to the continuous enhancement of AI model performance.

Requirements / Qualifications

Must-Have Qualifications

  • Experience in evaluating AI-generated content.
  • Ability to write detailed and clear evaluation rubrics.
  • Strong understanding of AI model outputs and their applications.

Preferred Qualifications

  • Experience collaborating with AI research teams.
  • Background in STEM domains or related fields.

Engagement Details

  • Contract Type: Contract
  • Location: Remote
  • Schedule: Flexible hours

Application Process (Takes 20-30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
  • For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Construction Manager (East)
Aerwave
Full time
Aerwave delivers next-generation Managed Wi-Fi for multifamily communities—seamless, gigabit-speed internet that’s always on, everywhere on your property. With 24/7 domestic support, intuitive digital tools, and real-time insights, we empower residents, property teams, and owners to stay connected and in control....
Software Development
United States
Hiring from: United States

Program Analyst (Remote Opportunity)
VetsEZ
Full time
VetsEZ is seeking a Program Analyst (DAWA Support) to assist with activities related to the Data Collection Workbook Assistive Web Application (DAWA) in support of the Department of Veterans Affairs (VA) Electronic Health Record Modernization (EHRM) program. This role will...
Software Development
United States
Hiring from: United States

VP of Technical Services
CaptivateIQ
Full time
225,000 - 300,000 USD / year
CaptivateIQ is the leading Sales Performance Management solution, recognized by Forrester and G2, and trusted by customers including Affirm, Gong, and Figma. With solutions for Sales Planning and Incentives, we help revenue teams automate processes, hit revenue targets, and adapt...
Software Development
United States
Hiring from: United States