AI Assessment Specialist – Remote $100/hr

Mercor
Part time
Software Development
Canada
Hiring from: Canada
About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Mercor Generalist

Type: Independent Contractor

Compensation: $30–$100/hour

Location: Remote

Duration: 1–3 months typical

Commitment: 10–20 hours/week, with potential to increase

Role Responsibilities

  • Evaluate AI-generated outputs for accuracy, clarity, and alignment with real-world reasoning.
  • Contribute written assessments and structured feedback on model performance.
  • Identify conceptual, logical, and stylistic strengths and weaknesses in AI responses.
  • Collaborate asynchronously with Mercor’s research and operations teams to maintain quality and consistency across evaluations.
  • Ensure strong analytical judgment, precise communication, and consistent application of evaluation criteria.

Qualifications

Must-Have

  • Strong English fluency and written communication skills.
  • Sharp attention to detail and ability to identify subtle errors or inconsistencies.
  • Analytical and critical thinking skills across a wide range of topics.
  • No formal educational background or specific degree required—curiosity, clarity, and reasoning skill are key.

Start Date

  • Rolling (immediate opportunities available)

Compensation & Legal

  • Independent contractor arrangement
  • Daily payments via Stripe Connect

Application Process (Takes 20–30 mins to complete)

  • Upload resume or professional summary
  • Complete a short, unpaid work trial introducing a core data type and task format used in Mercor projects
  • Candidates who perform well will be considered for future paid work across AI evaluation, training, and research collaborations

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
  • For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

,

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada
DataAnnotation
Full time
50 - 60 USD / hour
We are looking for a FP&A Analyst to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role...
Software Development
United States
Hiring from: United States