Remote Content Moderator - $35/hr
Mercor
Part time
Software Development
Canada
Hiring from: Canada
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Preference Ranking Model Evaluator
Type: Freelance
Compensation: $25–$35/hour
Location: Remote
Commitment: 10–20 hours/week
Role Responsibilities
Must-Have
,
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Preference Ranking Model Evaluator
Type: Freelance
Compensation: $25–$35/hour
Location: Remote
Commitment: 10–20 hours/week
Role Responsibilities
- Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness.
- Assign preference rankings to pairs or sets of model outputs.
- Follow detailed labeling guidelines and adjust based on evolving criteria.
- Provide brief written explanations for ranking decisions when required.
- Flag edge cases or inconsistencies in task design or model output.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
Must-Have
- Prior experience in data labeling, content moderation, or preference ranking tasks.
- Excellent critical thinking and reading comprehension skills.
- Comfort working with evolving guidelines and ambiguity.
- Strong attention to detail and consistency across repetitive tasks.
- Availability for regular part-time work on a weekly basis.
- Payments issued weekly via Stripe Connect.
- Classified as an independent contractor.
- Submit your resume.
- Complete a short form to highlight your relevant experience.
- You may be asked to complete a brief assessment to evaluate task fit.
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: [email protected]
,
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada
About The Job Do you want to substantially impact the future of Hopper's travel technology? We're hiring a Senior Software Engineer to join our Fintech team and help us innovate the evolution of travel selling and booking technology. Fintech contributes...
Software Development
Canada
Hiring from: Canada
Your Role Lead the Consumer Health data team across all Consumer Products, owning the end-to-end data stack from ingestion to GenAI-powered insights and visualization. With a startup mindset optimize and design architectures that eliminate bottlenecks, enable multi-product flexibility, and integrate...
Software Development
Canada
Hiring from: Canada