Computer Scientist
Mercor
Part time
Software Development
Canada
Hiring from: Canada
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Research Evaluator
Type: Contractor
Compensation: $50–$60/hour
Location: Remote
Commitment: 30 hours/week
Role Responsibilities
Must-Have
,
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Research Evaluator
Type: Contractor
Compensation: $50–$60/hour
Location: Remote
Commitment: 30 hours/week
Role Responsibilities
- Review and audit submitted data, including prompts, solutions, final answers, references, and metadata.
- Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency.
- Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, identifying flaws, gaps, or inconsistencies.
- Assess coding problems by validating test cases, solution correctness, and language consistency.
- Provide concise, well-reasoned written feedback to justify evaluation decisions.
- Work independently and asynchronously following provided tools and workflows.
Must-Have
- PhD (or current PhD candidacy) or Master's in Mathematics, Computer Science, Applied Mathematics, or a related STEM field.
- Expertise in one or more domains, including Mathematics (algebra, geometry, number theory, combinatorics, probability, graph theory), Coding (data structures, algorithms, application frameworks, testing & quality assurance), General domains (summarization, open/closed Q&A, classification, reasoning tasks).
- Strong analytical skills with the ability to evaluate multi-step reasoning.
- Excellent written communication and attention to detail.
- Ability to work independently in a fully remote environment.
- Basic knowledge of Python and testing frameworks (e.g., Pytest, JUnit).
- Contractor position via Mercor, paid hourly.
- Competitive rates based on expertise: $50–$60/hour.
- Weekly payments processed securely through Stripe Connect.
- Upload resume
- AI interview based on your resume
- Submit form
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: [email protected]
,
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada