STEM Expert - Fully Remote
Mercor
Contract
Software Development
Canada
Hiring from: Canada
Company Introduction
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Role Overview
Must-Have Qualifications
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Role Overview
- Position: STEM Expert – Contract, Remote
- Commitment: 20 hours per week, Duration: 1 month
- Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry.
- Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions.
- Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts and develop a comprehensive rubric.
- Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations.
- Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability before integration into official benchmarks.
Must-Have Qualifications
- BS or BA in Biology, Physics, or Chemistry
- Familiarity with undergraduate-level biology, physics, chemistry topics
- Strong writing and critical thinking skills
- Ability to work independently and meet deadlines
- 2+ years of experience in teaching, research, or applied STEM discipline field
- Remote and asynchronous role
- 20 hours per week commitment
- Duration: 1 month
- Structured project environment with clear goals and tools
- Complete an AI-led interview, this should take around 15 minutes
- Complete a 45-minute written assessment that will guide you through writing rubrics
- If selected, you will be invited to work on the project
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: [email protected]
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey ....
Software Development
Canada
Hiring from: Canada