Masterclass
AI Project Reviewer (CONTRACT)
Remote role where the employee must remain based in a particular country.
United States only
Employer listed it 5 weeks ago · Added 5 days ago
Been open since 5 weeks ago, still being checked, but it has been live a while.
Salary
Not stated
Location
United States only
Timezone
US East
Contract
Full-time
Experience
Mid
Category
Other
This employer didn't state pay. Jobs like this usually pay around $80k–$155k a year, a typical range taken from 397 mid-level other roles on Nomaders that do state pay. It's a guide, not an offer.
Remote flexibility
Work from home
This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.
What the employer says
- Source listing states candidate location: "Remote, USA, (Multiple States), United States"
What Nomaders makes of it
- Residency required in United States
- Payroll and tax are likely handled in that country only
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
About the role
Who we are:
MasterClass is the streaming platform where the world's best come together so anyone, anywhere, can access and be inspired by their knowledge and stories. We put you in the room with the creators, thinkers, makers and leaders who have changed the world, so that you can change yours.
Members get unprecedented access to 200+ instructors and classes across a wide variety of fields, including Arts & Entertainment, Business, Design & Style, Sports & Gaming, Writing and more. Step into Nas' recording studio and Gordon Ramsay's kitchen, and go behind the big screen with James Cameron. Design your career with Elaine Welteroth, get ready to win with Lewis Hamilton, perfect your pitch with Shonda Rhimes and discover your inner negotiator with Chris Voss.
If you want to help make an impact on our members' lives – we want to hear from you!
We are looking for more than what a resume can show. If you don't have the exact experience or skills, but think you'd be a great addition to MasterClass, please apply for the role.
Role Overview:
As a freelance AI Project Reviewer, you will be responsible for evaluating learner submissions against detailed rubrics for a new product. You will apply consistent judgment to determine pass/fail outcomes and provide clear, constructive feedback to help learners improve. Working alongside our product and learning design teams, you’ll help calibrate and validate assessment approaches to ensure fair, accurate, and valuable feedback for our members.
This is a temporary role with flexible engagement based on project needs. ~20 hours per week.
What You Will Do:
Review and evaluate projects against detailed rubrics, providing consistent pass/fail judgments.
Write clear, actionable feedback that helps learners understand areas for improvement.
Collaborate with the learning design and product team to refine rubrics and assessment criteria.
Compare human and AI assessment outcomes to identify areas for calibration.
Document reasoning behind evaluation decisions to support assessment consistency
About You:
5+ years of experience in assessment, evaluation, or educational feedback roles.
Proven ability to consistently apply detailed rubrics across multiple submissions.
Strong written communication skills with the ability to articulate reasoning clearly.
Experience providing constructive feedback to support learner growth.
Ability to work independently while maintaining high standards.
Willingness to refrain from using AI during evaluations and written rationales.
Experience in roles such as Mentor or Coach in educational settings, Educational Evaluator or Teaching Assistant (TA), Consultant in AI or learning design, or Instructor with experience in grading and providing feedback.
You’re a Great Fit If You:
Are passionate about education and committed to helping learners succeed.
Requirements
- ·5+ years of experience in assessment, evaluation, or educational feedback roles.
- ·Proven ability to consistently apply detailed rubrics across multiple submissions.
- ·Strong written communication skills with the ability to articulate reasoning clearly.
- ·Experience providing constructive feedback to support learner growth.
- ·Ability to work independently while maintaining high standards.
Benefits
No benefits package published with this listing. Ask about it at first interview.
How to apply
- 1Check the flexibility label above, work from home, matches where you plan to live and work.
- 2Tailor your CV to the role at Masterclass, mentioning your remote working experience and working hours (US East).
- 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.
Found 5d ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
Similar roles
Other open other roles with comparable remote rules.
Free to apply, no account needed.
Typically $80k to $155k per year · You'll be taken to the employer's careers page.