Terac logo

Terac

More roles at Terac

Subject Matter Experts: Machine Learning Model Evaluation

Work from home

Remote role where the employee must remain based in a particular country.

United States only

From the listing details: Source listing states candidate location: "United States, Remote"

Employer listed it 7 days ago · Added 3 days ago

First listed 7 days ago and still open.

Salary

Not stated

Location

United States only

Work style

Async

Contract

Contract

Experience

Mid

Category

Data

The employer did not publish a salary, and we have too few comparable roles to estimate one.

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Complete approximately five hours of asynchronous evaluation work
Where you can work from
Location eligibility not confirmed
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Compensation

Remote flexibility

Work from home

This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.

What the employer says

  • Source listing states candidate location: "United States, Remote"

What Nomaders makes of it

  • Residency required in United States
  • Payroll and tax are likely handled in that country only

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a requirement

  • “If you have experience evaluating technical content or research data, you will be a great fit for this project.”

Questions worth asking: Nomaders interpretation

  • The advert does not say where you can be based. Ask which countries they can legally employ or contract you from.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

What We're Researching

We are running a paid study to evaluate the quality and accuracy of machine learning model outputs. This work directly informs how AI systems handle complex research tasks and domain-specific prompts. By analyzing these generated responses, we can better understand where current models succeed and where they require further refinement.

How It Works

Participants will review a series of machine learning model outputs generated in response to specific research prompts. You will evaluate these responses for accuracy, relevance, and overall quality using a structured rating system. The project involves approximately five hours of independent work, which you can complete asynchronously. You will also provide brief written justifications for your ratings to help us understand your evaluation process.

Who This Is For

We are looking for subject matter experts across various academic and professional domains with a strong eye for detail. We welcome researchers, data analysts, technical writers, and domain specialists who can critically assess complex information. If you have experience evaluating technical content or research data, you will be a great fit for this project.

What You'll Do

Review machine learning model outputs across a variety of research tasks

Rate AI-generated responses for accuracy, relevance, and factual correctness

Provide clear written justifications for your evaluation scores

Complete approximately five hours of asynchronous evaluation work

Who Should Apply

Professional or academic expertise in a specialized domain

Strong critical thinking and analytical skills

Comfortable reading and assessing complex technical or research-focused text

Ability to commit approximately five hours to complete the evaluation tasks

Compensation

$75 per hour

Ready to participate?

Start your paid interview now

About Terac

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Learn more at terac.com or on YouTube at @jointerac .

Requirements

  • ·Comfortable reading and assessing complex technical or research-focused text
  • ·Ability to commit approximately five hours to complete the evaluation tasks
  • ·Ready to participate?
  • ·Start your paid interview now

Benefits

No benefits package published with this listing. Ask about it at first interview.

How to apply

  1. 1Check the flexibility label above, work from home, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Terac, mentioning your remote working experience and working hours (Async).
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 4d ago. Last checked 17 Nov. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar roles

Other open data roles with comparable remote rules.

Browse all open roles

Pay not stated · You'll be taken to the employer's careers page.