Contra
More roles at ContraStrategic Project Lead
Remote role where the employee must remain based in a particular country.
Listed for United States
Source: the job board's country tag. The advert itself does not name United States.
Employer listed it 5 months ago · Added 8 weeks ago
Been open since 5 months ago. Long-running listings are sometimes left up after the role is filled.
Salary
$150k to $200k per year
Location
Listed for United States
Timezone
Not stated
Contract
Full-time
Experience
Lead
Category
Other
Published by the employer
What the advert says
Quoted word for word from the employer's advert. Where it says nothing, we say so.
- Working hours
- Not mentioned in the advert
- Where you can work from
Based in San Francisco, California
- Contract
- Not mentioned in the advert
- Experience asked for
- Not mentioned in the advert
- Pay
Salary: $150,000 to $200,000 USD plus equity
Remote flexibility
Work from home
This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.
What the employer says
- Source listing states candidate location: "San Francisco, Remote"
- Job description states: "Based in San Francisco"
What Nomaders makes of it
- Payroll and tax are likely handled in that country only
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
Before you apply
Questions worth asking: Nomaders interpretation
- The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.
Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.
About the role
Who we are
Contra Labs is a human-centered research lab studying how creatives actually use AI, how tools can serve creative work better, and how to protect the originality that gets flattened as everything starts to look the same.
We connect a global network of top creative talent with frontier AI labs and product companies. By grounding our research in real creative workflows, we help define what "good" looks like across design, video, imagery, and beyond. Our work powers benchmarking, evaluation, and post-training for leading models and applications. Built on Contra, the professional network for independent creatives, we turn human judgment into the training and evaluation layer that helps these tools serve the people who use them.
Why this role exists
We are scaling across client engagements: post-training dataset creation, benchmarking programs, and ongoing evaluation partnerships. Each project spans a different mix of AI labs, creative-tool companies, and research teams, with different requirements, timelines, and quality bars. We need someone to own this work from end to end.
Think of yourself as the operator for a project or vertical. You sit between three groups that do not naturally talk to each other: the client who needs the data, the creative experts producing it, and the internal engineering team building the tooling. Your job is to make all three feel like they are working on the same thing, and to ship results that are both rigorous and genuinely useful.
What you'll own
The methodology. Annotation protocols, rubrics, and evaluation designs for creative and multimodal outputs.
Delivery. Scope, evaluator staffing, quality routing, timelines, and the client relationship, from kickoff to final readout.
Quality. Data quality, inter-rater reliability, and real-time course correction when something feels off. You hold the bar, and you hold the levers to fix it.
Analysis and storytelling. Qualitative and quantitative analysis turned into clear findings, recommendations, reports, and workshops that clients act on.
The systems behind it. You turn repeated work into clean, measurable process, and you partner with engineering on the tooling that makes that process faster and more reliable.
The narrative. Case studies and benchmark publications that sharpen how Contra Labs is understood in the market.
About you
You design studies for a living. You can scope a question, run the study, analyze the data, and translate it into a direction people can act on.
You understand good creative, and you can explain it. You recognize creative quality and can say why, and you can tell the difference between personal preference and something closer to ground truth. You build frameworks that capture that signal faithfully.
You care more about people than about technology for its own sake. You understand how humans judge creative work and design systems around that.
You turn messy work into machines. You make process clear, predictable, and measurable, and you run a tight ship across several projects at once.
High ownership, low ego, bias to action. You ship a v1, learn, and do what it takes to deliver.
Experience
3+ years designing studies, running evaluations, analyzing data, and presenting findings.
Experience with data labeling, annotation, human-in-the-loop systems, or AI and ML evaluation workflows.
A track record managing several concurrent projects, including annotation, evaluation, or QA work.
A real point of view on creative quality and what "good" looks like.
Requirements
- ·You design studies for a living. You can scope a question, run the study, analyze the data, and translate it into a direction people can act on.
- ·You care more about people than about technology for its own sake. You understand how humans judge creative work and design systems around that.
- ·You turn messy work into machines. You make process clear, predictable, and measurable, and you run a tight ship across several projects at once.
- ·High ownership, low ego, bias to action. You ship a v1, learn, and do what it takes to deliver.
- ·3+ years designing studies, running evaluations, analyzing data, and presenting findings.
Benefits
No benefits package published with this listing. Ask about it at first interview.
How to apply
- 1Check the flexibility label above, work from home, matches where you plan to live and work.
- 2Tailor your CV to the role at Contra, mentioning your remote working experience.
- 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.
Found 2mo ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
Similar roles
Other open other roles with comparable remote rules.
$150k to $200k per year · You'll be taken to the employer's careers page.