Terac
More roles at TeracSouth Asian Software Engineers: Coding Tasks for AI Evaluation
Remote role where the employee must remain based in a particular country.
India only
From the listing details: Source listing states candidate location: "India, Remote"
Employer listed it 4 weeks ago · Added 4 weeks ago
Been open since 4 weeks ago, still being checked, but it has been live a while.
Salary
Not stated
Location
India only
Timezone
APAC
Contract
Contract
Experience
Mid
Category
Software
The employer did not publish a salary, and we have too few comparable roles to estimate one.
What the advert says
Quoted word for word from the employer's advert. Where it says nothing, we say so.
- Working hours
- Not mentioned in the advert
- Where you can work from
We are hiring experienced software engineers based in South Asia who have a strong background in building and reviewing complex codebases.
- Contract
- Not mentioned in the advert
- Experience asked for
- Not mentioned in the advert
- Pay
Compensation
Remote flexibility
Work from home
This is a remote role, but the employee must be based in India. It is work from home rather than work from anywhere.
What the employer says
- Source listing states candidate location: "India, Remote"
- Job description states: "based in South Asia who have a strong b"
What Nomaders makes of it
- Payroll and tax are likely handled in that country only
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
Before you apply
Questions worth asking: Nomaders interpretation
- The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.
Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.
About the role
What We're Researching
We're running a paid study on the effectiveness of coding evaluation harnesses used to test AI agents. Our team is building a comprehensive suite of programming environments designed to measure agent performance accurately. This work ensures that AI coding assistants are evaluated against realistic, high-quality development scenarios.
How It Works
You will walk through a series of proposed coding tasks and environments during an AI-moderated session. We will ask you to review the structure, difficulty, and realism of these programming challenges. You will provide technical feedback on the evaluation harnesses and suggest improvements to the test suites. The conversation will focus on ensuring these tasks accurately reflect real-world engineering requirements.
Who This Is For
We are hiring experienced software engineers based in South Asia who have a strong background in building and reviewing complex codebases. We welcome backend developers, test automation engineers, and full-stack engineers who understand evaluation harnesses. Ideal candidates have hands-on experience verifying realistic programming tasks in professional environments.
What You'll Do
Review proposed coding tasks and programming environments for realism
Provide technical feedback on the structure and difficulty of evaluation harnesses
Walk us through your approach to verifying complex code challenges
Suggest improvements to make the test suites more robust
Who Should Apply
Professional software engineer based in South Asia
Experience building or reviewing realistic programming tasks
Familiarity with coding evaluation harnesses or test automation
Comfortable discussing technical workflows in an interview setting
Compensation
$35 per hour
Ready to participate?
Start your paid interview now
About Terac
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at terac.com or on YouTube at @jointerac .
Requirements
The employer hasn't listed requirements separately, they're described in the role summary above and on the original listing.
Benefits
No benefits package published with this listing. Ask about it at first interview.
How to apply
- 1Check the flexibility label above, work from home, matches where you plan to live and work.
- 2Tailor your CV to the role at Terac, mentioning your remote working experience and working hours (APAC).
- 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.
Found 26d ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
Pay not stated · You'll be taken to the employer's careers page.