ClickUp
More roles at ClickUpSenior AI Developer
Remote role where the employee must remain based in a particular country.
United States only
From the listing details: Source listing states candidate location: "United States, Remote"
Employer listed it 11 days ago · Added 11 days ago
First listed 11 days ago and still open.
Salary
$200k to $250k per year
Location
United States only
Timezone
US East
Contract
Full-time
Experience
Senior
Category
Software
Published by the employer
What the advert says
Quoted word for word from the employer's advert. Where it says nothing, we say so.
- Working hours
- Not mentioned in the advert
- Where you can work from
- Location eligibility not confirmed
- Contract
- Not mentioned in the advert
- Experience asked for
- Not mentioned in the advert
- Pay
- Not mentioned in the advert
Remote flexibility
Work from home
This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.
What the employer says
- Source listing states candidate location: "United States, Remote"
What Nomaders makes of it
- Residency required in United States
- Payroll and tax are likely handled in that country only
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
Before you apply
Questions worth asking: Nomaders interpretation
- The advert does not say where you can be based. Ask which countries they can legally employ or contract you from.
- The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.
Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.
About the role
At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We are an AI-native company. Every team member is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process. Join us and help redefine what's possible. 🚀
We're looking for a highly skilled and experienced Senior AI Engineer to join our ClickUp Engineering team, with a focus on AI evaluations . You'll own how we measure and improve the quality of ClickUp's AI: building the eval systems that tell us how well our AI is performing, the core agent harness, and the AI that performs well on those evals. You'll work on backend systems that make AI-powered capabilities scalable, reliable, and secure, while working hands-on with LLMs to solve real user problems and drive product innovation.
Key Responsibilities:
Design, build, and own ClickUp's AI evaluation system , including golden datasets, LLM-as-judge and automated scorers, regression detection, and quality tracking across AI features.
Build and evolve the core agent harness , and the AI that performs well on those evals, partnering closely with product and engineering to define what "great" looks like.
Build self-improvement loops where agents modify other agents or prompts, rerun evals, and iterate automatically.
Benchmark new models as they're released and own model selection, routing, and fallback strategies across providers (e.g., OpenAI, Anthropic, Google, open-weight), balancing quality, latency, and cost.
Architect, design, and implement scalable AI platform services that support the deployment, orchestration, and lifecycle management of LLMs and other AI models.
Build and maintain robust APIs and backend systems that integrate AI-powered features into ClickUp's core platform.
Develop infrastructure for model serving, monitoring, logging, and automated evaluation to ensure high reliability and performance of AI services in production.
Drive best practices in AI privacy, security, and compliance, including data anonymization, secure data handling, and regulatory adherence.
Collaborate cross-functionally with product, frontend, and data teams to deliver seamless, reliable, and user-centric AI experiences.
Qualifications:
5+ years of software engineering experience, including 2+ years building production LLM or ML systems.
Hands-on experience building LLM evaluation systems in production (golden datasets, LLM-as-judge, judge calibration, offline and online evals), tied to real product quality.
Strong experiment design and statistical rigor, including A/B testing, offline vs. online metrics, and separating real regressions from noisy or variable results.
Proven track record of applying LLMs and AI models to real-world, customer-facing product features.
Proven experience integrating and managing multiple LLMs, including benchmarking, routing, and cost/latency/quality tradeoffs.
Deep expertise in backend engineering, distributed systems, and cloud-native technologies (e.g., Kubernetes, Docker, AWS/GCP/Azure).
Strong programming skills in Python (preferred), Go, TypeScript, or similar languages used for backend and AI platform development.
Proficiency in orchestration frameworks and workflow engines (e.g., LangGraph, Airflow, Ray, or similar).
Familiarity with search and retrieval technologies and their integration into AI-driven applications.
Excellent collaboration and communication skills, with a track record of working effectively in cross-functional teams.
Passion for staying at the forefront of AI and applying new technologies to solve real-world problems at scale.
Requirements
- ·5+ years of software engineering experience, including 2+ years building production LLM or ML systems.
- ·Hands-on experience building LLM evaluation systems in production (golden datasets, LLM-as-judge, judge calibration, offline and online evals), tied to real product quality.
- ·Strong experiment design and statistical rigor, including A/B testing, offline vs. online metrics, and separating real regressions from noisy or variable results.
- ·Proven track record of applying LLMs and AI models to real-world, customer-facing product features.
- ·Proven experience integrating and managing multiple LLMs, including benchmarking, routing, and cost/latency/quality tradeoffs.
Benefits
No benefits package published with this listing. Ask about it at first interview.
How to apply
- 1Check the flexibility label above, work from home, matches where you plan to live and work.
- 2Tailor your CV to the role at ClickUp, mentioning your remote working experience and working hours (US East).
- 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.
Found 12d ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
$200k to $250k per year · You'll be taken to the employer's careers page.