Pavago
AI Operations Specialist - LLM & Conversation Systems
Remote role where the employee must remain based in a particular country.
Pakistan only
Employer listed it 2 weeks ago · Found 2h ago
Been open since 2 weeks ago, still being checked, but it has been live a while.
Salary
Not stated
Location
Pakistan only
Timezone
Not stated
Contract
Full-time
Experience
Mid
Category
Operations
This employer didn't state pay. Jobs like this usually pay around $90k–$160k a year, a typical range taken from 256 mid-level operations roles on Nomaders that do state pay. It's a guide, not an offer.
Remote flexibility
Work from home
This is a remote role, but the employee must be based in Pakistan. It is work from home rather than work from anywhere.
What the employer says
- Source listing states candidate location: "Pakistan, Remote"
What Nomaders makes of it
- Residency required in Pakistan
- Payroll and tax are likely handled in that country only
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
About the role
AI Operations Specialist – LLM & Conversation Systems
Position Type: Full-Time, Remote Working Hours: U.S. Business Hours
About the Role
We are looking for a hands-on AI Operations Specialist to own and improve our production AI conversation systems.
We are an AI-powered SMS lead recovery platform serving telehealth brands, processing millions of messages each month. Our AI systems interact directly with customers, and their performance directly impacts client conversions.
In this role, you'll onboard new clients, configure AI conversation systems, monitor live conversations, diagnose issues, improve prompts and system behavior, and measure whether your changes actually improve conversion.
This is not a theoretical AI role. We're looking for someone who has run LLM systems in production and understands how to continuously monitor, troubleshoot, test, and improve them.
Responsibilities
Client Onboarding & AI Setup
Onboard new clients into the AI conversation platform.
Set up webhook integrations and client knowledge bases.
Configure campaigns and conversation workflows.
Ensure new client systems are properly tested before going live.
Troubleshoot integration and configuration issues during onboarding.
Production AI Operations
Monitor live AI-generated conversations and customer interactions.
Review conversations to identify errors, inconsistencies, and missed opportunities.
Diagnose AI failure modes and determine their root causes.
Identify issues affecting conversation quality and conversion.
Escalate technical issues when necessary and follow through until resolved.
Prompt & System Optimization
Write, edit, and improve prompts that generate customer-facing messages.
Adjust system instructions and conversation logic based on real-world performance.
Test changes systematically before and after deployment.
Requirements
- ·Proven experience running LLM or AI systems in production .
- ·Hands-on experience monitoring and improving production AI outputs.
- ·Experience with prompt engineering and system prompt optimization.
- ·Strong understanding of LLM behavior, failure modes, and iterative testing.
- ·Experience analyzing AI-generated conversations or customer-facing outputs.
Benefits
No benefits package published with this listing. Ask about it at first interview.
How to apply
- 1Check the flexibility label above, work from home, matches where you plan to live and work.
- 2Tailor your CV to the role at Pavago, mentioning your remote working experience.
- 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.
Found 2h ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
Similar roles
Other open operations roles with comparable remote rules.
Free to apply, no account needed.
Typically $90k to $160k per year · You'll be taken to the employer's careers page.