Remote - AI Evaluator - English
- $15/hr
- Posted today
Hiring in some regions only
Evaluate AI voice, image, and video models in English
Evaluate AI voice, image, and video models by holding live conversations, comparing pairs of outputs, and rating them across dimensions like adherence, quality, and realism. Write specific explanations in English to point out what you saw or heard. Work remotely with flexible hours.
Why This Role?
Direct founder access, real impact from day one
Key Responsibilities
- Hold live, scenario-based conversations in English with AI voice models and rank their naturalness, usefulness, and clarity
- Compare pairs of AI-generated images and videos and judge which better follows the prompt
- Inspect outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering, or unnatural motion
- Rate each output across dimensions like adherence, quality, and realism, then write a specific explanation in English
Requirements
- Fluent English speaker with strong, clear written communication
- Comfortable with natural, everyday conversational speech
- Strong attention to detail and patience to look and listen closely
- Comfortable thinking on your feet and talking through realistic situations
- Experience writing short, evidence-based explanations or reviews
- Comfortable making a clear decision when both options have flaws
Required Skills
View original listingShow more
Original description from the original listing
Atlanta, Georgia (United States) Outlier helps the world's most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you You may contribute your expertise by Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded Comparing pairs of AI-generated images and videos and judging which one better follows the prompt Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard Examples of desirable expertise: Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech Pursuing or holding a Bachelor's degree or above Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way Experience writing short, evidence-based explanations or reviews Comfortable making a clear decision when both options have flaws What you'll need: A computer with a reliable internet connection and headphones A quiet place to talk for projects that involve live conversation Your ratings and written explanations must be your own work; AI tools can't be used to write them Getting started includes a short screening and onboarding, which may include a brief spoken English check Payment: Project work: Earn up to USD $15 per hour for core project work Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions - Outlier's version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%. Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants' needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data. This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.
Salary Context
Similar Engineering roles on LokerDollar pay around $148k/yr (range $1k–1040k/yr, n=622 active listings).
Market context
- VERIFIEDStated pay is 79% below the role median of $148,000/year (n=622 pay-disclosing listings).
- VERIFIEDOutlier: 1 postings in the last 3 months, 1 all-time on LokerDollar.
- VERIFIEDCompany first seen Oct 28, 2026.
- VERIFIEDThis listing first seen Oct 28, 2026.
- VERIFIEDLast verified live Oct 28, 2026.
Not quite right? Similar roles hiring now
See all 5 similar →Employer hires only in specific regions — check eligibility first
This listing comes from one of our partners, with the company profile and full details on this page. The one thing we can't auto-confirm is whether this specific apply link opens cleanly — it usually does, so go ahead and try it. Check back later if it doesn't load.
Frequently asked questions
- Is Remote - AI Evaluator - English at Outlier a remote job?
- Yes, Remote - AI Evaluator - English at Outlier is remote, but limited to candidates in United States. Check the listing for location requirements.
- What is the salary for Remote - AI Evaluator - English at Outlier?
- The listed pay range for this role is $15/hr.
- What type of employment is Remote - AI Evaluator - English at Outlier?
- This is a full time position.
- How do I apply?
- Click the "Apply" button on this page to go to the official application at Outlier.
More remote jobs in the United States
Browse all US jobs →- Senior Web Developer & Marketing Technology Specialist - Remote / TelecommuteCYNET SYSTEMS
- Application Security Architect - RemoteGenesis10
- Remote Commercial Litigation AttorneyJobot
- Senior Tax Manager - Flowthroughs (Remote)Jobot
- HYBRID Remote Primary Care Physician Assistant - Bilingual Spanish (Downtown Manhattan - must live in NYC metro))Jobot
- Business and Real Estate Litigation Attorney (Fully Remote or Hybrid in CA)Jobot
Explore related
Market data & reports
Salary & skill-demand research built from our own listings data.
- Skills Remote Employers Ask For in the AI EraMost-named skills in active listings by kind, AI-named skills and the fastest risers. Weekly data.
- Indonesia IT Jobs vs Global Remote (2026)Primary analysis of 2,049 listings: methodology, classification rules, downloadable datasets.
- AI-Skill Demand: Indonesia vs Global Remote (2026)10,000+ postings, taxonomy-first classifier, Wilson CIs, pre-registered before analysis.
- Remote ≠ Remote: The Skills That Open Global Work to Indonesians (2026)12,891 remote listings: the highest-paid coding skills are the most geo-locked for Indonesia-based applicants. CC BY 4.0 aggregate dataset.
- The Compliance Layer of the AI Hiring Stack (2026)6,349 remote listings: 77.2% never state who may apply. Methodology and a CC BY 4.0 aggregate dataset.
- AI in Job Ads: Indonesia vs Global (2026)Global engineering ads naming AI rose from 3.4% to 23% after ChatGPT; Indonesian ads went from 2.2% to 2.8%. 2027 scenarios and a CC BY 4.0 dataset.
- Cron vs LLM vs LangGraph vs Agent for Social Posts (2026)A pre-registered test of four ways to turn a blog post into social posts, on two models. Automated checks picked a cron template; the model mattered more than the framework.
- Indonesia Hiring Report: Tech vs Non-TechJob demand by field from aggregate open-job counts — never individual listings.
- Indonesia Salary BenchmarkAggregate salary ranges across roles, with open methodology and dataset.
- Indonesian Remote Work Salary & Demand IndexHow much of the global remote job corpus is open to Indonesia, and what it pays (USD) by role.
- Indonesia Quarterly Labor Market ReportLayoffs, funding, salaries & skills per quarter — open aggregates.
- Remote Market Reports by RoleAuto-generated per role family — skills, seniority, companies, salary.
- Global Remote Salary BenchmarkAnnual salary by role & currency, plus the share of listings open worldwide.
From the blog
This employer appears to hire only in certain regions.