Skip to main content
Back to Jobs

Remote - AI Evaluator - English

  • $15/hr
  • Posted today

Hiring in some regions only

Evaluate AI voice, image, and video models in English

Evaluate AI voice, image, and video models by holding live conversations, comparing pairs of outputs, and rating them across dimensions like adherence, quality, and realism. Write specific explanations in English to point out what you saw or heard. Work remotely with flexible hours.

Why This Role?

Direct founder access, real impact from day one

Key Responsibilities

  • Hold live, scenario-based conversations in English with AI voice models and rank their naturalness, usefulness, and clarity
  • Compare pairs of AI-generated images and videos and judge which better follows the prompt
  • Inspect outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering, or unnatural motion
  • Rate each output across dimensions like adherence, quality, and realism, then write a specific explanation in English

Requirements

  • Fluent English speaker with strong, clear written communication
  • Comfortable with natural, everyday conversational speech
  • Strong attention to detail and patience to look and listen closely
  • Comfortable thinking on your feet and talking through realistic situations
  • Experience writing short, evidence-based explanations or reviews
  • Comfortable making a clear decision when both options have flaws

Required Skills

communicationenglishattention-to-detailai-evaluationcritical-thinkingattention to detailcritical thinking
View original listingShow more

Original description from the original listing

Atlanta, Georgia (United States) Outlier helps the world's most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you You may contribute your expertise by Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded Comparing pairs of AI-generated images and videos and judging which one better follows the prompt Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard Examples of desirable expertise: Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech Pursuing or holding a Bachelor's degree or above Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way Experience writing short, evidence-based explanations or reviews Comfortable making a clear decision when both options have flaws What you'll need: A computer with a reliable internet connection and headphones A quiet place to talk for projects that involve live conversation Your ratings and written explanations must be your own work; AI tools can't be used to write them Getting started includes a short screening and onboarding, which may include a brief spoken English check Payment: Project work: Earn up to USD $15 per hour for core project work Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions - Outlier's version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%. Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants' needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data. This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.

Salary Context

Similar Engineering roles on LokerDollar pay around $148k/yr (range $1k–1040k/yr, n=622 active listings).

Market context

  • VERIFIEDStated pay is 79% below the role median of $148,000/year (n=622 pay-disclosing listings).
  • VERIFIEDOutlier: 1 postings in the last 3 months, 1 all-time on LokerDollar.
  • VERIFIEDCompany first seen Oct 28, 2026.
  • VERIFIEDThis listing first seen Oct 28, 2026.
  • VERIFIEDLast verified live Oct 28, 2026.

Not quite right? Similar roles hiring now

See all 5 similar →

This listing comes from one of our partners, with the company profile and full details on this page. The one thing we can't auto-confirm is whether this specific apply link opens cleanly — it usually does, so go ahead and try it. Check back later if it doesn't load.

Company
Outlier
Salary
$15/hr
Job Type
full time
Location
Remote · United States
Category
Seniority
entry
PostedNewNew & verified
Oct 28, 2026

Share this job

Help a friend find their next remote role.

Hiring? Find talent free

Frequently asked questions

Is Remote - AI Evaluator - English at Outlier a remote job?
Yes, Remote - AI Evaluator - English at Outlier is remote, but limited to candidates in United States. Check the listing for location requirements.
What is the salary for Remote - AI Evaluator - English at Outlier?
The listed pay range for this role is $15/hr.
What type of employment is Remote - AI Evaluator - English at Outlier?
This is a full time position.
How do I apply?
Click the "Apply" button on this page to go to the official application at Outlier.

More remote jobs in the United States

Browse all US jobs →

Explore related

Market data & reports

Salary & skill-demand research built from our own listings data.

From the blog

This employer appears to hire only in certain regions.