Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)
- Posted yesterday · via Himalayas
Full Description
About the Role Join a remote expert network as a senior rater and reviewer, evaluating challenging AI model outputs and helping calibrate other graders. Your work supports the development of reliable, high-quality AI systems. What You'll Do Rank and rate expert-level model answers in your domain using detailed rubrics and written rationales. Evaluate model reasoning step by step in specialized fields such as mathematics, code, law, medicine, or finance. Fact-check detailed claims against primary sources and verify accuracy. Assess answers against content policies, style guides, and edge cases. Review other raters' work, calibrate standards, and develop or refine grading guidelines. Assess search relevance and share feedback in live sessions. What We're Looking For At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or deep expertise in a relevant field. Native or near-native written English proficiency. Experience grading or reviewing expert-level answers against rubrics, policies, or style guides. Experience leading, reviewing, or mentoring other raters or reviewers. An advanced degree, professional license, or deep working expertise in the domain you evaluate. Hands-on experience with AI data annotation, preference ranking, rubric grading, process labeling, or search-quality rating is a plus. Compensation & Benefits Compensation is $50 to $120 per hour, depending on project, field, and expertise. Payment is for hours worked. Location Fully remote. Projects typically last from one week to several months. Compensation Range: $104K - $249.6K Originally posted on Himalayas
Not quite right? Similar roles hiring now
See all 5 similar →Opens on Himalayas — you may need 1–2 more clicks to reach the real application.
This listing is sourced from Himalayas, with the company profile and full details on this page. The one thing we can't auto-confirm is whether this specific apply link opens cleanly — it usually does, so go ahead and try it. Check back later if it doesn't load.
Openness not stated by employer — check the listing
Explore related
Market data & reports
Salary & skill-demand research built from our own listings data.
- Skills Remote Employers Ask For in the AI EraMost-named skills in active listings by kind, AI-named skills and the fastest risers. Weekly data.
- Indonesia IT Jobs vs Global Remote (2026)Primary analysis of 2,049 listings: methodology, classification rules, downloadable datasets.
- AI-Skill Demand: Indonesia vs Global Remote (2026)10,000+ postings, taxonomy-first classifier, Wilson CIs, pre-registered before analysis.
- Remote ≠ Remote: The Skills That Open Global Work to Indonesians (2026)12,891 remote listings: the highest-paid coding skills are the most geo-locked for Indonesia-based applicants. CC BY 4.0 aggregate dataset.
- The Compliance Layer of the AI Hiring Stack (2026)6,349 remote listings: 77.2% never state who may apply. Methodology and a CC BY 4.0 aggregate dataset.
- AI in Job Ads: Indonesia vs Global (2026)Global engineering ads naming AI rose from 3.4% to 23% after ChatGPT; Indonesian ads went from 2.2% to 2.8%. 2027 scenarios and a CC BY 4.0 dataset.
- Future of Jobs Index: every quarterly editionOne index per quarter from global remote and Indonesian job ads. Q4 2026 is the baseline (= 100); later editions are measured against it on the same sources.
- Future of Jobs Index, Q3 2026 (pre-baseline)Global remote and Indonesian job ads by job family: AI-skill demand, remote reach, pay transparency and seniority. Every figure with its sample size. CC BY 4.0 dataset.
- The Laptop Job Recession: Indonesia's Coders and Their Job Ads (2026)Indonesia's coders multiplied by eight while software job ads fell by two-thirds. 284,000 archived Southeast Asian job ads, 2019–2026, charts by job family and 2027 bets. CC BY 4.0 dataset.
- Pandora's Box Ep. 1: AI and Southeast Asian Job Ads (2026)118,545 archived job ads, 2019–2026: web and software developer ads shrank on every board, a phone app became the entry ticket, and a Job X-ray for 17 jobs. CC BY 4.0 datasets.
- Cron vs LLM vs LangGraph vs Agent for Social Posts (2026)A pre-registered test of four ways to turn a blog post into social posts, on two models. Automated checks picked a cron template; the model mattered more than the framework.
- Indonesia Hiring Report: Tech vs Non-TechJob demand by field from aggregate open-job counts — never individual listings.
- Indonesia Salary BenchmarkAggregate salary ranges across roles, with open methodology and dataset.
- Indonesian Remote Work Salary & Demand IndexHow much of the global remote job corpus is open to Indonesia, and what it pays (USD) by role.
- Indonesia Quarterly Labor Market ReportLayoffs, funding, salaries & skills per quarter — open aggregates.
- Remote Market Reports by RoleAuto-generated per role family — skills, seniority, companies, salary.
- Global Remote Salary BenchmarkAnnual salary by role & currency, plus the share of listings open worldwide.
This apply link is not verified yet.
