Senior LLM Evaluation Engineer & Metrics Architect
- Salary not listed
- Posted today · via Adzuna
Build LLM evaluation capabilities
Design end-to-end evaluation plans and build datasets to quantify model performance. Collaborate with algorithm, product, and data teams in a remote-first environment.
Why This Role?
Collaborate with cross-functional teams
Key Responsibilities
- Design evaluation plans for LLM models
- Build datasets for model performance quantification
- Drive automation of evaluation workflows
Requirements
- Algorithmic background
- Professional evaluation methods knowledge
- Collaboration skills
Required Skills
View Original Description from AdzunaShow more
Original description from Adzuna
Binance is seeking an evaluation expert with an algorithmic background to build LLM evaluation capabilities across dialogue, financial trading, and other scenarios, using professional evaluation methods to quantify model performance and guide R&D. You will design end-to-end evaluation plans, build datasets, and drive automation of evaluation workflows in a remote-first, Singapore-based team. Collaboration with algorithm, product, and data teams is essential. J-18808-Ljbffr
Not quite right? Similar roles hiring now
See all 5 similar →Opens on Adzuna — you may need 1–2 more clicks to reach the real application.
This listing is sourced from Adzuna, with the company profile and full details on this page. The one thing we can't auto-confirm is whether this specific apply link opens cleanly — it usually does, so go ahead and try it. Check back later if it doesn't load.
Apply link may be geo-restricted
This job is sourced from a regional Adzuna board and may show a geo-block for Indonesian users. If the Apply page doesn't load, try a VPN.
Openness not stated by employer — check the listing
Explore related
Market data & reports
Salary & skill-demand research built from our own listings data.
- Skills Remote Employers Ask For in the AI EraMost-named skills in active listings by kind, AI-named skills and the fastest risers. Weekly data.
- Indonesia IT Jobs vs Global Remote (2026)Primary analysis of 2,049 listings: methodology, classification rules, downloadable datasets.
- AI-Skill Demand: Indonesia vs Global Remote (2026)10,000+ postings, taxonomy-first classifier, Wilson CIs, pre-registered before analysis.
- Remote ≠ Remote: The Skills That Open Global Work to Indonesians (2026)12,891 remote listings: the highest-paid coding skills are the most geo-locked for Indonesia-based applicants. CC BY 4.0 aggregate dataset.
- The Compliance Layer of the AI Hiring Stack (2026)6,349 remote listings: 77.2% never state who may apply. Methodology and a CC BY 4.0 aggregate dataset.
- AI in Job Ads: Indonesia vs Global (2026)Global engineering ads naming AI rose from 3.4% to 23% after ChatGPT; Indonesian ads went from 2.2% to 2.8%. 2027 scenarios and a CC BY 4.0 dataset.
- Pandora's Box Ep. 1: AI and Southeast Asian Job Ads (2026)118,545 archived job ads, 2019–2026: web and software developer ads shrank on every board, a phone app became the entry ticket, and a Job X-ray for 17 jobs. CC BY 4.0 datasets.
- Cron vs LLM vs LangGraph vs Agent for Social Posts (2026)A pre-registered test of four ways to turn a blog post into social posts, on two models. Automated checks picked a cron template; the model mattered more than the framework.
- Indonesia Hiring Report: Tech vs Non-TechJob demand by field from aggregate open-job counts — never individual listings.
- Indonesia Salary BenchmarkAggregate salary ranges across roles, with open methodology and dataset.
- Indonesian Remote Work Salary & Demand IndexHow much of the global remote job corpus is open to Indonesia, and what it pays (USD) by role.
- Indonesia Quarterly Labor Market ReportLayoffs, funding, salaries & skills per quarter — open aggregates.
- Remote Market Reports by RoleAuto-generated per role family — skills, seniority, companies, salary.
- Global Remote Salary BenchmarkAnnual salary by role & currency, plus the share of listings open worldwide.
This apply link is not verified yet.