Andromeda Shimu Deep Research Reviewer at Welo Global
Job details
Use AI to assess how you fit
About this role
About the Role
We're looking for a QA Deep Research Reviewer to evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines. You'll read documents that include tables and citations, judge each criterion on its own merits, and write clear, evidence-based rationales that help us improve the quality of AI research tools. This role suits someone with a sharp editorial eye, a fact-checker's instincts, and the discipline to apply guidelines consistently
Project Details:
Location: Remote (Philippines/Mexico)
Commitment: 15-20 hours per week
Engagement type: Freelancer
Pay rate: Philippines: $7 USD, Mexico: $8 USD
What You'll Do
Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments
Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages
Write short, specific rationales (1-3 sentences) that point to concrete evidence
Follow guideline updates and calibrate your decisions consistently with the QA team.
Must-Have Qualifications
Native or near-native US English (C2), with the ability to read long documents containing tables and citations
Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA
Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)
Ability to write concise rationales that cite evidence
Ability to judge each criterion independently, without letting an overall impression influence the call
Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer.
Originally posted on Himalayas