Sports Content Reviewer (AI Evaluation)

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for an experienced Sports Content Reviewer to support the quality assurance of data used to evaluate Large Language Models. The role involves reviewing sports-related prompts and completed tasks, assessing factual accuracy, reasoning quality, completeness, and guideline compliance, and providing clear, evidence-based feedback to contributors.

The work may cover global sports, professional leagues, athletes, competitions, rules, statistics, sports history, analytics, training principles, and related developments across different sporting disciplines.

CONTRACT: Contractor assignment, 8 weeks

COMMITMENT: Full-time, 40 hours per week with at least 4 hours of PST overlap

LOCATIONS: Remote - Bangladesh, Brazil ,Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, Vietnam

PROCESS: Initial screening followed by domain manager review

Key Responsibilities

• Review and validate sports-focused prompts across a broad range of disciplines and topics.
• Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and relevance.
• Verify claims related to athletes, leagues, tournaments, rules, statistics, records, and sports history.
• Identify factual errors, hallucinations, outdated information, logical inconsistencies, and weak annotations.
• Assess whether prompts are sufficiently challenging and aligned with project objectives.
• Ensure compliance with project instructions, annotation standards, and review guidelines.
• Provide clear, constructive, and evidence-based feedback to contributors.
• Maintain consistency across reviews and document quality findings.
• Escalate ambiguous or complex cases when required.
• Collaborate with project managers and AI teams to improve evaluation and quality-review processes.

Requirements

• Master’s degree or higher in Sports Management, Sports Science, Kinesiology, Exercise Science, Physical Education, or a closely related discipline.
• At least 3 years of professional, research, teaching, or industry experience in a sports-related field.
• Strong knowledge of sports rules, competitions, statistics, history, performance, or analytics.
• Experience reviewing, evaluating, editing, or quality-checking academic or domain-specific content.
• Ability to identify factual, logical, statistical, chronological, and contextual errors.
• Excellent written English communication skills.