Geography Content Reviewer (AI Evaluation)
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are looking for an experienced Geography Content Reviewer to support the quality assurance of data used to evaluate Large Language Models. The role involves reviewing geography-focused prompts and completed tasks, checking factual accuracy, reasoning quality, completeness, and guideline compliance, and providing clear, evidence-based feedback to contributors.
The work may cover physical and human geography, countries and capitals, climate, geopolitics, demographics, maps, environmental systems, urban development, and related topics.
CONTRACT: Contractor assignment, 8 weeks
COMMITMENT: Full-time, 40 hours per week with at least 4 hours of PST overlap
LOCATIONS: Remote - Bangladesh, Brazil ,Colombia, Egypt, Ghana, India, Indonesia, Kenya, Nigeria, Pakistan, Turkey, Vietnam
PROCESS: Initial screening followed by domain manager review
Key Responsibilities
- Review and validate geography-focused prompts across a broad range of topics.
- Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and relevance.
- Identify factual errors, hallucinations, outdated information, and contextual inconsistencies.
- Verify geographic, demographic, environmental, and geopolitical claims.
- Assess whether prompts are sufficiently challenging and aligned with project objectives.
- Ensure compliance with project instructions, annotation standards, and review guidelines.
- Provide clear, constructive, and evidence-based feedback to contributors.
- Document review findings and escalate ambiguous or complex cases when required.
- Collaborate with project managers and AI teams to improve evaluation and quality-review processes.
Requirements
- Master’s degree or higher in Geography, Geoscience, Environmental Science, GIS, Urban Planning, or a closely related discipline.
- At least 3 years of professional, research, teaching, or industry experience in a geography-related field.
- Strong knowledge across physical geography, human geography, geopolitics, demographics, or environmental systems.
- Experience reviewing, evaluating, editing, or quality-checking academic or domain-specific content.
- Ability to identify factual, logical, geographic, and contextual errors.
- Excellent written English communication skills