Art Content Reviewer (AI Evaluation)
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are looking for an experienced Art Content Reviewer to support the quality assurance of data used to evaluate Large Language Models. The role involves reviewing art-focused prompts and completed tasks, assessing factual accuracy, reasoning quality, completeness, and guideline compliance, and providing clear, evidence-based feedback to contributors.
The work may cover art history, visual and fine arts, architecture, design, artists, artistic techniques, museums, cultural heritage, and major art movements across different periods and regions.
CONTRACT: Contractor assignment, 8 weeks
COMMITMENT: Full-time, 40 hours per week with at least 4 hours of PST overlap
LOCATIONS: Remote - Bangladesh, Brazil ,Colombia, Egypt, Ghana, India, Indonesia, Kenya, Nigeria, Pakistan, Turkey, Vietnam
PROCESS: Initial screening followed by domain manager review
Key Responsibilities
- Review and validate art-focused prompts across a broad range of periods, disciplines, and cultural contexts.
- Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and relevance.
- Identify factual errors, hallucinations, outdated information, and contextual inconsistencies.
- Verify claims related to artists, artworks, techniques, movements, architecture, and cultural heritage.
- Assess whether prompts are sufficiently challenging and aligned with project objectives.
- Ensure compliance with project instructions, annotation standards, and review guidelines.
- Provide clear, constructive, and evidence-based feedback to contributors.
- Maintain consistency across reviews and document quality findings.
- Escalate ambiguous or complex cases when required.
- Collaborate with project managers and AI teams to improve evaluation and review processes.
Requirements
- Master’s degree or higher in Art, Art History, Fine Arts, Design, Architecture, Visual Arts, or a closely related discipline.
- At least 3 years of professional, research, teaching, or industry experience in an art-related field.
- Strong knowledge of art history, visual arts, architecture, design, or related cultural disciplines.
- Experience reviewing, evaluating, editing, or quality-checking academic or domain-specific content.
- Ability to identify factual, logical, chronological, attribution, and contextual errors.
- Excellent written English communication skills.