AI Content Reviewer (Remote)

About the role

We are looking for a meticulous AI Content Reviewer to evaluate and improve AI‑generated outputs across text, image descriptions, and code. The role is fully remote and supports a worldwide team, ensuring that all content meets accuracy, clarity, brand, and safety standards.

Key responsibilities

• Review AI‑generated text, image captions, and code for relevance, toxicity, bias, and factual integrity.
• Create high‑quality training datasets by labeling data according to strict guidelines.
• Audit work of junior reviewers or automated systems to maintain consistency with project rubrics.
• Collaborate with operations to refine style guides and annotation instructions based on emerging edge cases.
• Identify recurring model errors and provide detailed feedback to data scientists and engineers.
• Track basic metrics such as inter‑agreement rates and F1 scores to gauge review impact.

Required profile

• Minimum 2 years of experience in content review, moderation, fact‑checking, or quality assurance within tech or digital media.
• Proven ability to analyze complex information quickly and justify decisions under ambiguous guidelines.
• Comfort handling potentially sensitive or disturbing content with professionalism.
• Experience testing or providing feedback on generative AI models (e.g., ChatGPT, Bard, Midjourney).
• Background in linguistics, data annotation, or computational linguistics is a plus.

Required skills

• Familiarity with generative AI models such as ChatGPT, Bard, Midjourney.
• Proficiency with data annotation tools and spreadsheet software.
• Understanding of evaluation metrics like inter‑agreement rates and F1 scores.