Remote | Senior Generalist Rubrics Expert — $65/hr

We are sharing a specialised part-time consulting opportunity for experienced professionals with strong expertise in evaluation frameworks, quality standards, and rubric development. This role supports a fast-scaling AI quality evaluation initiative in the shopping domain , where experts help define and maintain high-quality standards for AI-generated outputs. Experts will apply structured judgment and domain expertise to evaluate outputs and contribute to the development of robust rubric systems that guide large-scale AI evaluation processes. Key Responsibilities Contribute to rubric development and evaluation frameworks for AI-generated outputs Apply expert judgment to assess whether outputs meet clearly defined quality standards Help establish evaluation guidelines and best practices during early project phases Provide structured feedback that strengthens the quality of AI-generated content Ensure consistency and reliability in evaluation processes across multiple tasks Ideal Profile Strong candidates may have: Prior experience working with Plato evaluation systems or similar rubric-based review frameworks Strong analytical thinking and ability to apply structured evaluation criteria Experience reviewing, grading, or evaluating complex outputs Ability to maintain consistency and quality across evaluation tasks Additional qualities include: High attention to detail Strong written communication skills Ability to work independently in a remote environment Engagement Details Pay: $130 per task Average time per task: ~1.5 hours Equivalent hourly rate: ~$65/hr Project structure: Initial 3-week sprint High likelihood of continued work depending on project needs and performance Early contributors may help shape evaluation standards as the project scales Why This Opportunity Join a fast-scaling AI evaluation project in its earliest stage Help define quality standards used across large-scale AI systems Work directly on rubric frameworks that guide AI evaluation processes Flexible remote work with competitive compensation Contract Details Independent contractor role Fully remote with flexible scheduling Weekly payments via Stripe or Wise Projects may be extended based on performance and program needs About the Platform This opportunity is available through a leading AI-driven work platform.