The Domain Advisor Consultant (Subject Matter Expert) partners on advanced AI evaluation and training initiatives to define industry-specific standards for generative AI systems. This engagement focuses on establishing rigorous evaluation frameworks and curating benchmark examples that shape the reasoning accuracy and safety of large language models within specialized professional domains.
Responsibilities:
- Architect and review evaluation rubrics to ensure AI outputs meet expert-level professional standards
- Create, edit, and certify “golden” benchmark prompts and responses for model training
- Conduct expert gap analyses to identify logical failures, hallucinations, and reasoning errors
- Provide technical breakdowns explaining correct expert approaches to complex problems
- Advise on prompt complexity and rigor to ensure high-level model evaluation
- Deliver structured findings and recommendations under defined Statements of Work
Requirements:
- Advanced degree (PhD, MD, JD) or equivalent industry-recognized expertise
- Established independent consultant, freelancer, or academic leader status
- Demonstrated elite domain mastery within a specialized field
- Ability to clearly articulate complex reasoning processes in writing
- Professional autonomy with independent workflows and equipment
- Proper registration to operate as an independent contractor in country of residence
Benefits:
- Flexible, project-based engagement structure
- Opportunity to influence next-generation AI systems
- High-value intellectual consulting work
- Non-exclusive contracts allowing continued independent practice
This is a remote, business-to-business independent contractor engagement with defined scope, timelines, and compensation per assignment.