Academic Experts for LLM Evaluation
Pangeanic is recruiting contributors with advanced academic expertise to create challenging question-and-answer pairs for the training and evaluation of large language models. The job is fully remote / Work from home / Worldwide remote
Create expert level evaluation data for advanced AI systems
The task involves writing difficult question and answer pairs in your academic field. The questions should require substantial subject knowledge and should expose limitations in the answers produced by current AI models.
Your work will contribute to the training, testing and evaluation of large language models. All tasks will be completed in English through the client’s online platform.
Areas currently required
Candidate profile
- Master’s degree or PhD in one of the listed academic fields.
- Advanced written English.
- Ability to write precise, difficult and academically rigorous questions.
- Availability to begin at short notice.
- Willingness to work through the client’s online platform.
- Ability to provide a copy of the relevant degree certificate before starting.
Apply for this LLM evaluation project
Include your academic field, hourly rate, and availability. A copy of your degree certificate will be required before the project begins.