Looking For Contributors For LLM Response Annotation Dataset (research Project)

I’m a computer science student working on an independent research project studying how large language models respond to different prompt framings.

I’m building a dataset of annotated model responses and looking for a few contributors to help with labeling.

Task:

  • Read short LLM responses (2–5 lines)
  • Assign simple labels (agreement, reasoning quality, etc.)
  • No writing required, just structured selection

Setup:

  • Work is organized in small batches (50–100 samples at a time)
  • Clear rubric and examples provided
  • Focus is on consistency and quality

Contribution options:

  • You can contribute as a research collaborator and be acknowledged as an annotator in the paper
  • Alternatively, if you prefer not to be credited, a small payment per batch can be arranged

If you’re interested, comment and I’ll share a sample + details.

submitted by /u/lembodevil
[link] [comments]

Leave a Reply

Your email address will not be published. Required fields are marked *