15,908 Answers From 378 AI Models To The Same 87 Prompts, May 2024 To Now (CC BY 4.0)

Since May 2024 every new model got the same prompts: draw a pelican on a bicycle as an SVG, build a landing page in one HTML file, tell five jokes, pick a favourite film, 87 in all. One attempt each, no system prompt, temp 0.7. I kept every answer, and it’s now a dataset:

  • JSON Lines, one file per question, plus models and questions
  • SVG drawings as given, HTML pages with a 1280×800 screenshot each, image and audio answers as files
  • release dates, and which of the 378 models are retired (101 aren’t served on OpenRouter anymore)
  • CC BY 4.0, DOI 10.5281/zenodo.23305275

GitHub: https://github.com/museumofmodels/collection Zenodo: https://doi.org/10.5281/zenodo.23305275 Browse it: https://museumofmodels.com

Nothing is scored, it’s just the raw answers. Happy to hear what would make it more useful.

Disclosure: I made the museum and the dataset.

submitted by /u/sirjoaco
[link] [comments]

Leave a Reply

Your email address will not be published. Required fields are marked *