I spent the last year gathering as much Usenet text data as possible from a large variety of resources and including from about 7000 live active servers as well to fill in gaps.
The end result is a searchable/filterable dataset acessible via web+api (free and paid options)
API : https://www.usenet-rewind.com/api-docs
Web: https://www.usenet-rewind.com
Binaries have been filtered out and range is from posts from 1981-Current and constantly populating. the site includes a histogram of distribution of message counts per year.
I welcome feedback or possible use cases. Built on Apache Solr 10, Mariadb 12 (rocksdb) and NVME disk hardware for fastest operation.
[self-promotion] [free] [paid]
submitted by /u/cstadler18
[link] [comments]
