15 Million Websites With Historical Data – What Do You Want To Know?

Hey y’all,

I’m Luke, and I built Stackra for some context. Not selling a ding o dang thing here, just looking to see what this dataset is really capable of.

The corpus is 15 million sites pulled from HTTP, CommonCrawl, CrUX, and Overture.

I have a few thousand elements mapped out, like analytics, tools, vendors, link value, site category, schema, plugins, you name it. It runs back to 2024, and I’ve started putting some of this data user facing.

I find things like being able to identify that the market for funeral homes is dominated by two vendors, that I can identify site directories and their value/trajectory, that custom built websites pass CVW at a higher rate than WP, but rarely crack the top rankings without investor backing.

Weird little stuff like an emulator site that has been highjacked by porn/gambling sites. A popular listing tool that claims their links provide DR, but are explicitly UTM and nofollow. Pinpointing an ICP for a small business from clustering shared linked domains.

I’m curious to see what it can do, what would you want to ask?