Working With Public Scraped Datasets Is Actually Soul Crushing

Im trying to put together a clean corpus for an ai reasoning test right now (mostly to distract myself from how badly im doing at my driving school lessons this week tbh) and I downloaded this massive “pre-cleaned” open-source corporate registry dataset

The data hygiene is just offensively bad. half the rows are misaligned and the contact columns are filled with literal regex nightmares and placeholder junk. I ended up having to pipe the whole thing through mail tester just to strip out the dead syntax and fake emails so my script wouldn’t crash every five seconds

why do people upload these 10GB csv files to github without doing even basic sanitization first? my laptop fan is literally screaming right now.