Every US healthcare provider has an NPI, and CMS publishes the whole registry as a bulk file. It’s public, but it ships as a multi-million-row monster with taxonomy codes instead of job titles, no category labels and no dedupe, so most people bounce off it.
I mapped the taxonomy codes to 290 plain-English profession labels across 14 sectors, normalized the addresses and deduped it. 9,270,029 rows. Per row: name, full mailing address, profession, the federal source it came from, and the date it was last rebuilt.
A few things I learned doing it:
- The state column has 124 distinct values, not 50. Military post codes (AE/AP/AA), foreign provinces, and genuine junk like “ZZ” and “–” with one row each. 99.947% are real US codes.
- “Medical (Other)” isn’t an unclassified bucket — it’s 258 real professions, led by Nurse Practitioner (498k), Pharmacist (326k) and Registered Nurse (296k).
- Ratings exist on only ~33,000 of 9.5M rows (CMS-rated facilities only), so they’re useless as a feature. I stopped advertising them.
Source files: NPPES/NPI, CMS, plus NCES for schools and FDIC for banks. All US government works, so public domain under 17 U.S.C. §105.
Happy to send a free 1,000-row sample to anyone who wants to look at the structure — comment or DM. Sourcing writeup is at procureadjacent.com/data-sourcing if you want the provenance detail.
submitted by /u/ac3boy
[link] [comments]