Hope this is the right place, and apologies if this is a stupid question. I am trying to scrape the congressional bioguide to gather information on historic members of congress, namely their political parties and death date. Every entry has a nice json version like https:\/\/bioguide.congress.gov\/search\/bio\/R000606.json<\/a>, which would be very easy to work with if I could get to it… I tried using the official Congress.gov API, but that doesn’t seem to have information on historic legislators past the late 20th-century.<\/p>\n I have found the existing congress-legislators dataset https:\/\/github.com\/unitedstates\/congress-legislators<\/a> on GitHub, but the political parties in their YAML file don’t always line up with those listed in the BioGuide, so I’d prefer to make my own dataset from the bioguide information. <\/p>\n Is there any way to scrape the json or bioguide text? I am hitting 403s whatever I try. It seems that people have somehow scraped and parsed the bioguide entries in the past, but that may no longer be possible? Thanks for any help.<\/p>\n<\/div>\n submitted by \/u\/Emotional-Heart948 <\/a>
[link]<\/a><\/span> [comments]<\/a><\/span><\/p>
