Building A Multi-source Feminism Corpus (France–Québec) – Need Advice On APIs & Automation

Hi,

I’m prototyping a PhD project on feminist discourse in France & Québec. Goal: build a multi-source corpus (academic APIs, activist blogs, publishers, media feeds, Reddit testimonies).

Already tested:

  • Sources: OpenAlex, Crossref, HAL, OpenEdition, WordPress JSON, RSS feeds, GDELT, Reddit JSON, Gallica/BANQ.
  • Scripts: Google Apps Script + Python (Colab).

Main problems:

  1. APIs stop ~5 years back (need 10–20 yrs).
  2. Formats are all over (DOI, JSON, RSS, PDFs).
  3. Free automation without servers (Sheets + GitHub Actions?).

Looking for:

  • Examples of pipelines combining APIs/RSS/archives.
  • Tips on Pushshift/Wayback for historical Reddit/web.
  • Open-source workflows for deduplication + archiving.

Any input (scripts, repos, past experience) 🙏.

submitted by /u/Commercial-Soil5974
[link] [comments]

Leave a Reply

Your email address will not be published. Required fields are marked *