Need Urgent Help Merging MIMIC-IV CSV Files For ML Project

Hi everyone,

We’re working on a machine learning project using the MIMIC-IV dataset, but we’re struggling to merge the CSV files into a single dataset. The issue is that the zip file is 9GB, and we don’t have enough processing power to efficiently join the tables.

Since MIMIC-IV follows a relational structure, we’re unsure about the best way to merge tables like patients, admissions, diagnoses, procedures, etc. while keeping relationships intact.

Has anyone successfully processed MIMIC-IV under similar constraints? Would SQLite, Dask, or any cloud-based solution be a good alternative? Any sample queries, scripts, or lightweight processing strategies would be a huge help.

We need this urgently, so any quick guidance would be amazing. Thanks in advance!