How To Store 175 Million Rows And Query Them

Hey! I have many Json files that equate to 175 million pieces of data, I’m unsure how to store them in a database, I’ll need to first create one big json file or loop through each or the files and move the data from them into a database.

I’ll need to do querys against the whole dataset multiples times a day so the quicker the better.

I’ve already experimented with mongodb but I just can’t see past the way querys are written.

Any ideas?

submitted by /u/ScottishVigilante
[link] [comments]

Leave a Reply

Your email address will not be published. Required fields are marked *