Hi fellows. I’m looking for datasets for construction and oil & gas industry project datasets. If someone can provide with or can guide, please reply.

Does anyone have good data sources for/datasets of art? I know that MoMA, Tate & Rijksmuseum have open databases and/or APIs, but I’m wondering if anyone knows of other institutions that make their data fully open. I’m looking specifically at artists and artworks (bonus points if the source focuses on sculptures, monuments, and memorials). Thank you!

The JFK assassination has been an unassailable mystery even after decades of investigations by premier agencies, the media, and ordinary people. A large-scale analysis of the assassination records may offer new clues, and help substantiate or refute some of the theories. There are about six million files related to the event that are to be made public through archives.org over time.

I am releasing JFK-TELL, a dataset I generated by extracting text from the scanned PDFs of the assassination records released until April 2025. The extraction was done with Google Gemini LLM API to generate Markdown text, using a very simple prompt. For detailed methodology, check out the Github repo.

I plan to index this data with a RAG system and analyze it later. In the meantime writers, journalists, computational linguists, and data scientists can try their hands on the breadth and variety of this data.

Hi everyone,
I have a CSV file where each row is a tweet, and each tweet has a user ID column (or username) and a text column. I’d like to create a separate .txt file for each user, with all their tweets combined in that file (one tweet per line).

Has anyone done this before? What’s the best way to do it in Python?

Any tips for cleaning up usernames or handling large datasets would also be appreciated. Thanks in advance!

Hi everyone,

I’m working on a school assignment where we need to find a dataset and build our project around a clear research question. We’re expected to analyze the data, draw meaningful insights, and potentially use forecasting or other analytical techniques.

We’re open to many different topics, but ideally we’re looking for a dataset that is: – Publicly available – Rich enough to support a research question (multiple variables, time series, etc.) – Related to areas like productivity, remote work, social behavior, or economics – but we’re open to other suggestions too!

If you know of any interesting datasets or sources that would be a good fit for a student research project, I’d really appreciate your help.

Thanks in advance!

Hi, are there any good datasets for estimating crime rates across different countries (esp European ones) between around 1980-2015? So far I know about ICVS, which is great and VERY thorough but a bit of a nightmare to aggregate across time, and the United Nations Office of Drug and Crime data, which is good but not available for more fine-grained crime types (e.g. larceny) and not from before 1993.

I tried looking on kaggle and roboflow. Most of what I saw was general plant diseases so a mix of things from tomatoes to trees. I’m specifically interested in turf grasses. Particularly warm season turf if anyone knows of any good labeled Datasets available whether that’s annotated for classification or detection. I’m not finding anything so far.

Hi everyone!

I’m an Electrical Engineering student, doing my final project in pairs on Animal communication.

We’ve been really stuck on trying to find a good dataset which is also available for free/for students/whatever

what we need is basically one of those things if possible:

1. (the most important one) a labeled dataset of some kind of animal, where each entry is an audio recording of a “call” of that animal.

so birds are the obvious choice but other animals are ok as well

1. a dataset of the animal above, but this time – “sentences”, so a few calls in one audio recording.

thanks a lot in advance!

Hi everyone,

I’m looking for any datasets, charts, or visualizations related to generational cohorts — specifically Boomers, Gen X, Millennials, Gen Z, Gen Alpha, and beyond. I’m interested in data that defines the boundaries of these generations (birth years), as well as comparative data on things like population size, education, income, digital habits, values, etc.

Has anyone here worked on or come across any well-structured data or compelling visualizations related to this? I’d really appreciate any guidance on where to find such data or if someone has already done a project on this.

Thanks in advance!

Bulk names emails phone numbers websites Prices as low as .06/lead on orders over 1,000,000 leads

.10/lead on orders under 500,000 leads

Hey all,

I am fairly new to this subreddit but I am endeavoring to create an API for grocery pricing data. The use case is to allow integration of the API into an application or even host a site myself that allows people to compare prices across stores and locations.

I have seen other posts similar in scope but many were a few years old and I have not seen any posts that fit the description of what I want to make. At first I would focus on big shopping brands to begin with and allow for location based tailoring. I have quite a bit of experience with APIs but am new to creating and managing large datasets. I have already scraped a bunch of data but I do not know the best way to get the data out or where to host the API when I get it fully functional. What would be the best way to do that?

Hi,

Where would I be able to access publicly available dataset that contains patient data, including smoking status, genetic markers, and the incidence of lung cancer? The patient would of course be anonymized.

I have search Kaggle but it only contains smoking and lung cancer data without any family history.

Thanks!

I’m looking to get grocery receipts from well-known Canadian grocery stores such as Walmart, Superstore, or similar for market research purposes. Ideally from BC, but I’m open to receipts from other locations in Canada as well.

Does anyone know where I can find these, or help me get them? Any help is greatly appreciated!

I’ve searched to corners but nothing came about at least even 2 years range worth of dataset.

I am looking for someone who can provide me with ESG ratings for certain ISINs in combination with certain dates, so that an analysis between different rating agencies “RepRisk versus others” can then be carried out. Is there anyone who is interested in working with me?

Hi everyone,

I’m looking for reliable and up-to-date sources for Turkish imports and exports data. Specifically, I need recent, detailed statistics covering trade volumes, product categories, and country-specific trade relationships.

I’ve checked basic sources like TurkStat (TÜİK) and some general reports, but I’m looking for more detailed, frequently updated, or alternative databases (free or paid).

Does anyone know good sources for:

• Detailed product-level trade data?
• Monthly or quarterly updates?

Any suggestions or experiences with specific resources would be greatly appreciated!

Thanks!

Are there any datasets which measure human vs robotized workers task completion efficiency in a manufacturing line? The only thing I’ve found so far is the Factory Worker Performance dataset on kaggle but its human focused and a little massive. Would there be anything more specific with robotized workers involved? Thank you in advance.

Emails phone number and more

My joinpoint shows an error every time I try to import data from an excel file. The error says: “You must have Excel (Office 2013 or later) installed on your machine to perform this action”. I have Microsoft 2021 so I don’t understand why it’s showing this. This has been the case since I downloaded Joinpoint. Could someone who has experience with using Joinpoint please guide what I should do to fix this error?

I’m looking for a dataset from the Netflix series “YOU” that includes details like episodes, seasons, characters, dialogue, and anything else related. Something like a script or structured metadata would be perfect.

Any idea where I can find this? Would really appreciate any leads or suggestions!

Anyone having access to VixCeleb2 dataset or any other dataset that could be used to train a lipsync model?

I am working on quite an ambitious research project related to the design of Linear Induction Motors (LIMs) specifically. It is about generating the shape of a LIM with some given constraints and/or performance targets (thrust, achieved speed, efficiency, etc).

I cannot give away too much information regarding the exact way that I will be using the data, but I am looking for a dataset that consists of 3D model files of LIMs and if possible, the level of performance metrics it is able to achieve on paper or in real world. I can make do without the latter part maybe, but desperately need the 3D model file samples of atleast some LIMs.

I tried searching for anything related in this subreddit, online, and on google datasets site but could not find anything helpful.

Anyone would be kind enough to point me in the right direction in my quest?

In short I need:

• 3D models of Linear Induction motors
• Calculated/simulated/real world performance of said motors

Hello,
I’m trying to get access to the full dataset from the Two Sigma: Using News to Predict Stock Movements Kaggle competition (it ended a while back and the data is no longer officially available).

I’ve found a small sample, but it’s way too limited for any real analysis or model training.

If anyone still has the full dataset files and would be willing to share or point me in the right direction, I’d be super grateful!

Thanks in advance!

Does anyone know where can I get the dataset of OCT images for coronary artery calcification segmentation?

I need datasets classification for face shape and eyebrow shape/thickness… Do you have any idea where I can get it? Thanks in advance!

All the ones I’ve found of kaggle have expired links

Is there anywhere I can find a dataset for the most popular songs on Spotify in a particular year, for example, 2024? Something like this: https://www.kaggle.com/datasets/sveta151/spotify-top-chart-songs-2022 , with several variables such as length of the song and scores for characteristics like danceability and energy. I need the dataset to have a license that allows use in a data analytics project (it’s for a presentation in university), without profiting from it.

I’m curious if anyone knows of datasets that have average rents by zip code for US metropolitan areas, specifically Los Angeles. Month-to-month data would be fantastic, but quarterly or yearly data would also suffice. If my best bet is to scrape, any advice on that process?

I am currently working on my Data Analytics Master’s dissertation under the name of « The Use of Data Analytics in Criminal Profiling and Predicting Behavioral Patterns of Violent Offenders » with 2 questions « Q1: What are the key behavioral patterns among violent offenders based on data analytics, Q2: Can machine learning be used to predict the likelihood of recidivism among violent offenders? » I want to find a dataset to work on for this, that would ideally contain real data of criminals with information about them , but I could not find anywhere.. any ideas?

Hi all. I am looking to do a suitability analysis map for a GIS class and map the safest and most efficient supply routes for military, humanitarian aid, and logistics operations in Yemen (specifically the city of Sanaa) while minimizing exposure to Houthi attack zones (based on past conflicts).

I am pretty new to this, so I was looking for help as to where I could find these data sets? Im okay with vector or raster.