I have coordinates within the USA. Ideally trying to recreate this at scale: https://screencapturePL.tinytake.com/msc/MTA1NjIxMjlfMjQyNjM2MTU

But a poor man on a budget. This data is commonly freely available at the state DOT level for small roads. For highways and national routes you can get it from USDOT sources.

Any and all advice?

Hello everyone, I want to share with you this dataset that contains the inflation record from 1960 to 2023 country by country, I hope it can be useful for your project. Kaggle Link -> https://www.kaggle.com/datasets/fredericksalazar/global-inflation-rate-1960-present

I’ve been looking for a dataset for the Lewis and Clark expedition, specifically the National Historic trail that is a federal designation. I can only find it represented online in interactive maps that don’t allow downloads. Any help is appreciated!

Hey Reddit! 👋

With the PGA season heating up, we’re giving away 90 days of free access to our PGA API to the first 20 people who sign up by Sunday, February 9th. This isn’t a sales pitch—there’s no commitment, no credit card required—just an opportunity for those of you who love building, experimenting, and exploring with sports data.

Here’s what you’ll get access to:

Real-time tournament stats Past tournament stats Season schedules, golfer information + more

Curious about the API? You can check out the full documentation here: PGA API Documentation

We know there are tons of creative developers, analysts, and data enthusiasts here on Reddit who can do amazing things with access to this kind of data, and we’d love to see what you come up with. Whether you’re building an app, testing a project, or just curious to explore, this is for you.

If you’re interested, join our discord to sign up – just let us know you’re joining for PGA data! Spots are limited to the first 20, so don’t wait too long!

We’re really excited to see how you’ll use this. If you have any questions, feel free to ask in the comments or DM us.

Looking for a collection from various instrumentation suppliers (ie: Aesculap, Zimmer, Integra, etc)
That minimally contains
Instrument Name, Supplier, & Catalog Number

Hi,

Navigating the complexities of dataset acquisition for my PhD research has proven challenging, particularly with the VGGSound dataset. Despite my extensive efforts, I’ve encountered significant roadblocks in downloading the required audio files. While the GitHub repository speedyseal/audiosetdl suggests a straightforward download method with the command python download_audioset.py, both for VGGSound and audioSet, the actual video retrieval has been thwarted by unavailable resources. Ironically, recent ICLR 2024 publications reference this dataset.

If anyone can help, that would be awesome. Thanks

Hi, I want to share this dataset that I had created y published in Kaggle, contain all the record of population from 1960 to 2023 country by country, I wait that you can use in your projects, here the Kaggle link -> https://www.kaggle.com/datasets/fredericksalazar/population-world-since-1960-to-2021

Hey there! We’re working on annotating a significant dataset of approximately 180M photography images complete with Exif and geolocation data and are exploring popular benchmarks in order to showcase the datasets value. What benchmarks would be helpful for the community in terms of showing the relative value of the dataset vs others? If you’re interested, here’s a sample of the dataset.

Hi everyone,

I’m a high school student working on my AP Research project, and I’m running into some issues with data collection that I could really use help with. My study focuses on analyzing how Reddit-driven stock recommendations impact long-term investment decisions. I’m specifically looking at subreddits like r/wallstreetbets, r/stock, r/investing, and r/SecurityAnalysis to track sentiment around different stocks and see if that sentiment can predict stock performance over time.

I had originally planned to use the Pushshift API to collect historical Reddit data, but with Reddit’s recent API changes, Pushshift no longer works. Since I’m pretty new to programming and APIs, I’m not sure what the best alternative is. I’ve tried looking into PRAW, but I’m concerned about its limitations when it comes to accessing older posts.

Here’s what I need:

A reliable way to collect historical Reddit posts (from 2022 to 2025 if possible). Advice on whether PRAW can handle this, or if there’s another tool or method I should use. Suggestions for workarounds or public datasets that might help with historical Reddit data.

Since this is part of a project I hope to eventually publish, I’m really eager to find a solution. I’d love any advice, resources, or guidance you can offer, especially considering I’m new to this and learning as I go.

Here’s a link to my original methodology plan if it helps clear up some questions. Feel free to add coments to the document!

Methodology Plan

Hello! I’m new to researching and came across the NOAA Onestop, but I have no idea how to get the data I want from the metadata. It looks like a bunch of code to me.

https://data.noaa.gov/onestop/collections/details/dbed0210-f838-4c40-b1f3-b5300d53f6ce

Is there any way I can format the metadata into charts and info I can use? Thanks in advance!

Where is the cheapest place to purchase data for bank analytics? I am a data analyst for a small bank and wanted to do some analytics to be impressive. Where can I get data that would be super helpful and relevant to the executives of the bank?

Does anyone have a copy of the experimental data product that was previously hosted here: Trade by Industry and Product Statistics (TIPS)

The 4 excel files for 21/22 import and exports have not been restored to the site yet. Thank you!

I am excited to share Synthetic Emotions, a dataset featuring AI-generated videos of individuals expressing different emotions, including happiness, anger, sadness, fear, surprise, disgust, love, confusion, and more.

This dataset was created using OpenAI Sora and consists of 100 short videos, each 5 seconds long, 480p resolution, 9:16 aspect ratio, and generated in one-shot to ensure consistency. The dataset covers a diverse range of ethnicities and demographics to provide a balanced representation of human emotions.

Key Details:

Video Duration: 5 seconds Resolution: 480p Aspect Ratio: 9:16 Generation Mode: One-shot using OpenAI Sora Total Videos: 100 Emotion Categories (10 total): Happiness and Joy, Anger, Sadness, Fear, Surprise, Disgust, Love and Affection, Confusion, Neutral/Everyday, Mixed Emotions

Potential Applications:

Emotion Recognition Research Affective Computing & AI-Human Interaction Synthetic Video Data Exploration

If you are working in emotion recognition, AI-human interaction, or affective computing, or are simply interested in how AI-generated human emotions compare to real-world expressions, this dataset may be useful.

The dataset is available on Hugging Face:
🔗 https://huggingface.co/datasets/aadityaubhat/synthetic-emotions

Hi all, I want to share this dataset that I had created, contains all countries inflation rate of 1960 to 2023, I wait that you can use it in your projects,

https://www.kaggle.com/datasets/fredericksalazar/global-inflation-rate-1960-present

Hey, I am currently preparing my master thesis experiment and was looking for datasets. My experiment will use LLMs as baseline with different RAG variations. Data contamination is a big topic for LLMs, because if the LLM has already been trained on the data I want use, then the whole experiment is pointless. The dataset I found on zenodo.org is for vulnerability detection.

Public and readable datasets are problematic, but what’s about downloadable datasets that do not have a preview on its side?

Should I be worried ?

Hi all,

I’m helping a client evaluate a list of various data providers, but can’t quite seem to get a demo with some of these companies. It’s likely because their qualification process vets me out.

Is anyone willing to share the pricing of RavenPack’s products (like their sentiment analysis) the quality of their data?

If you have experience with other data providers, would love to learn about your experience with them as well.

Thanks in advance!

Hi everyone,

I am in need of a dataset that shows data about eco-home owners**.**

Definition of eco-home: “An eco-home, or eco-house, is a home built to have a minimal impact on the environment. Eco-homes are designed to use less energy, reduce waste, and conserve water.”

Does anyone know where I could potentially find something like this? I am at a dead end and have procrastinating badly due to being unable to find a data source for this niche.

Thanks so much.

*Edit: data around LEED-certified homes would work too

I am looking for a video dataset containing CCTV recordings of smoke/fire in buildings. My project aims to detect smoke and fire in the office buildings, factories and etc. I’ve already searched every video on YouTube, Archive org, etc. Any help would be appreciated, thanks.

I prepared “Datasets” repo which contains data sources of diverse topics, i.e., from Legal cases, health, sports, transport, finance, company filings etc., along with links to open data portals, data dumps. Feel free to contribute and share.

It will be useful for data collection. Repo here.

So I am reading a lot about evolution and for a big part, that’s about genes. I’m now a few books down, so I can kind of confidently talk about those subjects now, but the thing is that I have never ever worked with or even explored genetic data. Mind you, I am a data scientist. As a hobby project, I want to explore some genetic datasets. Does anyone know of any good a freely available resources, or could someone tell me a little about the different types of genetic data?

Hi! I’ve done quite a bit of research trying to find datasets that fit the description above. Essentially, I’m working on an AI that can upscale 180-degree VR videos, preferably they’d be SBS. As a bit of a side project, I’d also like to work on an AI that has only one eye’s view as an input, and the other as an output. Essentially turning a 2D video into a 3D SBS video. Any help/leads would be appreciated. Thank you!

So, I’m trying to do research on whether one should be an independent contractor or an employee. This includes benefits, pay, work/life balance and a bunch of other stats. Do you know of any good secondary sources that can help me research this and do you have any advice on how to make my own survey (the survey doesn’t have to be on reddit)?

Also, if you know a good sub to ask this in, go ahead and point that out.

I’m working on building a comprehensive travel spreadsheet and I have a section that contains a lot of airport data. I’m currently trying to find a comprehensive list of annual passenger traffic and if the airport is a domestic, regional, international, etc. I Ideally want to be able to pull data from IATA directly, but I can’t seem to find a good way to do that. I’ve been searching through GitHub and I haven’t found a dataset that contains this information yet. I am open to adding more info to the spreadsheet, so if you have any other good data sources to check out regarding airports that would be great too!

Hey all,

I hope this is the right forum, but I am kind of new to all of this.

I am looking for a news API (doesn’t really matter which type of API) which goes back to at least 2000.
Can be from one big (NYT or so source), but the more sources it covers the better. Must include financial news (but doesnt have to be limited to that)
Doesn’t have to be free (sure, the less the better)

I found a couple, but none of them goes further than let’s say the past 5 years.

Any help?

Cheers 🙂

Edit: with financial news I don’t necessarily mean it very specific. Let’s say the API just Covers different newspaper, which have a financial section, that would be enough

If I webscraped data from a website that ‘surveys’ users to populate their database, then publicly displays it for users to see without any paywall or sign up required, can I freely post and use this data as I please? I would like to make it publicly available, but I don’t want to infringe on anything while doing so.

My end goal would be to just post it on kaggle for public use as well as do some analysis viewable in some sort of website or dashboard

Hi, CDC took down the YRBS dataset and the BRFSS dataset. Does anyone backup those most updated 2023 dataset and being willing to share? Thanks!

Hi everyone,

Hope you’re all well, I’m in the early stages of designing a PhD project and hope to work with linked large datasets to evaluate mental healthcare in prison and forensic settings, and evaluate economic aspects and effectiveness of care. I’m hoping to base this work on linked datasets. So far I’ve been reading about the solutions for missing data, and been surprised at the number of theories. Really interesting stuff!

If anyone has any suggestions for how to approach this topic, or ideas for methods , resources, books, YouTube and general thoughts please these would all be really appreciated. I’m literally starting from scratch with the stats knowledge so grateful for any suggestions,

I see this as part of the background work rather than requesting anything unscrupulous!

Thank you in advance

I’ve seen this for football a while back. Perhaps there’s something here?