Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

Movies That Were Added On Streaming Services

Hey,

I’m building my own dataset about movies that were added later on streaming services (like Netflix, Hulu, Disney+, etc). I’ve found some useful datasets in Kaggle that include the date which a specific movie was added on Netflix, for example. I need to find the dates for other movies I have in my dataset, in all other streaming services which those movies were added on. Does anyone have any idea where can I find it? When I search a specific movie in Amazon Prime, for example, I don’t find the date in which it was added on their platform.

Thanks.

submitted by /u/Porcoddio45
[link] [comments]

Paid Product Discovery Call – Dataset Procurement Protocol

Hey all!

I am building a data procurement protocol to make it easier for researchers to access proprietary datasets. We’re in the end stages of designing the UI/UX and are looking for more data points regarding pain points in the dataset procurement process. We’re offering $25 USD to anyone who can spare 15 minutes to talk about their experiences purchasing proprietary datasets. Some of the questions to expect include “Can you walk me through your typical data procurement process from identifying a need to acquiring the data?” and “Are there any specific improvements or innovations you’re hoping to implement in your data sourcing approach?”

Send me a DM if you’re interested and I’ll send you a calendly to pick a time!

submitted by /u/EmetResearch
[link] [comments]

Hello, I’m New To Datasets And Would Like To See Whether It’s Possible To Filter A Dataset From Huggingface Before Downloading It.

Hello everyone. I’m currently trying to find a more or less complete corpus of data that is completely public domain or under a free software / culture license. Something like a bundle of Wikipedia, Stack Overflow, the Gutenberg Project, and maybe some GitHub repositories for good measure. And I found RedPajama is painfully close to that, but not quite:

It includes the Common Crawl and C4 datasets, which are decidedly not completely open-source. It includes the Arxiv dataset, which might work for my purposes, but it includes both open-source and proprietary-licensed papers, so it would need filtering before I proceed. And it had to drop the Gutenberg dataset parser because of issues with it accidentally fetching copyrighted content (!!)

So, what I would like to do with RedPajama is:

Fetching Wikipedia, like usual, but also add other Wiki-projects like Wikinews and Wiktionary, and languages other than English, for completion purposes (as we’re ditching C4) Fetching more of the Stack Overflow data to compensate for the lack of C4 Fixing the Gutenberg parser so it can actually download the public-domain books from there. Alternately, download the Wikibooks dataset instead Filtering the Arxiv dataset to remove anything not under a public-domain, CC-By, or CC-By-SA license, preferably before downloading each individual paper

Is it possible to do that as a Huggingface script, or do I need to execute some manual pruning after downloading the entire RedPajama dataset instead?

submitted by /u/csolisr
[link] [comments]

Multimodal Terror Propaganda Repository Research

Looking for data on terror propaganda, Ideally multimodal e.g. social media image video audio text or others. Should be recent and ideally have a time component. The specific group behind the content is not that relevant, the more the better. There is a number of issues regarding this type of data. But as i am getting desperate i am greatful for what ever. Am looking to run some ML models for sentiment clasification tasks so need a few thousand observations. Cheers!

submitted by /u/SixMight
[link] [comments]

Looking For Options To Curate Or Download A Precurated Dataset Of Pubmed Articles On Evidence Based Drug Repositioning

To be clear, I am not looking for articles on the topic of drug repositioning, but articles that contain evidence of different drugs (for example, metformin in one case) having the potential to be repurposed for a disease other than its primary known mechanism of action or target disease (for example. metformin for Alzheimer’s). I need to be able to curate or download a dataset already curated like this. Any leads? Please help!

So far, I have found multiple ways I can curate such a database, using available API or Entrez etc. Thats good but before I put in the effort, I want to make sure there is no other way, like a dataset already curated for this purpose on kaggle or something.

For context, I am creating a RAG/LLM model that would understand connections between drugs and diseases other than the target ones.

submitted by /u/LukewarmTakesOnly
[link] [comments]

Looking For Data On Drone Delivery For Retail For A Research Project

Hey everyone,

I’m working on a research project looking into the feasibility of drones in retail delivery, and I’d really appreciate any help you could offer! My focus is mainly on a few key areas, including:

The cost-effectiveness of drone delivery How drone battery life has improved over time Changes in delivery times for drones over the past few years The number of users or corporations adopting drone delivery

That said, I’m open to any other data sets related to retail drone delivery! I’ve already looked through data sources such as AWS, Kaggle, and went through all 12 pages of Google, but I struggled to find much relevant data. The biggest challenge I’ve been facing is finding data on the costs of drone delivery and their trends, especially since many companies keep that info private.

If anyone has any data sets or knows of websites that offer this kind of data, I’d really appreciate it! Ideally, I’m looking for CSV or XLSX files, but honestly, I’m happy with any format.

Thanks so much in advance!

submitted by /u/gapple_quagsire
[link] [comments]

Just Uploaded Multiple High-Quality Datasets On Kaggle! 🚀 | IMDB, Spotify, Reddit, Air & Water Quality

Hey r/datasets

I’ve recently uploaded several diverse and high-quality datasets on Kaggle, perfect for EDA, machine learning, data visualization, and predictive modeling! If you’re looking for real-world datasets to work with, check these out:

📌 IMDB Movies Dataset 🎬

📌 Spotify Music Dataset 🎵

📌 Reddit r/todayilearned (TIL) Dataset 📜

📌 Air Quality Monitoring Dataset 🌍

📌 England Water Quality Dataset 💧

📥 Explore & Download the Datasets Here: https://www.kaggle.com/krishnanshverma/datasets

If you use any of these datasets in a project, I’d love to hear about it! Also, upvotes and feedback would be greatly appreciated to help more people discover these resources. 🚀🔥

#Kaggle #MachineLearning #DataScience #DataAnalysis #AI #BigData #OpenData

submitted by /u/krishnanshxx
[link] [comments]

Seeking Data On Children With Incarcerated Parents For A Visualization Project

Hello,

I come to you humbly! I run a small company that’s hell-bent on making a difference in the lives of children who have or had an incarcerated parent. We’re working on a project to raise awareness of the challenges these children face through data-driven storytelling and visualizations.

I’m looking for reliable datasets related to:

The number of children with incarcerated parents (preferably broken down by state or region) Demographic information (age, race, socioeconomic status) Outcomes related to education, mental health, or other relevant indicators for these children

We’ve hit multiple roadblocks in our search so far. Many schools either aren’t capturing this data because it’s not seen as a priority, or they simply don’t have the capacity to track it. If anyone knows of publicly available data sources—government reports, research studies, or anything similar—I’d be incredibly grateful for your help. This data will help inform our advocacy efforts and inspire real change.

Thanks in advance for your time and suggestions!

submitted by /u/marrthecreator
[link] [comments]

NSCH Dataset/Codebook Request 2018-2022

I’m not quite sure if this is the right place to ask for this. I’m trying to work on a project using data from the National Survey Of Children’s Health.

I was hoping someone on here would have the 2018-2022 topical data available, as well as the codebooks in SAS.

Please let me know if you’re able to share this or redirect me. They’re no longer on the website to download and I am unsure what to do.

submitted by /u/mathduckie
[link] [comments]

Looking For Kaggle Jane Street Datasets

I am trying to change my career path back to a quant researcher after a decade of being in a different field (PhD and post PhD career has been in biotech). I wasn’t a quant for a very long time either. Thus I feel like I need to rebuild my quant portfolio – and I felt Kaggle competitions would be a good way to do that. As luck would have it, the current Jane Street competition isn’t allowing new entrants and the older one doesn’t have the data available any longer.

Is there a way to access the data of the JS competitions – either the new one or the old one?

Any help is much appreciated.

submitted by /u/Electrical_Medium666
[link] [comments]

Anyone Have NSCH Datasets From 2016-2023??

Hi everyone, this is kind of a long shot but I really need the National Survey of Children’s Health datasets from 2016-2023. I am writing a thesis-type paper for my Master’s program and after working really hard on my proposal, I go to download the data from the US Census Bureau and realize it’s all gone. Not sure if this is because of executive orders but I can’t find the data ANYWHERE. So if anyone has the micro data files downloaded for NSCH any years between 2016-2023 and would be willing to email them to me I would be so appreciative!!

submitted by /u/Box-Unique
[link] [comments]

Open Dataset Of 1500 Driving/collision Videos [self-promotion]

Nexar just released an open dataset of 1500 anonymized driving videos—collisions, near-collisions, and normal scenarios—on Hugging Face (MIT licensed for open access). It’s useful for research in autonomous driving and collision prediction.

There’s also a Kaggle competition to build a collision prediction model—running until May 4th, results will be featured in CVPR 2025.

Regardless of the competition, I think the dataset by itself carries great value for anyone in this field. If you’re interested in the details, feel free to ask or reach out!

Disclaimer: I work at Nexar. Regardless, I believe a completely open and free dataset of labeled anonymized driving videos is helpful to the community.

submitted by /u/ricardo03_c
[link] [comments]

How Can I Access IPUMS .CSV Data Using Python?

Hello. I’ve been trying to access an IPUMS (.CSV) data using Python, but it’s not letting me. I would like to view the first 1000 rows of data and all columns (independent variables).

So far, I have this:

import readers

import pandas as pd

import requests

print(“Pandas version:”, pd.version) print(“Requests version:”, requests.version)

ddi = readers.read_ipums_ddi(r”C:UsersjennyDownloadsusa_00003.xml”) ipums_df = readers.read_microdata(ddi, r”C:UsersjennyDownloadsusa_00003.csv.gz”)

iter_microdata = readers.read_microdata_chunked(ddi, chunksize=1000)

df = next(iter_microdata)

What am I doing wrong?

submitted by /u/jenny-0515
[link] [comments]