Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

Looking For Owner-occupied Housing By ZIP Code (USA)

I’ve been searching for a reliable data set showing owner-occupied housing numbers by ZIP code in the US. I’ve found several data sets from HUD and the Census Bureau, but so far I’ve not found these numbers, at least broken down by ZIP code. Has anyone else found a reliable source for such data? Thanks in advance.

submitted by /u/tdmitch
[link] [comments]

Need Dataset For The Final Project ..

I need to make a Ai/ML final project for my course, the deadline is for 2 weeks and i have decided to go with personalised learning pathways…. therefore i need for the same so that i can make the project and also some feedback would be good , about is this a good project . If not then , please tell me some ideas or share resources for another idea…but yeh please share the dataset

submitted by /u/Pristine_Rough_6371
[link] [comments]

Looking For A Labeled Water Quality Anomaly Dataset

Hi good people,

I’m currently working on a project focused on anomaly detection in water quality and am on the lookout for a labeled dataset that include labeled instances of abnormal water quality conditions.

If anyone has come across or worked with such datasets, I’d greatly appreciate it if you could share a link or point me in the right direction.

Any help is much appreciated!

submitted by /u/evonshahriar
[link] [comments]

Has Anyone Used The Health And Retirement Study 2016

I was doing a project using the Health and Retirement Study (HRS) but it turns out the years I wanted to use would not work but 2016 would. The data is downloading as a .dat file which means that it is not possible to open. Has anyone ever used it in the past before it was converted to a .dat file. I need to make this change in 24 hours and have spent the last few months trying to clean the other data I thought I needed. Now I need to make this switch.

submitted by /u/Rajah_1994
[link] [comments]

Looking For Datasets On The May 6, 2010 Flash Crash

Hi everyone!

I’m a student working on a research project about the 2010 Flash Crash. My focus is on understanding how algorithmic trading and market infrastructure contributed to the event.

I’m searching for historical datasets that capture intraday trading activity on May 6, 2010, particularly for key indices (Dow Jones Industrial Average, S&P 500, and Nasdaq Composite Index) and other heavily impacted individual equities. Ideally, i’m looking for tick-level or minute-by-minute data, but i’m open to aggregated datasets as well.

Also any pointers to how I can obtain this data is appreciated!

Thanks in advance!

submitted by /u/FunTax2689
[link] [comments]

Looking For DATA Sets Sites And Sources

Hello everyone,

I am currently working on module as part of my artificial intelligence course in the university, and my task is to develop a module which find correlation connection chronical diseases with ECG and blood test recordings.
I am currently struggling to find the right data sets and recordings on PhysioNet and on Kaggle.
Can you direct to me more websites contain data bases or even specific data sets?

Thanks.

submitted by /u/The_Eliyahu
[link] [comments]

Need Help Retrieving Parcel Data Set

I’m trying to download the parcel data set from the following public website:

https://gishub-beltramicounty.hub.arcgis.com/datasets/BeltramiCounty::tax-parcels/about

But it seems to keep failing out and not being able to create the download. i’ve tried this on multiple computers for several different internet connections and haven’t been able to get this to work.

Does anyone know what I’m missing here? Or do i just need to email the county and ask for the file directly?

Thank you!

submitted by /u/cptncivil
[link] [comments]

Looking For Dataset For My Project Due To Next Week

Hello everyone, this is my first time posting in here and I’m really really in need of heart beat, geroscope, thermometer,

My project is about detecting phobia specifically agoraphobia using ML and AI yet I couldn’t find any dataset for it or any kind of data related to stress and it’s too late for me to back off and change the topic

I’m begging you, if you can help me please dont hesitate I am desperate and I dont know what to do

submitted by /u/Revolutionary_Bat94
[link] [comments]

Weight And Height Of People In One Country Over Time

People used to be small. And now they are taller and have a heavier BMI. But i wonder what the increase of just weight (mass) over time looks like. Theres data for BMI in ourworldindata and gapminder. But not raw
average mass eg of men in France 1900 60kg, 1920 65kg 1940 70kg etc type data.
The separated out heights and weights that make up BMI.

Do you know a dataset like this?
This wikipedia page links to individual government sites but searching for German data if you are not german is really hard https://en.wikipedia.org/wiki/Human_body_weight

BMI but not height and weight separated https://w3.unece.org/PXWeb2015/pxweb/en/STAT/STAT__30-GE__06-Health/006_en_GEHEWeight_r.px/table/tableViewLayout1/

https://www.gapminder.org/fw/world-health-chart/
Heght and weight but not with by historical time https://www.kaggle.com/datasets/burnoutminer/heights-and-weights-dataset
3 recent years but not a long view https://data.gov.ie/dataset/his53-average-weight
Does the us army have data on the people it takes in each year? That would do it.

submitted by /u/cavedave
[link] [comments]

Explore The Minerals Yearbook Dataset For Africa & Middle East

Hi everyone

I’ve just uploaded an exciting dataset to Kaggle that could be a game-changer for researchers, data analysts, and anyone interested in the mineral industry of Africa and the Middle East. 🪨💎

🔍 What’s in the Dataset ?

The dataset is sourced from the USGS Minerals Yearbook and includes:

• 📈 Annual data on mineral commodities across various countries.

• 🏛️ Information on government policies, environmental issues, and trade.

• 🏗️ Insights into industry structure, commodity developments, and infrastructure.

• 📊 XLS files organized by country and year for easy analysis.

This dataset offers a treasure trove of information to analyze trends, explore economic impacts, or even build machine learning models for predictive insights. 🚀

📜 Source and Collection

Source: USGS National Minerals Information Center.

Methodology: Data was collected using Scrapy and Selenium to handle dynamic content, ensuring a complete and accurate dataset.

Disclaimer: The dataset is for educational and research purposes only. It’s not affiliated with or endorsed by USGS.

🔗 Explore Now

You can access the dataset here: https://www.kaggle.com/datasets/amaboh/africa-and-the-middle-east-minerals-dataset/data

(Feel free to upvote if you find it helpful! 👍)

💡 Why Check This Out?

Whether you’re into:

Data Science 🧑‍💻: Test algorithms on real-world data.

Economics & Policy 📚: Analyze the role of minerals in regional economies.

Geography 🌍: Understand spatial trends in mineral production.

Environmental Studies 🌱: Dive into the impact of mining on the environment.

There’s something here for everyone!

🙌 Let’s Collaborate

I’d love to hear how you’re using the dataset or collaborate on a project. Drop a comment or DM me if you’re exploring something interesting!

Feel free to share this with your networks and let me know what you think. Let’s uncover insights together! 🔎✨

P.S.: If you’re on Kaggle, don’t forget to upvote the dataset if you find it useful and share your findings! 🙏

submitted by /u/Think_Huckleberry299
[link] [comments]

Working With Vectors Of Data, Building Intuition On Disparate Data Sources

If I have two vectors:

exam scores [100, 80, 90] exam weights [.4, .3, .3]

I can take the dot product of these two and find *i’*s total score. Now across many rows, I can find “the class” total scores by i.

Now, imagine I have two other random vectors:

happiness score [10, 8. 9] sadness score [10, 8, 8]

Mathematically, nothing is stopping me from taking the dot product of happiness score and sadness score for person i.

This is where my intuition isn’t strong. What “possibly” could the dot product of these two mood scores tell me? I am just looking for any random ideas or ways to take the dot product and “make it make sense”.

Overall, This will help me take different vectors of data sets and infer insights. So, if you are given two vectors, how do you approach “combining them” to product an output that “makes sense”?

submitted by /u/RoyalScarcity260
[link] [comments]

Help Regarding NIS Database Research Analysis

I’m fairly inexperienced with programming/data analysis and I’m unsure of how to proceed with my dataset. Hopefully I’m posting in the correct subreddit.

I’m using a national inpatient hospital database (NIS database) to analyze at how a specific procedure volume changed pre vs. post COVID. I’ve already combined the years I’m looking at (2018-2021), filtered the data for only the procedure code I’m interested in, introduced a time period variable (2018/2019 =1, 2020/2020 =2) and weighed my cases by the “discharge weight” variable to represent population estimates. At this point, each row is basically a count for the procedure.

Now I’m stuck and don’t know what kind of statistical analysis I should be doing and what variables to use. I’ve played around with using independent t test using time period x discharge weights, thinking that each row x discharge weight = estimate of procedures, but I’m not really sure if that’s right.

I’d appreciate it if someone could please help me with this.

submitted by /u/igneouscloud
[link] [comments]

Looking For 3D Successful Prints Dataset Sources

Hello guys! We have a thesis proposal entitled: YOLOv10s in anomaly detection and classification in 3D Printing. Since we want to train our model for both images of 3d prints with defects and without defects, we already have dataset source for 3D Prints that have defects but we are having a problem with finding dataset for the one without defect or 3D prints that are successful. Anyone has the idea where we can look sources that has those images, if possible with annotations already. We already looked all throughout Kaggle and Roboflow. Thank you in advance!!

submitted by /u/smg_nabi
[link] [comments]

Request For Dataset On CcTLD Royalty Revenue And GDP Proportion

I’m looking for a dataset that includes information on the royalty revenue generated by countries’ country-code top-level domains (ccTLDs) and the percentage of this revenue relative to their respective GDPs. Specifically, I am looking for data that covers the following variables:

1. Country Name or ISO Code 2. ccTLD Royalty Revenue (annual) 3. Percentage of ccTLD Royalty Revenue Relative to GDP

submitted by /u/HealthyInstance9182
[link] [comments]

Undergraduate Dissertation Dataset Access

Hello,

I am doing my dissertation in music recommendation systems and I was wondering if academic/research access to the Spotify Million Playlist dataset is still available outside the scope of the challenge? The AI Crowd challenge states the following:

“Please note: The dataset associated with this challenge is not available for download anymore. We request you to directly reach out to Spotify Research for access to this dataset.”

I have sent an email to Spotify Research to ask for access to the datasets two weeks ago, but I still did not receive any replies, so I was wondering since you can still access the dataset in the resource tab and there is a citation part in the challenge still, can I use it as long as I still cite it?

submitted by /u/Anal_bandaid
[link] [comments]

Help With Calculating Spotify Profile Matches For A Scientific Experiment

Hi everyone,

I’m currently working on my Bachelor’s thesis and I want to calculate the match between Spotify profiles to study its influence on relationship satisfaction. The idea is to have two people authenticate via the Spotify API, and then I analyze their listening data (Top Songs, Artists, Genres, etc.) to create a “match score.”

My questions are:

Metrics: What metrics are best for calculating similarity between two users? I’ve been thinking about using Jaccard Index (for genres or artists) and Cosine Similarity (for audio features). Has anyone worked on a similar project? Automation: Is there a way to replicate the Spotify Blend logic or use similar functions via the API? I would like to automate this match calculation. Playlist Creation: How can I automatically create a playlist with the best matching songs from both users? I’m currently using Python and the Spotipy library. Scaling: My goal is to provide this feature to multiple participants in an online experiment. Are there any best practices for integrating Spotify data into web apps (e.g., with Flask or Django)?

I’d appreciate any tips or resources that could help me implement this. Also, if anyone knows how I could contact Spotify directly to learn more about their algorithms (e.g., behind the Blend feature), that would be really helpful.

Thanks in advance for your support!

submitted by /u/eliahgrgi
[link] [comments]

Product Retail Sales & Demographics Dataset Needed.

🚨 Dataset needed 🚨

Product Retail Sales & Demographics Dataset Needed.

Hey, everyone!
We are on the lookout for a Product Retail Sales & Demographics Dataset.

If you have access to this type of data or know of any reliable providers, your assistance would be invaluable!

Dataset Requirements:
The ideal dataset should include sales data at a daily level, product details, and demographic information from the sales points.

Here’s a more detailed breakdown of what we’re looking for:

Sales Data (Day-Level) Product Information Sales Point Demographics Geographical Insights Time-Based Trends Consumer Behavior Insights

How You Can Help:
• If you have this type of dataset or anything similar, please share details!
• Know a provider or source? Recommendations are welcome!

Contact Us:
Feel free to reach out via social media or [sales@opendatabay.com](mailto:sales@opendatabay.com)
Any assistance in locating this dataset would mean a lot!

submitted by /u/Opendatabay
[link] [comments]