Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

Explore The Minerals Yearbook Dataset For Africa & Middle East

Hi everyone

I’ve just uploaded an exciting dataset to Kaggle that could be a game-changer for researchers, data analysts, and anyone interested in the mineral industry of Africa and the Middle East. 🪨💎

🔍 What’s in the Dataset ?

The dataset is sourced from the USGS Minerals Yearbook and includes:

• 📈 Annual data on mineral commodities across various countries.

• 🏛️ Information on government policies, environmental issues, and trade.

• 🏗️ Insights into industry structure, commodity developments, and infrastructure.

• 📊 XLS files organized by country and year for easy analysis.

This dataset offers a treasure trove of information to analyze trends, explore economic impacts, or even build machine learning models for predictive insights. 🚀

📜 Source and Collection

Source: USGS National Minerals Information Center.

Methodology: Data was collected using Scrapy and Selenium to handle dynamic content, ensuring a complete and accurate dataset.

Disclaimer: The dataset is for educational and research purposes only. It’s not affiliated with or endorsed by USGS.

🔗 Explore Now

You can access the dataset here: https://www.kaggle.com/datasets/amaboh/africa-and-the-middle-east-minerals-dataset/data

(Feel free to upvote if you find it helpful! 👍)

💡 Why Check This Out?

Whether you’re into:

Data Science 🧑‍💻: Test algorithms on real-world data.

Economics & Policy 📚: Analyze the role of minerals in regional economies.

Geography 🌍: Understand spatial trends in mineral production.

Environmental Studies 🌱: Dive into the impact of mining on the environment.

There’s something here for everyone!

🙌 Let’s Collaborate

I’d love to hear how you’re using the dataset or collaborate on a project. Drop a comment or DM me if you’re exploring something interesting!

Feel free to share this with your networks and let me know what you think. Let’s uncover insights together! 🔎✨

P.S.: If you’re on Kaggle, don’t forget to upvote the dataset if you find it useful and share your findings! 🙏

submitted by /u/Think_Huckleberry299
[link] [comments]

Working With Vectors Of Data, Building Intuition On Disparate Data Sources

If I have two vectors:

exam scores [100, 80, 90] exam weights [.4, .3, .3]

I can take the dot product of these two and find *i’*s total score. Now across many rows, I can find “the class” total scores by i.

Now, imagine I have two other random vectors:

happiness score [10, 8. 9] sadness score [10, 8, 8]

Mathematically, nothing is stopping me from taking the dot product of happiness score and sadness score for person i.

This is where my intuition isn’t strong. What “possibly” could the dot product of these two mood scores tell me? I am just looking for any random ideas or ways to take the dot product and “make it make sense”.

Overall, This will help me take different vectors of data sets and infer insights. So, if you are given two vectors, how do you approach “combining them” to product an output that “makes sense”?

submitted by /u/RoyalScarcity260
[link] [comments]

Help Regarding NIS Database Research Analysis

I’m fairly inexperienced with programming/data analysis and I’m unsure of how to proceed with my dataset. Hopefully I’m posting in the correct subreddit.

I’m using a national inpatient hospital database (NIS database) to analyze at how a specific procedure volume changed pre vs. post COVID. I’ve already combined the years I’m looking at (2018-2021), filtered the data for only the procedure code I’m interested in, introduced a time period variable (2018/2019 =1, 2020/2020 =2) and weighed my cases by the “discharge weight” variable to represent population estimates. At this point, each row is basically a count for the procedure.

Now I’m stuck and don’t know what kind of statistical analysis I should be doing and what variables to use. I’ve played around with using independent t test using time period x discharge weights, thinking that each row x discharge weight = estimate of procedures, but I’m not really sure if that’s right.

I’d appreciate it if someone could please help me with this.

submitted by /u/igneouscloud
[link] [comments]

Looking For 3D Successful Prints Dataset Sources

Hello guys! We have a thesis proposal entitled: YOLOv10s in anomaly detection and classification in 3D Printing. Since we want to train our model for both images of 3d prints with defects and without defects, we already have dataset source for 3D Prints that have defects but we are having a problem with finding dataset for the one without defect or 3D prints that are successful. Anyone has the idea where we can look sources that has those images, if possible with annotations already. We already looked all throughout Kaggle and Roboflow. Thank you in advance!!

submitted by /u/smg_nabi
[link] [comments]

Request For Dataset On CcTLD Royalty Revenue And GDP Proportion

I’m looking for a dataset that includes information on the royalty revenue generated by countries’ country-code top-level domains (ccTLDs) and the percentage of this revenue relative to their respective GDPs. Specifically, I am looking for data that covers the following variables:

1. Country Name or ISO Code 2. ccTLD Royalty Revenue (annual) 3. Percentage of ccTLD Royalty Revenue Relative to GDP

submitted by /u/HealthyInstance9182
[link] [comments]

Undergraduate Dissertation Dataset Access

Hello,

I am doing my dissertation in music recommendation systems and I was wondering if academic/research access to the Spotify Million Playlist dataset is still available outside the scope of the challenge? The AI Crowd challenge states the following:

“Please note: The dataset associated with this challenge is not available for download anymore. We request you to directly reach out to Spotify Research for access to this dataset.”

I have sent an email to Spotify Research to ask for access to the datasets two weeks ago, but I still did not receive any replies, so I was wondering since you can still access the dataset in the resource tab and there is a citation part in the challenge still, can I use it as long as I still cite it?

submitted by /u/Anal_bandaid
[link] [comments]

Help With Calculating Spotify Profile Matches For A Scientific Experiment

Hi everyone,

I’m currently working on my Bachelor’s thesis and I want to calculate the match between Spotify profiles to study its influence on relationship satisfaction. The idea is to have two people authenticate via the Spotify API, and then I analyze their listening data (Top Songs, Artists, Genres, etc.) to create a “match score.”

My questions are:

Metrics: What metrics are best for calculating similarity between two users? I’ve been thinking about using Jaccard Index (for genres or artists) and Cosine Similarity (for audio features). Has anyone worked on a similar project? Automation: Is there a way to replicate the Spotify Blend logic or use similar functions via the API? I would like to automate this match calculation. Playlist Creation: How can I automatically create a playlist with the best matching songs from both users? I’m currently using Python and the Spotipy library. Scaling: My goal is to provide this feature to multiple participants in an online experiment. Are there any best practices for integrating Spotify data into web apps (e.g., with Flask or Django)?

I’d appreciate any tips or resources that could help me implement this. Also, if anyone knows how I could contact Spotify directly to learn more about their algorithms (e.g., behind the Blend feature), that would be really helpful.

Thanks in advance for your support!

submitted by /u/eliahgrgi
[link] [comments]

Product Retail Sales & Demographics Dataset Needed.

🚨 Dataset needed 🚨

Product Retail Sales & Demographics Dataset Needed.

Hey, everyone!
We are on the lookout for a Product Retail Sales & Demographics Dataset.

If you have access to this type of data or know of any reliable providers, your assistance would be invaluable!

Dataset Requirements:
The ideal dataset should include sales data at a daily level, product details, and demographic information from the sales points.

Here’s a more detailed breakdown of what we’re looking for:

Sales Data (Day-Level) Product Information Sales Point Demographics Geographical Insights Time-Based Trends Consumer Behavior Insights

How You Can Help:
• If you have this type of dataset or anything similar, please share details!
• Know a provider or source? Recommendations are welcome!

Contact Us:
Feel free to reach out via social media or [sales@opendatabay.com](mailto:sales@opendatabay.com)
Any assistance in locating this dataset would mean a lot!

submitted by /u/Opendatabay
[link] [comments]

Looking For A Dataset Of Common Grammar Mistakes By English Learners

Hi everyone!

I’m working on a project where I need a dataset focused on common grammar mistakes made by people learning English as a second language. Ideally, this dataset would include examples of incorrect sentences along with their corrected versions and, if possible, brief explanations of the corrections.

I’ve heard about resources like the Cambridge Learner Corpus, but it seems to be proprietary. Are there any open-source datasets or tools that provide similar information?

If anyone knows where I can find something like this, or if you have suggestions for creating such a dataset from scratch, I’d really appreciate your input!

submitted by /u/No_Sorbet1211
[link] [comments]

Project Management Datasets Required

Hi Everyone, I am writing a doctoral thesis on project management methodology selection for digital product teams. I am looking for datasets which would have certain dimensions of the projects listed (team size, org structure, industry, etc.) the project management methodology applied (e.g. agile, waterfall) and whether the project was a success. I know it’s a very specific/particular ask but thought it might be worth asking. Thanks!

submitted by /u/teerakh
[link] [comments]

ISO Data On Number Of Environmental Technology Patents By City (any Country/region Is Fine)

Not sure if this exists but I am looking for a dataset that shows a breakdown of the number of environmental technology patents by city. Any country or region is fine. Alternatively, a dataset showing all patents for a country by metro area with a technology classification that includes environmental patents would work. Already checked OECD but they only break it down by country and I’m looking to show a spatial distribution of patents for a country or region.

submitted by /u/Forsaken-Adagio-2967
[link] [comments]

Datasets That Contain User And Website Interactions

Hey people,

I need some help with my dataset search. My project is about web behaviour and manipulative design patterns. Manipulative design patterns, or Dark Patterns, are for example marking the accept button green and hiding/greying out the decline button of cookie banners to sway the user to click on the accept button and use their subconscious against them.

What I’m looking for in a dataset is how users interact with these patterns. In this case something like how many times do people click on the accept button of a cookie banner for example. Or how many people click on ads etc. Basically a dataset that records a user clicking on any kind of web element. Im not interested in their IP or location though, so any kind of identifiable information. If it’s included it’s not a problem, I’ll just delete it/anonymize.

Can somebody give me some pointers or keywords I should use in my search? I didn’t really get any results from my previous search which is fine, but I was curious if I’m maybe just missing the correct keywords or search terms? I used terms like web behaviour and so on but didn’t really get good results.

Cheers!

submitted by /u/vertfreeber
[link] [comments]

Dataset Help With An Assignment(house Prices)

Hello everyone,

I have been having trouble finding a dataset for an assignment including house prices,past and present.The assignment is to make a model that takes in user input(for example the price of the house currently,rooms,bathrooms,square footage etc) and then gives a prediction on the price of the house.I have searched for a lot of datasets and all of them have price indexes and not the actual prices. Open to suggestion using the price indexes too but i have no idea how i would use them.Also the assignment is in python.

submitted by /u/denkseroo
[link] [comments]

How Can Find Out Food Dataset With Instructions

Hi there, I am looking for a dataset for my final year graduation project (an AI-based food recommendation web project). I found a well-designed dataset, but the instructions were missing.

What I am looking for are the following fields: food name, fat, carbohydrates, protein, saturated fat, image, fiber, ingredients, and food instructions.

submitted by /u/Mr01d
[link] [comments]