I’m currently investigating what the general opinion is of U.S. high school graduates in areas of the different commonly taught subjects (i.e. history, math, biology, chemistry, etc) that are ubiquitous for all students. In other words, I’m only interested in subjects that are generally mandatory throughout all of high school. Personally, I know physics was NOT a mandatory subject at my school, and if that policy scales to most of the rest of the country, I would not be interested in what the opinions of physics are. I’m trying to study and better understand what subjects people have respect—and to some extent admiration—for regardless of if they did well in them. I did not do particularly well in my high school biology course, but my opinions of biology of a subject were never negative, just my opinions of the textbook, teacher, etc. I would like to know if there are any datasets that probe at this particular aspect high school classes. My gut feeling is that mathematics class leave more people with a genuine distain for the subject itself more so than people would have with an art class, even though, for example, the frequency of people unable to paint a fence after an art class might be comparable with that of the people unable to find the zeros of a quadratic equation. Normally, I would put a lot more effort into tracking down this kind of data myself, but this endeavor would be best described as a side-side project and can’t afford myself to get too sidetracked on it. If anyone has a reference to such a dataset, or even an analysis that mirrors what I’ve detailed, I would be greatly appreciative if you could point me toward it.

Hi folks,

So I am a data analyst. And spent yesterday fetching hot reddit posts for top subreddits as an EDA activity. I fetched the common parameters like post title, url, upvotes, number of comments, shares, etc. Removed the ‘author’ (userid of person who made the post) for privacy reasons.

I am thinking of uploading the dataset to Kaggle for other fellow analysts and researchers, under the Reddit API Terms license available on Kaggle.

Is this ok? Or am I going to get in any legal trouble?

Regards

Link to Dataset – Kaggle

I am relatively new to python, pandas. Recently getting better.
So I wanted to do an EDA on top reddit posts of all time. I couldn’t find something concise. I saw a few datasets in 10s of GBs of entire data dumps by pushshift. But that was too much for me to go through.

I wanted something simpler, lightweight for myself and potentially other newbies to get their feet wet when coming into analytics.

So I wrote a script and had to take chatgpt help (pardon my poor coding skills, im not from a programming background) to use reddits api to fetch top posts from top 50 subreddits.

I did a bit of data preprocessing and cleaning to ensure the formatting was ok, removed the OP(author) field for privacy.

Uploaded to Kaggle and prepared a starter notebook – whether or not you check out the dataset, the notebook is a must look. Short and to the point intro.

The script needs work, cleanup and commenting, and updates to ensure I don’t fetch OP info in the first place. Will also try to fetch some other necessary parameters. When finalized, will share that on github. (I do not know how to use github yet, again sorry).

Thanks for your time.

I hope to find some interesting datasets on r/datasets for my eda as well.

Thenk 😀

Im looking for some kind of service (free or cheap) that offers daily weather data for multiple cities around the globe. I initially OpenWeatherMap but their bulk data downloads require a professional subscription which costs over $400 which is too much for my simple project. Any alternatives? Ideally it would be a csv or json file of various cities with the average weather for that day or even hourly would be better.

We built the best job postings database which includes:

De-duplicating and removing ghost job postings Tagging jobs by O*NET SOC code (the standard occupation taxonomy in the US) Tagging employers by NAICS code Extracting job title, salary range, benefits, and qualifications

Disclaimer: I am one of the founders. If you’d like to try a sample of the dataset, please comment below or DM.

Hi,

I am finishing my Masters in epidemiology and I need to analyze a dataset for my thesis. I am looking for any datasets related to pediatric brain cancer, cancer survivorship/outcomes, and also treatment modalities (chemotherapy, surgery, radiation). I am familiar with SEER but was wondering if anybody had other recommendations. I am hoping there is a dataset out there with more specific treatment information than SEER.

Ty!

Hi, I am looking for a detailed dataset with information about births, including the estimated gestation week or even day, mother age, if it is a natural delivery or c section, and any other details. I am interested in applying the possible results in Europe, but different geographic contexts would be really interesting. Thanks

I’m a student for CSU and I’m taking CIS 250. For a project I need to determine a problem domain, establish a set of questions to answer, and find a data set to adequately answer those questions.

The domain I decided upon is E-Commerce and the questions I set were Q1 “How has the use of online storefronts by customers changed over the decade?” and Q2 “How much does ease of access in a digital storefront’s UI affect the amount of customers who order from said storefront?”. I chose this data set called Amazon Data Set (on Kaggle.com. Link to dataset here), but it doesn’t have sales data, making it unfeasible to use to answer the questions. That’s when I realized how tricky it is to find a data set that does answer those questions.

So, is it possible any of you know any good sites where I can find data that suits those questions or should I propose a new set of questions that are feasible to answer with the data I have access to?

Hello,

Is there any dataset related to scanned documents that we can read and process the text. After that, we can figure out access control policies that are there in the document? Or figure out the access role of the user?

Any lead is appreciated.

I want to create a detector for nearby thunderstorms. I’m a slight amateur meteorologist and a full time machine learning engineer. It’s always annoyed me that you can basically tell if there’s bad weather coming your way from just a glimpse at the weather radar sites.. but somehow there’s no personalized app that warns me.

I teach kayaking to groups on the water, so there’s a bit of personal safety involved. My wife does research on open fields so I’d also like to provide her with warnings.

I’m an European citizen so I might have access to ESA data?

I would like to analyze live stats for soccer match to build up a machine learning previsional model. Unfortunatelly i can only find final stats while i would like a succession of snapshot with stats like possession, goals, cards and so on. Do you have any idea?

I am trying to make my university-level statistics class more engaging. I previously used the data sets provided by the book in my class notes, but I would like to start using real-world data sets that are more relatable and interesting to college students.

Would anyone happen to have a suggestion of where I can find these types of data sets? Does anyone know what kind of data sets seem to click with 18-20 year olds? I’m thinking social media use, maybe specific data about the college they are currently attending, anything about money.

Thank you!

Where can i find numberic value only datasets for simple random forest classifier on colab

Need help asap plz!

Hello everyone!

I’m working on a computer vision task that involves detecting broken fences, but the dataset I have is quite small.

I was thinking of generating synthetic data to overcome this issue. Since it’s easier to find images of intact fences, I thought about using an image-to-image model to artificially “break” parts of the fence in those images.

Do you think this approach is feasible? Any suggestions or recommendations on how to implement this?

Thanks in advance!

Hello, I am conducting an undergraduate thesis study and am looking for (preferrably) video datasets of Romanian Deadlifts and Squats. I will be performing something involving computer vision models such as MediaPipe and YOLOv8, and I require videos for my study. Thank you in advance!

Is there any available dataset of job description and resumes that secured the job based on the job description?

This is for a college project that I’m doing. If anybody knows anything about this help me.

This might be a bit of a stretch, but I’m hoping to find a dataset of completed project management artefacts, things like schedules, project charters/briefs, RAIDD logs, reports etc. hopefully categorised by types of projects (development work, platform adoption, infrastructure work). I realise that a lot of this work would be proprietary to organisations so I might not have much luck.

I want to reach a data set for labeled data of SNPs or microarray gene expression for Alzheimer’s Disease to train a model.

I am looking for carbon emission dataset from India coal mines in recent years to calculate carbon footprint

And appreciate suggestions for machine model to train the dataset

I am looking for dataset of videos that scan different items like objectron ?

No need for object detection, segmentation or pose estimation data. Just videos of scanned different items.

For a pet project, I want to build a robot that collects fallen apples and clears dog mess from the lawn and garden areas. To identify the items to clear and collect I will need images of the subject items in various poses and scenarios. Whilst I do have both dogs and apples trees, it will take me a while to collect images and also generate variations of those images for training. I thought the best way (maybe not the most sensible) was to ask Reddit. Please people of Reddit, please can you send me images of the requested items from about a metre (3ft) away where possible. email: ozoid at proton dot me
Thank you.

Anyone knows where should I try finding them? We are ready to pay for it. Thankyou so much

where can i get datasets related to “agriculture commodities production like for onions, potatoes etc” and their price trends

I need data about MOF material for CO2 capture for post-combustion?

I’m looking for data on public support for infrastructure projects, particularly in the energy sector. Do you have any recommendations for where to look? I’m new to data science and having a tough time figuring out where to start. All help is appreciated 🙂

My company is currently creating a synthetic facial dataset (a 3D geometry head set, based on real human scans). Our set strives to be more diverse with respect to ethnicity, age, body type and gender. Additionally, we have the ability to create an infinite number of facial variations (ie, blended percentages of differing people, thus creating many unique resulting faces)

All of our input source subjects have consented (via a robustly worded model release), to ensure fairness as well as adherence to all current and any future legislation pertaining to facial datasets. 🙂)

My question is: What elements would data scientists like to have, to make their training sets more effective and usable? For example, we currently have 3D and 2D facial tracking points, plus occlusion identifiers. Also, we can completely randomize any aspect of the face (skin, eyes, hair, clothing, etc) and also the rotation of the head, camera view, lighting, background image, etc.

What other things would be useful?

Hello, I’m studying statistics using the handbook mentioned above, unfortunately the companion website is no longer available so I don’t know how to access the the data set to perform the example and do some of the end of chapter exercises. So I don’t know if anyone has the said data set and could hand it over to me or has a valid link where I can download it. Thank you in advance for your kind reply.

I have downloaded version 18 of Mozilla common voice for Pashto language. There are a lot of folders in the file I downloaded and I am unable to understand what they mean.

Someone help me understand how can I use this data to finetune my whisper model.

Screenshot of the language folder

Does anybody know if this is available/where can I find this?