I am a clueless about what to do and would appreciate any help.

Hi everyone,

I’m working on a project for a machine learning course at my university, and I’m looking for a free dataset to help me out. The project focuses on competitive pricing models, and I’ve been searching online but haven’t had much luck finding something that fits my needs.

Here’s what I’m looking for:

Features (must-have): Product cost Competitor pricing (or at least enough info so I can look it up online if the product is easily searchable) Market share Label (must-have): Price level categorized as High, Medium, or Low.

The tricky part is that these three features and the label are non-negotiable for my project to be considered. Any additional features would be a great bonus, but I absolutely need these core components to meet the project requirements.

If anyone has a dataset like this, knows where I could find one for free, or has any tips on where to look, I’d really appreciate it! Open-source options would be ideal.

Thanks so much for any help or advice—this would be a huge help! 😊

Hi, I’m doing a project on airline delays looking to answer the question of ‘What airline carriers are more likely to have delays or cancellations?”. BUT, I am unable to find datasets of airlines outside of the USA. I was wondering if anyone has any of these types of datasets or know where to find them, I have been searching everywhere! Perhaps if you are from somewhere in Europe or Asia you could send a dataset of the given area. Thank you so much!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Hi everyone,

I’m currently working on a machine learning project aimed at estimating repair costs from car accident images. To proceed with the research, I’m looking for datasets that meet the following criteria:

1. Car accident images: Photos showing vehicle damage after accidents.

2. Associated repair costs: Information about repair estimates or actual repair costs.

3. Vehicle information (if available): Details such as make (brand), model, year of manufacture, and other relevant attributes.

The project’s goal is to build a tool that can analyze vehicle damage based on accident images, vehicle details and estimate repair costs. If you know of any publicly available datasets, open-access research projects, or organizations that share this type of data, I’d greatly appreciate your help! Even general suggestions on where to look or how to approach this problem would be extremely helpful.

Thank you in advance for your time and guidance!

Does anyone know if there is any dataset with subnational results (preferably NUTS3 or LAU-level) for all EU countries? I know that the data exists – several people have posted maps on Wikimedia Commons displaying the data, some of which are NUTS3-level, but most of them don’t provide a source for their claims. It has been done before in this interactive map, but you can’t even view it because it’s under a paywall.

I was thinking maybe I could go to each open data site for every EU country and compile them together, but for the life of me, I cannot find anything for any country at this level. A lot of them are not in English and nothing interesting comes up when I look up “European election” or whatever that is Google Translated into that country’s language.

I find it so frustrating that I can’t easily find detailed data for one of the largest elections on the planet. If someone could please direct me to a dataset like this, or at least to one of a particular country, that would really make my day!

Hi . I am looking for live / database of dataset on property listing at unit, building , area and city level in dubai

Some metrics that I want to calculate are 1. Sales supply index ( no of properties listed for sale in a period / total number of properties )

Rental supply index ( number of properties listed for rent in the period / total number of properties in the market )

I am working on creating an LLM agent to help write scripts for TV shows. There are publicly available scripts for popular shows like FRIENDS, BBG etc. But the problem with those is the LLM is already pretty aware of these shows which makes it hard to distinguish and evaluate between the LLM and my approach. Is there any show that is not this popular and has its scripts available? Language is not a problem, the only requirement is that it needs to be a long-running show so that I have sufficient data at my disposal.

I’ve recently been using the FBI Crime Data Explorer (CDE) for work, but I’ve been having trouble parsing the monthly data points for violent crime rates. The monthly rates for property crimes hover around 150 per 100,000, which makes sense since the FBI reported annual property crime rate of around 1,954 per 100,000 people for 2022 (around 160 crimes per month per 100,000 people). So that tracks. The monthly rates for violent crimes, on the other hand, are usually around 115 per 100,000 people per month, which seems way too high, especially considering the FBI reported a rate of 380 violent crimes reported per 100,000 people per year in 2022 according to Pew Research. If you add up the monthly US violent crime rate data points for 2022 on the CDE tracker, you get an annual rate of about 1306 violent crimes reported per 100,000 residents, which seems absurdly high. Where is this discrepancy coming from?

TLDR: violent crime is typically reported at 1/5 the rate of property crime in the US, according to extensive reporting on major newsites, and the FBI’s own documentation. But on to the FBI’s statistical database, it’s reported at 2/3 the rate. It seems to be a problem for the Crime Data Explorer’s national, state and local numbers. Does anyone know why?

Hi all, I’ve created a data science tool that I hope will be very helpful and interesting to a lot of you!

https://www.csv-ai.com/

Its a one click tool to generate a PowerPoint/PDF presentation from a CSV file with no prompts or any other input required. Some AI is used alongside manually written logic and functions to create a presentation showing visualisations and insights with machine learning.

It can carry out data transformations, like converting from long to wide, resampling the data and dealing with missing values. The logic is fairly basic for now, but I plan on improving this over time.

My main target users are data users who want to quickly have a look at some data and get a feel for what it contains (a super version of pandas profiling), and quickly create some slides to present. Also non-technical users with datasets who want to better understand them and don’t have access to a data scientist.

The tool is still under development, so may have some bugs and there lots of features I want to add. But I wanted to get some initial thoughts/feedback. Is it something you would use? What features would you like to see added? Would it be useful for others in your company?

It’s free to use for files under 5MB (larger files will be truncated), so please give it a spin and let me know how it goes!

All the data Sets I find are fruit mainly and vegetables on the side or the take Like 6 types of vegetables and have less than 100 images for training

Disclosure first. https://gribstream.com/ is my indie hacking side project.

It has a free tier with a generous daily limit.

The original data is the NOAA National Blend of Models (NBM) https://vlab.noaa.gov/web/mdl/nbm and it is totally free. But if you’ve worked with grib2 datasets you know how cumbersome it can be for some usecases and that is what this API is for.

The API let’s you query this dataset to extract timeseries for thousands of coordinates, for months at a time, for many weather parameters in a single http request taking a few seconds, without having to download tens of terabytes of grib2 files.

It supports as-of/time-travel which is priceless to do proper backtesting when using the dataset as features into other prediction models.

I’d really appreciate any feedback 🙂

Thank you!

Hi guys, I am looking to train a machine learning model for the following data types any leads would be appreciated to find datasets that might contain these values –

Filter_size (bytes): The size of the encrypted file in bytes; File Entropy: The degree to which the encrypted file’s contents are unpredictable or random; Network Traffic (KB): The total quantity of data transferred over the network during the ransomware attack; Number_of_Encrypted_Extensions: How many different types of files the ransomware can encrypt; Time_to_Encrypt (seconds): The number of seconds needed for the ransomware to encrypt the data; Cloud Provider: The name of the cloud storage provider where the secret information is stored; Number_of_Shared_Folders: The total number of infected shared folders; Encryption Strength: How secure the ransomware’s encryption algorithm is; CPU Usage (%): Ransomware CPU use as a percentage; Suspicious_Activity: An attack-related suspiciousness indicator expressed as a binary variable; Ransomware_Type (Output): The ransomware strain (the dependent variable) that was used in the attack.

Has anyone compiled a list of every KEXP “Live on KEXP” performance on You Tube? I’m looking for a master list.

So, I looking for dataset which has human generated summary of scientific papers and orginal pdfs of those papers.

Hi guys,

I’m working for my end of bootcamp project, and I’m still missing some data ! I’m looking for some tips or sources to get everything I need. I have a full dataset of nasdaq stock data since 1980, identified by their tickers. I now need to add the company name + some basic data to classify each one (sector, some tags about what they do, and business size). I’d like to give each one an “ESGish” score.

Seems like such data isn’t free!

If anyone around here had any idea to help, i’d be really thankful =)

Hi I need an Allergy dataset which has the food item and the allergy associated with it. It needs to cover all allergies.

If someone could help me find it Thank you!

Actual data https://docs.foursquare.com/data-products/docs/access-fsq-os-places

If anyone need number and details data i got some. Feel free message me for those data

I wanted to use an API but they require to have an established business with lot of users

Does anyone know where I might be able to find up-to-date PGA Tour data? Or are there any APIs available for this?
Most datasets ive found online that are free dont provide enough data for the project Im working on and or the data is out of date.
Anyone have any recommendations?
Websites like https://datagolf.com/ or https://rickrungood.com/ cost too much in my opinion for the APIs, i just want a once off dataset.
If anyone has datasets they are willing to share it would be a great help or if anyone has a web scraping project done for the PGA tour i would love to check it out.

Hey everyone for my statistics class I am required to gather some data in order to explain my hypothesis. I need 100+ participants and hurd that this was a good place to get that done. The link below is a simple 1 question survey on who do you think would win in a fight Garfield or Snoopy. Please and thank you.

link https://docs.google.com/forms/d/e/1FAIpQLSfTtUr7W14934Uz2JjZTRrWTQtLLofiMeiZWcAqAYDFuF6Haw/viewform?usp=sf_link

I’m doing a project on ArcGIS Pro about water management in Peru, but I’m struggling to find available data about water and land use in Peru. Does anyone know where I can find data for my project?

Here is a summary of my project:

Lime production is a critical industry in Peru, supporting sectors such as mining, agriculture, and construction. However, lime processing is water-intensive, often located near scarce water resources, potentially impacting local ecosystems and communities. Sustainable management of water resources is essential to balance industrial needs with environmental conservation and community access to water. This project will use GIS analysis to assess the environmental and community impact of water consumption by lime production facilities in Peru.

I will be addressing the following questions: What is the spatial relationship between lime production facilities and local water sources? How does water usage by these facilities affect nearby communities and ecosystems? Which areas are most at risk of water scarcity as a result of high industrial water demand from lime production? By addressing these questions, my project seeks to identify high-risk areas, assess the environmental impact, and offer insights into sustainable water management practices for this critical industry.

I’d like to look at how earnings correlate with age (or years of experience), ideally within each occupation, but even within general industries would suffice.

Most of the datasets I have came across are binary, so I am here looking for some suggestions 🙂 My scope is only tabular data.

Hello! I am seeking time-series data for any previous US presidential election (or really, any nationwide election). I am looking to use this data to experiment with election visualizations that display the state of the US’s voting as the night progresses (like found on Google or any major journal on Election night). If anyone knows how I may find such data, or reconstruct it myself, I would appreciate it greatly.

I specifically am looking for time-series data, not final vote counts alone, as I’m interested in creating a live-updating visualization for the votes as they come in. I thought about just gradually interpolating towards the final vote counts to simulate the votes over time, but this wouldn’t communicate the flip-floppy nature that makes watching an updating visualization exciting/stressful. If you linearly interpolate, whoever wins that state will always be ahead in that state, which is typically not the case. The rate at which counties return voting data, the populations of those counties, and the political leanings of those counties, and timezones all vary greatly nationwide.

I know this is a long shot – seems like election data is surprisingly hard to come by in the first place – but I appreciate any leads or suggestions!

My sister is doing her Masters degree and her Uni can’t provide her with an access to Pitchbook. Was wondering if somebody here could help her out with an access for a few minutes or with screenshots of entries.

Any help is much appreciated

I am looking for data for beverage importers. Anyone can help me?

I’m looking for English text-only datasets from December 2014 or earlier. Specifically, I’m interested in datasets that cover a broad range of topics, and it would be useful if they are free of spam or low-quality content. I’d like them to be from twitter, reddit, Discord, or emails.

If anyone knows where I can find those kind of datasets or has access to them, please let me know. Your help is greatly appreciated!

Thanks in advance!

(I’m making an LLM for my games dialogue system and the game is set in 2014)

Hi guys, i’ve been trying to train a neural network that recognizes trucks, cars and a specific type of golf cart of which i already have many pictures, my question is, are there out there any datasets with specifically that type of images but close? Most of what i’ve found also include images from afar and i only need the neural to recognize from up close, at most 5 to 10 meters from the vehicle

Also, regarding my “golf cart” dataset, that set sometimes has cars or trucks in the background, should i label those as well? even though i only want the neural to learn about the specific type of vehicle?

Thanks in advance!