Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

Looking For A Dataset Of Common Grammar Mistakes By English Learners

Hi everyone!

I’m working on a project where I need a dataset focused on common grammar mistakes made by people learning English as a second language. Ideally, this dataset would include examples of incorrect sentences along with their corrected versions and, if possible, brief explanations of the corrections.

I’ve heard about resources like the Cambridge Learner Corpus, but it seems to be proprietary. Are there any open-source datasets or tools that provide similar information?

If anyone knows where I can find something like this, or if you have suggestions for creating such a dataset from scratch, I’d really appreciate your input!

submitted by /u/No_Sorbet1211
[link] [comments]

Project Management Datasets Required

Hi Everyone, I am writing a doctoral thesis on project management methodology selection for digital product teams. I am looking for datasets which would have certain dimensions of the projects listed (team size, org structure, industry, etc.) the project management methodology applied (e.g. agile, waterfall) and whether the project was a success. I know it’s a very specific/particular ask but thought it might be worth asking. Thanks!

submitted by /u/teerakh
[link] [comments]

ISO Data On Number Of Environmental Technology Patents By City (any Country/region Is Fine)

Not sure if this exists but I am looking for a dataset that shows a breakdown of the number of environmental technology patents by city. Any country or region is fine. Alternatively, a dataset showing all patents for a country by metro area with a technology classification that includes environmental patents would work. Already checked OECD but they only break it down by country and I’m looking to show a spatial distribution of patents for a country or region.

submitted by /u/Forsaken-Adagio-2967
[link] [comments]

Datasets That Contain User And Website Interactions

Hey people,

I need some help with my dataset search. My project is about web behaviour and manipulative design patterns. Manipulative design patterns, or Dark Patterns, are for example marking the accept button green and hiding/greying out the decline button of cookie banners to sway the user to click on the accept button and use their subconscious against them.

What I’m looking for in a dataset is how users interact with these patterns. In this case something like how many times do people click on the accept button of a cookie banner for example. Or how many people click on ads etc. Basically a dataset that records a user clicking on any kind of web element. Im not interested in their IP or location though, so any kind of identifiable information. If it’s included it’s not a problem, I’ll just delete it/anonymize.

Can somebody give me some pointers or keywords I should use in my search? I didn’t really get any results from my previous search which is fine, but I was curious if I’m maybe just missing the correct keywords or search terms? I used terms like web behaviour and so on but didn’t really get good results.

Cheers!

submitted by /u/vertfreeber
[link] [comments]

Dataset Help With An Assignment(house Prices)

Hello everyone,

I have been having trouble finding a dataset for an assignment including house prices,past and present.The assignment is to make a model that takes in user input(for example the price of the house currently,rooms,bathrooms,square footage etc) and then gives a prediction on the price of the house.I have searched for a lot of datasets and all of them have price indexes and not the actual prices. Open to suggestion using the price indexes too but i have no idea how i would use them.Also the assignment is in python.

submitted by /u/denkseroo
[link] [comments]

How Can Find Out Food Dataset With Instructions

Hi there, I am looking for a dataset for my final year graduation project (an AI-based food recommendation web project). I found a well-designed dataset, but the instructions were missing.

What I am looking for are the following fields: food name, fat, carbohydrates, protein, saturated fat, image, fiber, ingredients, and food instructions.

submitted by /u/Mr01d
[link] [comments]

Looking For A Free Dataset On Competitive Pricing Models

Hi everyone,

I’m working on a project for a machine learning course at my university, and I’m looking for a free dataset to help me out. The project focuses on competitive pricing models, and I’ve been searching online but haven’t had much luck finding something that fits my needs.

Here’s what I’m looking for:

Features (must-have): Product cost Competitor pricing (or at least enough info so I can look it up online if the product is easily searchable) Market share Label (must-have): Price level categorized as High, Medium, or Low.

The tricky part is that these three features and the label are non-negotiable for my project to be considered. Any additional features would be a great bonus, but I absolutely need these core components to meet the project requirements.

If anyone has a dataset like this, knows where I could find one for free, or has any tips on where to look, I’d really appreciate it! Open-source options would be ideal.

Thanks so much for any help or advice—this would be a huge help! 😊

submitted by /u/BitNo934
[link] [comments]

Airline Data Set For Delays And Cancellations

Hi, I’m doing a project on airline delays looking to answer the question of ‘What airline carriers are more likely to have delays or cancellations?”. BUT, I am unable to find datasets of airlines outside of the USA. I was wondering if anyone has any of these types of datasets or know where to find them, I have been searching everywhere! Perhaps if you are from somewhere in Europe or Asia you could send a dataset of the given area. Thank you so much!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

submitted by /u/CurrentUpper9431
[link] [comments]

Looking For Datasets With Car Accident Images, Vehicle Details, And Repair Cost Data For Research Purposes

Hi everyone,

I’m currently working on a machine learning project aimed at estimating repair costs from car accident images. To proceed with the research, I’m looking for datasets that meet the following criteria:

1. Car accident images: Photos showing vehicle damage after accidents.

2. Associated repair costs: Information about repair estimates or actual repair costs.

3. Vehicle information (if available): Details such as make (brand), model, year of manufacture, and other relevant attributes.

The project’s goal is to build a tool that can analyze vehicle damage based on accident images, vehicle details and estimate repair costs. If you know of any publicly available datasets, open-access research projects, or organizations that share this type of data, I’d greatly appreciate your help! Even general suggestions on where to look or how to approach this problem would be extremely helpful.

Thank you in advance for your time and guidance!

submitted by /u/Much-Net9110
[link] [comments]

Subnational Results For The 2024 European Parliament Election?

Does anyone know if there is any dataset with subnational results (preferably NUTS3 or LAU-level) for all EU countries? I know that the data exists – several people have posted maps on Wikimedia Commons displaying the data, some of which are NUTS3-level, but most of them don’t provide a source for their claims. It has been done before in this interactive map, but you can’t even view it because it’s under a paywall.

I was thinking maybe I could go to each open data site for every EU country and compile them together, but for the life of me, I cannot find anything for any country at this level. A lot of them are not in English and nothing interesting comes up when I look up “European election” or whatever that is Google Translated into that country’s language.

I find it so frustrating that I can’t easily find detailed data for one of the largest elections on the planet. If someone could please direct me to a dataset like this, or at least to one of a particular country, that would really make my day!

submitted by /u/StrayberryFilling
[link] [comments]

Complete Script Collection For Unpopular Long-running TV Show

I am working on creating an LLM agent to help write scripts for TV shows. There are publicly available scripts for popular shows like FRIENDS, BBG etc. But the problem with those is the LLM is already pretty aware of these shows which makes it hard to distinguish and evaluate between the LLM and my approach. Is there any show that is not this popular and has its scripts available? Language is not a problem, the only requirement is that it needs to be a long-running show so that I have sufficient data at my disposal.

submitted by /u/woke_basher
[link] [comments]

FBI Crime Data Explorer Violent Crime Data Discrepancy

I’ve recently been using the FBI Crime Data Explorer (CDE) for work, but I’ve been having trouble parsing the monthly data points for violent crime rates. The monthly rates for property crimes hover around 150 per 100,000, which makes sense since the FBI reported annual property crime rate of around 1,954 per 100,000 people for 2022 (around 160 crimes per month per 100,000 people). So that tracks. The monthly rates for violent crimes, on the other hand, are usually around 115 per 100,000 people per month, which seems way too high, especially considering the FBI reported a rate of 380 violent crimes reported per 100,000 people per year in 2022 according to Pew Research. If you add up the monthly US violent crime rate data points for 2022 on the CDE tracker, you get an annual rate of about 1306 violent crimes reported per 100,000 residents, which seems absurdly high. Where is this discrepancy coming from?

TLDR: violent crime is typically reported at 1/5 the rate of property crime in the US, according to extensive reporting on major newsites, and the FBI’s own documentation. But on to the FBI’s statistical database, it’s reported at 2/3 the rate. It seems to be a problem for the Crime Data Explorer’s national, state and local numbers. Does anyone know why?

submitted by /u/huhboh
[link] [comments]

Built A One-click Tool Which Analyses Any CSV File And Generates A PowerPoint

Hi all, I’ve created a data science tool that I hope will be very helpful and interesting to a lot of you!

https://www.csv-ai.com/

Its a one click tool to generate a PowerPoint/PDF presentation from a CSV file with no prompts or any other input required. Some AI is used alongside manually written logic and functions to create a presentation showing visualisations and insights with machine learning.

It can carry out data transformations, like converting from long to wide, resampling the data and dealing with missing values. The logic is fairly basic for now, but I plan on improving this over time.

My main target users are data users who want to quickly have a look at some data and get a feel for what it contains (a super version of pandas profiling), and quickly create some slides to present. Also non-technical users with datasets who want to better understand them and don’t have access to a data scientist.

The tool is still under development, so may have some bugs and there lots of features I want to add. But I wanted to get some initial thoughts/feedback. Is it something you would use? What features would you like to see added? Would it be useful for others in your company?

It’s free to use for files under 5MB (larger files will be truncated), so please give it a spin and let me know how it goes!

submitted by /u/TheRazerBlader
[link] [comments]

API Access To The National Blend Of Models – Weather Forecasts History [self-promotion]

Disclosure first. https://gribstream.com/ is my indie hacking side project.

It has a free tier with a generous daily limit.

The original data is the NOAA National Blend of Models (NBM) https://vlab.noaa.gov/web/mdl/nbm and it is totally free. But if you’ve worked with grib2 datasets you know how cumbersome it can be for some usecases and that is what this API is for.

The API let’s you query this dataset to extract timeseries for thousands of coordinates, for months at a time, for many weather parameters in a single http request taking a few seconds, without having to download tens of terabytes of grib2 files.

It supports as-of/time-travel which is priceless to do proper backtesting when using the dataset as features into other prediction models.

I’d really appreciate any feedback 🙂

Thank you!

submitted by /u/ElPeque222
[link] [comments]

Need Technical Data For Multiple Ransomware Attacks

Hi guys, I am looking to train a machine learning model for the following data types any leads would be appreciated to find datasets that might contain these values –

Filter_size (bytes): The size of the encrypted file in bytes; File Entropy: The degree to which the encrypted file’s contents are unpredictable or random; Network Traffic (KB): The total quantity of data transferred over the network during the ransomware attack; Number_of_Encrypted_Extensions: How many different types of files the ransomware can encrypt; Time_to_Encrypt (seconds): The number of seconds needed for the ransomware to encrypt the data; Cloud Provider: The name of the cloud storage provider where the secret information is stored; Number_of_Shared_Folders: The total number of infected shared folders; Encryption Strength: How secure the ransomware’s encryption algorithm is; CPU Usage (%): Ransomware CPU use as a percentage; Suspicious_Activity: An attack-related suspiciousness indicator expressed as a binary variable; Ransomware_Type (Output): The ransomware strain (the dependent variable) that was used in the attack.

submitted by /u/packet404
[link] [comments]