Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

[self-promotion] Every Product Listed On LEGO.com, May 2023

I made a little Python crawler that slurps up data about products listed on LEGO.com. That’s every product on the site, not just LEGO sets.

Here’s the crawler’s JSON output from May 9, 2023: https://gist.github.com/ryukoposting/070bea86a3b9fefc285388b0ffe651aa

Each product includes the following information:

The product’s name A link to the product page on LEGO.com The product’s price in USD The product’s discount price in USD, if there is a discount. The number of LEGO pieces in the product (if the product isn’t a LEGO set, this value is null) LEGO’s suggested age range of the product, if one is available. Whether or not the product is currently available for purchase. Note: this is misleadingly called in_stock, but its value will be true for products that are on backorder. The product’s customer rating average, 1-5 stars. A list of themes to which the product belongs. Many products have only one theme, but some belong to multiple themes.

submitted by /u/ryu-ryu-ryu
[link] [comments]

Dataset Or Repository Of People Looking To Acquire External Datasets

I am looking for a dataset or repository that has a list of individuals or organizations actively searching and looking to purchase external datasets. The datasets can be used for research, academia, or business purposes, and they can encompass any type of data as long as the potential buyers have the intent and budget to make the purchase. I’m not even sure such a compilation exists (besides r/datasets) but thought it would be worth a try to ask!

submitted by /u/-x-Knight
[link] [comments]

Datasets Suggestions For These Requirments

Hey guys. I am currently starting to work on my universtiy project for Fundamentals of Artificial Intelligence class. I would really appreciate if you could suggest me the datasets according to these requirments :

“Select a dataset that is suitable for a classification task. The student must avoid selecting the Iris dataset or the

Palmer Archipelago (Antarctica) penguin dataset. In addition, the meaningfulness of the classification has to be

considered, e.g. it is meaningless to classify continents by the number of Covid-19 cases because, first, there are

only six continents and new ones will not appear soon, second, the number of Covid-19 cases is not a

defining characteristic of continents;

• it is preferable to select a dataset that is already given in the format of a .csv datafile;

• the dataset should be well-documented (there should be information about who created the set, when and what

the data source is);

• the dataset should be of reasonable size (at least 200 data objects);

• the dataset should be deeply annotated (there should be information about which features are stored and what

they mean);

• the number of features should be between 5-15;

• the dataset should be labelled;

• the student must avoid datasets with many Boolean (true/false, 1/0, etc.) or categorical type feature (attribute)

values. It is preferable to use datasets in which most of the attributes are represented by continuous attribute

values;

• you should avoid datasets of unlabelled data (e.g. text corpora and raw images)”

submitted by /u/kktsrvii
[link] [comments]

Looking For Java Exception/Error Datasets And Solutions

Hey fellow developers!

I hope you’re all doing well. I’m currently working on a project that involves analyzing Java exceptions and errors. To enhance the accuracy of my analysis, I’m in need of a comprehensive dataset that includes various Java exceptions, errors, and their corresponding solutions. I believe having such a dataset would greatly benefit the development community as a whole.

Therefore, I’m reaching out to you all to see if anyone knows of any existing datasets or resources that provide information about Java exceptions and errors. Specifically, I’m looking for a dataset that encompasses a wide range of exceptions, covering different classes, such as NullPointerException, ArrayIndexOutOfBoundsException, and IllegalArgumentException, among others.

Ideally, the dataset would include:

Exception/Error name

Description and context of the exception/error

Stack trace (if available)

Common causes/triggers of the exception/error

Recommended solutions and best practices to handle or avoid the exception/error

I understand that documenting every exception and error might be an enormous task, but even a partial dataset or relevant resources would be highly appreciated. I’m willing to put in the effort to curate and organize the information into a cohesive format, making it accessible to the community.

Additionally, if you have any personal experiences or insights related to specific Java exceptions or errors, feel free to share them! Practical examples and real-life scenarios are often invaluable for understanding and addressing these issues effectively.

Thank you in advance for your time and assistance. Your contribution will not only aid my project but will also assist numerous developers who encounter similar challenges in their Java projects. Let’s collaborate and make Java development more seamless for everyone!

Looking forward to your suggestions, datasets, and insights.

Happy coding!

submitted by /u/Farjou69
[link] [comments]

Looking For A Dataset Of Letters. Any Ideas?

I’m doing a project for a website where I analyze the similarity in writing style and content of letters of different users and try to match them to another user with the highest similarity. I need a dataset of letters/emails/long text messages for that and that’s what I’m looking for. I’ve found the subreddits r/letters and r/loveletters but they haven’t been too satisfactory in terms of the quality of texts. I’ve thought about making dataset with sample letter texts from English exams but since there is no one authentic human writer behind it, it’s not the best source either. Historic archives exist but since my focus is on modern casual letter/email writing, I’ve decided to pass on that. If there was a blog, for example, where someone publicly wrote letters to someone, that would be great but I am unable to find any. Any help would be must appreciated!

submitted by /u/cakeandflowers2202
[link] [comments]

You Haven’t Killed Anyone Driving, Have You? Of Course Not!

You might never have been in an accident and certainly not one where three people were sent to the hospital. Or morgue. I mean, that option was put on the table, too.

And you might not be that bad of a driver — no what the others say about you.

I’m in your corner here. I want you to know that. And help you, my friend, here are 10 years of [Denver Traffic Accident data](https://www.kaggle.com/datasets/hrokrin/denver-traffic-accidents).

Now, you might be thinking: “How is this going to help me?” A valid question.

Cherry-picking is always a good option but let’s not forget both obfuscation and actual analysis. Three solid options right there and let’s be honest, already this has been worth your time.

Think of how good you’re going to look when you can *conclusively* (or not) show how accidents due to cell phone usage have been trending so that fender bender is not *technically* your fault.

The [attached notebook](https://www.kaggle.com/code/hrokrin/denver-traffic-accidents-eda) is there … just waiting for you. Your improvements; your questions. Just waiting.

What’s the best place to hit a pedestrian in a car? Just waiting. Which precinct does the worst job with its paperwork? Just waiting. What’s the best neighborhood to take a bike ride in case you don’t want to get hit? JJust waiting. Is there a correlation between road conditions and accidents? Denver has great snow clearing right? Right? Just waiting.

Oh, and there’s a heat map.

This isn’t some picked-over dataset about people on a boat. Who cares? They’re dead already! Not that many in this dataset are.

Ok, so in all seriousness, I’d love feedback. And for you to take a spin the two for a spin.

submitted by /u/hrokrin
[link] [comments]

ECG Data Using Apple Watch And HealthKit Api In CSV Format

Hi, Fellows I need ECG data from apple watch in .csv format for a project wich is due in a week. I need only 10 sample to prove what I am doing. Unfortunately, I live in a region where apple’s to collect and export ECG data in .csv format is not available. I need your help to get the 10 ECG samples taken at rest from 10 different people using apple watch and apple official app in .csv format. Can anyone here help me get the samples?

submitted by /u/u109e114
[link] [comments]

Textraction.ai Released! AI Text Parsing API

It allows extracting custom user-defined entities from free text. Very exciting!
It can extract exact values (e.g. names, prices, dates), as well as provide ChatGPT-like semantic answers (e.g. text summary).
I like the interactive demo on their website (https://www.textraction.ai/) – it allowed me to try my own texts and entities within minutes. It works great 🙂
The service is accessible also as an API for any purpose via the RapidAPI platform: https://rapidapi.com/textractionai/api/ai-textraction (sign up to RapidAPI and get your own token)

submitted by /u/DoorDesigner7589
[link] [comments]

Datalab: Automatically Detect Common Real-World Issues In Your Datasets

Hello Redditors!

I’m excited to share Datalab — a linter for datasets.

I recently published a blog introducing Datalab and an open-source Python implementation that is easy-to-use for all data types (image, text, tabular, audio, etc). For data scientists, I’ve made a quick Jupyter tutorial to run Datalab on your own data.

All of us that have dealt with real-world data know it’s full of various issues like label errors, outliers, (near) duplicates, drift, etc. One line of open-source code datalab.find_issues() automatically detects all of these issues.

In Software 2.0, data is the new code, models are the new compiler, and manually-defined data validation is the new unit test. Datalab combines any ML model with novel data quality algorithms to provide a linter for this Software 2.0 stack that automatically analyzes a dataset for “bugs”. Unlike data validation, which runs checks that you manually define via domain knowledge, Datalab adaptively checks for the issues that most commonly occur in real-world ML datasets without you having to specify their potential form. Whereas traditional dataset checks are based on simple statistics/histograms, Datalab’s checks consider all the pertinent information learned by your trained ML model.

Hope Datalab helps you automatically check your dataset for issues that may negatively impact subsequent modeling — it’s so easy to use you have no excuse not to 😛

Let me know your thoughts!

submitted by /u/jonas__m
[link] [comments]