Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

Exploring The Potential Of Data For The Public Good: Share Your Insights!

Hey everyone!

We are a group of design students currently conducting academic research on an intriguing topic: the democratization of data and its potential of data to benefits the public. We believe that data can play a vital role in improving people’s lives outside the realm of business, and we would love to hear your thoughts and experiences on this subject.

If you have a moment, we kindly invite you to answer one or more of the following questions either privately or as a comment:

– Please share your most recent experience using datasets for self– worth or public value (non-business purposes). For example, a project that makes data accessible or extracts insights that can help the general public?

– Working on the project, what worked and what didn’t work? Were there barriers and challenges that you can share?

– Are there any insights or tips you would like to share following the project?

– Do you have any insights or thoughts regarding the use or accessibility of data for the public good?

Your contribution can be as brief or as detailed as you like. We greatly appreciate any answers, thoughts, or perspectives you are willing to share.

Thank you all!

submitted by /u/Direct-Goat-2072
[link] [comments]

Need A Dataset For Fruit Disease Detection I Will Show The Code Below And Pls Tell Me A Dataset And How To Use It. I’m A Total Idiot When It Comes To This. I Learnt Theory ABT It But Not That Much Practicals..can Somebody Help

import os import cv2 import numpy as np

Data organization

dataset_root = ‘path_to_dataset_root_directory’ categories = [‘healthy’, ‘diseased’]

for category in categories: category_dir = os.path.join(dataset_root, category) images = os.listdir(category_dir) for image_name in images: image_path = os.path.join(category_dir, image_name) # Perform further processing on each image

Preprocessing and disease detection

def preprocess_and_detect_disease(image_path): # Load the image image = cv2.imread(image_path)

# Preprocess the image gray_image = cv2.cvtColor(image, cv2.COLOR_BGR2GRAY) blurred_image = cv2.GaussianBlur(gray_image, (5, 5), 0) # Apply image processing techniques (e.g., thresholding) _, thresholded_image = cv2.threshold(blurred_image, 100, 255, cv2.THRESH_BINARY) # Find contours in the image contours, _ = cv2.findContours(thresholded_image.copy(), cv2.RETR_EXTERNAL, cv2.CHAIN_APPROX_SIMPLE) # Loop over the contours and detect fruit disease for contour in contours: # Calculate the area of the contour area = cv2.contourArea(contour) # Set a threshold for disease detection threshold_area = 5000 if area > threshold_area: # Draw a bounding box around the detected fruit x, y, w, h = cv2.boundingRect(contour) cv2.rectangle(image, (x, y), (x+w, y+h), (0, 255, 0), 2) # Display the output image cv2.imshow(‘Fruit Disease Detection’, image) cv2.waitKey(0) cv2.destroyAllWindows()

Example usage

image_path = ‘path_to_your_image.jpg’ preprocess_and_detect_disease(image_path)

submitted by /u/No-Bad-5051
[link] [comments]

Where Can I Find Historical Datasets On Cyberattacks?

I’m currently in search of datasets that contain historical cyberattacks and their features. More specifically, I am looking at these columns: Type of Malware, Attack Vector, Purpose, Attacker or Groups, Damages Done (in USD or number of people affected), Type of Sector, and Size of the Organization Affected. Any recommendations or sources where I can find such datasets?

submitted by /u/Much_Pineapple_6027
[link] [comments]

Dataset For Cyclone And Storm Damage Machine Learning

Looking for a dataset containing cyclone/storm damage to apply machine learning. All the damage data that I can find is a single number for each event. Ideally, I would like to know the damage for each event split by region (by region, this could be by postcode/zip code, suburb, etc). To specifically describe what I am after:

Time period: At least for the last 20 years, but more the better. County: Preferably Australia but happy for it to be any other county if that county has the required data available. Event: As mentioned in the title, interested in cyclone and storms. Note, I use the term cyclone to include events such as hurricanes, typhoons, etc. Damage: This could be total economic damage, recovery cost, lives lost, casualties or any other reasonable metric. Granularity: This is the most important feature I am after. The more granular the better. Ideally the damage data would be by postcode/zip code. Though perhaps that is too much to hope for so will take what I can get.

Thanks in advance!

submitted by /u/Nanoputian8128
[link] [comments]

Any Dataset Of Threaded Conversations Of Everyday Work?

I want to get hold of threaded communication that happens at work.

I have taken a look at,

Mailing lists, but mails are elaborate and I want to specifically train a model on shorter day to day conversations.
IRC archives don’t contain information about the message replied to.

Any open platforms/data sets you have come across where I can find the information containing regular day to day chats?

submitted by /u/lambainsaan
[link] [comments]

Maternal Mortality Rates In The United States, 2021

Hey Everyone!

I’m having issues attempting to decode the information provided by the CDC. I downloaded the Mortality Multiple Cause File for 2021, and the .txt file is – not only over 2GB, but also incomprehensible. I followed the accompanying .pdf file and was even more confused by its “List of File Data Elements and Tape Locations”, and how I’m supposed to use the file to comprehend a list of codes upon codes upon codes? Especially, when the .txt file has no structure, and when I try to follow a top down approach, codes don’t seem to match.

I wanted to ask if there is a common approach to this, or if I am missing something?

Additional Info:

I am using R for statistical analysis. I wanted the raw data for this reason. I attempted to convert the .txt file to a .csv file format using Python, and it helped by structuring the data a little, but I still don’t know what I am looking at in terms of what it all means.

This is how the rows look now: 11 7101 F1080 422210 4D1 2021U7CN C851129 039 13 0511I509 21I518 31I513 41C851 61M481 05 C851 I509 I513 I518 M481 100 01 184005949020

I would appreciate any, and all help. Thank you all very much in advance.

submitted by /u/Meece156
[link] [comments]

Building A Behavior Classifier For Flies: How To Approach The Problem?

Hey everyone,

I have a dataset that contains the positions of 9 flies for each frame. I want to build a behavior classifier based on this data, but I’m not sure how to approach the problem.

Sample: https://drive.google.com/file/d/1W960Z92f1im80o1l6FveWXBQI5883iRx/view?usp=sharing

My goal is to create an input that takes 9 rows at once, where each row represents the position of one fly, and then learn from it by finding distances between each body part of the flies with each other to determine whether they are touching, grooming, or avoiding.

Additionally, I would like to consider past frames while predicting current frame outputs. Does anyone have suggestions on how to approach this problem? Are there any similar models or approaches that already exist for this?

I’m open to using various machine learning models such as decision trees, support vector machines, or even deep learning models.

If you have any insights or resources that could help me get started, please let me know! Thanks in advance.

submitted by /u/SahilSingh2402
[link] [comments]