Looking for a tomato plant dataset in a polytunnel setup to predict growth and canopy coverage. Would be fine with a different plant for the time being. Thank you.

I’ve been working on a project using Python to compile a list of websites based in Europe that offer monthly subscription plans. Here’s my current approach:

1. Data Collection: I pulled data from the Common Crawl API for URLs from May 2024. This resulted in approximately 3 billion records. I started processing them in batches of 30,000 records. 2. Location Filtering: For each batch of 30,000 records (I’ve only done 3 batches so far), I used a free geo-location API to filter URLs by country based on their IP addresses, starting with the UK. This filtering narrowed it down to about 6,000 URLs per batch. 3. Subscription Plan Filtering: I have another script that filters these URLs based on the presence of keywords in the URL (such as “subscription,” “pricing,” “monthly,” “yearly,” etc.). I realize this step might not be the most efficient, as adding more filters increases the processing time. However, it has returned some websites that match the keywords.

So far, I’ve filtered around 90,000 URLs but found only one site matching my criteria. Most of the URLs in the results are either outdated websites or do not offer a subscription plan.

This method is proving inefficient, as it involves processing a vast number of irrelevant URLs.

My Question: Is there a smarter way to approach finding websites that specifically offer monthly subscription plans? Are there more efficient tools or APIs available that can directly provide this information, or any datasets that could help narrow down the search more effectively?

I’m open to using paid services if they can provide a more targeted and scalable solution. Any advice or recommendations would be greatly appreciated. Thanks in advance for your support!

Looking to build something useful based on analysis of product prices, SKU reviews count and review sentiment.

We built a methodology that allows us to represent the motivation of Github developers.

We do that using labeling functions like retention in the project, working diverse hours, etc.

The dataset, on 150k developers, and the creation and analysis code is at https://github.com/evidencebp/motivation-labeling-functions

Where would I find all publicly available word2vec datasets?
I know there is a google news, but are there other commonly used word2vec datasets?

I’m doing a project that requires that I have some historic rental datasets to look at. I’m specifically looking for datasets focused on Washington DC. I’m making a program to compare current rental prices to historic prices for buildings in the address. Anyone who could point me to a relevant set of data would be greatly appreciated.

Hey everyone! I don’t know if this is the right sub but I hope you can help me!

I need a platform that allows me to do the following: I must send several surveys to several clients and, in turn, my clients’ clients must respond to those surveys. They will respond with a few words, a maximum of four words or 30 characters, and with the results I want to put together a kind of graph. Google Sheets is the first thing that came to my mind. Then I have thought of a word cloud, or perhaps a list, putting the most repeated words at the top. I also want the platform or tool to be capable of compiling repeated words within the answers and putting them as one result. For example, if I ask who is your favorite soccer player and one person answers “Lionel Messi” and another person answers only “Messi”, I want only one result to appear: “Messi”. And the number of people who answered that is 2, (I don’t want two different results, one with the full name and another only with the last name). The thing is, I don’t know what people will reply. I don’t know if they’ll come up with a 1990 player or a kid who is now playing very well and is very young, so there are millions of players available to choose from and millions of ways of writing their names.

I had thought about Word Clouds, but the tools I found online have this error that they don’t compile repeated words. (So now I’m thinking that maybe a list of results would be better if the first option doesn’t exist) I would also like that once the survey, which is simply a single question, has been answered, it takes them to this graphic panel to see the result and see what the rest of the people are putting. For this, I thought that having Google Sheets or another platform or tool would be a good idea. I need them to be able to respond several times by re-entering the same link (if the survey is a Google Sheets one this can be done easily). I found the www.mentimeter.com but it cannot collect similar words. However, it is the one that I liked the most because of its simplicity and its adaptability to answer from the phone, which is very important for my case.

Hi Everyone

We built a subreddit to sell datasets, domains and more –https://www.reddit.com/r/sohonest/s/vll1WaKhYi

Join and you can start selling by just making the post!

Can someone please help me find this? I want to build something in python that will have match time, scores, competitors, country, athlete names, ect for the Olympics.

Which games has the most mods, and largest community of modders? (I.e. Sims TSR, Skyrim nexus, Minecraft Curse forge)

I would calculate it myself but I can’t find any data for average men. Does anyone know what the average and standard deviation is here? Any links to data is also appreciated.

I need household bankruptcy data by state. It could be raw numbers it could be by chapter filing I’m just doing a project on consumer bankruptcies compared across the states in the USA and can’t find anywhere that provides a data set of either a % or raw bankruptcy numbers. I’m curious if anyone has any suggestions?? Thanks

How do I get access to a detailed sales report of a (Preferrably a D2C brand) company to scrap a sales forecaster model. Any online resources/websites or do I need to reach out to a certain company. If that is the case to whom do I need to reach out to specifically? BOD, CAs

Hi!

Unfortunately, the Azure links for the dataset have gone private and are no longer available for public access.

I was wondering if anyone has Mind-Small validation data?

I need a full-fledged sales report dataset of a company including everyday reports of their products sold across platforms to scrap for a sales forecast model I’m building. Are there any websites that offer this for free?

Hey, I scraped rotten tomatoes! From each movie I grabbed the URL, title, release date, critic score, and audience score. These were the only data points I needed for my own needs so no other information is there. It’s major release US titles and it’s only from 1970 – 2024. If this is useful at all to you here is both the csv and json files.

This data is not ALL movies on rotten tomatoes in this range, unfortunately, rotten tomatoes uses very inconsistent naming conventions in their URLs which makes it very difficult not to miss a few movies here and there but I managed to get over 12,000 of them. I hope this is useful to someone.

https://drive.google.com/file/d/12IpMErb4j83h5gGTdTpv0WZOf5ceY7b3/view?usp=sharing

I want to get food product label information that is on the packaging. If you were to write to a company and ask for data on all their current products who would you contact? A Board Member, some customer service phone number or is there a better person to ask for this info? I do have a USDA database, but I am finding that some of their values don’t match the values on the labels from the store.

Any recommendations for an API or platform where I can get all goals for particular football players across their careers year by year? E.g Mohamed Salah from 2014-2024, Jude Bellingham 2020-2024 etc

There used to be an EZDI dataset but seems to have been removed by the creator. I’m looking for one that has voice records of medical terminologies.

Hello everyone.

Recently I embarked on the adventure of implementing a Guitar Chord classifier. My goal is to classify 14 guitar chords (A, Am, B, Bm, C, Cm, D, Dm, E, Em, F, Fm, G, Gm). Unfortunately, I found no publicly available datasets containing all of the chords as most contained only the non-minor chords. Therefore, I decided to build my dataset.

I shoot three different videos for each chord in three different locations of two different people playing the chords. The videos were shot in 4k 60fps so I had plenty of HQ frames to choose from.

I sampled 250 images for training, 100 for valid validating, and 100 for testing. After that, using Robflow I augmented my data, which is now publically available.

I started training my classifier with this data (MobileNetv2) and I was surprised to find that the model achieved almost 100% in the validation set (97%). I’m trying to figure out why that happened because it seems very suspicious to me but till now I cannot pinpoint the problem. I generated a PCA plot for each of the splits which can be found here: PCA

Any feedback would be appreciated 🙂

My goal is to never hear “I don’t have data” from ML people again.

So I did this app which is still experimental, it’s a search engine UI that uses a LLM to invent datasets that match your query. That means you can type any kind of dataset and you will always get results.

https://huggingface.co/spaces/infinite-dataset-hub/infinite-dataset-hub

For example for `star wars vs star trek preference classification`:

https://huggingface.co/spaces/infinite-dataset-hub/infinite-dataset-hub?q=star+wars+vs+star+trek+preference+classification

It was pretty fun to make, it runs for free on HF, and it’s open source in case you want to modify it.

Hi, can anybody provide a variety of data formatted in Excel that I can carry over to PPT to “beautify?” I’m trying to practice before having to create slides professionally.

Thanks in advance!

I’m looking for a classification dataset preferably with missing values that is beginner-friendly for a course project. I was wondering if anyone had any suggestions. Preferably one on Kaggle or UCI machine learning repository. Thanks in advance.

I have to check how the creative class(particularly musicians) responded to wars, how music got effected by these events. I am unsure how to approach this, it is not final I can make amends in this project and add things to it to get more useful insights but I am open to discussion, but all needs to be logical.

One thing I have come across is that I categorise the songs into protest songs, loss and grief, hope songs and etc. Then, compare these categorises.

I am open to ideas

I need some satellite images from the Earth, just plain photos without clouds, no water/forest or whatever other satellite images datasets are about.

My intention is to use computer vision (with a Jetson Orin Nano) in a drone which will be taking photos of the ground below it. These photos will be compared to the dataset images so that the drone can estimate its location without GPS (still not sure if this will workout, I wanna know your opinions on this too).

Correct me if I’m wrong, but I need datasets of a certain region because the whole Earth images dataset is extremely heavy on memory and a Jetson Nano SD card cannot store it all. So the dataset being able to be segmented into a region is also a must.