Hi Everyone I have the 40k tax invoices/bills data which is generated by me which looks like real invoices/bill only. Can anyone help me to connect with someone who needs data ? There is no legal issue as the invoices belongs to me only. You can DM me for rates and further details. Thanks

for college project i urgently needed forest fire satellite images dataset, any information links or anything related to this would be valuable to me. please help me find forest fire dataset i would be so grateful to you guys

I am creating an API for food etymology. I am debating the choice of creating a new dataset by scraping open source forums and websites or using a dataset if avaliable.

I wanted to ask if there are any already available datasets for food-etymology or food history ?

Sage Business Vision Delta DOS based accounting software from the 80s/90s. The data files are .ism and .idx, I’ve not been able to figure out a way to export this data to csv files. Hoping there is somewhere out there who has done this and can help. Thanks!

Working on a multi-modal approach for classification.

Hi All,

I am looking for a dataset for football players that would include their key performance stats, days of injury, xG etc over the years. Can you all suggest good sources or existing datasets on the same?

I want to collect in game player behavior for Xbox/playstation/steam but how can I do this? Unfortunately they won’t sell the data so some ideas I have are (1) tracking each pixel, (2) using video recognition on twitch videos, or (3) sending out surveys. It appears to be unobtainable to hack into an Xbox server to do this.

I know Kaggle has like a lot of data cleaning datasets, but most of them already had their data one hot encoded, or cleaned. Trying to find datasets that are uncleaned like in areas of Housing Prices, Loan etc. Mostly regression or classification is what i am looking for

I’m interested in data that is continuously being updated. It should be real world data that is useful. Thanks.

I’m fairly new to reddit so please forgive me if there’s a subreddit this thread would be more suited to!

Context: I’m currently working on my research proposal paper for a PhD in Fine Arts. I’m primarily a painter, so this is a practice-led research project on the subject of post-photography/image theory, post-digital visual culture and traumatic representation. I am by no means a data scientist and have a very base level understanding of ML and image recognition, but as I’m exploring traumatic representation in images on the internet/in relation to screen culture, my work does somewhat intersect with the field of computer vision – which is, of course, what brings me to Reddit.

I’m interested in how image recognition is used for the automated moderation/censorship/removal of “sensitive” content on social media platforms. I’m trying to locate any known dataset that’s been used to train this kind of image recognition model – I know there are plenty of datasets specifically for training ML to identify porn, but as my research revolves around trauma I’d ideally like to find one that includes a broader range of NSFW categories (violence, gore, etc.). I’m not too hopeful that any image based dataset of this kind would be publicly accessible (I suppose you’d hope it wasn’t), but alas, just putting this out here if anyone has any leads.

Even if you can’t answer my question, any thoughts/feedback/comments on this are more than welcome. I don’t particularly speak the language of computer science, but always open to having conversations about the project 🙂

Hello,

We are using GDELT events for our project but have realised that many events need reclassification to the correct event code after taking a closer look at the data.

We are considering clustering techniques or using proprietary/OS LLMs for this task. But we want to make sure that we are not duplicating the same strategy by gdelt itself.

To evaluate this, I have been trying to read about Gdelt’s actual classification strategy. What does it do to classify one event to a CAMEO code? How is it happening automatically? Without much luck as I cannot find any documentation on this.

Any help is much appreciated!

Hello everyone, I want to download some logs file to analyze them like webserver logs / server logs / application logs … Where I can download them. Thanksss

Does anyone know of a reilabel API(preferably free) that offers prp bets for major sports-(NFL, NBA, MLB), i need the odds and results too.

Hi, i’m looking for an open source dataset containing clips of gameplay from titles such as csgo, dota2, witcher3, gtaV, minecraft, etc. at a quality of atleast hd.

Does anyone know any such dataset? TIA

Recently I’m building a dictionary & flashcard app, i’m using cambridge-dictionary-api to get dictionary data, but I also want to have a search suggestion for my search bar, I have tried to use puppeteer to get search suggestion data from cambridge dictionary website but it was sooo slow, so I want to use Trie data structure to get the search suggestion data, but I can’t find the dataset for all the english word.

Any one knows any dataset about that?

Hello, everyone!

Are there any free publicly available datasets with data like market name, market size in 2023, projected market size, etc. (e.g. global bakery products market size, global smartphone market size, …, basically the most popular and established market sizes)? And are there any paid versions?

During my googling, I only found websites with separate market sizes, written in form of a report. I would really like to have a proper dataset, with the biggest markets and their sizes written in a nice way.

I don’t mind getting a bit inaccurate sizes. But at least orders of magnitude should be correct.

I tried to generate one using different LLMs, but all of them just hallucinated the numbers. If there isn’t a dataset, I will probably have to just web scrape all the markets one by one.

Hi everyone,

I’m working with a dataset that’s approximately 200GB in size, and it is split into 200 compressed parts on Google Drive, named like this:

My Google Drive has a total capacity of 500GB, with 250GB of free space available.

I understand that on a Linux system, I can combine and uncompress all parts using the following commands:

However, when I try to perform this operation on Google Colab, I encounter the following error:

Has anyone faced a similar issue or does anyone have suggestions on how to handle this? Any help would be greatly appreciated!

Thanks in advance!

Several years ago now my college accidentally sent the entire faculty and student directory master excel sheet through email. Now I cant remember who they sent it to, if they rescinded it moments later but I was staring at my email when it was sent. I opened it and downloaded it, it contains over 5000 email addresses, majors, home phones numbers and cell phone numbers. Now I am curious as to what I could do with this data, I understand its usually very hard to come across something like this unless sold you. Are there legal aspects? Could these be email marketing leads? Obviously scammers, etc would love this but id like to just be ethical about it.

Thanks…

Hello! I’m starting a thesis on data analytics and fast fashion, do you know where can I find some dataset with maybe some of the retailer’s data like sales, stocks, etc?

for example: Margerita pizza 1 image, Pepperoni Pizza 1 image.

like this I want images of all popular dishes.

I’m looking for public datasets on consumer/household expenditures in the US by county and household size. I know the BLS’s Consumer Expenditure Survey provides this data, but it’s not available on a county level. Does anyone know where this information is available? I’d like to see mean values for rent/mortgage, food (both store-bought groceries and delivery/restaurant), and other household expenses for Manhattan (NY County) specifically. Thank you!

Hi, I need to get data for marketing of our company, What is the best way to extract data from Linkedin?
Is there an existing service for getting Contacts of Linkedin profiles and searching the companies?
I need the contacts of companies working in Cryptocurrency. Thanks for your helps in advance.

Hey, I just joined a new job as Data Manger with little to no experience in the field and they told me that they want to move away from SAS for the data base.

As I said, I have almost no experience in this filed and they are looking for my input on where we can migrate to. It is a fairly big data base with (I think) about 1 TB of storage of medical information on different studies and patients (we are studying sleep apnea and other sleep illnesses)

Does anyone have suggestions or ideas on what I could propose to the team to switch?

I don’t know the exact structure, but we seem to be using SAS for generating queries and saving the data base and we use MySQL to look at the different tables and gather the necessary info.

Hi All, I need to find a dataset which has at least 20 predictors and 100 observations. I need this dataset for a university assignment where we are going to run a linear regression model on this dataset. Any datasets that fit the criteria are welcome. Thanks!

now I am trying to do a project which is associated with the representation learning for large scale dynamic network, and I want to look for a reliable reddit data set( the data should include post_id, user_id, time, comment). So that I can build the graph by using the user as node and if two user comment the same post i can build one edge.

The macro task of the current article is to create a representation learning. For the purpose of the reddit dataset (build a good representation learning to complete a community search based on a graph of social network data. I want to use reddit data to complete my project, and I have some requirements for the data I need. I want the reddit dataset to contain users as nodes, and then I want to use different users to comment on the same post to build edges. I tried a few datasets, but I feel that none of them meet my needs. I would like to ask if you have a link to a reddit dataset that meets my needs. The following are what I have tried：

https://github.com/dingidng/reddit-dataset (I only can create several edge based on these data which is not making sense) https://snap.stanford.edu/graphsage/#datasets (the node is not user)

And I also have problem about how to using the Pushshift to access any Reddit data. Since whenever I submitted the request of the access to the data, my request will be rejected by the bot automatically. If anyone knows how to use the pushshift to access the data set and get the access permission for that.
https://pushshift.io/signup

This is my first time posting for help, thank you for any help you can provide！

I have been searching for a dataset that contains screenshots of social media posts from various platforms (Twitter, Instagram, Truth Social, Facebook, etc.). I have been able to find datasets that contain URLs of social media posts, but none of sufficient size that include screenshots. I would like at least 1,000 images per platform. Please let me know if there are any datasets that you know of or if you have any advice.

Hello everyone,

I recently started to learn about AI and RNN. I started to learn how do models work. But recently I wanted to do something else I though i can make my first NLP model from scratch but the main problem is that there is little to no information on how to make a rich dataset to train the model.

I’ve looked everywhere but whenever I put the model to test the results are very bad.

Can someone help me or refer me to dataset examples that it is used for training a chatbot model? Thanks

Interested in working with data on war casualties. Wikipedia has an interesting page (List of battles by casualties), but the data seems implausible/lacking evidence/sources.

E.g., the Battle of Stalingrad is listed with 1,250,000 to 4,172,000 casualties while the Battle of Berlin is listed with 1,286,367 casualties.

These numbers fall out of numbers I read elsewhere. Is there a more reliable list/dataset to be found online?

I’m also looking for the average square footage of the hotels and grocery stores in certain countries for an energy project.

How would you go about doing this research? Ive started with Google searches, looking up tourism ministries but it feels impossible!!