Good evening/morning/night everyone;

My professor suggested to use the International Energy Agency dataset (as if there was just one) to obtain past data on Co2 emissions per country. The international energy agency appears to require 900 euros for a twelve month access as the smallest possible transaction.

Two questions:

1 – do you know any free dataset that covers single countries’ past Co2 emissions?

2- do you know any way to get the International Energy Agency dataset for free? any site? What prompts such question, of perhaps dubious legality, is that the very director of the agency has started the process of making its database free, as it is basically sustained by public money anyway. t is for a master’s thesis; there is no profit involved.

We have a setup for surface particle quantification, where we classify particles in few different classes wrf their size. However, we are able to measure only roughly 80% of the whole surface. Question would be: how to extrapolate the amount to 100% surface, and is probability-plot the right direction? Or do you have any other proposal?

A standard spatial dataset would have a list of n coordinates (like X and Y or longitude and latitude) and then n sets of covariates (local attributes). I’m looking for a spatial dataset like this that replicates these n data points K times, where K is the number of global attributes, and each global measurement applies uniformly to all n locations.

I am wanting to analysis weather data (Historic station data – Met Office) and I’m struggling to export the raw data in each stations txt file into a pandas dataframe, does anyone know and can explain the steps into how I can achieve this?

I am looking for Zip Codes with the Metropolitan Statistical Area, Longitude and Latitude Data, County, City, State, etc…I cannot find a complete dataset anywhere-any help is greatly appreciated.

Hi Everyone I have the 40k tax invoices/bills data which is generated by me which looks like real invoices/bill only. Can anyone help me to connect with someone who needs data ? There is no legal issue as the invoices belongs to me only. You can DM me for rates and further details. Thanks

for college project i urgently needed forest fire satellite images dataset, any information links or anything related to this would be valuable to me. please help me find forest fire dataset i would be so grateful to you guys

I am creating an API for food etymology. I am debating the choice of creating a new dataset by scraping open source forums and websites or using a dataset if avaliable.

I wanted to ask if there are any already available datasets for food-etymology or food history ?

Sage Business Vision Delta DOS based accounting software from the 80s/90s. The data files are .ism and .idx, I’ve not been able to figure out a way to export this data to csv files. Hoping there is somewhere out there who has done this and can help. Thanks!

Working on a multi-modal approach for classification.

Hi All,

I am looking for a dataset for football players that would include their key performance stats, days of injury, xG etc over the years. Can you all suggest good sources or existing datasets on the same?

I want to collect in game player behavior for Xbox/playstation/steam but how can I do this? Unfortunately they won’t sell the data so some ideas I have are (1) tracking each pixel, (2) using video recognition on twitch videos, or (3) sending out surveys. It appears to be unobtainable to hack into an Xbox server to do this.

I know Kaggle has like a lot of data cleaning datasets, but most of them already had their data one hot encoded, or cleaned. Trying to find datasets that are uncleaned like in areas of Housing Prices, Loan etc. Mostly regression or classification is what i am looking for

I’m interested in data that is continuously being updated. It should be real world data that is useful. Thanks.

I’m fairly new to reddit so please forgive me if there’s a subreddit this thread would be more suited to!

Context: I’m currently working on my research proposal paper for a PhD in Fine Arts. I’m primarily a painter, so this is a practice-led research project on the subject of post-photography/image theory, post-digital visual culture and traumatic representation. I am by no means a data scientist and have a very base level understanding of ML and image recognition, but as I’m exploring traumatic representation in images on the internet/in relation to screen culture, my work does somewhat intersect with the field of computer vision – which is, of course, what brings me to Reddit.

I’m interested in how image recognition is used for the automated moderation/censorship/removal of “sensitive” content on social media platforms. I’m trying to locate any known dataset that’s been used to train this kind of image recognition model – I know there are plenty of datasets specifically for training ML to identify porn, but as my research revolves around trauma I’d ideally like to find one that includes a broader range of NSFW categories (violence, gore, etc.). I’m not too hopeful that any image based dataset of this kind would be publicly accessible (I suppose you’d hope it wasn’t), but alas, just putting this out here if anyone has any leads.

Even if you can’t answer my question, any thoughts/feedback/comments on this are more than welcome. I don’t particularly speak the language of computer science, but always open to having conversations about the project 🙂

Hello,

We are using GDELT events for our project but have realised that many events need reclassification to the correct event code after taking a closer look at the data.

We are considering clustering techniques or using proprietary/OS LLMs for this task. But we want to make sure that we are not duplicating the same strategy by gdelt itself.

To evaluate this, I have been trying to read about Gdelt’s actual classification strategy. What does it do to classify one event to a CAMEO code? How is it happening automatically? Without much luck as I cannot find any documentation on this.

Any help is much appreciated!

Hello everyone, I want to download some logs file to analyze them like webserver logs / server logs / application logs … Where I can download them. Thanksss

Does anyone know of a reilabel API(preferably free) that offers prp bets for major sports-(NFL, NBA, MLB), i need the odds and results too.

Hi, i’m looking for an open source dataset containing clips of gameplay from titles such as csgo, dota2, witcher3, gtaV, minecraft, etc. at a quality of atleast hd.

Does anyone know any such dataset? TIA

Recently I’m building a dictionary & flashcard app, i’m using cambridge-dictionary-api to get dictionary data, but I also want to have a search suggestion for my search bar, I have tried to use puppeteer to get search suggestion data from cambridge dictionary website but it was sooo slow, so I want to use Trie data structure to get the search suggestion data, but I can’t find the dataset for all the english word.

Any one knows any dataset about that?

Hello, everyone!

Are there any free publicly available datasets with data like market name, market size in 2023, projected market size, etc. (e.g. global bakery products market size, global smartphone market size, …, basically the most popular and established market sizes)? And are there any paid versions?

During my googling, I only found websites with separate market sizes, written in form of a report. I would really like to have a proper dataset, with the biggest markets and their sizes written in a nice way.

I don’t mind getting a bit inaccurate sizes. But at least orders of magnitude should be correct.

I tried to generate one using different LLMs, but all of them just hallucinated the numbers. If there isn’t a dataset, I will probably have to just web scrape all the markets one by one.

Hi everyone,

I’m working with a dataset that’s approximately 200GB in size, and it is split into 200 compressed parts on Google Drive, named like this:

My Google Drive has a total capacity of 500GB, with 250GB of free space available.

I understand that on a Linux system, I can combine and uncompress all parts using the following commands:

However, when I try to perform this operation on Google Colab, I encounter the following error:

Has anyone faced a similar issue or does anyone have suggestions on how to handle this? Any help would be greatly appreciated!

Thanks in advance!

Several years ago now my college accidentally sent the entire faculty and student directory master excel sheet through email. Now I cant remember who they sent it to, if they rescinded it moments later but I was staring at my email when it was sent. I opened it and downloaded it, it contains over 5000 email addresses, majors, home phones numbers and cell phone numbers. Now I am curious as to what I could do with this data, I understand its usually very hard to come across something like this unless sold you. Are there legal aspects? Could these be email marketing leads? Obviously scammers, etc would love this but id like to just be ethical about it.

Thanks…

Hello! I’m starting a thesis on data analytics and fast fashion, do you know where can I find some dataset with maybe some of the retailer’s data like sales, stocks, etc?

for example: Margerita pizza 1 image, Pepperoni Pizza 1 image.

like this I want images of all popular dishes.

I’m looking for public datasets on consumer/household expenditures in the US by county and household size. I know the BLS’s Consumer Expenditure Survey provides this data, but it’s not available on a county level. Does anyone know where this information is available? I’d like to see mean values for rent/mortgage, food (both store-bought groceries and delivery/restaurant), and other household expenses for Manhattan (NY County) specifically. Thank you!

Hi, I need to get data for marketing of our company, What is the best way to extract data from Linkedin?
Is there an existing service for getting Contacts of Linkedin profiles and searching the companies?
I need the contacts of companies working in Cryptocurrency. Thanks for your helps in advance.

Hi All, I need to find a dataset which has at least 20 predictors and 100 observations. I need this dataset for a university assignment where we are going to run a linear regression model on this dataset. Any datasets that fit the criteria are welcome. Thanks!