I’m working on a course project to do an analysis (NLP) on both the pages and wanted data for the last year (rutgers had a big union strike) while using the API I’m just able to get 1000 submissions at max which is about two months (yes they shit post a lot)

Tried: PRAW PUSHSHIFT

Found a random link on r/PUSHSHIFT that has data untill 2022

I am doing a project on finding which links download load links are fake on a website… I am finding it difficult to find a data set

All the websites I’ve looked at required some kind of access request which I find cumbersome.

Just a list of all french swear words. Can’t find it anywhere online.

l’m working on a course project to do an analysis (NLP) on both the pages and wanted data for the last year (rutgers had a big union strike) while using the API I’m just able to get 1000 submissions at max which is about two months (yes they shit post a lot)

Tried: PRAW PUSHSHIFT (doesn’t work)

Found a random link on r/PUSHSHIFT that has data untill 2022

HT also known by other umbrella terms such as, Trafficking in Persons (TIP), Trafficking in Human Beings (THB), Modern Slavery (MS), Modern Slavery Human Trafficking (MSHT).

I have two excel sheets both containing huge set of data of colleges names in different formats and abbreviations. I want to find the list of colleges common in both the sheets, however because of inconsistency in format names of colleges it is proving to be very tedious and difficult to do so. kindly suggest the best effective method to do the work.
Is there any way to do so in excel with the help of some other tool or maybe some in-build tools in excel. I have already used filters like sort, find and replace filters etc.

Im looking for .gov, .com and others as long as its official websites of cities, village etc in the US.

Dear community, I’m in search of a comprehensive dataset that includes Receipt Data and Invoice Data, with more than 100,000 item-lines in formats such as PDF, JPG, etc. Additionally, I need the corresponding general ledger/ERP entries, including the chosen account according to the chart of accounts, VAT, and so on.
I haven’t been able to find anything on the web. Does anyone know where I can obtain such datasets?

Hey everybody,

I’m currently building something that relates molecular biology, time-series algos and more to optimize muscle and strength building.

For that I need data in the form of workout logs from people. They should look something like this:

Deadlift 180kg 1×3

Squats 100kg 3×12

Lying Hamstring curls 50kg 3×8

Would help me out immensely if you have such a dataset / know someone who does and are willing to share it!

In return, everyone who contributes is invited to use the beta version for free of course!:)

Cheers,

Tim

​

Better way to prepare datasets ?

I have my datasets in format :

text : length 19k

extracted entity 1 : list of entity 1 extracted

extracted entity 2 : list of entity 2 extracted

Does anyone have idea on how to finetune opensource model with this kind of data .

Is finetuning better option becuase the model(llm) have to learn to extract items from the text and length of text is so large ?

Example : I have train a llm model to look at whole book text and extract author name, place name, people name Now I have 100 of books data how can I proeare datsets to fine-tune llm to be very good at extracting also consider I have supervised data of book text with extracted author, people name place name from whole text……
How can I finetune a good model let me know

I would like to run a regression analysis and am looking for data for crop yield, temperature, rainfall.

I am interested in soybeans.

Hi, I am doing a University Project, and part of it is creating a bill prediction service and I am having a really tough time finding good sources for what I need. I’m focusing on Bristol at the moment to help with initial development, but if there are datasets based on regions that would work too.

I need the average monthly cost for electricity and gas (separately) in Bristol dating back to at least 2018/19 to 2024, ideally with upper and lower values. I also need the price cap data (unit rates, standing charges) for those periods of time, which typically change every three months and have been posted by Ofgem, however I cannot seem to find any sources for previous years – only the current year.

I’d really appreciate any help, as I’ve said, I am really struggling to find valid datasets.

Hello, I’m trying to find historic daily pollen count for full year 2023 and YTD 2024 for North and South Carolina. I think Pollen.com only goes back 30 days, so would love to know if anyone has a promising lead. Thanks!

Hello! I’m trying to add bottle deposit data to my e-commerce store.

Does anyone know where I can find Bottle deposit information? I’d prefer something with UPC values to cross-reference against my products.

Has anyone trained Swin Transformer model in the research paper – “When Transformer Meets Robotic Grasping: Exploits Context for Efficient Grasp Detection”. If so plz share weights of trained model or any other suggestion to train faster.

Link to paper : https://arxiv.org/abs/2202.11911

Title. Doing a school project in R Studio and want to have it set up where I can plot a gradient to see higher vs. lower income areas at a glance.

I am looking for a dataset that has various features and a label identifying a real(an original account that may or may not be verified) and fake (an account impersonating someone else that has a twitter account), so far I have only been able to find the ones that identify bot accounts. Thanks

Hey Everyone!

I’m currently working on a project focused on analyzing different niches and growth trends within the data analytics industry. My objective is to gain insights into emerging trends, market opportunities, and career prospects within various niche segments of the data analytics field.

I’m reaching out to this community to seek assistance in gathering relevant datasets for my analysis. Specifically, I’m looking for datasets that include information on:

Market size and growth rates of different niche segments within the data analytics industry. Job demand, postings, and salary trends for various data analytics roles. Emerging technologies, tools, and applications in specialized areas of data analytics. Industry reports, research studies, or surveys providing insights into niche markets and trends.

I’m open to suggestions and recommendations for reliable sources or datasets that could contribute to my analysis. Any publicly available datasets, research reports, or academic publications related to the data analytics industry would be greatly appreciated.

Your assistance in finding suitable datasets for this project would be invaluable to my research efforts. Thank you in advance for your help and contributions.

Hi everyone!

Where can i find a really messy CRM dataset? I have been told that I’ll be working with CRM data in about a month, so looking for similar datasets to practice on.

My project partner and I would like to analyze the association between air pollution, floods, and other environmental concerns and health outcomes like respiratory diseases, prenatal health, premature birth, etc. I’ve been looking for datasets for this specific aim but haven’t found one. There are multiple studies on this topic, but I can’t seem to access the datasets.

​

I am trying to import a csv file to my mysql localhost server, but this error is coming:
Unhandled exception: ‘charmap’ codec can’t decode byte 0x8d in position 4887: character maps to <undefined>
I’ll link the csv file too, please do try to import it, if you are successful then PLEASE HELPPPPPP!
link: https://drive.google.com/file/d/16s54EfGnKFeedkD0Z-JItt_piqKPA370/view?usp=sharing

Hello, this is a bit of a specific request. I’m wondering if anyone has any suggestions for finding a dataset with patient data including all (or at least most) medical conditions the patient had and their birth/death dates.

I’m having difficulty finding this looking around on various databases.

I am stuck on part 2! I am unable to find similar datasets with at least 100 values. I’m hoping for 150 to 200. Please Help! I can do parts 3 & 4 I just can’t find that data! at this point, I don’t care what the data pertains to!

The Project (Outlined Below)

The project must be submitted as a single PDF file after completing the following tasks.

Only one group member needs to submit the report. Note that if you submit a DOCX

or XLSX file for your project, you will receive a score of 0.

Download two data sets you can compare containing similarly quantifiable information (such as stock prices, economic indicators, sports analytics, and weather forecasts) that have at least 100 data values each. If you downloaded a .csv file, save it as a .xlsx file. You can find data sets on dataset search. research. google.com, data.gov, or simply Googling “public data sets”.

Set up the file with two data sets of equal size (at least 100 data values each).

Create a frequency distribution table and frequency polygons of both data sets.

Use the minimum value in the data set as your lowest class limit.

Compute the mean, median, variance, standard deviation, coefficient of variation

of each dataset.

I’m looking for some sort of Sanskrit corpus where the words are in a Romanized script for a research paper. Does anyone have any suggestions? I’ve already found this: https://sanskritdocuments.org/dict/dictall.pdf, but I want to know if there are any other corpora out there that are a bit more credible/reputable.

I have to create a power BI project with a data which should be present in MySQL online hosted server But the problem is that the data which i have is 2 tables with 130k rows each (csv files), and i made a mysql server on freemysqlhosting.net but there are 2 problems, firstly it has a 5mb limit for the database Secondly each row takes about 4 seconds to upload And on this speed i think itll take 6 days to just upload 1 table

Is there any other way to do this? Maybe something like, i could make the database in the local mysql server with the tables which doesn’t take much time and then i could maybe set up this server to be accessible to publoc somehow Please help🥲

I am trying to find good datasets for classifying web images as ads, so that I can use it to train an image classification model for filtering out ads and only downloading useful image content from websites. I would also be interested in sets for classifying marketing/ad text to help with filtering out ad captions as well. I’m suspecting that there might be issues with copyright that are preventing people from releasing ad sets publicly, but I’m hoping that something is out there.
I found this dataset on PapersWithCode, and several sets that use old banner ads from the 90s/early 2000s, but I am wondering if there are any other publicly available web ad datasets with more recent data.
Does anyone have suggestions on good quality public datasets or preexisting classification models for ad detection?

Hi all, hope you guys are doing well!

I am doing a project on lymphoma detection using WSI images of lymph node tissues. I am a bit stuck as I cannot find any control dataset for this project. I am looking for a dataset which contains WSI images of healthy Lymph node tissues which can help me in the classification model.

Please leave any tips or suggestions that can be helpful

What the title says. I would like to get some data about non-technical loss of Eletrical Energy for work with machine learning for my masters program.

Hey, i wanna reproduce some paper and it requires this dataset:
https://pan.baidu.com/s/1rnUoDm7IxxmX1n1LmtXNXw#list/path=%2F,
can anyone help how to download it? It requires baidu account which requires chinese phone number to authenticate.