Hey all,

I’ve been thinking a lot about how data quality is getting harder to manage as everything scales—more sources, more pipelines, more chances for stuff to break. I wrote a brief post on what I think are some of the biggest challenges heading into 2025, and how teams might address them.

Here’s the link if you want to check it out:
Data Quality Challenges and Solutions for 2025

Curious what others are seeing in real life.

Hi everyone! I’m working on a machine learning project to detect people littering in images or videos (e.g., throwing trash in public spaces). I’ve checked datasets like TACO and UCF101, but they don’t quite fit as they focus on trash detection or general actions like throwing, not specifically littering.

Does anyone know of a public dataset that includes labeled images or videos of people littering? Alternatively, any tips on creating my own dataset for this task would be super helpful! Thanks in advance for any leads or suggestions!

Planning to create a dataset of government documents, previously published in paper format (and from a published selection out of archives at that).

These would be things like proclamations, telegrams, receipts, etc.

Doing this is a practice and a first attempt, so some basic questions:

JSON or some other format preferred?

For any annotations, what would be the best practice? Have a “clean” dataset with no notes or have one “clean” and one with annotations?

The data would have uses for language and historical research purposes.

Hi, I have developed my own SaaS website that dilivers Reddit posts and comments based on a keyword or regex pattern you insert when submitting an order.

Its now early stage, and the orders are dilivered semi-auto, but it will be super fast soon.

Sign up and get free 1000 credits.

Hi all — I’m an internal medicine resident working on research for upcoming abstract submissions (ASH/ASCO/NCCN) and I’m currently using the HCUP NIS dataset (2017–2022).

I’m comfortable with clinical ideas and statistical concepts but still learning Stata/NIS navigation. Specifically, I’m looking for: • Guidance on setting up Stata to load NIS .asc files correctly • Help choosing variables and outcomes for a GI/GU cancer disparities study • Any tips from those who have published or submitted NIS-based abstracts to ASCO, ASH, or similar

i cannot find any good data, do you guys have some suggestions?

Howdy homies 🙂 I had my own analysis to do for a job and found out pytrends is no longer maintained and no longer works, so I built a simple API to take its place for me:

https://rapidapi.com/super-duper-super-duper-default/api/super-duper-trends

This takes the top 25 4-hour and 24-hour trends and delivers all the data visible on the live google trends page.

The key benefit of this over using their RSS feed is you get exact search terms for each topic, which you can use for any analysis you want, seo content planning, study user behavior during trending stories, etc.

It does require a bit of compute to keep running so I have tried to make as open a free tier as I could, with a really cheap paid option for more usage. If enough people use it though I can drop the price since it would spread over more users, and costs are semi-fixed. If I can simplify setup with docker more easily I’ll try to open source it as an image or something, it’s a little wonky to set up as it is.

Hit me with any feedback you might have, happy to answer questions. Thanks!

Secure your face recognition system with EasyShield — an open-source AI solution built to detect and defend against print and replay attacks. It’s designed for easy integration into a wide range of projects.

EasyShield provides ready-to-use model weights and a practical, reliable anti-spoofing pipeline. Our paper will be published soon.

A GitHub star ⭐ would be a great encouragement — thanks!

Hi, is anyone knows recommended dataset about Azerbaijan (market sales, car sales etc.)?
I need it for my classroom project

Hi everyone!

I’m organizing a fun and educational data workshop for first-year data students (Bachelor level).

I want to build a murder mystery/escape game–style activity where students use Python in Jupyter Notebooks to analyze clues (datasets), check alibis, parse camera logs, etc., and ultimately solve a fictional murder case.

🔍 The goal is to teach them basic Python and data analysis (pandas, plotting, datetime…) through storytelling and puzzle-solving.

✅ I’m looking for:

• Example datasets (realistic or fictional) involving criminal cases or puzzles
• Ideas for clues/data types I could include (e.g., logs, badge scans, interrogations)
• Experience from people who’ve done similar workshops

Bonus if there’s an existing project or repo I could use as inspiration!

Thanks in advance 🙏 — I’ll be happy to share the final version of the workshop once it’s ready!

Dioxus is a relatively new but popular framework. That said, comparatively there are not a lot of source example projects, documentation, and articles that would help LLMs learn to write Dioxus code during training. It may take years for this to get up to speed. That said, on the discord, there are thousands of members and each day the team fields dozens of questions from active developers in community. But I don’t think commercial LLMs have access to discord and thus these technical discussions. Is there a place to best expose this so future commercial LLMs would likely pick up this data?

Hey everyone, I’m currently working on a project where I’m building a kill prediction model for CS2 players, and I’m looking for a dataset with all the relevant stats that could help make this model accurate.

Ideally, I’m looking for a dataset that includes detailed player-level and match-level statistics, such as: • Player ratings (e.g., HLTV rating 2.0, impact rating) • Kills per round, deaths per round, damage per round • Headshot percentage, opening duels (won/lost), clutch stats • Match context (opponent team rank, map played, event type, BO1/BO3, etc.) • Team-level metrics (team ranking, recent form, match odds)

If anyone has scraped something like this or knows where I can find it (CSV, SQL, JSON — anything works), I’d really appreciate it. I’m also open to tips on how to collect this data if there’s no clean public source.

Thanks in advance!

Hi All,
I am a data scientist who wants to use the Parish Register Aggregate Analyses, 1662-1811 dataset hosted by UK Data Service. However, I am not affiliated with a UK college or university so I cannot login.

I am requesting that someone affiliated with a UK higher ed institution download the dataset for me. The dataset is located here: https://beta.ukdataservice.ac.uk/datacatalogue/studies/study?id=4491

Thanks!

Hi! Has anyone here used football-api.com before?
I’m trying to get fixtures for FINLAND: Suomen Cup matches scheduled for tomorrow. I’m using 2025 as the season and sending the following request

Any idea when newer seasons like 2024 or 2025 will become available on the free tier?
Weirdly enough, it worked just yesterday for the 2024 English Premier League — now both 2024 and 2025 seem blocked?

 "get": "fixtures", "parameters": { "league": "135", "season": "2025", "from": "2025-05-27", "to": "2025-05-29" }, "errors": { "plan": "Free plans do not have access to this season, try from 2021 to 2023." }, "results": 0, "paging": { "current": 1, "total": 1 }, "response": [] 

Need data to work on disease detection project for saffron. Please help to provide relevant data sets in regards to this.

Im a high school student doing a science fair project on AI and waste identification and i cannot find any datasets that focus on this for the life of me. Hoping you all will have something to help me out.

I’m currently working on a project that involves analyzing the global natural gas markets. While I’ve found a valuable dataset for Europe specifically, Bruegel’s European natural gas imports dataset I’m looking to expand my research to include other regions and obtain more comprehensive data.

Could anyone recommend reliable datasets or APIs that provide up-to-date information on natural gas markets, including aspects like prices, production, consumption, imports/exports, and storage levels? I’m particularly interested in data that covers regions beyond Europe, such as North America, Asia, and the Middle East.

Any suggestions or pointers to resources would be greatly appreciated!

I’m looking for a dataset that includes crawled onion links with titles and descriptions or site content, I’ve been crawling myself and made a filter to remove CP but due to the speed of the TOR network it’s quite a slow process and all the datasets I could find were outdated, these sites go down a lot,

any help would be appreciated, thanks!

Can someone tell me where collect Data about Soil data collection Climate data Market Data of crops

https://huggingface.co/datasets/AmarAleksandr/OusiaBloom

Ousia Bloom is an evolving, open-source record of personal consciousness made for the future. Mostly Incoherent now.

Using data from the excel file and coding in Python, you should now estimate the following: for each ETF, estimate the sensitivity of ETF flows to past returns. a. Write down the main regression specification, and estimate at least five regression models based on it (e.g., with varying the number of lags). Then, present the regression output for one ETF of choice, including coefficients with t-stats, R squared, and number of observations.

a. Estimate the OLS regression from (2a) for each ETF and save betas. Then, conduct cluster analysis using k-means clustering with different variables, but for a start, try these two dimensions: i. Flow-performance sensitivity (i.e., betas from point (2)) vs fund size (AUM). ii. Propose at least one other dimension, and perform the cluster analysis again. What did you learn? iii. Now, instead of clustering, analyse fund types, and see whether flow- performance sensitivity varies by fund type.

dm me so that I can send you the cleaned up data

Hi everyone,

Any ideas on how I could have access to IEA’s World Energy Outlook 2024 extended data set (without paying 23k€) ? I am doing research on the storage solutions and would need to have their data on pumped hydro, batteries behind the meter and utility scale, and others. This for their NZE, STEPS and APS scenarios. Thanks for the help !

I am looking for official compliance account data for bank data. I looked FDIC office of comptroller and see lots of regulations which is great but not any sample data I could use. This doesn’t have to be great data just realistic enough that scenarios can be run.

I know that if your working with bank you will get this data. However it would be nice to run some sample data before I approach a bank so I can test things out.

Hi! I am trying to build a ML model to detect Reddit bots (I know many people have attempted and failed, but I still want to try doing it). I already gathered quite some data about bot accounts. However, I don’t have much data about human accounts.

Could you please send me a private message if you are a real user? I would like to include your account data in the training of the model.

Thanks in advance!

Hi i’m looking for datasets which contains accurate vulnerabilties related to 5G, this could be really useful for my thesis project.

Hi everyone,

I’m sharing a dataset I built while working on a recent project where I needed a list of countries and cities with accurate Arabic translations and population data.

I checked out several GitHub repositories but found most were:

• Incomplete or had incorrect translations
• Missing population info
• Not consistently formatted
• Labeled incorrectly — many included states but called them cities

So I decided to gather and clean the data myself using trusted sources like Wikidata, and I’m making it publicly available in case it helps others too.

What’s included:

• Countries
• Cities
• Arabic and English names
• Population data (where available)

Available formats:

• CSV
• Excel (.xlsx)
• JSON
• JSONL
• SQL insert script

All files are open-source and available here:

🔗 https://github.com/jamsshhayd/world-cities-translations

Hopefully this saves other developers and data engineers some time. Let me know if you’d like to see additional formats or data fields added!