I’m releasing a limited open dataset of Truth Social activity focused on Donald Trump’s account.
This dataset includes:

• 31.8 million comments
• 18,000 posts (Trump’s Truths and Retruths)
• 1.5 million unique users

Media and URLs were removed during collection, but all text data and metadata (IDs, authors, reply links, etc.) are preserved.

The dataset is licensed under CC BY 4.0, meaning anyone can use, analyze, or build upon it with attribution.
A future version will include full media and expanded user coverage.

Heres the link 🙂 https://huggingface.co/datasets/notmooodoo9/TrumpsTruthSocialPosts

All of the data right now is point-in-time. What would you like to see from a 7 year look back period?

Hi, I’m doing some research into how AI, robotics, and perception teams source real-world data (like driving or mobility footage) for training and testing models.

I’m especially interested in understanding how much demand there really is for high-quality, region-specific, or legally-cleared datasets — and whether smaller teams find it difficult to access or manage this kind of data.

If you’ve worked with visual or sensor data, I’d love your insight:

• Where do you usually get your real-world data?
• What’s hardest to find or most time-consuming to prepare?
• Would having access to specific regional or compliant data be valuable to your work?
• Is cost or licensing a major barrier?

Not promoting anything — just trying to gauge demand and understand the pain points in this space before I commit serious time to a project.
Any thoughts or examples would be massively helpful

Looking for datasets in mainly Swedish and Norwegian languages that contain toxic comments/insults/threats ?

Helpful if it would have a toxicity score like this https://huggingface.co/datasets/google/civil_comments

but without it would work too.

https://drive.google.com/file/d/11mF6Kocs3eBVsli4qGODOlyrKWBZKL1R/view?usp=sharing

Just thought i would share what i made, it is probably out dated by now, if this gets enough attention, i will consider regenerating it.

We just added a Hugging Face Datasets integration to fenic

You can now publish any fenic snapshot as a versioned, shareable dataset on the Hub and read it directly using hf:// URLs.

Example

“`python

Read a CSV file from a public dataset

df = session.read.csv(“hf://datasets/datasets-examples/doc-formats-csv-1/data.csv”)

Read Parquet files using glob patterns

df = session.read.parquet(“hf://datasets/cais/mmlu/astronomy/*.parquet”)

Read from a specific dataset revision

df = session.read.parquet(“hf://datasets/datasets-examples/doc-formats-csv-1@~parquet/*/.parquet”) “` This makes it easy to version and share agent contexts, evaluation data, or any reproducible dataset across environments.

Docs: https://huggingface.co/docs/hub/datasets-fenic Repo: https://github.com/typedef-ai/fenic

Hi everyone,

I’m working on an automation + machine-learning project focused on content performance in the niche of AI automation (using n8n, workflow automations, etc). Specifically, I’m looking for a dataset of public posts from Instagram Threads (threads.net) that includes for each post:

– Post text/content

– Timestamp of publication

– Engagement metrics (likes, comments/replies, reposts/shares)

– Author’s follower count (or at least an indicator of their reach)

– Ideally, hashtags or keywords used

If you know of any publicly available dataset like this (free or open-source) or have scraped something similar yourself, I’d be extremely grateful. If not I’ll scrape it myself

Thanks in advance for any pointers, links, or repos!

I needed a glovo scraper on apify but the one that exists already has been broken for a few months. So I built one myself and uploaded it to apify for people to use it.

If you need to use the scraper for big data feel free to contact me and we can arrange a wayyyy cheaper option.

The current pricing is mainly for hobbyists and people to try it out with the free apify plan.

https://apify.com/blagoysimandoff/glovo-product-scraper

Hello guys,
I’m sure what I’m trying to do already exists. Has anyone else done something similar?

I manage an esports team, with four teams from four divisions competing each week in BO3 matches to reach Division 1. Before each BO, each team flips a coin, and the winner gets to pick two maps and ban two maps, while the loser gets to pick one map and ban two maps. I enjoy entering all this data into an Excel spreadsheet every week, but I would like to be able to generate a dashboard that shows me each team’s pick and ban trends for each map, as well as their win rate and loss rate on each map. This will allow me to anticipate a team’s favorite maps so I can ban them and, conversely, pick the maps they like the least. I’m terrible at pivot tables in Excel and can’t get what I want, and I don’t know what other tools could help me do that.

A while back, someone needed a dataset that wasn’t available in its latest version. I ended up scraping it myself probably around 20k rows with 20–25 columns from some business related site and sent it over.

Now I’m wondering can I actually sell this kind of data on any platform, legally? If I collected it myself, am I allowed to list it somewhere for sale?

I’ve built tons of scrapers and have sent data directly to clients before, but I’m looking for a proper platform if there is one to sell on.

Yeah, I know I can Google it but Reddit bros are more brutally honest than search engines hehe…
Anyone know how this actually works?

Hi everyone, Im trying to track down historical ChatGPT question and response pairs, basically what ChatGPT was saying in its early days, to compare to responses now.

I’m mostly interested in culturally sensitive questions that require deeper thinking for example (but not exclusively these) -Is pineapple on pizza unhinged? -When will the Ukraine war end? -Who is the cause of biggest unrest in the world? -Should I vote Kamala or Trump? -Gay and civil right questions

Would be nice to have a few business orientated questions like what is the best ev to buy in 2022?

Does anyone know if there are public archives, scraped datasets, I will even take screen shots, or research projects that preserve these older Q&A interactions? I’ve seen things like OASST1, ShareGPT, both of which have been a good start to digging in.

English QA pairs at this stage. But will gladly take leads on other language sets if you have them.

Any leads from fellow hoarders, researchers, or time traveling prompt engineers would be amazing.

Any help greatly appreciated.

Stu

Good Day People of Reddit! Please help me graduate :))) by helping me find a suitable dataset that has the following:
1. US or any other English Speaking Country Electorial Campaign Dataset. (Debate, Speech, etc)
2. Either CSV or JSON. (Would also appreciate if you can help me find some links where i could data scrape)
3. Not limited to Presidents, Vice Presidents. Any Politician would do
4. Must be more than 10K.

For those that will recommend or comment. I thank you all!!!

• 25-year residual series; warp (logistic + Omori tail) > linear
• Permutation tests; prg’d methods; negative controls planned
• Repo includes data, scripts, CHECKSUMS.txt, and a one-click run
• Looking for replications, critiques, and extensions

OSF – https://osf.io/exywu/overview

I’m trying to find the most complete source of live music event data — ideally accessible through an API.

For example, when I search Austin, TX or Portland, OR, I’ve noticed that Bandsintown seems to have a much more extensive dataset compared to Songkick or Jambase. However, it looks like Bandsintown doesn’t provide public API access for querying all artists or events by city/date.

Does anyone know of: – Any public (or affordable) APIs that provide event listings by city and date? – Any open datasets or scraping-friendly sources for live music events?

I’m building a project to build playlists based on upcoming live music events in a given city.

Thanks in advance for any leads!

Hi datasets!

We have been working on https://tapintodata.com/, which lets you turn raw data files into managed, production-ready APIs in seconds. You upload your data, shape it with SQL transformations as needed, and then expose it via documented, secured endpoints.

We originally built it when we needed an API from the Scottish Energy Performance Certificate dataset, which is shared as a zip of 18 CSV files totalling 7.17 GB, which you can now access freely here: https://epcdata.scot/

It currently supports CSV, JSONL (optionally gzipped), JSON (array), Parquet, XLSX & ODS file formats for files of any size. The SQL transformations allow you to join across datasets, transform, aggregate and even geospatial indexing via H3.

It’s free to sign up with no credit card required and has generous free tier (1 GB or storage and 500 requests/month). We are still early and are looking for users that can help shape the product or any datasets you require as APIs that we can generate for you!

We analyzed over 1,000 high-performing social media hooks across Instagram, YouTube, and LinkedIn using Adology’s systematic data collection and categorization.

By studying only top-performing content with our proprietary labeling methodology, we identified distinct psychological patterns that drive engagement on each platform.

What We Discovered: Each platform has fundamentally different hook preferences that reflect unique user behaviors and consumption patterns.

The Platform Truth:
> Instagram: Heavy focus on identity-driven content
> YouTube: Balanced distribution across multiple approaches
> LinkedIn: Professional complexity requiring specialized approaches

Why This Matters: Understanding these platform-specific psychological triggers allows marketers to optimize content strategy with precision, not guesswork. Our large-scale analysis reveals patterns that smaller studies or individual observation cannot capture.

Want my 1,000 hooks full list for free? Chat in the comment

Hi folks,

I work on the data science team at AirROI, we are one of the largest Airbnb data analytics platform.

FYI, we’ve released free Airbnb datasets on nearly 1,000 largest markets, and we’re releasing it for free to the community. This is one of the most granular free datasets available, containing not just listing details but critical performance metrics like trailing-twelve-month revenue, occupancy rates, and future calendar rates. We also refresh this free datasets on monthly basis.

Direct Download Link (No sign-up required):
www.airroi.com/data-portal -> then download from each market

Dataset Overview & Schemas

The data is structured into several interconnected tables, provided as CSV files per market.

1. Listings Data (65 Fields)
This is the core table with detailed property information and—most importantly—performance metrics.

• Core Attributes: listing_id, listing_name, property_type, room_type, neighborhood, latitude, longitude, amenities (list), bedrooms, baths.
• Host Info: host_id, host_name, superhost status, professional_management flag.
• Performance & Revenue Metrics (The Gold):
  • ttm_revenue / ttm_revenue_native (Total revenue last 12 months)
  • ttm_avg_rate / ttm_avg_rate_native (Average daily rate)
  • ttm_occupancy / ttm_adjusted_occupancy
  • ttm_revpar / ttm_adjusted_revpar (Revenue Per Available Room)
  • l90d_revenue, l90d_occupancy, etc. (Last 90-day snapshot)
  • ttm_reserved_days, ttm_blocked_days, ttm_available_days

2. Calendar Rates Data (14 Fields)
Monthly aggregated future pricing and availability data for forecasting.

• Key Fields: listing_id, date (monthly), vacant_days, reserved_days, occupancy, revenue, rate_avg, booked_rate_avg, booking_lead_time_avg.

3. Reviews Data (4 Fields)
Temporal review data for sentiment and volume analysis.

• Key Fields: listing_id, date (monthly), num_reviews, reviewers (list of IDs).

4. Host Data (11 Fields) Coming Soon
Profile and portfolio information for hosts.

• Key Fields: host_id, is_superhost, listing_count, member_since, ratings.

Why This Dataset is Unique

Most free datasets stop at basic listing info. This one includes the performance data needed for serious analysis:

• Investment Analysis: Model ROI using actual ttm_revenue and occupancy data.
• Pricing Strategy: Analyze how rate_avg fluctuates with seasonality and booking_lead_time.
• Market Sizing: Use professional_management and superhost flags to understand market maturity.
• Geospatial Studies: Plot revenue heatmaps using latitude/longitude and ttm_revpar.

Potential Use Cases

• Academic Research: Economics, urban studies, and platform economy research.
• Competitive Analysis: Benchmark property performance against market averages.
• Machine Learning: Build models to predict occupancy or revenue based on amenities, location, and host data.
• Data Visualization: Create dashboards showing revenue density, occupancy calendars, and amenity correlations.
• Portfolio Projects: A fantastic dataset for a standout data science portfolio piece.

License & Usage

The data is provided under a permissive license for academic and personal use. We request attribution to AirROI in public work.

For Custom Needs

This free dataset is updated monthly. If you need real-time, hyper-specific data, or larger historical dumps, we offer a low-cost API for developers and researchers:
www.airroi.com/api

Alternatively, we also provide bespoke data services if your needs go beyond the scope of the free datasets.

We hope this data is useful. Happy analyzing!

I’m supposed to do a research and a report about water retention gel and Lende process. The thing is I don’t know how to start and where to find resources.

So how do y’all do a research? Are there websites that can help me find resources directly? (cause that’s the main problem, I think)

What tricks do you know I can use to facilitate doing a research?

Tysm （＾ｖ＾）

Hey everyone,

I recently bought a server that lets me extract geodata from OpenStreetMap. After a few weeks of experimenting with the database and code, I can now generate full datasets for any region — including every street name, ZIP code, city name, and coordinate.

It’s based on OSM data, cleaned, and exported in an easy-to-use format.
If you’re working with mapping, logistics, or data visualization, this might save you a ton of time.

i will continue to update this and get more (i might have fallen into a new data obsession with this hahah)

I’d love some feedback — especially if there are specific countries or regions you’d like to see .

Hi everyone

I’m currently working on my final year project focused on video deraining – developing a model that can remove rain streaks and improve visibility in rainy video footage.

I’m looking specifically for: video deraining datasets if its night time deraining it would be helpful

If anyone knows open-source datasets, research collections, or even YouTube datasets I can legally use, I’d really appreciate it!

I’m trying to request for this dataset for my university research and tried sending mails for the owners through the web portal

https://dataverse.nl/dataset.xhtml?persistentId=doi:10.34894/FWYPYC

No positive feedback received. Another way to get access?

I want to find data on how long it took Ambulances to respond and where it started and it’s destination.

I tried NEMESIS, but I couldn’t really find data on destination and starting station, where would I find data like this?

We’re releasing Kanops. Open Access · Imagery (Retail Scenes v0): a curated set of retail in store photographs (multi-retailer, multiple years, seasonal “Halloween 2024”), intended for tasks like shelf/fixture detection, planogram reasoning, and merchandising classification alongside many other use cases, such as spatial awareness and detection and other use cases we haven’t thought of.

Our first dataset attempt!

Part of a 1m strong image dataset in totality.

• Size: ~10.8k images (v0)
• Format: folder-per-retailer/category; MANIFEST.csv, metadata.csv, checksums.sha256
• Privacy: all identifiable faces blurred; EXIF/IPTC owner/terms embedded
• License: evaluation-only (no redistribution of images or model weights derived exclusively from this data)
• Access: gated on HF (quick request form)

Hugging Face: https://huggingface.co/datasets/dresserman/kanops-open-access-imagery

(quiick load after access granted)

# pip install datasets

from datasets import load_dataset

ds = load_dataset(“imagefolder”, data_dir=”hf://datasets/dresserman/kanops-open-access-imagery/train”)

print(len(ds[“train”]))

Contact: HF Discussions on the dataset card or DM u/malctucker

I’m trying to get some stats on public domain texts, and need to find a way to automatically correlate a gutenburg book with its (possible) page on goodreads for a class. I thought I was told at one point that OpenLibrary had some way of knowing both, so I would be able to go through that but that doesn’t seem to be the case…

Does anyone know if there is some site that has this correlation already done? Or do I just need to do a search by title and author and hope everything comes up roses? In particular, I’m sort of worried I’ll get false hits with some of the more generic titles and end up with completely wrong genre and review data.

Hi everyone(:

I have a question and would really appreciate some advice. This might sound a little silly, but I’ve been wanting to ask for a while. I’m still learning about machine learning and datasets, and since I don’t have anyone around me to discuss this field with, I thought I’d ask here.

My question is: What kind of text datasets could be useful or valuable for training LLMs or for use in machine learning, especially for low-resource languages?

My purpose is to help improve my mother language (which is a low-resource language) in LLM or ML, even if my contribution only makes a 0.0000001% difference. I’m not a professional, just someone passionate about contributing in any way I can. I only want to create and share useful datasets publicly; I don’t plan to train models myself.

Thank you so much for taking the time to read this. And I’m sorry if I said anything incorrectly. I’m still learning!

As the title says, I wanted to create an attention tracker for one of my projects, however I’m struggling to find an appropiate dataset for it

I only require the model to detect whether you’re looking at the PC screen or not and also detect blinking, but other features are welcomed

Guys I have only 1 week left , I’m doing project called medical diagnosis summarisation using transformer model , for that I need a dataset that contains the long description as input and doctor related summary and also parent related summary as a target value based on the mode the model should generate the summary and also I need a guidance on how to properly train the model

Do you know of a source of high res satellite imagery ideally GeoTIFF files (or something similar I am not too savvy in this field).

Ideally for free.

I need to get a lot of it, and through API not manually.

Or maybe there are alternatives that I’m not aware of like images from aircrafts or something like that.

I need the images to be suitable for an AI to detect vehicle in them.

Problem/Goal: Hi everyone, I’m a psychology student and currently doing our data gathering for our thesis. And we need more thann 100 respondents/50 couples to answer our research questionnaires

For context: We need a minimum of 100 respondents for our study and we must accomplished it before October ends. If anyone fits in our criteria can you pm me pls plsss. Badly need anyone. We are just starting with our data gathering and our final defense po is next month na so nag rarush po kami.

This is our criteria po:

We’re looking for participants who are: ✅️ 18–26 years old ✅️ Residents of Pampanga (within its cities or municipalities) ✅️ Couples who are currently in an undefined romantic relationship or situationship ✅️ More than friends but not officially labeled or exclusive

And our research is entitled “Attachment Styles and Communication Patterns as Predictors of Relationship Commitment among Couples in Undefined Relationships.”

Thank you and have a lovely day! ✨️🍂