I’d like to get the transcripts for all Apple Keynotes (the September ones) since 1998. I was hoping to play with this dataset and get fun data nuggets.

But I can only find the transcripts for the last 3 ones (as they were auto-generated on YouTube). The other videos are on YouTube, but without transcript.

I can’t believe they are not stored somewhere on the Internet… does anyone have any tip or suggestion?

I’m a student researcher working on immunotherapy response prediction. I requested access to IMvigor210 on EGA but haven’t been approved yet. In the meantime, are there any public processed versions (like TPM/FPKM + response labels) or packages (e.g., IMvigor210CoreBiologies) I can use for benchmarking?

Dear all,

I am conducting a personal research project focused on the testing of a system for heart sound analysis. To properly evaluate this system, I am seeking volunteers to provide short recordings of their heart sounds via Phone.

Eligibility

• Participants must be 18 years or older.
• Participation is voluntary and can be withdrawn at any time.

What is needed

• Two categories of recordings:
  • 🫀 Normal heart sounds
  • 💔 Murmur/abnormal heart sounds (murmur, extra_systole, extra_heart_sound)
• Recording device: your smartphone microphone (no stethoscope required).
• Duration: approximately 10–15 second.

1. Place the phone close to your chest (apical area of the heart) – Instruction here: Instruction
2. Record for 10–15 seconds.
3. Save the file (WAV or MP3 preferred, but any common format is acceptable).
4. Label recording if its normal or abnormal (specific here if its murmur, extra_systole_systole, extra_heart_sound)
5. Upload the recording in the given link

Thank you!

Need tweets containing a certain term over the years. Where can i find it? I tried scraping but it didn’t work.

I’m curious, is there a marketplace for individuals for selling small synthetic datasets (500 -1000 lines) ? Synthetic datasets about emotional nuance in text, Annotated by emotion, intensity, tone, register and context and handchecked by a practitioner in mental health for example? And can anyone sell datasets or do you have to be a developer to know what you’re doing/selling ? Thank you in advance for your help!

Good evening, community. This is my first post; if I break a rule, please let me know.

I’m working on MedeX v25.8.3, a clinical assistant aimed at professional use with an educational mode. I’m looking for public, open medical datasets for finetuning.

Ideal traits: clear licenses, solid annotations, documented pipelines, population diversity, common formats (CSV/JSON/DICOM), and standard benchmarks/splits.

Disclosure: I’m the developer of MedeX. I’ll add the repo in the first comment if the sub allows.

I’m looking for pointers to one or more datasets that have some or all of the following data:

• Faculty name (tenure track only)
• Current professional title/designation
• Department employed
• Name of the university/academic employer
• Degree-granting department and institution (PhD, Masters, and undergraduate degrees, as applicable)
• Year of degree (PhD, Masters, and undergraduate degrees)
• Current employment start year
• Other academic employment history (eg. department, start and end date of previous post-PhD employments)

It would be really nice if longitudinal data (every academic year) was also available for these items. In addition, data about non tenure track faculty appointments would also be nice, but not necessary.

I’m looking for something similar (but expanded in terms of scope) to the dataset used in this paper.

I’m aware that AARC could be a potential data source but I’ve been told it’s not trivial to get data access through them, so looking for alternatives.

Alternatively, would also appreciate if anyone can point me to ways to scrape (at least some of) this data from university directories.

Thanks in advance!

I run a synthetic data platform called DataCreator AI that helps AI professionals and businesses generate customized datasets.

Along with these capabilities, we offer a section called Community Datasets where we post datasets for free. Community Datasets

Some of the current free datasets we have are:

• A dataset to perform Direct Preference Optimization to reduce sycophancy of LLMs.
• A dataset that contains structured multi-turn conversations between patients and customer service agents at hospitals.
• A dataset with a collection of random facts from various topics like biology, astronomy,
• Classification and Question-Answer Datasets.

Your feedback would be of huge help to me to come up with more useful datasets. If you have any specific dataset ideas, please let me know in the comments so that we can put up more of them.

From the main worldwide news providers is great!

Hiya, I’m investigating marketing to oral health care companies and what to simply know how their market is segmented, by purchases, by age and sex.

General or specific info would be fine. I suspect it’s women, but what age range?

Hi everyone,
I’m working on a bird species classification + migration prediction project for my capstone. I have a list of ~512 bird species, and I need help collecting at least 100–150 samples per species (images, and audio if possible).

I’m working on a data project and need a more complete dataset for Powerball and Mega Millions than what’s usually available on sites like lotteryusa or state lottery pages.

Most public datasets just have the draw date and winning numbers, but I need all the columns, specifically things like: – Draw date & draw number – Winning numbers + Powerball/Mega Ball – Power Play / Megaplier multiplier – Jackpot amount (annuity & cash value) – Number of winners by tier (match 5, 4+PB, etc.) – Power Play winners by tier – State-by-state winner breakdown (if available)

Basically, the full official results table that the lotteries publish after each draw, not just the numbers themselves.

I haven’t been able to find a historical dataset with all of this.

Does anyone know if this exists publicly, or will I need to scrape it directly from Powerball.com / MegaMillions.com (or individual state sites)? If scraping is the way to go, I’d love any tips on best practices for this since the data spans back to the ’90s.

I have 90 videos downloaded from yt i want to crop them all just a particular section of the videos its at the same place for all the videos and i need its cropped video along with the subtitles is there any software or ml model through which i can do this quicklyy?

I am conducting academic research on supplier evaluation and selection using machine learning as part of my postgraduate work. For this, I am seeking access to supplier-related datasets that include features such as unit price, product availability, order quantities, revenue generated, stock levels, lead times, shipping times, shipping costs, shipping carriers, supplier location, production volumes, manufacturing lead times, manufacturing costs, defect rates, transportation modes, and overall procurement costs. The data will be used strictly for academic purposes, and any confidential or sensitive information will be anonymized. Access to such data would greatly enhance the reliability of my research and contribute to building a practical decision-support framework for procurement systems.
If these features are not there any dataset will do. Please I really need the dataset

I’m in the process of developing a marketplace to sell data because I feel like there is no simple marketplace to facilitate sell data, especially for subscriptions and I really wanted people in the communities opinions. If you have data, are interested in selling data etc. an entry would be appreciated, it has been checked by mods, emails are not collect

Here is the link: https://forms.gle/xNp7a7vEEioa7vrE8

Looking for paid dataset providers for Indian grocery/retail data (similar to quick-commerce platforms).

Format: CSV/JSON

I’m a new data analyst trying to land my first full-time role, and I’m building a portfolio and practicing for interviews as I apply. I’ve done the usual polished datasets (Titanic/clean Kaggle stuff), but I feel like they don’t reflect the messy, business-question-driven work I’d actually do on the job.

I’m looking for public datasets that let me tell an end-to-end story: define a question, model/clean in SQL, analyze in Python, and finish with a dashboard. Ideally something with seasonality, joins across sources, and a clear decision or KPI impact.

Datasets I’m considering: – NYC TLC trips + NOAA weather to explain demand, tipping, or surge patterns – US DOT On-Time Performance (BTS) to analyze delay drivers and build a simple ETA model – City 311 requests to prioritize service backlogs and forecast hotspots – Yelp Open Dataset to tie reviews to price range/location and detect “menu creep” or churn risk – CMS Hospital Compare (or Medicare samples) to compare quality metrics vs readmission rates

For presentation, is a repository containing a clear README (business question, data sources, and decisions), EDA/modeling notebooks, a SQL folder for transformations, and a deployed Tableau/Looker Studio link enough? Or do you prefer a short write-up per project with charts embedded and code linked at the end?

On the interview side, I’ve been rehearsing a crisp portfolio walkthrough with Beyz interview assistant, but I still need stronger datasets to build around. If you hire analysts, what makes you actually open a portfolio and keep reading?

Last thing, are certificates like DataCamp’s worth the time/money for someone without a formal DS degree, or would you rather see 2–3 focused, shippable projects that answer a business question? Any dataset recommendations or examples would be hugely appreciated.

I can record videos or take photos of random things outside or around the house, label and add variations on labels. Where might I sell datasets and how big would they have to be to be worth selling?

I need dataset of medical forms like medical reports, hospital admission form, medical insurance form,etc .

Please drop links

Okay so I need to find a dataset that has at least like 3 tables, I’m search stuff on kaggle like supermarket or something and I can’t seem to find simple like a products table, order etc. Or maybe a bookstore I don’t know. Any suggestions?

https://www.dropbox.com/scl/fi/vm7zztz460hfgb0sxy633/bounty-columns-offset-data-sample.csv?rlkey=ytsp9dcuabxhywhun5tbs1lm6&e=2&st=ogqkbbez&dl=0

this is the provided data set and i need someone to predict the next half of the dataset with either 90% or 100% accuracy please

I don’t care how you solve it, only that you provide proof of the solve, and the algo code that solved it. Must provide full code to replicate.

The data is multi-dimensional, and catalogued. I have both halves of the data, to compare against.

Thanks, dm me if you are interested, i am ready to offer upwards of 150 USD for the solution

Hi everyone,

I’m working on a side project and need real-time gas/fuel price data in Canada.

I know GasBuddy and Waze get theirs from crowdsourcing. GasBuddy also used to have a GraphQL API, but that seems shut down. I already emailed OPIS but got no response.

Ideally, I’m looking for:

• Station-level data with location
• Prices by fuel type (regular, premium, diesel, etc.)
• Search by postal code or lat/long
• Brand filtering if possible
• Fuel price based on the type of fuel – Petrol, Diesel and also the price for Regular, Premium etc.

Are there any real-time APIs or datasets available for this? Or is scraping the only realistic option here for real-time data for the daily fuel price?

Thanks! 🙏

Researching ML data pipeline pain points. For production ML builders: what’s your biggest training data prep frustration?

🔍 Data quality? ⏱️ Labeling bottlenecks? 💰 Annotation costs? ⚖️ Bias issues?

Share your real experiences!

Spent weeks trying to find realistic e-commerce data for AI/BI testing, but most datasets are outdated or privacy-risky. Ended up generating my own synthetic datasets — users, products, orders, reviews — and packaged them for testing/ML. Curious if others have faced this too?

https://youcancallmedustin.github.io/synthetic-ecommerce-dataset/

Hi all,

I’ve been working on a side project where I crawled and AI-enriched over 2.6 million company websites across 111 industries worldwide.

What’s inside:

• Company name, website, industry
• Long + short descriptions (AI-generated)
• Enriched metadata (socials, emails, locations where available)
• Website screenshots
• Delivered in JSONL, Parquet, and CSV formats

Access:

• A free sample explorer with 150 companies is live here: https://ctxdb.ai/sample-dataset
• Full dataset available for purchase (Q3 2025 edition + Q4 coming soon).
• A yearly “Momentum Plan” also refreshes the dataset quarterly with new companies + updated profiles.

Why I built this:

I wanted an up-to-date, structured dataset useful for:

• Lead generation / prospecting
• Market research & competitive tracking
• AI/ML model training
• Academic or investment research

Happy to hear your thoughts / feedback / need for API access? – also curious how you’d use a dataset like this.

Hey everyone! I’ve been working on a project to make SEC financial data more accessible and wanted to share what I just implemented. https://nomas.fyi

**The Problem:**

XBRL taxonomy names are technical and hard to read or feed to models. For example:

– “EntityCommonStockSharesOutstanding”

These are accurate but not user-friendly for financial analysis.

**The Solution:**

We created a comprehensive mapping system that normalizes these to human-readable terms:

– “Common Stock, Shares Outstanding”

**What we accomplished:**

✅ Mapped 11,000+ XBRL taxonomies from SEC filings

✅ Maintained data integrity (still uses original taxonomy for API calls)

✅ Added metadata chips showing XBRL taxonomy, SEC labels, and descriptions

✅ Enhanced user experience without losing technical precision

**Technical details:**

– Backend API now returns taxonomy metadata with each data response

– Frontend displays clean chips with XBRL taxonomy, SEC label, and full descriptions

– Database stores both original taxonomy and normalized display names

– Caching system for performance

Upvote1Downvote0Go to comments