Hi, I would be grateful if anyone can provide report on oncology drugs. The link is below. Thanks in advance.

https://www.statista.com/outlook/hmo/pharmaceuticals/oncology-drugs/worldwide#revenue

Project is object detection in engineering drawing (mechanical). I cant seem to find any related dataset to it. Can someone tell how to build a dataset from scratch? Go easy on me…

Thanks!

Heyo!

I’m a Computer Science MSc student with recent interest in web scraping and data automation. Over the past few years, I’ve honed my skills in backend development and web scraping, and I’m excited to share two Apify Actors I’ve developed to help you build comprehensive datasets effortlessly.

🔍 What I Built:

Newegg Scraper: Newegg Scraper on Apify Features: Extracts detailed product information, pricing, customer reviews, and category listings from Newegg. Use Cases: Ideal for creating datasets for market analysis, price tracking, and competitive research in the electronics and e-commerce sectors. Glovo Scraper: Glovo Scraper on Apify Features: Gathers comprehensive restaurant data, including names, addresses, delivery fees, promotions, and menu items from Glovo. Use Cases: Perfect for building datasets related to food delivery services, local restaurant analysis, and market trend tracking.

Why These Scrapers?

Building high-quality datasets can be time-consuming and technically challenging. These scrapers are designed to simplify the data collection process, providing you with structured and ready-to-use data for your projects. Whether you’re conducting research, developing machine learning models, or performing business intelligence, these tools can save you valuable time.

Seeking Your Feedback:

I’m eager to hear your thoughts! If you have any suggestions for improvements, additional features you’d like to see, or feedback on your experience using these scrapers, please let me know. Your insights are invaluable in making these tools even better for the community.

Thank you for your time, and happy data hoarding! 🗄️✨

Hello everyone,

I’m curious about how people in this community are handling data provenance. For those unfamiliar, data provenance is about tracking the origins and transformations of data throughout its lifecycle.

Are you currently using any tools or methods to track the provenance of your datasets? If yes, what solutions are you using? Are they custom-built or off-the-shelf? If not, do you see a need for such tools in your work? What features would you consider essential in a data provenance solution?

I am trying to decompose retail electricity prices into its components (transmission costs, fuel costs etc), and discuss determinants of retail energy prices in these two markets. My overarching goal is to explain the reason(s) behind different energy costs faced by retail customers across the US. These two regions have the most similar markets among those with organized capacity markets (although correct me if I am wrong). These regions have consistently high pricing, but what explains this discrepancy compared to the rest of the country? Locational Marginal Prices would also work.

Any advice is greatly appreciated. Thanks in advance!

Hi,

I am looking for a dataset of technical documentation (such as manuals, API guides, quick start guide, etc.). The most important part are manuals. Does anyone know of such a dataset? My goal is to train a classifier.

Hi all,

I am currently a Malaysian student, in my final year and have my FYP pending. I am studying computer science, specialising in Data Analytics. I’ll need to do the standard data pre-processing, visualising, model building etc. However, it is mandatory to include 1 of the SDG goals in my overall project.

I just need some advice on which potential topics I could go into, as I keep over thinking every topic, and am struggling to settle with one. And if anyone could help me find some good datasets to go with the topic, that would be very appreciated.

Thanks to anyone who takes time to read this!

I’m learning Python and data science. I was given a challenge in my work to create a machine learning that reads diplomas and extracts only the text from them. I would like to suggest a library, but mainly how can I get an image bank for training?

Diploma in this case I am referring to a higher education diploma.

Does anyone know where to find FHLB advances data at the quarterly level? I thought the FHFA would have it but I can seem to find it anywhere.

Hi everyone, I am currently working on a hackathon project, and urgently needed some datasets that includes pre-disaster and post-disaster aerial imagery to build a post disaster analytics report with the help of deep learning(using CDNet model). Please help!!!!

I’ve been searching for a reliable data set showing owner-occupied housing numbers by ZIP code in the US. I’ve found several data sets from HUD and the Census Bureau, but so far I’ve not found these numbers, at least broken down by ZIP code. Has anyone else found a reliable source for such data? Thanks in advance.

Hey guys i am doing an NLP mental Health Prediction, using Reddit dataset, any suggestion on dataset and model that i should do that would make my project unique, please help me with this project I am very new to this

I know NYC and Chicago require ride share apps to report data. I am unable to find the aggregate data set.

My goal is to find how many ride share trips are made to JFK / LGA / EWR from a distance of over 20 miles away. Is this level of granularity possible?

Thanks!

I need to make a Ai/ML final project for my course, the deadline is for 2 weeks and i have decided to go with personalised learning pathways…. therefore i need for the same so that i can make the project and also some feedback would be good , about is this a good project . If not then , please tell me some ideas or share resources for another idea…but yeh please share the dataset

Hi good people,

I’m currently working on a project focused on anomaly detection in water quality and am on the lookout for a labeled dataset that include labeled instances of abnormal water quality conditions.

If anyone has come across or worked with such datasets, I’d greatly appreciate it if you could share a link or point me in the right direction.

Any help is much appreciated!

I was doing a project using the Health and Retirement Study (HRS) but it turns out the years I wanted to use would not work but 2016 would. The data is downloading as a .dat file which means that it is not possible to open. Has anyone ever used it in the past before it was converted to a .dat file. I need to make this change in 24 hours and have spent the last few months trying to clean the other data I thought I needed. Now I need to make this switch.

Hi everyone!

I’m a student working on a research project about the 2010 Flash Crash. My focus is on understanding how algorithmic trading and market infrastructure contributed to the event.

I’m searching for historical datasets that capture intraday trading activity on May 6, 2010, particularly for key indices (Dow Jones Industrial Average, S&P 500, and Nasdaq Composite Index) and other heavily impacted individual equities. Ideally, i’m looking for tick-level or minute-by-minute data, but i’m open to aggregated datasets as well.

Also any pointers to how I can obtain this data is appreciated!

Thanks in advance!

Hello everyone,

I am currently working on module as part of my artificial intelligence course in the university, and my task is to develop a module which find correlation connection chronical diseases with ECG and blood test recordings.
I am currently struggling to find the right data sets and recordings on PhysioNet and on Kaggle.
Can you direct to me more websites contain data bases or even specific data sets?

Thanks.

I’m trying to download the parcel data set from the following public website:

https://gishub-beltramicounty.hub.arcgis.com/datasets/BeltramiCounty::tax-parcels/about

But it seems to keep failing out and not being able to create the download. i’ve tried this on multiple computers for several different internet connections and haven’t been able to get this to work.

Does anyone know what I’m missing here? Or do i just need to email the county and ask for the file directly?

Thank you!

I just created this dataset of paired ancient latin, ancient greek, bible Hebrew and english sentences.

The sentences have been selected so that many different topics are treated:

foods/animals/religion/family/war/peace/vegetation/colors/temperature/countries/clothing/constructions/fear/insects/mountains/sea/navigation/sports/anatomy/

Hello everyone, this is my first time posting in here and I’m really really in need of heart beat, geroscope, thermometer,

My project is about detecting phobia specifically agoraphobia using ML and AI yet I couldn’t find any dataset for it or any kind of data related to stress and it’s too late for me to back off and change the topic

I’m begging you, if you can help me please dont hesitate I am desperate and I dont know what to do

People used to be small. And now they are taller and have a heavier BMI. But i wonder what the increase of just weight (mass) over time looks like. Theres data for BMI in ourworldindata and gapminder. But not raw
average mass eg of men in France 1900 60kg, 1920 65kg 1940 70kg etc type data.
The separated out heights and weights that make up BMI.

Do you know a dataset like this?
This wikipedia page links to individual government sites but searching for German data if you are not german is really hard https://en.wikipedia.org/wiki/Human_body_weight

BMI but not height and weight separated https://w3.unece.org/PXWeb2015/pxweb/en/STAT/STAT__30-GE__06-Health/006_en_GEHEWeight_r.px/table/tableViewLayout1/

https://www.gapminder.org/fw/world-health-chart/
Heght and weight but not with by historical time https://www.kaggle.com/datasets/burnoutminer/heights-and-weights-dataset
3 recent years but not a long view https://data.gov.ie/dataset/his53-average-weight
Does the us army have data on the people it takes in each year? That would do it.

This is probably a long shot. I know there’s a huge one with all charting songs, but I only need #1 songs.

Hi everyone

I’ve just uploaded an exciting dataset to Kaggle that could be a game-changer for researchers, data analysts, and anyone interested in the mineral industry of Africa and the Middle East. 🪨💎

🔍 What’s in the Dataset ?

The dataset is sourced from the USGS Minerals Yearbook and includes:

• 📈 Annual data on mineral commodities across various countries.

• 🏛️ Information on government policies, environmental issues, and trade.

• 🏗️ Insights into industry structure, commodity developments, and infrastructure.

• 📊 XLS files organized by country and year for easy analysis.

This dataset offers a treasure trove of information to analyze trends, explore economic impacts, or even build machine learning models for predictive insights. 🚀

📜 Source and Collection

• Source: USGS National Minerals Information Center.

• Methodology: Data was collected using Scrapy and Selenium to handle dynamic content, ensuring a complete and accurate dataset.

• Disclaimer: The dataset is for educational and research purposes only. It’s not affiliated with or endorsed by USGS.

🔗 Explore Now

You can access the dataset here: https://www.kaggle.com/datasets/amaboh/africa-and-the-middle-east-minerals-dataset/data

(Feel free to upvote if you find it helpful! 👍)

💡 Why Check This Out?

Whether you’re into:

• Data Science 🧑‍💻: Test algorithms on real-world data.

• Economics & Policy 📚: Analyze the role of minerals in regional economies.

• Geography 🌍: Understand spatial trends in mineral production.

• Environmental Studies 🌱: Dive into the impact of mining on the environment.

There’s something here for everyone!

🙌 Let’s Collaborate

I’d love to hear how you’re using the dataset or collaborate on a project. Drop a comment or DM me if you’re exploring something interesting!

Feel free to share this with your networks and let me know what you think. Let’s uncover insights together! 🔎✨

P.S.: If you’re on Kaggle, don’t forget to upvote the dataset if you find it useful and share your findings! 🙏

If I have two vectors:

exam scores [100, 80, 90] exam weights [.4, .3, .3]

I can take the dot product of these two and find *i’*s total score. Now across many rows, I can find “the class” total scores by i.

Now, imagine I have two other random vectors:

happiness score [10, 8. 9] sadness score [10, 8, 8]

Mathematically, nothing is stopping me from taking the dot product of happiness score and sadness score for person i.

This is where my intuition isn’t strong. What “possibly” could the dot product of these two mood scores tell me? I am just looking for any random ideas or ways to take the dot product and “make it make sense”.

Overall, This will help me take different vectors of data sets and infer insights. So, if you are given two vectors, how do you approach “combining them” to product an output that “makes sense”?

I’m fairly inexperienced with programming/data analysis and I’m unsure of how to proceed with my dataset. Hopefully I’m posting in the correct subreddit.

I’m using a national inpatient hospital database (NIS database) to analyze at how a specific procedure volume changed pre vs. post COVID. I’ve already combined the years I’m looking at (2018-2021), filtered the data for only the procedure code I’m interested in, introduced a time period variable (2018/2019 =1, 2020/2020 =2) and weighed my cases by the “discharge weight” variable to represent population estimates. At this point, each row is basically a count for the procedure.

Now I’m stuck and don’t know what kind of statistical analysis I should be doing and what variables to use. I’ve played around with using independent t test using time period x discharge weights, thinking that each row x discharge weight = estimate of procedures, but I’m not really sure if that’s right.

I’d appreciate it if someone could please help me with this.

Hello guys! We have a thesis proposal entitled: YOLOv10s in anomaly detection and classification in 3D Printing. Since we want to train our model for both images of 3d prints with defects and without defects, we already have dataset source for 3D Prints that have defects but we are having a problem with finding dataset for the one without defect or 3D prints that are successful. Anyone has the idea where we can look sources that has those images, if possible with annotations already. We already looked all throughout Kaggle and Roboflow. Thank you in advance!!