Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

Need A Movie Dataset For My Big Data Course

I have a project in mind for my big data course. I have always been interested in films and movie culture. I currently have a minor in Film Studies as well. I want to predict movie success based on the people associated with each movie. Movie success can be defined either by box office success or critical success such as Oscar nominations. Obviously, it is always an unpredictable thing because a lot of factors lead to the success or failure of a movie. I want to look at if a movie was a success what factors led to that success and if it is a failure what led to that failure. I believe in both “buckets” there will be patterns that show up. For example, does the social media following of an actor have an impact on the box office success of a movie. The idea applies for newer movies more than older movies. There are many data sources where I can retrieve data such as IMDB. Please let me know your thoughts.

My prof. responded by saying that IMDB while being around 5GB may not be enough to be called “big data.” He suggested I look at datasets with text reviews as they can be pretty lengthy and can lead to a larger size.

Is there any way I can get a dataset for this project? I was thinking about web scraping movie reviews as well. If I web scrape, I would use IMDB, Rotten Tomatoes, Letterboxd, etc.

Appreciate all the help!

submitted by /u/Sakaburu
[link] [comments]

Searching For A Free Dataset From Retail Sales Of A Shop Or Brand For Learning Purposes

Hello there.
I’m part of a team of four Data Analitics’ students and we are searching for a useable dataset to make our capstone. We are searching for a sales dataset of a retail shop. We tried in places like Kaggle and saw in horror that some of the ones that could work for us are the same previous years’ teams had already used or criminally non-updated ones. Trying to search in several places only make us to hit our faces against paywals, some of them extremely high.

The main idea is simple, the registry of sales of that retail shop over time.

If any of you could give some insights of where we could find something workable. There is any company that gives that kind of information for free?

submitted by /u/Most_Breadfruit_2388
[link] [comments]

Poll: How Does Your Organization Manage Their Data Quality?

Hi everyone!

My team and I are studying how different organizations manage their data quality.

This poll is 5 questions and takes <1 min. Take the poll here and get exclusive access to the in-depth report: https://qkbg47fsj9g.typeform.com/to/D6qL7hfB

Confidentiality Notice: Your responses will be kept confidential and won’t be associated with your name or company’s likeness.

Thank you for providing your time and participation!

submitted by /u/BlueStreetDataTeam
[link] [comments]

Datasets Related To Contract Lifecycle Management (CLM) And Dispute Resolution

I am looking for any kind of dataset I am currently conducting research on Contract Lifecycle Management (CLM) and I am looking for datasets related to the management of contracts within CLM systems. Specifically, I am interested in any datasets that provide insights into how contracts are handled, monitored, or executed within CLM platforms.

Additionally, I would like to know if there are any available datasets focused on dispute resolution, especially concerning contractual disputes. Any information or guidance on where to find such data would be highly appreciated.

Thank you in advance for your assistance.

submitted by /u/lahaine93
[link] [comments]

Music Statistics For Punk And Other Genres

Hello!

Does anyone know any good sources of music statistics? I am studying sound production at uni and part of the course requires us to do research on marketing and promotion.

I thought that looking at statistics and weaving that into the report would be a good idea but i cant find anything that’s specific enough and if it is it will be behind a pay wall.

the genre we are researching is punk but I can find a way to tie in a wider genre if punk is too specific.

Edit: mostly looking for demographic statistics and what medium music is consumed

submitted by /u/_callumstewart_
[link] [comments]

Need Help Finding A Dataset Longitudinal, Multiple Waves, Sociology

I need a dataset

1) it has to have multiple waves/ be longitudinal .

2) Needs to be easy enough to use I’ve been deemed by a statistics professor as not being “capable enough” to use quantitative data. If it’s not easy to use that is fine. I’ve had to hire a tutor before.

3) looking at hospitalizations, reasons for hospitalization, age, and cause/mode of death.

4) or half of these variables

5) for a human geography population project.

6) our professor wants it to be a public dataset that is national for the states if it is not national it needs to include the United States.

submitted by /u/Rajah_1994
[link] [comments]

Looking For Open Unstructured Medical Notes, Ideally In Remote Patient Monitoring, To Research LLM Capabilities

Hi everyone,

I’m currently working on my PhD, focusing on reconstructing and creating patient stories and clinical narratives for clinicians using Large Language Models (LLMs). I’m looking for open, unstructured medical notes, ideally related to Remote Patient Monitoring. If the dataset also includes some quantitative data, that would be even better!

I’ve already looked into MIMIC and am considering applying for access, but I’m wondering if there are any other datasets or sources that might be useful for my research. Any recommendations or pointers would be greatly appreciated!

Thanks in advance!

submitted by /u/Stealthy_Nachos
[link] [comments]

Looking For US Tip Earnings Data Specifically

Hey all,

This is my first post in this sub. I am looking for a dataset that I would’ve assumed would be easy to find but I’m having no luck 🙁 As the US politics has been a recent fixation for me, a small project I would like to start involves looking at currently tipped occupations (ie waiters, cashiers, hair salons etc) and comparing the income that comes from tips currently to what we will observe in the future due to both parties (Dem and Rep) committing to a tax free tip policy. So far the closest dataset I have found is this from the US bureau of labor stats however it only details their gross pay (I’m assuming this means pre tax) and includes the tips. This doesn’t help much because as a part of this project I would like to answer the questions;

(i) Will these occupations force more tips onto consumers due to the policy change?

(ii) Will other occupations that don’t currently get tipped begin to take tips in order to get more tax free income?

I unfortunately don’t see how I can answer these questions if the tips are included and the numbers are pre tax 🙁

Any help or suggestions is welcome and appreciated.

submitted by /u/Girgis99
[link] [comments]

Do You Know Where I Can Access Twitch Stream-level Historical Data For Free?

Hello everyone, I hope you’re doing okay.

The thing is that for a project at uni I want to access historical data on daily streams, and get, for example, info about the time and date of the stream, channel, content, average viewers, stream duration, etc. What I need is something like this (but for this page I have to pay):

https://streamscharts.com/streams?sortBy=avg_concurrent_viewers&time=30-days

Does anyone know any alternatives to get this kind of data for free?

Thank you in advance ! Any help is appreciated.

submitted by /u/Valuable-Interest921
[link] [comments]

Can I Find Tune A LLM Model Like GPT4-O To Parse Data In A JSON Format From Partially Structured PDFs?

I am working on a project that relies heavily on pattern matching and regexes to extract and give strucuture to data that the company relies on. This data is extracted from PDFs that are partially structured but here and there something will break because of weird character or some edge case that is not taken care off. Because of this there is a chance that our current parsing engine might miss something in the pdfs.

I have been wondering a lot and have tested GPT4-O as it is by uploading pdfs attachments and have observed that is pretty good at parsing the information that we need. Ever since I have been planning to build something new that instead of pattern recognition relies on LLMs such as the ones from OPEN AI.

My question is, can I train a OPEN AI or another model to parse the information that I need from these PDFs and make it spit output in purely a JSON structure that I want? So I can use OPEN AIs’ API and integrate it in our backend services to do all of the work. Do you guys think this is possible?

If fine tuning is not possible, what is the best way of going about building something like this.

submitted by /u/captain-ass-smasher
[link] [comments]

Any Dataset In Cardiology Domain To Begin A Project ?

Hello everyone, Context : I have medical background and I want to enter in the deep learning/machine learning world. Some requires have be obtain, like in python programmation, machine learning and deep learning theory. I want to create a project in the cardiology. But I don’t know what’s the free dataset in the domain. I research many point of view, like radiology, pharmacology, biology etc…

Question : Can you have many suggestions on free dataset, I can use for my project. Thanks all,

submitted by /u/Sane_pharma
[link] [comments]

Customer Segmentation But With Ground Truth Labels

Hello, as the title states I am looking for customer segmentation datasets but with segment labels since I want to benchmark different methods. In truth, any variable (such as satisfaction) will be fine as long as it is more than 2 categories.

I’ve looked all around kaggle and UCI but I cannot find any, all these datasets contain no labels. Do you guys have any suggestions? Thanks

submitted by /u/Grand_Comparison2081
[link] [comments]

Q: Fine-tuning Coding LLMs On Git[hub] Histories Rather Than Just Final Code?

I run a small software company creating traditional C++ desktop apps for font & graphic design work. We have 10+ years of Git histories of our apps.

What open “coding” LLMs are there out there that weren’t just trained on final code but on Git histories (commits & pull requests), and Github stuff (PR discussions, issues etc.)?

What dataset formats for such data would be advisable to use?

I’d like to fine-tune a coding LLM to privately assist in our software development, ideally not just on the current state of the code but on its evolution.

I have a “feeling” that this would be much better. 🙂

submitted by /u/Minimum_Art_2263
[link] [comments]

[Request] Need Workout Images Dataset

Greetings! I’m working on a project that requires me to annotate people in different workout postures. I’ll be requiring workout images of individual people where their bodies are either 1) On the ground (Crunches, Russian Twist, etc.)/ any flat surface like a gym bench (Bench Press), or 2) parallel to the ground(Push-Up, Mountain Climbers, etc.).

I’ve already found two for Push-Ups on Roboflow, but the rest have been a pain to find.

Please suggest datasets where I can either find a such images.

submitted by /u/tekinayor
[link] [comments]

Soccer Corner Odds Dataset For Betting

Hello everyone,

I am looking for a website, API, or database that contains historical data on corner odds. I have found some databases online, but they all only offer limited odds values, covering just a specific betting range: less than 9, 10-12, and more than 13, for example (Betfair’s free historic data service). I am looking for a database that includes odds for over, exactly, and under for each corner value in a large range of values (4 to 18 coerner), as I have built a betting model based on these types of odds. I just need a good database to test the model.

submitted by /u/Fun-Associate-6139
[link] [comments]