When we launched Mockingbird a few weeks ago, the idea was to make it super simple to generate mock data from a schema that you could stream to any destination. When we launched it, you could send mock data streams to Tinybird and Upstash Kafka.

Now, we’ve added support for Ably, AWS SNS, and Confluent.

You can check out the UI here: https://tbrd.co/mock-rd and it’s also available as a CLI with npm install @tinybirdco/mockingbird-cli

Hope this helps when you can’t find the dataset you need!

Hello, as the title states, I am looking for all men under 55 in the state of Va, USA who died on that date.

I’ve tried VA newspapers but most are not online.

Any help would be appreciated.

Hey! I have many Json files that equate to 175 million pieces of data, I’m unsure how to store them in a database, I’ll need to first create one big json file or loop through each or the files and move the data from them into a database.

I’ll need to do querys against the whole dataset multiples times a day so the quicker the better.

I’ve already experimented with mongodb but I just can’t see past the way querys are written.

Any ideas?

I’ve been working on a tokenizer that determines the best possible tokens to represent the test dataset in the least number of tokens for various different vocabulary sizes.

It works well but I’ve been testing with The Pile test data, but it’s mostly English so it’s a not good representation for multi-lingual. It also lacks a fair amount of code and tags.

I need around 1-2GB raw text uncleaned and uncensored, that represents a few different languages and a fair amount of code from different programming languages. Better to be raw, and include data both with HTML tags as it would be when scraped, and also without HTML tags (as it would prioritize the HTML tags too heavily if they were always present).

So just a good representation of general text.

I know I could build my own dataset from various different ones, but it seems to me that a dataset like this should already exist. Any leads would be helpful. Thank you.

Hi. I’m looking for a data set of employee titles at US companies. Not specific companies and not specific people just generalities. Currently have a record set of a million plus job titles of all varieties from cashier to CEO… However looking to pair these up with job level. Wondering if anything like this exists anywhere. I’ve tried the SAMs database but that’s even messier than the records that I have.

Thanks

We are building a hosted embedding marketplace for builders to augment their leaner open-source LLMs with relevant context. This lets you avoid all the infra for finding, cleaning, and indexing public and third-party datasets, while maintaining the accuracy that comes with larger LLMs.

Will be opening up early access soon, if you have any questions be sure to reach out and ask!

Learn more here

Need help

Hey guys, does someone maybe know how I can get a global ODA or Aid-Data dataset. I am curently working on my Bachelors thesis and therefore I would need these Datasets in a form that I could use with Stata.

I tried downloading the ODA-Data and import it to stata but for some reason I didn’t have any obervations. I would need Data which would contain information on the amount of aid delivered to countries in a given year for an analysis of the impact of humanitarian aid on conflict dynamics.

If someone has a tip or could help me, that would be realy nice.

Feel very much like making some tools to index viability/value of carbon offsets (which I am very aware is in parts extremely murky). Are there any good api or data sources out there? Needless to say anything I build I will share, will be free, accessible etc etc :). Thanks in advance!

Seen in this video they describe the optimal strategy for this math dice game

https://youtu.be/ULhRLGzoXQ0

Datasets on this as it might be a useful simulation project 6000 observations

https://rpruim.github.io/fastR2/reference/Pigs.html

Includes dataset of gpt2 explaining it’s neurons

Hey so I’m building a real-time data platform (here) and I’ve put a decent amount of time series data on it but it still needs A LOT of work. The goal is to get as much good real time data on there as possible

Feel free to play around with it and download some of the data. Appreciate any feedback – the more critical the better.

Hi everyone, I am PhD student and currently working on an NLP and Network Analysis project. I am in search of an email dataset with sender, receiver and the message information. Preferably from companies with some other metrics such as performance and so on included (which is not absolute necessity). If anyone know of such a dataset like ENRON or SpamAssasian and direct me to it, I would be most thankful.

I was wondering if there were any job datasets with statistics about employment rates and types of jobs recent graduates get. The more variables for a data point, the better.

There are legitimate gripes about Java syntax, to be sure—the same is true of JavaScript and every other language. As Bjarne Stroustrup once said, “There are only two kinds of languages: the ones people complain about and the ones nobody uses.”

The JVM

I’m taking a programming module in my Economics course and I need an easy csv dataset to analyse as my first one for some coursework.

I have absolutely zero experience with this so a relatively simple one would be very nice thanks!

Working on a side project, but cant seem to find this data. Its weird that this should be obviously out there but is behind pay walls. Is there a free source I can get this data from?

Doing a project where we are finding data about airlines. I need a dataset with complex demography of passengers from the years 2019-2022. This primarily focuses on age, gender, and possibly nationality. It has been a pain in the ass to find anything that specific, and I’m guessing it is hard to find because most datasets have limited information, and others may have restrictions on how data can be used. If you do find anything, please comment.

Preferably west pomeranian university one but could be anything. I’m in need of a way to download and access it.

The subject for my project is predicting forest fires and I am looking for a dataset similar to the one shared on Kaggle but I can’t find one. I looked on Earth engine and found some datasets but they don’t provide dates and they are Imagecollections, not csv. I am familiar with machine learning and cleaning datasets in csv format after turning it into dataframes but not at all familiar with Imagecollections. So basically my question comes down to two paths:

I use the datasets from Earth Engine but I don’t know how to work with them. So perhaps someone could give me some tips on how to predict Can someone guide me towards a suitable dataset to predict forest fires?

I appreciate all input!

On the hunt for dollar store data from the past 5 years, including opening year. Preferable including Dollar General and Dollar Tree, but either/or is fine. I’m able to find some data through SNAP and BluePages, but they don’t have any information on when the store was opened. Any ideas?

Are there any good tools/techniques for capturing workflow data, specifically to help train an LLM? Use case is accurate question answering around processes/best practices inside an organization.

Is this where something like a UiPath would be necessary?

I started on this idea of finding a comprehensive book dataset which for sure has a description and more than one genre (makes things more realistic), since I wanted to cluster them based on similarity to find some good ones to read for myself 😉 The only ones I could find on Kaggle were ones with a single genre label, so collected it on my own.

So sharing it here in case it helps someone else too:

[Dataset](https://www.kaggle.com/datasets/ishikajohari/best-books-10k-multi-genre-data)

The data was collected from Goodreads from their list – Books That Everyone Should Read At Least Once and contains Description, Ratings and Multiple Genre classifiers.

Can anyone assist me?

I’m wondering if there is a free aviation API to track arrivals and departures to a set airport. It would collect: Callsign, Aircraft Type, Gate, and Arrival/Departure airport, then plug that into a Google Sheet.
Currently I run this process manually by looking at FlightAware data, but if I can automate this for free that would be great!

From the assignment ” Source a data set with regard on equipment failure on the internet that can help you to illustrate the difference between causation and correlation. “

I need each country’s population, area (preferably in square miles), GDP, and year of founding. Just raw data.