I searched in parlGov dataset but nothing

So I’m new to this group. I’ve worked in corporate “big data” and “data warehousing” for almost 20 years. I also own a small business that sells the “CMS/NPPES Npi database in most popular database flavors.

My observation is as follows…it seems to me that a good portion of the requests in this group are for a very specific set of data.

I’m not an academic, but how do you end up deciding what you want your thesis to be before figuring out if the data is even available?

Many of the assistance requests are for data whose source is behind a corporate policy which the industry / corporations are not going to let become public.

Another example is medical data which is protected by HIPPA in the US.

Pardon my wording, but is this a “cart before the horse” situation?

I saw on London datastore that they released a dataset called MPS Antisocial. I want to contact them to see if they can make a similar one for MPS Violence Offences or link me an earlier version of MPS Antisocial as it says it started July 2022 but doesn’t have any data for 2022 (unless they meant 2023) as it has only 2023.

Hi does anyone know how I could find census (ideally) or other microdata on lgbtq individuals in Canada? The census survey only has a variable for gender and gender diversity in a couple, but not directly a sexual orientation question, which I guess there should be.

Hi,

Can someone help with scraping data? Unfortunately I don’t have the skills to do that. I want to create a dataset of US corporations’ expenditures on lobbying, for each available year.

Example: https://www.opensecrets.org/federal-lobbying/clients/summary?id=D000023883

Here is Amazon’s total expenditures on lobbying in 2023. You can type any other company who participates in lobbying. I guess there are more sources for such data. If someone can help me collecting this data, it will be highly appreciated. Thanks!

I want to build an application that has a job experience feature, like Linkedin. Where can I get an API (or other resource) to at least have the name, logo, and location? I would like primarily tech-oriented companies, but all companies would definitely be better.

I’ve done my best in googling this topic, but I couldn’t find any studies done on how many or how often police officers become bystanders while other officers do unlawful things.

I’ve found anecdotes like the George Floyd story but nothing that suggests a number or percentage.

I asked r/AskStatistics and they referred me here.

I found parlGov database but I have to construct what I want by myself and it is time consuming

Just as the title says. I am in search of raw data in the marijuana industry within specific states as well. Such as demographics, categories, amount spent within each category, brands etc. that sort of stuff.

Any ideas where I can find something like this?

I am looking for a list of federal charges that I can use as reference data when extracting mentions of said charges from unstructured text. For example, such a list would include things like:

Possession with Intent to Distribute 50 Grams or More of Methamphetamine Possession with Intent to Distribute 28 Grams or More of a Mixture or Substance Containing Cocaine Base Possession with Intent to Distribute Cocaine Possession with Intent to Distribute Heroin

I know I can get text extracts of US Code – but what I am looking for is how I could detect something like “Possession with Intent to Distribute 50 Grams or More of Methamphetamine” in freeform text and then ideally crosswalk over to a reference in USC. (example50%20grams%20or%20more%20of%20methamphetamine%2C%20its%20salts%2C%20isomers%2C%20and%20salts%20of%20its%20isomers%20or%20500%20grams%20or%20more%20of%20a%20mixture%20or%20substance%20containing%20a%20detectable%20amount%20of%20methamphetamine%2C%20its%20salts%2C%20isomers%2C%20or%20salts%20of%20its%20isomers%3B)).

Hey all!
I’m a marketing master’s student and for one of my assignments, I have to interpret the digital metrics of a certain campaign or company using GA4. The demo account offers only data from Google merchandise or Flood it. I want to find more interesting campaign data that I can use!
I understand that most companies keep their metrics confidential but is there any resource online that hosts digital metrics data of different companies to use for educational purposes?
I would love to get all the help I can!
I really appreciate any help you can provide.

Anybody who has verified emails, please let me know. I’m in desperate need of data. Thanks in advance (:

I really needed a daily count of violent crime in London but I don’t think it exists.

I decided to try any other related datasets and see if there is a correlation when aggregating them into months and checking against my monthly violent crime data. If it correlates well, I’ll use the dataset as a way to split the monthly violent crime into daily.

Any dataset with daily X of something in London that may correlate well to violent crime and that domain would be appreciated.

Thank you

Hello everybody, trying to create a model which detects damge on a car and estimates repair cost need some data for creating a model for estimating repair cost. Need data like car brand and model, damage area, damage severity, location, claim amounts, damage severity. It would helpful if someone could find dataset like this.

Monitor

Mouse

Keyboard

Hard Disk

Printer

Hello,

Looking for data similar to that used in this paper https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10648304/.

The dataset is “openly available” at https://www.aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&aihubDataSe=realm&dataSetSn=138, but I am unable access it.

Any similar acoustic data for pipeline conditions (e.g., leaks) would be appreciated.

I’m looking for average monthly temperature and precipitation datasets so I can do a Köppen climate classification by country. It would be best if it went up to the year 2022 however, this isn’t exactly a requirement. I haven’t had any luck finding a data set for this so if anyone finds one and is willing to share please do!

Hi everyone,

I have a project where I need to know the daily number of crimes in London. The Police datasets I’ve come across record crime monthly which doesn’t work for me.

Can anyone help please?

.

Hello!

I am interested in analysing weather trends using images. Therefore, I am in search of a dataset of images which are taken at the same location every hour or every day (timestamped). The image doesn’t need to be exclusively of the sky, but the sky must be partially visible. Ideally I would like 1 year’s worth of data.

I have looked into FAA weather cams and other live web cam sites, but I could not ascertain whether these sources had historical data archived. Currently I am scheduling a python script to take a screenshot of these sites at specified times, but the job is only executed when my computer isn’t asleep.

Hi! I’m an Applied Stats major and for our capstone we have to choose a statistical topic and go in depth on the learning of it and use it on a dataset. If you couldn’t tell by the title I’m doing bootstrap stats.

My issue is that since it’s simulating missing/limited population data I don’t know where I could find datasets to use for it and even more so what type.

Would anyone be willing to point me in the right direction?

Hello! I’m looking for a “large” dataset for a class project. It needs to have providers with multiple products and consumer behavior information (basically consumers interacting with different providers). An example of this would be something like Amazon or eBay where users buy from different sellers. Thanks!

If anybody interested, I have 15MB of artist data which is equal to approx. 1.107.600 artists. It’s sorted from A to Z and can share a portion of a specific letter if need proof. DM me for more information.

I was wondering if there is some website that shows me all subreddits by member count or by the date the sub was created from oldest to newest.

I am currently doing research regarding natural language processing and have no idea where to start for gathering data. Mainly, I need a way to get both Big 5 scores and writing samples from the user in order to train the model. Any ideas where to look?

I am looking for a dataset that contains these variables for my economics capstone project. I’ve been looking for hours and I don’t know if it’s what I’m searching or what but I cannot find anything related to this.

I’m not really too worried about what the other variables are, just as long as it has those two and the other variables arent “weird”, I guess.