Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

Issue While Using ESIOS API (Spain) To Request Past Data

Hi! I am a bioinformatics student interested in learning data analysis and drawing conclusions. Currently, I am working on a project where I will analyze the changes in the electricity price in Spain using Python.

To access the required data, I am using the ESIOS API and have obtained my TOKEN successfully. I can access the electricity price for today without any issues. However, I am facing difficulties accessing the price for previous days, such as yesterday or two days ago.

I wonder if anyone has encountered a similar issue or might have a solution for this problem. Could it be that I do not have sufficient permissions to access historical data? I have attached the relevant code below. Any assistance would be highly appreciated. Thank you!

ESIOS API

import requests from datetime import datetime, timedelta def http_req(url_web, headers_pet, params_pet): return requests.get(url_web, headers=headers_pet, params=params_pet) def date_calc(days_before): return (datetime.now() – timedelta(days=days_before)).strftime(‘%Y-%m-%d’) TOKEN = “my_token” url = ‘https://api.esios.ree.es/indicators/1001’ headers = { ‘Accept’: ‘application/json; application/vnd.esios-api-v2+json’, ‘Content-Type’: ‘application/json’, ‘Host’: ‘api.esios.ree.es’, ‘Authorization’: f’Token token=”{TOKEN}”‘ } params = { ‘date’: date_calc(1) } response = http_req(url, headers, params) print(f’Fecha:{date_calc(1)}nRespuesta:{response.json()}’) —-Response—- Fecha:2023-07-18 Respuesta:{‘Status’: 403, ‘message’: ‘Forbidden’} Process finished with exit code 0

EDIT: I think it might be related to the way the URL is built. Perhaps I don’t need to use ‘params,’ but instead, edit the URL to insert the date there.

submitted by /u/MarioPnt
[link] [comments]

[Request] A Dataset Of Tweets Of Large European Companies

Hello everyone,

I am on the prowl for some more data about (recent) Twitter usage of bigger european companies. This is for a research project of mine. I created a prove a concept already with self-scraped data for the DAX40 companies, which was a good first step, but insufficient for what I want to end up doing. The recent API restrictions have made cleaning up data and branching out a little bit difficult, especially cause I do not have the budget for the premium developer access.

Does anyone already have a dataset with firm Tweets of e.g. the EuroStoxx 600 or CAC 40 in a timeframe between around 2018 and now they can/are willing to share or know of a publicly accesible one?

submitted by /u/Sapere_Aude_Du_Lump
[link] [comments]

Anyone With Statista Access That Can Help A Friend Out?

Hi guys. I’m sorry to be writing this now. But I am in a terrible situation where I need to do a thing? homework? idk how to say it in spanish but something important for a subject at my university, and I depend on this homework to basically pass the year. The problem is that the case is about information that I have not been able to find anywhere else but in Statista. (It is a marketing Asian case, written in English). And I don’t even speak English very well. So yeah! I’m struggling.

Does anyone have access to Statista that can lend me the account just for some minutes? or download the info for me?

submitted by /u/AirXval
[link] [comments]

Anti-government/establishment Movies And TV Shows By Decade, That Could Cause Government Mistrust In Later Years

Firstly dont know if this is the right place for this, however, never ask means you never know

I’ve been rewatching the 90’s TV series “The X-Files” just for the fun of it, as I haven’t seen it since my younger days. While watching, I’ve noticed how the show has a strong anti-government and anti-establishment vibe, making you question hidden motives behind everything. In my family or group of friends, we have different political views, with some thinking there’s always something shady going on with people in power. Interestingly, this perspective seems more common among people from my generation (90’s teenagers), while the younger generation (2010’s teenagers) has a completely different outlook.

So, it got me thinking: Did the 90’s have more media that distrusted authority compared to other generations?

submitted by /u/RhyderZA
[link] [comments]

4.5M Headlines Between 2007-2023 (From 10 Major News Sites)

Some context: I’m a high school student with an interest in data, and I wanted to explore how political bias has changed over the past decade or so.

I ended up scraping headlines from the past 15 years from major publications (New York Times, CNN, FOX, New York Post, BBC, Washington Post, USA Today, Daily Mail, CNBC, and The Guardian)

​

Here’s the link if you’re interested!

https://www.kaggle.com/datasets/jordankrishnayah/45m-headlines-from-2007-2022-10-largest-sites

submitted by /u/imJordanNYC
[link] [comments]

Unable To Access Crash Tables For The State Of NJ. Any Fixes Or Alternatives?

I’m using an NJ Department of Transportation website to get crash tables for New Jersey based on my home county and the year 2020. When I input these parameters, the page refreshes and I have to fill them in again. The datasets do not download to my computer or open on the side.

Does this glitch occur on your devices too? If the website is just nonfunctional, where else could I find crash tables?

Link to input form, which should be returning the crashes dataset when completed: https://www.state.nj.us/transportation/refdata/accident/rawdata01-current.shtm

submitted by /u/ThereWasAnAnomaly
[link] [comments]

Sensor Luminosity Measurements Dataset

I am looking for any open dataset of luminosity measurements collected from sensors.

I want to develop an application that forecasts hourly luminosity values. For that reason, measurements should originate from sensors in a room or an open area with lights. For instance, an office, classroom, gym, coffee shop etc.

Additionally, the values should be stored as floating-point numbers.

I have searched the web and dataset databases but I have found no such dataset.

I would appreciate your help!

​

​

​

submitted by /u/Puzzleheaded_Way_704
[link] [comments]

Business Stats (Employee Count, Payroll, Industry, Etc) For Every US State & County

Compiled, joined, and clean data from US Census County Business Patterns: 2021 to get it into a readable/usable format and thought I would share it here in case it’s helpful to others:

https://app.gigasheet.com/spreadsheet/Business-Stats-for-Every-County—State-in-US/6e479286_3fc6_459e_95d7_8b87930e1cbb [self-promotion]

Original source data comes from: https://www.census.gov/data/datasets/2021/econ/cbp/2021-cbp.html

submitted by /u/n1nja5h03s
[link] [comments]

Dataset Of Electromechanical Brake Booster

I need a dataset that included:

input-output force, control signal of electromechanical brake booster and output pressure of master cylinder.

I’m in hot water. My PhD theses depends on this dataset. After two years of working and researching, I realized the company that was supposed to provide me with the dataset is denying it.

I have tried contacting a few companys and their associated universities, but they didn’t get back to me.

I have tried github and google scholar for this exact dataset but got nothing.

Guys I really appreciate it.

submitted by /u/my-tiktok-daily
[link] [comments]

How Do Financial Databases Obtain Their Data?

Hi all,

I’ve come across a number of different financial databases (CapIQ, Bloomberg, Factset, Traxcn etc) throughout my career and always been interested in how these platforms obtain their data and looking for some insights into this.

If anyone has any then please share!

Thank you.

submitted by /u/_therthon
[link] [comments]

Track Private Flight Info (from LA To Las Vegas) From 2016?

I’m looking for info about a private or charter flight from Los Angeles (probably LAX, but possibly another airport) to Las Vegas. The only info I have are: (1) that it took off on 2016 Feb 11, around 12 – 3pm; and (2) a partial manifest of the names & passport numbers of the passengers. Is there any way I would be able to locate this flight? Thanks!

submitted by /u/xodac
[link] [comments]

Financial Data Needed For Eurostoxx 50 And S&P 500 Top 50 Companies For 10 Years

Hi, everyone!

[Financial Data]

Trying to gather data for cross-country research. I need data for Eurostoxx 50 and S&P 500 Top 50 indices companies from 2013 to 2022.

Following data fields:

% Women on board

% independent directors

Board size

CEO tenure

Current ratio

Debt equity ratio

Total Assets

% women employed in workforce

% disabled employed in workforce

​

Eikon has this data most likely so if someone can help, it will be appreciated. Also willing to pay.

Thanks!

submitted by /u/Ill_Journalist_5292
[link] [comments]