Category: Datatards

Here you can observe the biggest nerds in the world in their natural habitat, longing for data sets. Not that it isn’t interesting, i’m interested. Maybe they know where the chix are. But what do they need it for? World domination?

What Advantages Or Disadvantages Does Synthetic Data Have Over Real-world Data?

Need to understand the perks to pivot to a synthetic data generator and whether it has a market. I work in a data annotation company by the name of Acme AI and a key bottleneck of clients is a scarcity of data (in many cases) for training ML models. Naturally, this led me to question the existence of said novel ML solution if data is scarce in the first place (i.e. no market value). Seeking responses with practical examples or experiences.

submitted by /u/SithisR
[link] [comments]

Who Knows How This Dataset Was Labeled?

I’m trying to find an efficient way to reproduce a csv labeling similar to this Shakespeare one:

“Dataline”,”Play”,”PlayerLinenumber”,”ActSceneLine”,”Player”,”PlayerLine”

“1”,”Henry IV”,,,,”ACT I”

“2”,”Henry IV”,,,,”SCENE I. London. The palace.”

“3”,”Henry IV”,,,,”Enter KING HENRY, LORD JOHN OF LANCASTER, the EARL of WESTMORELAND, SIR WALTER BLUNT, and others”

“4”,”Henry IV”,”1″,”1.1.1″,”KING HENRY IV”,”So shaken as we are, so wan with care,”

“5”,”Henry IV”,”1″,”1.1.2″,”KING HENRY IV”,”Find we a time for frighted peace to pant,”

“6”,”Henry IV”,”1″,”1.1.3″,”KING HENRY IV”,”And breathe short-winded accents of new broils”

“7”,”Henry IV”,”1″,”1.1.4″,”KING HENRY IV”,”To be commenced in strands afar remote.”

“8”,”Henry IV”,”1″,”1.1.5″,”KING HENRY IV”,”No more the thirsty entrance of this soil”

“9”,”Henry IV”,”1″,”1.1.6″,”KING HENRY IV”,”Shall daub her lips with her own children’s blood,”

“10”,”Henry IV”,”1″,”1.1.7″,”KING HENRY IV”,”Nor more shall trenching war channel her fields,”

“11”,”Henry IV”,”1″,”1.1.8″,”KING HENRY IV”,”Nor bruise her flowerets with the armed hoofs”

“12”,”Henry IV”,”1″,”1.1.9″,”KING HENRY IV”,”Of hostile paces: those opposed eyes,”

“13”,”Henry IV”,”1″,”1.1.10″,”KING HENRY IV”,”Which, like the meteors of a troubled heaven,”

Here’s the complete dataset:https://paste.c-net.org/WidelyTibetan

The ,”Play”,”PlayerLinenumber”,”ActSceneLine”,”Player”, columns is what I’d need to know how to reproduce, ideally fully automated or semi automated.

Anyone know how this was done and the way to reproduce it efficiently?

Thanks for your suggestions!

submitted by /u/Efficient_Fix1026
[link] [comments]

US County Level Housing Unit Estimates Csv 1960-present?

Does anyone know of where I can find csvs for US couny level Housing Unit totals from each decadal census 1960-present? The 1990-2020 ones are available from the census website, but the 1960-1980 ones are not. 1960 and 1970 are on the census website, but in non readable PDF form, so that would be a lot of work to digitize. 1980 I just straight up cannot find the right link. I found some data on ISPSR, but they are at the census tract level, and I am not confident if I aggregate I will get the true county estimate from the census since before 1990 census tracts were only defined for limited areas. If anyone knows of a place this has already been digitized I would really appreciate it. Sorry if this isn’t the best place to post, I’ll probably cross post.

submitted by /u/estheticpotato
[link] [comments]

Need Alternative To Parsehub. I Need Only To Run One Project

Hi,

I have build a project in parsehub to scrape some data, and when I test run it works great. But its impossible to extract all the data through test run, as PC freezes (consumes too much RAM).

I have spoken to parsehub, they tried IP rotating on their end, but website is blocking, so they are suggesting to use a proxy to do that.

However, cheapest parsehub subscription + purchasing a proxy costs are too much to handle.

Is there any other free tool, that could work on this case?

Sorry if this is a wrong place to ask for this.

Thanks.

submitted by /u/ConsistentPromise156
[link] [comments]

Is There A Way To Seek Comprehensive And Crucial Data For A City Chitradurga Analysis

Is there a way to Seek Comprehensive and Crucial Data for Chitradurga Analysis

I’m in the process of conducting an extensive analysis focused on Chitradurga, and I’m on a quest for crucial and all-encompassing data. I’m interested in gathering information that covers a wide spectrum of topics, ranging from village land prices, land utilization trends, and the transition from agriculture to industry, to intricate details like population trends, literacy rates, employment statistics (covering both the employed and the unemployed), and any noteworthy initiatives related to sustainable growth and renewable energy. My specific interest lies in comprehending the status and developments in wind power generation.

The purpose behind this endeavor is to construct a meticulous and complete overview of Chitradurga’s growth trajectory. Your participation could be instrumental in this undertaking. If you’re privy to essential data sources, databases, or possess first-hand insights on village land prices or any other pertinent facets, I would be extremely appreciative if you could share your knowledge.

By collaborating on this effort, we can contribute to a more profound understanding of Chitradurga’s journey and the multitude of factors that shape its progression. Thank you for considering participation in this endeavor; your contributions will undoubtedly elevate the quality and depth of this research.

Best regards.

submitted by /u/Sure_Ad8210
[link] [comments]

Need Help Finding BOM Parts Data To Mesh With My FPDS Info! Anyone Know A Good Source?

Hello everyone,

I’m working on a project where I’ve integrated supplier and contract data from the Federal Procurement Data System (FPDS). Currently, my dataset encompasses fields such as [list some of your key fields here, like Supplier ID, Parent Supplier ID, etc.]. I’ve established relationships in my database primarily through these fields.

However, I’ve hit a roadblock. I’m trying to find a comprehensive source for Bill of Materials (BOM) parts details that I can integrate with my existing data. The goal is to understand the products/components that these suppliers provide and to establish meaningful relationships with my current tables.

Does anyone know of a reliable source for BOM data, preferably one that provides fields that can be related to my existing dataset? I’m particularly interested in [mention any specific industries or product categories if applicable].

Any guidance on where to find such data, or even how to approach integrating it, would be immensely appreciated!

submitted by /u/Connect_Physics_7664
[link] [comments]

Multi-Modal Data (and/ With Individual Pretrained Models)

Hi there! Thanks for your time

I am looking for multi modal datasets, preferably with an already pretrained model for each modal (not something on whole). I care about the embedding and the predictions.

It’s not my area so I’m not sure where I should look at. Are there also well known papers, benchmarks etc that I should know of?

Thanks again🙏🏻

submitted by /u/TheBamba
[link] [comments]

[self-promotion] New Streamlit App – Search For Healthcare Providers By State/zip, Toggle Between Total/per Capita, And Drill Down To Your Preferred Level Of Detail

Check it out here. Built on top of Cybersyn’s US Insurance & Healthcare Provider Foundation which includes details on registered US healthcare providers (e.g. names, licenses, addresses, specialties, NPI, location) and on the benefits plans (e.g. healthcare, medical, life insurance) of all large US employers.

submitted by /u/aiatco2
[link] [comments]

[self Promotion] Explore Hundreds Of Open Datasets With SQL, For Free

Hi everyone!

I’m building [subsets.io](http://subsets.io) to make it easier to access open data. You can query 360+ datasets, such as housing prices or world development indicators, through a simple SQL interface. You can also easily turn results into charts, and share them.

The goal is to make it easier to access data, which I’ve found to be my greatest obstacle in data analysis. With most providers having their own portals and API standards, it often takes me hours just to prepare data for a simple query.

It’s still in the very early stages: datasets are currently updated manually, and our charting capabilities are limited. Still, I hope that the core premise can be validated. Do you think something like this could be useful? If so, would you prefer to use it just to download data, or would you also like to do analysis on the platform?

Would love to hear your thoughts!

submitted by /u/salmiakdrop
[link] [comments]

Where Can I Find Dataset Of Baby Images For Photogrammetry?

I need to create a 3D scans of infants faces but the main challenge is finding/scraping 2D pictures themselves. If we scrape the images, it’s highly probable that there might not be multiple angles of the model’s face. Is there a repository where I could find multiple angles of a single image? I was thinking even magazines or public photo albums but no luck.

submitted by /u/nobilis_rex_
[link] [comments]

Automation: How To Get A Threshold Value Between Curves For Any Dataset?

https://imgur.com/a/ja0URmC

I have (X,Y) values for the curves in a graph as shown in the figure.I want to separate these curves into Curve1: 1-2-3-4, Curve2: 5-6-7-8-9-10-11 and Curve3: 12-13-14-15-16. I intend to use the distances between the adjacent points for this. For example, `d4` and `d11` in the graph are considerably large compared to other distance values. So I would split Curve1 and Curve2, knowing that the distance `d4` is large between points 4 and 5. Same for Curve2 and Curve3 with `d11` between points 11 and 12.
Is there a method that determines the minimum threshold value for distance to separate all the curves? New approaches are also welcome.
Thank you.

submitted by /u/PsynapseAural
[link] [comments]