I am having trouble finding this, what do people use to store and create these datasets? Not as in ‘JSON’ or a relational\/non-relational data bases, but is there a popular project that streamlines all of this or should I write my own?<\/p>\n
I am a software developer so the scraping and storing of data isn’t an issue, what I don’t want to do is re-invent the wheel. I am just starting to get into this generation of AI tech.<\/p>\n
I’d like to find something that can take in data like images and text with ‘tagged’ context for fine tuning AI models. Something I can write scraper and parsers and add to a database, then export data for training data sets. <\/p>\n
Like I said I am about to just write my own stuff to do this but I feel like this is a common enough problem that I should just use whatever the popular kids are using these days. Trouble is I am just not finding the right words to search. <\/p>\n
So does this exist? am I overcomplicating this?<\/p>\n<\/div>\n
submitted by \/u\/drywallfan <\/a>
[link]<\/a><\/span> [comments]<\/a><\/span><\/p>
