{"id":25690,"date":"2024-02-14T19:27:27","date_gmt":"2024-02-14T18:27:27","guid":{"rendered":"https:\/\/www.graviton.at\/letterswaplibrary\/what-tools-and-tech-should-i-use-to-build-an-open-source-dataset\/"},"modified":"2024-02-14T19:27:27","modified_gmt":"2024-02-14T18:27:27","slug":"what-tools-and-tech-should-i-use-to-build-an-open-source-dataset","status":"publish","type":"post","link":"https:\/\/www.graviton.at\/letterswaplibrary\/what-tools-and-tech-should-i-use-to-build-an-open-source-dataset\/","title":{"rendered":"What Tools And Tech Should I Use To Build An Open Source Dataset?"},"content":{"rendered":"<p><!-- SC_OFF --><\/p>\n<div class=\"md\">\n<p>Hey everyone,<\/p>\n<p>I want to build an open source dataset in the clinical trial space. I&#8217;m looking for some tech\/tools recommendations that make building an open source dataset easy.<\/p>\n<p>I guess the easiest would just be to set up a Google Sheet and Google Form to get new data submissions. I also came across: <a href=\"https:\/\/github.com\/dolthub\/dolt\">https:\/\/github.com\/dolthub\/dolt<\/a>, but this seems to be quite expensive.<\/p>\n<p>Some requirements that need to be fulfilled:<br \/> &#8211; The core dataset should be public, but we want to restrict access to contact information such as email or phone numbers to avoid that people get spammed<br \/> &#8211; People should be able to submit new data or submit updates to existing data points, but this data should be verified before it&#8217;s written to the public dataset &#8211; The final dataset could become quite large (10-20GB). Google Sheet won&#8217;t work with this &#8211; Users and contributors are non-technical. So it needs to be easy for them to user<\/p>\n<p>Would be curious to learn more about how other people have built their datasets.<\/p>\n<p>Thanks a lot!<\/p>\n<\/div>\n<p><!-- SC_ON -->   submitted by   <a href=\"https:\/\/www.reddit.com\/user\/Affenbob123\"> \/u\/Affenbob123 <\/a> <br \/> <span><a href=\"https:\/\/www.reddit.com\/r\/datasets\/comments\/1aqtay8\/what_tools_and_tech_should_i_use_to_build_an_open\/\">[link]<\/a><\/span>   <span><a href=\"https:\/\/www.reddit.com\/r\/datasets\/comments\/1aqtay8\/what_tools_and_tech_should_i_use_to_build_an_open\/\">[comments]<\/a><\/span><\/p><div class='watch-action'><div class='watch-position align-right'><div class='action-like'><a class='lbg-style1 like-25690 jlk' href='javascript:void(0)' data-task='like' data-post_id='25690' data-nonce='65e0e39b87' rel='nofollow'><img class='wti-pixel' src='https:\/\/www.graviton.at\/letterswaplibrary\/wp-content\/plugins\/wti-like-post\/images\/pixel.gif' title='Like' \/><span class='lc-25690 lc'>0<\/span><\/a><\/div><\/div> <div class='status-25690 status align-right'><\/div><\/div><div class='wti-clear'><\/div>","protected":false},"excerpt":{"rendered":"<p>Hey everyone, I want to build an open source dataset in the clinical trial space. I&#8217;m looking&#8230;<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[85],"tags":[],"class_list":["post-25690","post","type-post","status-publish","format-standard","hentry","category-datatards","wpcat-85-id"],"_links":{"self":[{"href":"https:\/\/www.graviton.at\/letterswaplibrary\/wp-json\/wp\/v2\/posts\/25690","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.graviton.at\/letterswaplibrary\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.graviton.at\/letterswaplibrary\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/www.graviton.at\/letterswaplibrary\/wp-json\/wp\/v2\/comments?post=25690"}],"version-history":[{"count":0,"href":"https:\/\/www.graviton.at\/letterswaplibrary\/wp-json\/wp\/v2\/posts\/25690\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.graviton.at\/letterswaplibrary\/wp-json\/wp\/v2\/media?parent=25690"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.graviton.at\/letterswaplibrary\/wp-json\/wp\/v2\/categories?post=25690"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.graviton.at\/letterswaplibrary\/wp-json\/wp\/v2\/tags?post=25690"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}