Built this over the past few weeks as part of a multilingual research project. Figured I’d share it here. Check it out!
What: ~9.8M web documents across 11 languages — hi, bn, ta, te, mr, gu, kn, ml, pa, ur, en. ~8.4B tokens. CC0 license.
submitted by /u/ashtok897
[link] [comments]
