How To Generate Text Dataset Using LLama 3.1? [Synthetic]

So I am working on my semester mini-project. It’s titled “Indianism Detection in Texts Using Machine Learning” (yeah, I just randomly made it up during idea submissions). Now the problem is, there’s no such dataset for this in the entire world. To counter this, I came up with a pipeline to convert a normal (correct) English phrase into English with Indianisms using my local LLama 3.1 and then save both the correct and converted sentences into a dataset with labels, respectively.

I also created a simple pipeline for it (a kind of constitutional AI) but can’t seem to get any good responses. Could anyone suggest something better? (I’m 6 days away from the project submission deadline.)

I explained the current pipeline in this GitHub repo’s README. Check it out:
https://github.com/iamDyeus/Synthetica

submitted by /u/dyeusyt
[link] [comments]

Leave a Reply

Your email address will not be published. Required fields are marked *