{"id":39668,"date":"2026-03-15T23:27:24","date_gmt":"2026-03-15T22:27:24","guid":{"rendered":"https:\/\/www.graviton.at\/letterswaplibrary\/how-to-split-a-dataset-into-2-to-check-for-generalization-over-memorization\/"},"modified":"2026-03-15T23:27:24","modified_gmt":"2026-03-15T22:27:24","slug":"how-to-split-a-dataset-into-2-to-check-for-generalization-over-memorization","status":"publish","type":"post","link":"https:\/\/www.graviton.at\/letterswaplibrary\/how-to-split-a-dataset-into-2-to-check-for-generalization-over-memorization\/","title":{"rendered":"How To Split A Dataset Into 2 To Check For Generalization Over Memorization?"},"content":{"rendered":"

<\/p>\n

\n

I wish to ensure that a neural network does generalization rather than memorization. <\/p>\n

in terms of using 1 dataset that is a collection of social media chats, would it be sufficent to split it chornologically only so to create 2 datasets?<\/p>\n

or something more needs to be done like splitting it into different usernames and channel names being mentioned.<\/p>\n

basically I only have 1 dataset but I wish to make 2 datasets out of it so that one is for supervised learning for the model and the other is to check how well the model performs<\/p>\n<\/div>\n

submitted by \/u\/Calm_Maybe_4639 <\/a>
[link]<\/a><\/span> [comments]<\/a><\/span><\/p>