Small changes to the website, better training data, efficiency, and performance!

Try it! -> https://k754a.hackclub.app/PoemAi

‎
This took so freaking long, just because of all the random bugs, issues, and problems training an AI can have. But some of the biggest changes came from the dataset. Changing the dataset from a lot of junk to more Shakespeare ended up really improving output and structure (even though it doesn’t really rhyme).
‎
The other things were mixing the data. Instead of training on the same text doc, I shuffle the data around, still in the chunks so as to not affect output performance, but because of shuffling each epoch, running longer training (like 400 epochs) created much better results.
‎
Another update was because of these larger parameters and changes to the model; it created a problem where my loader could no longer load the model file, so I switched it to a bin and to store pure binary, allowing much faster loading and a memory drop from 3 GB to 1.1, running on the NEST server!
‎
Overall, this has been a super fun project! There is still one thing I want to change: the main chat loader is basically all AI, and I kind of hate using it, so I’m going to attempt to code my own. I could see that taking a bit, but then I’m done!
‎
EDIT: I’ve also been testing with different learning speeds, epochs, and context windows, and i ended up getting a even better model than the one currently, so i’m going to run the 400 epochs, overnight, and it should be updated by morning!