Poem AI
By
@kallenseelo
- 4 Devlogs
- 12 Total hours
An Ai that creates poetry based off the first word you give it
3h 23m 52s logged
Migrated to C++, as well as made training faster and smarter!
Some of the main things I changed were to add epochs (going through the data more than once). Also, thanks to C++, I was able to improve the speed from about an hour and a half to under 2 seconds; however, with epochs, it’s about a minute, which isn’t too bad overall!
I’m almost done with this project; I’ll build the chat interface, then I’m planning to make a UI for it on Nest so that people can use it!
This project has really taught me a lot about ML and LLMs, and I’m starting to understand (and appreciate) how they are built!
There really isnt much to see still, but next time i should have a vid of it working fully!
4h 4m 7s logged
Converted the tokenizer and data processing to C++!
Ok, this wasn’t as horrible as I thought it would be; however, it was just super long, as I had to search for similar functions and fix tons of errors, and overall it took a bit!
However, I’m in the perfect place for converting the training part, then testing it! So stay tuned for that. :)
The vid below shows just the basic loop running! (Not much to see, though)
2h 21m 27s logged
Trained the first version!
Ok, so today, I was able to build a full tokenizer and train the first version!
However, it was super duper slow, but thanks to learning how to do this in Python (with very minimal libraries), I think I can code it in C++!
The AI took about 2 hours for about 100 neurons and 96k samples.
My plan is to make this train faster and smarter, as it has poetry structure but not the poetry part overall!
The video below shows the code, as the AI currently returns bad outputs!
Thanks for reading!
2h 10m 42s logged
Started work on the AI!
Ok, taking a break from my other project, I wanted to program a simple AI without using libraries like PyTorch, as well as learn Python! The idea for my AI is you give it a word, and it creates poetry from that word (even if it doesn’t make much sense, I’m just trying to get it to rhyme)!
Today, I worked on learning some Python, as well as building the start of the tokenizer! So far it’s not too bad, and I should have it finished by the end of today!
Some challenges I’ve been running into are just learning Python in general, because I keep trying to do std::cout to print things, lol, but overall it’s going well!
Thanks for reading!
