I am making a bigram language model first, and I am making it a lot better than I thought. I am using the wizard of oz to train it, but it shows mostly giberish but it is really good. Also I did more recap on the functions in PyTorch so I could use it in other projects too!
This is going to be a short one, since all I did was get used to the pytorch library, and all the math. Also, the dot product and the matrix mult was not that bad! I did all my functions and all that I need for the llm. The importants are softmax, concat and stuff like this. I really like where this project is going and where it is taking me! SO STAY TUNED IN!
This is a whole new project GUYS! This project is called ARIA. ARIA can hear your voice, run it through an custom, built from scratch LLM, and talk it out. All I did today was only math that would make me understand LLMs better and also code a teeny tiney bit, but I still like it! Follow allow my journey! Also this is a lab of mine that I made by myself! So my really good projects are probably going to be here! (Some other projects that are really good MIGHT not be here so check my other projects to! (Sorry that there are incomplete projects))