What I made?

My model is trained. Final val loss is 3.28 after 3.5 hour, in comparison original GPT-2 was around 3.1 after 169 hours on 32 Google TPUs. Also my costed 18.8$ while OpenAi one 43.1k$. Technical info about training in previous devlog

What’s new in this devlog?

I added CPU support and CLI for inference. Most of new CPUs should works with it. It only works on windows.
Ready to ship!