CGPT
- 4 Devlogs
- 12 Total hours
3h 59m 14s logged
Succesfully improved Tokenizer. Now 100MiB of text encode in around 1 minute. In previous devlog 8MiB nedded 22 seconds. So huge improvemnt
40m 8s logged
Optimized tokenizer - 100Mib require 21.8s training time. Encoding time 5.5MiB/s
6h 26m 17s logged
Implemented RMSNorm, linear layer kernel. Implemented BPE Tokenizer - currently its slow.
34m 17s logged
Successfully complied CUDA hello world
