ziglm
- 2 Devlogs
- 19 Total hours
an llm interference engine written in pure zig
an llm interference engine written in pure zig
So after a lot of trial and error i finally added multimodal audio and video support because they were the only two things missing from a complete cpu engine because i wanted a fully working cpu reference before doing anything with cuda and stuff but i want to get cuda working asap because the smaller models that i have been testing that would run on my cpu with a good speed they kinda have bad multimodal performance
Thank you for reading my devlog
So i decided to start this new project while waiting for my other project getting reviewed
I was kinda bored waiting for my other project to be reviewed by ppl and i wanted to try out zig so i thought this is a great toy project idea to play with in zig