You are browsing as a guest. Sign up (or log in) to start making projects!

ziglm

  • 2 Devlogs
  • 19 Total hours

an llm interference engine written in pure zig

Open comments for this post

7h 29m 3s logged

Devlog 2: Finally working multimodal audio and video support

So after a lot of trial and error i finally added multimodal audio and video support because they were the only two things missing from a complete cpu engine because i wanted a fully working cpu reference before doing anything with cuda and stuff but i want to get cuda working asap because the smaller models that i have been testing that would run on my cpu with a good speed they kinda have bad multimodal performance
Thank you for reading my devlog

0
1
79
Open comments for this post

11h 17m 12s logged

First devlog for this new project

So i decided to start this new project while waiting for my other project getting reviewed

Why did i do this:

I was kinda bored waiting for my other project to be reviewed by ppl and i wanted to try out zig so i thought this is a great toy project idea to play with in zig

What models are tested (others might work but i havent tested them):

  • smollm2-360m
  • gemma 4 and its variants with curently only image multimodal working but sound and video might be added in the future

Thank you for reading my devlog

0
1
115

Delete project?

Are you sure you want to permanently delete this project? This action cannot be undone.

All devlogs, followers, and associated data will be removed.

Followers

Loading…