No-inference

Hi! so, i am making this devlog with 15 hours on record because i was honestly not sure if this would work. In my last stardance project, i tried making an agentic chatbot utilizing LLMs, but trying to make it as light and as compatible as possible so it can run even on my poopy 7gb of ram laptop.

That whole thing got me thinking. Do we even need LLMs? Do we even need generative AI for this?

So this project started. This is an attempt at making agentic AI without LLMs, or weights or anything similar. The entire idea is that this can be fast and easily modified without having to use an entire datacenter to retrain the model, because there is no model.

Right now, i have worked on a conversational “engine”, that basically puts words together algorithmically by detecting certain properties from the users prompt. Its not very impressive right now, but i think im onto something that could be quite a big deal if i get right. I dont even know if this project will be shippable but ill still document its development because i think its interesting. Alright smooches! See you later! <3