Second Devlog
As promised this one will introduce the demo, it took me longer than expected. I hosted the demo on my home server so fortunately no extra costs there:)
The demo itself sits on its own branch which has demo users, and uses Open Router as the LLM provider. The demo uses the google/gemma-4-26b-a4b-it model, since that was the closest one to which I am using locally which is: google/gemma-4-12b-qat. Apart from using a external LLM provider for the demo I also added multiple user support. They aren’t protected by passwords or anything, but should give you the chance to try out your own situations whether real or fake (the app doesn’t log any data). Surprisingly Open router has a much bigger latency than locally hosted LMstudio, so please be patient.
Any feedback in the comments would be amazing.
LonleySailor
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.