So this is an idea I’ve had for a while, but I want to revisit this. Gemma 4 12b can run on my 12gb 1080 ti and still have some context which is great.

I made a basic harness to let me make custom tools for the AI. Right now, it’s just a fake weather one, but it is pretty modular.