You are browsing as a guest. Sign up (or log in) to start making projects!

1h 10m 29s logged

BIIIIIIIG NEWS!!!!! The terminal response says it all , but the logic is working very well. Just fixed the little bug at the end where the model returned too JSON messages so that should go away, but if you look at the top right of the image the test2.txt file actually generated. This means my model is using the tools correctly and is starting to get the hang of it. WHAT I LEARNED: building the prompt you send to the model after each user input is VERYYYY important. You kind of have to spoon feed models information, or else they don’t know what to do. ESPECIALLLLY with a smaller model.

EDIT: I also changed models to a slightly bigger one from Ollama, the gemma3:12b model. I highly recommend Ollama for projects such as this, as it is free to download and run a tonnnnnn of local models on it. This is a list of all of the models that are available:https://ollama.com/library.

0
2

Comments 0

No comments yet. Be the first!