penguin
- 1 Devlogs
- 1 Total hours
penguin is a desktop assistant that uses a small local LLM with 1-3 billion parameters and a tool-calling function with agent-friend to perform small actions. It is designed to run on almost every device.
I tested several local models for tool calling performance. Until now, it’s the qwen2.5:3b leading the “board”. To do this, I built a small tool selection(e.g. get_weather, etc.), quite a lot of typing work. But then, I found the agent-friend toolkit in this blogpost(https://dev.to/0coceo/ollama-tool-calling-in-5-lines-of-python-3h5f) and it’s just amazing! I can now get straight into the tool development without hundreds of lines in JSON.
