Devlog #4
We can finally see some success in actually reducing token count significantly. PromptGuard has been able to achieve significant token reduction in prompts containing system logs. We have documented a ~64% token reduction in that area of prompting.
There are now 3 other types we need to find ways to reduce token counts for. They are code, text and JSON data.
A few new updates have been made to PromptGuard…
PromptGuard is not only a VS Code extension now; it is a token-reducing proxy as well. The PromptGuard-Extension now can only show dashboard metrics fetched from the proxy and expand prompts if the prompt is too vague. The PromptGuard-Proxy runs locally on port 8787 by default and carries out all the token reduction and cost estimate required by the dashboard. PromptGuard is not merely an extension anymore, it is an ecosystem.
I will be publishing the Python package for the proxy by Monday(IST) evening. You can view the Proxy’s source here: https://github.com/ShreeyashBihade/PromptGuard-Proxy