What I updated:
- The history source to include summaries
- summary agent
- Prompt Renderer
The history source now summarieses the past conversation if it doesn’t fit into the token budget.
You can configure it like this:
history, err := history.New(sessionID, store, &history.SummarizerDefinition{
Model: model,
Enabled: true,
})
or create a custom summarizer and pass it in the SummarizerDefinition
The Summary agent got some bug fixes and better error handling
It doesn’t panic if no model is configured :)
The Renderer and the whole Prompt builder is updated with the focus on better renderer final prompts
- there is now a Render Part function that turns a part into a RenderNode
- Part and RenderNode can be recursive / hierarchical
the default XML Renderer renders something like this:
<system>...</system>
<history>
<user>...</user>
<assistant>...</assistant>
<user>...</user>
....
</history>
....
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.