You are browsing as a guest. Sign up (or log in) to start making projects!

Open comments for this post

4h 4m 46s logged

What I updated:

  • The history source to include summaries
  • summary agent
  • Prompt Renderer

The history source now summarieses the past conversation if it doesn’t fit into the token budget.

You can configure it like this:

history, err := history.New(sessionID, store, &history.SummarizerDefinition{
	Model:   model,
	Enabled: true,
})

or create a custom summarizer and pass it in the SummarizerDefinition


The Summary agent got some bug fixes and better error handling

It doesn’t panic if no model is configured :)


The Renderer and the whole Prompt builder is updated with the focus on better renderer final prompts

  • there is now a Render Part function that turns a part into a RenderNode
  • Part and RenderNode can be recursive / hierarchical

the default XML Renderer renders something like this:

<system>...</system>
<history>
    <user>...</user>
    <assistant>...</assistant>
    <user>...</user>
    ....
</history>
....
0
2

Comments 0

No comments yet. Be the first!