Devlog#24 - Greeting Everyone !
TL;DR -
Added evaluation for both context selection and final context quality, covering correctness, budget limits, and deterministic behavior. Added focused tests to validate the complete evaluation flow.
Long -
So exams are going on so can’t do long hour session. Was planning to add manythings over few days but it would stretch for about more days.
Things did -
-
Added context-selection evaluation against expected entities using precision recall f1
-
added end to end evaluation for final context accuracy budget compliance etc.
-
adde d validation for unkown , mising extra and empty entities or context cases.
-
addded tests for the same
Js this much today. Leave ur thoughts in the comments .
Comments 1
!!!!!!!!!!!!!!!!!!!!!!!!
Sign in to join the conversation.