Devlog#23 - Greetings EVeryone !
TL;DR -
Retrieval and task-grounding quality can now be measured deterministically against repository ground truth, with full regression coverage
Long -
Short sesssion today.
- added the tp*.txt in gitignore for me to make temporary text files
- Added deterministic retrieval and task-grounding evaluation with precision recall F1 metrics
- Added stable repo entity ground truth and evaluation ccovergae
- Added test for the same
- added init.py in every subfolder of test bcz there were name clashes in pytest.
So today this much only . Leave ur thoughts in the comment and wish me luck!!
Comments 1
!!!!!!!!!!!!!!!!!!!!!!!
Sign in to join the conversation.