devlog 4 - UI refactor
streamlit was replaced with FastAPI + a frontend and i think it looks much better than previously now.
issues + features:
- hugging face’s api (i.e. HfApi.list_models() was not filtered correctly during search)
- direct model import based on local dir is now possible
- openrouter judge was outdated and replaced, now user-configurable
- install now possible in a oneliner pip install -r requirements.txt && waifmark
- if a benchmark was cancelled, previously a bg server process vLLM workers would leak; instead process groups (start_new_session=True) and os.killpg gets rid of all processes when a session is ended.
- streamlit ran CORS and XSRF disabled; rebound to localhost
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.