DEVLOG #41 - If the model grows, the extra capacity has to help
I do not want SL-LLM-R to add parameters just because a larger model sounds better. If the system ever needs more capacity, my current idea is to add a small module in a copy and test whether that addition actually improves the model. If it does not help, the extra module should be deleted just like any other failed update.
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.