@bartoszkasyna on CGPT · 23 days ago 5h 29m logged I was trying to train my model, but something went wrong. I need to find out, why loss jumped into sky. Ln(32000) = 10.37 which mean tokens are random but I got 20.8 so model is predicting worst possible token???
@bartoszkasyna on CGPT · 23 days ago 5h 29m logged I was trying to train my model, but something went wrong. I need to find out, why loss jumped into sky. Ln(32000) = 10.37 which mean tokens are random but I got 20.8 so model is predicting worst possible token???
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.