increased The local Gemma LLM query timeout to 180 seconds (3 minutes) after the reviewer had an issue with the model, originally i had it capped to 60 seconds and anything that takes longer than that, I just had a hard coded message about how it is taking too long for the model to run. This was put because my mac is only has an intel i5 and 8 gigs of ram, causing the model to freeze my mac after any question. If needed too or if your macbook can handle a it, you should increase the thinking time shown in the pic below to atleast 5 minutes
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.