@craisin on tinyapper · 12 days ago 1h 38m 47s logged Devlog 4: I tried to get away with not using a KV Cache and ship today… but CPU said no. Considering using cloud to host this until I implement a KV Cache, but I know I should just code one up. Why do LLMs need so much compute
@craisin on tinyapper · 12 days ago 1h 38m 47s logged Devlog 4: I tried to get away with not using a KV Cache and ship today… but CPU said no. Considering using cloud to host this until I implement a KV Cache, but I know I should just code one up. Why do LLMs need so much compute
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.