Just hit 91tk/s with “cosine_similarity”: 0.9994624257087708
its actually crazy its like 5x faster the hf full devlog comming soon!
ITS LIKE 0.054% away from perfect!!!
The selective MXFP4 gate/up profile reached ~96 tok/s while preserving top-1 on the tested SmolLM3-3B through my thintensor runtimeeeee
Full DevLogs gonna be crazy
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.