Optimizations
I was working on optimizing CUDA kernels and adding some Doxygen documentation.
In the image you can see GPU utilization per kernel.
Note: The relatively low utilization is expected — these kernels are likely optimized for larger GPUs than the RTX 3050 (which is quite limited in terms of Tensor cores and SM count).
My small language model is written entirely in CUDA and C++ with no third-party dependencies.
Note I posted kernels bechamrk in the image because stardance markdown doesnt support tables yet
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.