You are browsing as a guest. Sign up (or log in) to start making projects!

3h 12m 43s logged

Optimizations

I was working on optimizing CUDA kernels and adding some Doxygen documentation.

In the image you can see GPU utilization per kernel.

Note: The relatively low utilization is expected — these kernels are likely optimized for larger GPUs than the RTX 3050 (which is quite limited in terms of Tensor cores and SM count).

My small language model is written entirely in CUDA and C++ with no third-party dependencies.

Note I posted kernels bechamrk in the image because stardance markdown doesnt support tables yet

1
97

Comments 0

No comments yet. Be the first!