Forward pass
After adding all necessary operations on the GpuMatrix I implemented the forward pass. It was surprisingly hard to get the caching for the backward pass right because reallocating buffers on the gpu should be avoided. As always I let AI write some test cases and everything passed.
Next I’ll implement the backward pass which will hopefully let the network learn with incredible speeds.
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.