I am curious about doing the same kind of thing for compute shaders. I'm aware of Kompute.cc (which is Vulkan based) but haven't looked at their GEMM kernels, and also of wonnx for WebGPU ([1] is their GEMM code).

I'm also curious whether warp shuffle operations might be useful to reduce some of the shared memory traffic.

[1]: https://github.com/webonnx/wonnx/blob/master/wonnx/templates...