Efficient Gather-and-scatter Matrix Multiplication Kernel with Triton
This post is to log my implementation of gather-and-scatter matrix multiplication operation with Triton. Click here to jump to the final implementation code....
Recent Posts
Understand CUDA Unified Memory
This post is to log my experiments with CUDA unified memory and some innovative and interesting application of UVM in large language model (LLM).
Profile CUDA UVM Performance
This post is to log my profile of CUDA unified virtual memory.