Skip to content

vllm.models.kimi_k3.nvidia.specialized_decode.cutedsl.common.prefetch

L2 weight prefetch: each warp walks a persistent device table of (address, bytes), spreading 16-KiB chunks over the grid in table order. The owner retains the weights and table through graph replay; activations and mutable caches may not be ranges before their producer completes.