Skip to content

vllm.models.kimi_k3.nvidia.specialized_decode.cutedsl.mla

Modules:

  • dcp –

    MLA decode under decode context parallelism (DCP = TP, rank d owns head block d)

  • prepared –

    Prepared MLA core: the packed input projection feeds the query kernel, then either

  • query –

    Cluster MLA query RMSNorm, Q_B projection, W_UK absorption and paged FP8 KV insert.

  • value –

    MLA value projection (W_UV) and sigmoid gate of the BF16 attention latent.