vllm.models.step5.nvidia
¶
Modules:
-
flashinfer_sparse–Step5 sparse selection and attention using FlashInfer and PyTorch.
-
layernorm–Step5 normalization layers.
-
mega_moe–Step5 NVFP4/FP8/BF16 DeepGEMM MegaMoE with shared symmetric storage.
-
model–Inference-only Step5 model.
-
mtp– -
ops– -
sparse_attention–Hopper and B300 sparse attention using FlashInfer and Triton.
-
vl–Inference-only Step5 vision-language model.