Not a subscriber? Request 30 days free access to exclusive, behind-the-scenes reporting on defense policy and procurement.

This repo contains official implementation for Training LLMs with MXFP4. Our MXFP4 training recipe achieves near-lossless training by computing unbiased gradient estimates (with stochastic rounding ...