🔥🔥🔥 [2024/10/31] We released MFTCoder v0.5 mainly for MFTCoder-accelerate, which is now supporting preference alignment methods like DPO/RPO/ORPO in the new xxpo module, adding full-parameter ...