Skip to content

MFTCoder v0.4.2: Support more open source models; Support QLoRA + Deepspeed ZeRO3 / FSDP
Compare
Choose a tag to compare
@chencyudel chencyudel released this 04 Jun 04:06
· 28 commits to main since this release
v0.4.2
d0b8457
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Support more open source models like Qwen2, Qwen2-moe, Starcoder2, etc.
Support QLoRA + Deepspeed ZeRO3 / FSDP, which is efficient for very large models.

Assets 2
Loading