[FSDPv1] Only perform cat() during last microbatch backward() within FlattenParamsWrapper#1184
Merged
chrisxcai merged 1 commit intongoyal_changes_for_pp_fp8_jiecaoyu_free_fp16_shardfrom chriscai_ngoyal_changes_for_pp_fp8_jiecaoyu_free_fp16_shardMay 16, 2024
+108-7
