Skip to content

Commit

Permalink
fix formatting in the video generation state blog post (#2630)
Browse files Browse the repository at this point in the history
  • Loading branch information
sayakpaul authored Jan 29, 2025
1 parent bdc0e5e commit 4192d57
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions video_gen.md
Original file line number Diff line number Diff line change
Expand Up @@ -175,8 +175,8 @@ We used HunyuanVideo for this study, as it is sufficiently large enough, to show
| BF16 + Group offload (leaf) + VAE tiling | 6.66 GB | 887s |
| FP8 Upcasting + Group offload (leaf) + VAE tiling | 6.56 GB^ | 885s |

<sub><sup>*</sup>8Bit models in `bitsandbytes` cannot be moved to CPU from GPU, unlike the 4Bit ones.<sub>
<sub><sup>^</sup>The memory usage does not reduce further because the peak utilizations comes from computing attention and feed-forward. Using [Flash Attention](https://github.com/Dao-AILab/flash-attention) and [Optimized Feed-Forward](https://github.com/huggingface/diffusers/pull/10623) can help lower this requirement to ~5 GB.<sub>
<sub><sup>*</sup>8Bit models in `bitsandbytes` cannot be moved to CPU from GPU, unlike the 4Bit ones.</sub>
<br><sub><sup>^</sup>The memory usage does not reduce further because the peak utilizations comes from computing attention and feed-forward. Using [Flash Attention](https://github.com/Dao-AILab/flash-attention) and [Optimized Feed-Forward](https://github.com/huggingface/diffusers/pull/10623) can help lower this requirement to ~5 GB.</sub>

We used the same settings as above to obtain these numbers. Also note that due to numerical precision loss, quantization can impact the quality of the outputs, effects of which are more prominent in videos than images.

Expand Down Expand Up @@ -331,4 +331,4 @@ We cited a number of links throughout the post. To make sure you don’t miss ou
- [Memory optimization guide for CogVideoX](https://huggingface.co/docs/diffusers/main/en/api/pipelines/cogvideox#memory-optimization) (it applies to other video models, too)
- [`finetrainers`](https://github.com/a-r-r-o-w/finetrainers) for fine-tuning

*Acknowledgements: Thanks to [Chunte](https://huggingface.co/Chunte) for creating the beautiful thumbnail for this post. Thanks to [Vaibhav](https://huggingface.co/reach-vb) and [Pedro](https://huggingface.co/pcuenq) for their helpful feedback.*
*Acknowledgements: Thanks to [Chunte](https://huggingface.co/Chunte) for creating the beautiful thumbnail for this post. Thanks to [Vaibhav](https://huggingface.co/reach-vb) and [Pedro](https://huggingface.co/pcuenq) for their helpful feedback.*

0 comments on commit 4192d57

Please sign in to comment.