Example to help understand Dynamic SplitFuse #4623
Unanswered
puddingfjz
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Thanks for the wonderful work of Dynamic SplitFuse!
Could you provide an example to show how Dynamic SplitFuse determines the batches and how the inference is done when there is a list of prompts coming?
Beta Was this translation helpful? Give feedback.
All reactions