Clarification on 1-bit Adam speed comparison for SQuAD #1648
Unanswered
sarvghotra
asked this question in
Q&A
Replies: 1 comment
-
|
Need confirmation from @awan-10 , but I believe this is a typo that TCP lines are actually Infinibands, and Infiniband lines are actually TCP. On the other hand, for most up to date results please refer our final paper in ICML http://proceedings.mlr.press/v139/tang21a/tang21a.pdf |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, it seems counter-intuitive to me that Infiband scales worse than TCP as shown in the following figure from DeepSpeed wiki here:
So wanted to confirm if the figure is correct.
Beta Was this translation helpful? Give feedback.
All reactions