Support for using DeepSpeed Layers for inference without going through Hugging face #3785
bharatv007
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I would like to define my own GPT model architecture and use DeepSpeed layers for inference.
Any tutorials on how to make a GPT model using DeepSpeeds custom layers for inference without goinng through Hugging Face.
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions