You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
hi, im having trouble where the api would randomly crash. and i cant pinpoint why. at one case it crashed while loading model. some other crashed while saving. i noticed that sometimes its still keeping the model inside vram, and possibly ran out of memory and crashed.
is there a way i could get more verbose information on why it crashed, as well as trying to prevent it from crashing. since it takes me 5 atleast 5 minutes to stop the instance and turn it back on.
im using AWS G5, with 24gb vram and 16gb ram.
The text was updated successfully, but these errors were encountered:
hi, im having trouble where the api would randomly crash. and i cant pinpoint why. at one case it crashed while loading model. some other crashed while saving. i noticed that sometimes its still keeping the model inside vram, and possibly ran out of memory and crashed.
is there a way i could get more verbose information on why it crashed, as well as trying to prevent it from crashing. since it takes me 5 atleast 5 minutes to stop the instance and turn it back on.
im using AWS G5, with 24gb vram and 16gb ram.
The text was updated successfully, but these errors were encountered: