Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR is made to help others struggling with training on lower VRAM. I got this to work on 24gb on the RTX-4090 with the settings i provided in the readme.
Added a new export_pth() function that save the weights to an outputs/pth_export/<step_number>.pth file; this is to make it easier to test in actual comfyui workflows
Also I changed the
save_checkpoint()
function as follows:next_save_iter
step is now used to call theexport_pth()
function--model_checkpoint_n_steps
; every time thesave_checkpoint
function is called, it checks if the current step is past the value in this parameter and if so, also saves the full model