Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fine-tune update #61

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Conversation

paul-lupu
Copy link

This PR is made to help others struggling with training on lower VRAM. I got this to work on 24gb on the RTX-4090 with the settings i provided in the readme.

Added a new export_pth() function that save the weights to an outputs/pth_export/<step_number>.pth file; this is to make it easier to test in actual comfyui workflows

Also I changed the save_checkpoint() function as follows:

  • the next_save_iter step is now used to call the export_pth() function
  • added a new parameter called --model_checkpoint_n_steps; every time the save_checkpoint function is called, it checks if the current step is past the value in this parameter and if so, also saves the full model

@paul-lupu paul-lupu closed this Nov 25, 2024
@paul-lupu paul-lupu reopened this Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant