Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem with Image editing #16

Open
chkmook opened this issue Aug 21, 2024 · 2 comments
Open

problem with Image editing #16

chkmook opened this issue Aug 21, 2024 · 2 comments

Comments

@chkmook
Copy link

chkmook commented Aug 21, 2024

I read the technical report and observed the impressive performance of the t2i generation using the provided demo code.
There is an issue with the image editing process using demo_image2image.py. I tried to edit an image generated by t2i generation, it doesn't work. Even after changing the CFG, there is no change. Could you please explain if there are hyperparameters to perform i2i editing?

Here is the result of editing:
Screenshot 2024-08-21 at 11 18 45 AM

@ChrisLiu6
Copy link
Contributor

We do observe that for the editing task, the model has a strong inclination to keep the original image unchanged. I think it might be related to the small number of used editing data and the feature of the editing task per. se., namely during training, the model is supervised to keep the very most regions unchanged, making the gradient of the editing part swamped. Currently, for the editing task we suggest trying multiple times with different seeds (usually 5 is enough) and some of the trials should work

@chkmook
Copy link
Author

chkmook commented Aug 26, 2024

Thank you for your response. Then, could you provide an example of an image and prompt that can be easily edited?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants