Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Understanding re-aging results #4

Open
luchaoqi opened this issue Aug 23, 2024 · 1 comment
Open

Understanding re-aging results #4

luchaoqi opened this issue Aug 23, 2024 · 1 comment

Comments

@luchaoqi
Copy link

Hello, thanks for this awesome work! I have a question trying to understand the following re-aging results, given an input face here:

I got the following different results with the same inference code:
python age_editing.py --image_path xxx --age_init 39 --gender male --save_aged_dir xxx --specialized_path xxx --target_ages 0 10 20 30 40 50 60 70 80 90 100
image
image
image
Do you have any idea why the results are not deterministic in the above case?

Also in case 2:

image
Do you have any idea why there are artifacts?

@gh-BumsooKim
Copy link

Hi, I'm not an author of this paper, but have some insight.

First, I conjecture artifacts are raised by non-enough optimization in null-text optimization process (before Prompt2Prompt editing process) or huge gap between source prompt and inputted image. One potential solution is to increase the steps of null-text optimization to obtain more faithful null-text embeddings. To do that, you can modify num_inner_step in

def null_optimization(self, latents, num_inner_steps, epsilon):

like from num_inner_step=10 to num_inner_step=20. It takes more time, but might generate more faithful results.


In addition, I observed that input age also affects the resulting images like below figure:

image

To mitigate this issue, you can use off-the-shelf age estimator (e.g., DEX, InsightFace) than age constant via command line.

I hope it works well 😀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants