-
Notifications
You must be signed in to change notification settings - Fork 112
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add image to image vae compile demo #406
Conversation
#pipe.vae = oneflow_compile(pipe.vae) | ||
# ImageToImage has encoder and decoder, so we need to compile them seperately. | ||
pipe.vae.encoder = oneflow_compile(pipe.vae.encoder) | ||
pipe.vae.decoder = oneflow_compile(pipe.vae.decoder) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
compile the encoder and decoder separately
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is there an automatic way to detect and report the cause of inappropriately compiling encoder and decoder together?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is there an automatic way to detect and report the cause of inappropriately compiling encoder and decoder together?
Yes, we are working on it in another PR: directly compile the full vae.
|
||
if args.compile_vae: | ||
from onediff.infer_compiler import oneflow_compile | ||
#pipe.vae = oneflow_compile(pipe.vae) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Related work takes my time: #394
But it's not trivial to compile the encode and decode in one graph.
Performance:
Run: