-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature Request]: Marigold depth - high-quality diffusion-based monocular depth estimation #2330
Comments
It looks like it could be combined with Patchfusion, according to their paper, is a high-definition approach to depth maps that is technically independent of the base model. |
Great; Marigold produces depth maps of the same revolution as input |
Wow, Marigold inference is using a diffusion pipeline to produce depth maps? I think this is heavy enough that we make it an optional component. (Or we want a component management system for ControlNet?) |
Yes, but it can be integrated similarly to https://github.com/kijai/ComfyUI-Marigold by copying the code, so there is no need for extra dependencies. When we roll out an update for Marigold, we will notify dependency repositories about improvements upstream! |
Apologies for the late reply, because while huggingface's range of packages are very good to replicate and implement, the iteration between versions makes breaking changes difficult to maintain. |
I think a generic config neural network structure for reading diffusers might be the way to go. |
Improved monocular depth estimation algorithm based on fine-tuned stable diffusion. Expecting better guidance for depth-to-image and other models employing monocular depth.
https://marigoldmonodepth.github.io/
https://twitter.com/AntonObukhov1/status/1732946419663667464
The text was updated successfully, but these errors were encountered: