Hey @yiyixuxu, I'm excited to give this a try. Do you have an estimated time frame for how long it might take?

Interested as well!

@charchit7 @staghado

welcome!! and feel free to collaborate

There is no official reference implementation for this pipeline. You can dig into the source code of comfy UI or auto1111 extension if you want. Or you can just experiment on your own to come up something that works well and fit in our design:) so it's a little bit hard to estimate the timeframe.

I suggest starting with our ControlNet pipeline and AnimateDiff pipeline code and try to combine the logics in a way so that this example would work. The first draft should not take long :)

cc @DN6 here

@charchit7 @staghado If it's alright, I'd like to jump in as well if you're collaborating.

@a-r-r-o-w, @staghado happy to collaborate :)

I'm happy to collaborate on this as well.

@charchit7 @staghado @EdoardoBotta Awesome! Let's set up a discord server to discuss more on this and distribute work?

@charchit7 @staghado @EdoardoBotta @a-r-r-o-w Can I join too?

Please reach out on discord : .archer_cs

Hello ! I have worked on Animate Anyone and Animate Diff and would love to make a contribiution for the pipeline here. I see a PR that had been merged. Are there any adittional issues in this which will be worth a solve ?

Hello @souvikg544, I think we forgot marking this issue as resolved. Please feel free to look at the others ones tagged good-first-issue or Good Second Issue if you'd like to help add anything. Looking forward to your PRs, thanks!