Skip to content

A high resolution and faster face editing framework (TPAMI)

License

Notifications You must be signed in to change notification settings

neuralchen/SimSwapPlus

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

92 Commits
 
 
 
 
 
 
 
 

Repository files navigation

SimSwap++: Towards Faster and High-Quality Identity Swapping

Accepted by TPAMI (IEEE Transactions on Pattern Analysis and Machine Intelligence)

Xuanhong Chen, Bingbing Ni $\dagger$, Yutian Liu, Naiyuan Liu, Linzhi Zeng, Hang Wang

$\dagger$ Corresponding author

Project page of SimSwap++

Please note that the current respository is a supplementary material for the SimSwap++ paper, NO issues will be replied at this stage. Once everything is ready we will release training and testing codes like our SimSwap.

logo

Methodology of SimSwap++

Additional Results:

[Source ID: Angelina Jolie Target ID: Gamora]

[Source ID: Tom Cruise Target ID: Gamora]

[Source ID: Brad Pitt Target ID: Gamora]

[Source ID: Will Smith Target ID: Gamora]

[Source ID: Geoffrey Hinton Target ID: Gamora]

[Source ID: Captain America Chris Evans Target ID: Gamora]

[Source ID: Jim Carrey Target ID: Gamora]

[Source ID: Matthew McConaughey Target ID: Gamora]

[Source ID: Jackie Chan Target ID: Gamora]

[Source ID: Messi Target ID: Gamora]

[Source ID: Kylian Mbappé Target ID: Gamora]

[Source ID: Cristiano Ronaldo Target ID: Gamora]

[Source ID: Quentin Tarantino Target ID: Gamora]

Video in-the-wild Results (under construction):

Videos are generated frame by frame without any temporal smoothing (e.g., Kalman Filter), which may cause some subtle flickering.

Group1 [SimSwap++ (S)]:

Source ID: Scarlett Johansson Target ID: Shakira (1080p on YouTube)

Scarlett Johansson

Source ID: Dilireba Target ID: Shakira (1080p on Google Drive)

Dilireba

Source ID: Tom Cruise Target ID: Shakira (1080p on Google Drive)

Tom Cruise

Source ID: Elon Musk Target ID: Shakira (1080p on Google Drive)

Musk's face is always so recognizable!

Elon Musk

Source ID: Keira Knightley Target ID: Shakira (1080p on Google Drive)

Keira Knightley

Source ID: Brad Pitt Target ID: Shakira (1080p on Google Drive)

Brad Pitt

Source ID: Nicole Kidman Target ID: Shakira (1080p on Google Drive)

Nicole Kidman

Group2 [SimSwap++ (S)]:

Source ID: Kelly Clarkson Target ID: Taylor Swift (1080p on YouTube)

Source ID: Geoffrey Hinton Target ID: Taylor Swift (1080p on YouTube)

Geoffrey Hinton

Source ID: Gal Gadot Target ID: Taylor Swift (1080p on YouTube)

Gal Gadot

Source ID: Leonardo DiCaprio Target ID: Taylor Swift (1080p on YouTube)

Source ID: Elon Musk Target ID: Taylor Swift (1080p on YouTube)

Elon Musk

Source ID: Robert Downey Target ID: Taylor Swift (1080p on YouTube)

Robert Downey

Source ID: Aamir Khan Target ID: Taylor Swift (1080p on YouTube)

Aamir Khan

Group3 [SimSwap++ (S)] Complex Movie Scene:

I am Iron Man

Few previous face-swapping papers have published such complex movie scenes

The subtle flickering can be resolved by introducing temporal smoothing, which is not our concern

Source ID: Captain America Chris Evans Target ID: Iron Man (1080p on YouTube)

captain-america-chris-evans

Source ID: Scarlett Johansson Target ID: Iron Man (1080p on YouTube)

Scarlett Johansson

Source ID: Elon Musk Target ID: Iron Man (1080p on Google Drive)

Elon Musk

Source ID: Leonardo Target ID: Iron Man (1080p on YouTube)

Leonardo

Source ID: Gal Gadot Target ID: Iron Man (1080p on YouTube)

Gal Gadot

VGGFace2-HQ Dataset

VGGFace2-HQ contains more than $1.36M$ $512 \times 512$ aligned face images and up to $9, 630$ distinct identities. In addition, this dataset consists of two parts:

  • (1) a natural image sub-collection, which collects up to $200, 000$ images covering $1, 000$ different identities;
  • (2) a synthetic image sub-collection, containing $8, 630$ cleaned and re-annotated identities (i.e., clean up the images with mismatching identities and low-quality faces in the cropped VGGFace2).

Download the dataset:

Via Google Drive:

[Google Drive] VGGFace2-HQ

We are especially grateful to Kairui Feng PhD student from Princeton University.

Via Baidu Drive:

[Baidu Drive] VGGFace2-HQ Password: sjtu

Samples from VGGFace2-HQ

Natural Part:

naturalpart.png

Synthetic Part:

naturalpart.png

Acknowledgements

About

A high resolution and faster face editing framework (TPAMI)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published