Skip to content

Commit

Permalink
Merge pull request #26 from AK391/master
Browse files Browse the repository at this point in the history
migrating gradio hub demo to huggingface spaces
  • Loading branch information
wilson1yan authored Oct 21, 2021
2 parents d157da5 + 58e3f98 commit c230bc3
Show file tree
Hide file tree
Showing 4 changed files with 1 addition and 50 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
# VideoGPT: Video Generation using VQ-VAE and Transformers

[[Paper]](https://arxiv.org/abs/2104.10157)[[Website]](https://wilson1yan.github.io/videogpt/index.html)[[Colab]](https://colab.research.google.com/github/wilson1yan/VideoGPT/blob/master/notebooks/Using_VideoGPT.ipynb)
Integrated to [Huggingface Spaces](https://huggingface.co/spaces) with [Gradio](https://github.com/gradio-app/gradio). See demo: [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue)](https://huggingface.co/spaces/akhaliq/VideoGPT)

We present VideoGPT: a conceptually simple architecture for scaling likelihood based generative modeling to natural videos. VideoGPT uses VQ-VAE that learns downsampled discrete latent representations of a raw video by employing 3D convolutions and axial self-attention. A simple GPT-like architecture is then used to autoregressively model the discrete latents using spatio-temporal position encodings. Despite the simplicity in formulation and ease of training, our architecture is able to generate samples competitive with state-of-the-art GAN models for video generation on the BAIR Robot dataset, and generate high fidelity natural images from UCF-101 and Tumbler GIF Dataset (TGIF). We hope our proposed architecture serves as a reproducible reference for a minimalistic implementation of transformer based video generation models.

Expand Down
Binary file removed gradio/bear.mp4
Binary file not shown.
Binary file removed gradio/breakdance.mp4
Binary file not shown.
50 changes: 0 additions & 50 deletions gradio/demo.py

This file was deleted.

0 comments on commit c230bc3

Please sign in to comment.