README.md

metadata

title: FollowYourEmoji WebUI
emoji: 🤪
colorFrom: pink
colorTo: purple
sdk: gradio
sdk_version: 5.42.0
app_file: app.py
pinned: false
license: apache-2.0

FollowYourEmoji WebUI

This is a fork of FollowYourEmoji-Webui adapted for Hugging Face Spaces.

About this fork

This fork implements the FollowYourEmoji functionality in a web UI, modified to expose as many settings as possible for convenient use in Hugging Face Spaces.

You can see sample videos in the example folder: https://github.com/daswer123/FollowYourEmoji-Webui/tree/main/example

Features

Here is a short list of what has been added to the web UI:

1. Convenient Upload: Ability to conveniently upload a reference picture and video
2. Face Cropping Tool: A tool to crop the reference picture so that it fits the video perfectly
3. Crop Preview: Ability to see a preview of the cropped picture, zoom in or shift the cropping
4. Video Processing: The ability to upload any video without the need for additional processing (the interface itself processes everything)
5. NPY File Support: Ability to upload .npy file, as well as choose from a folder. Each processed video is added to the folder, which allows you to select the same video without re-processing
6. Animation Preview: Ability to see how the animation will look like before generation
7. Extensive Settings: Many different settings, both custom and official
8. Custom FPS: Ability to specify the FPS of the output video
9. Anomaly Detection: Mechanism to remove "Anomalous frames" in automatic mode
10. Frame Archive: Possibility to get all frames in the archive in addition to video

And many more small improvements that will allow you to work conveniently in one interface.

Screenshot

Original Project

This is a fork of the original Follow-Your-Emoji project:

Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation

Yue Ma*, Hongyu Liu*, Hongfa Wang*, Heng Pan*, Yingqing He, Junkun Yuan, Ailing Zeng, Chengfei Cai, Heung-Yeung Shum, Wei Liu and Qifeng Chen

Citation

If you find Follow-Your-Emoji useful for your research, welcome to 🌟 this repo and cite our work using the following BibTeX:

@article{ma2024follow,
  title={Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation},
  author={Ma, Yue and Liu, Hongyu and Wang, Hongfa and Pan, Heng and He, Yingqing and Yuan, Junkun and Zeng, Ailing and Cai, Chengfei and Shum, Heung-Yeung and Liu, Wei and others},
  journal={arXiv preprint arXiv:2406.01900},
  year={2024}
}

Follow Family

• Follow-Your-Pose: Pose-Guided text-to-Video Generation
• Follow-Your-Click: Open-domain Regional image animation via Short Prompts
• Follow-Your-Handle: Controllable Video Editing via Control Handle Transformations
• Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation