Spaces:
Sleeping
Sleeping
| title: FollowYourEmoji WebUI | |
| emoji: 🤪 | |
| colorFrom: pink | |
| colorTo: purple | |
| sdk: gradio | |
| sdk_version: 5.42.0 | |
| app_file: app.py | |
| pinned: false | |
| license: apache-2.0 | |
| # FollowYourEmoji WebUI | |
| This is a fork of [FollowYourEmoji-Webui](https://github.com/daswer123/FollowYourEmoji-Webui) adapted for Hugging Face Spaces. | |
| ## About this fork | |
| This fork implements the FollowYourEmoji functionality in a web UI, modified to expose as many settings as possible for convenient use in Hugging Face Spaces. | |
| You can see sample videos in the example folder: https://github.com/daswer123/FollowYourEmoji-Webui/tree/main/example | |
| ## Features | |
| Here is a short list of what has been added to the web UI: | |
| 1. **Convenient Upload**: Ability to conveniently upload a reference picture and video | |
| 2. **Face Cropping Tool**: A tool to crop the reference picture so that it fits the video perfectly | |
| 3. **Crop Preview**: Ability to see a preview of the cropped picture, zoom in or shift the cropping | |
| 4. **Video Processing**: The ability to upload any video without the need for additional processing (the interface itself processes everything) | |
| 5. **NPY File Support**: Ability to upload .npy file, as well as choose from a folder. Each processed video is added to the folder, which allows you to select the same video without re-processing | |
| 6. **Animation Preview**: Ability to see how the animation will look like before generation | |
| 7. **Extensive Settings**: Many different settings, both custom and official | |
| 8. **Custom FPS**: Ability to specify the FPS of the output video | |
| 9. **Anomaly Detection**: Mechanism to remove "Anomalous frames" in automatic mode | |
| 10. **Frame Archive**: Possibility to get all frames in the archive in addition to video | |
| And many more small improvements that will allow you to work conveniently in one interface. | |
| ## Screenshot | |
|  | |
| ## Original Project | |
| This is a fork of the original [Follow-Your-Emoji](https://github.com/mayuelala/FollowYourEmoji) project: | |
| **Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation** | |
| [Yue Ma*](https://mayuelala.github.io/), [Hongyu Liu*](https://kumapowerliu.github.io/), [Hongfa Wang*](https://github.com/mayuelala/FollowYourEmoji), [Heng Pan*](https://github.com/mayuelala/FollowYourEmoji), [Yingqing He](https://github.com/YingqingHe), [Junkun Yuan](https://0-scholar-google-com.brum.beds.ac.uk/citations?user=j3iFVPsAAAAJ&hl=zh-CN), [Ailing Zeng](https://ailingzeng.site/), [Chengfei Cai](https://github.com/mayuelala/FollowYourEmoji), [Heung-Yeung Shum](https://scholar.google.com.hk/citations?user=9akH-n8AAAAJ&hl=en), [Wei Liu](https://scholar.google.com/citations?user=AjxoEpIAAAAJ&hl=zh-CN) and [Qifeng Chen](https://cqf.io) | |
| <a href='https://arxiv.org/abs/2406.01900'><img src='https://img.shields.io/badge/ArXiv-2406.01900-red'></a> | |
| <a href='https://follow-your-emoji.github.io/'><img src='https://img.shields.io/badge/Project-Page-Green'></a> <a href='assets/wechat_group.png'><img src='https://badges.aleen42.com/src/wechat.svg'></a>  [](https://github.com/mayuelala/FollowYourEmoji) | |
| ## Citation | |
| If you find Follow-Your-Emoji useful for your research, welcome to 🌟 this repo and cite our work using the following BibTeX: | |
| ```bibtex | |
| @article{ma2024follow, | |
| title={Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation}, | |
| author={Ma, Yue and Liu, Hongyu and Wang, Hongfa and Pan, Heng and He, Yingqing and Yuan, Junkun and Zeng, Ailing and Cai, Chengfei and Shum, Heung-Yeung and Liu, Wei and others}, | |
| journal={arXiv preprint arXiv:2406.01900}, | |
| year={2024} | |
| } | |
| ``` | |
| ## Follow Family | |
| - [Follow-Your-Pose](https://github.com/mayuelala/FollowYourPose): Pose-Guided text-to-Video Generation | |
| - [Follow-Your-Click](https://github.com/mayuelala/FollowYourClick): Open-domain Regional image animation via Short Prompts | |
| - [Follow-Your-Handle](https://github.com/mayuelala/FollowYourHandle): Controllable Video Editing via Control Handle Transformations | |
| - [Follow-Your-Emoji](https://github.com/mayuelala/FollowYourEmoji): Fine-Controllable and Expressive Freestyle Portrait Animation |