File size: 4,380 Bytes
781d374
40ac571
 
 
781d374
 
 
 
 
513805e
781d374
 
40ac571
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
---
title: FollowYourEmoji WebUI
emoji: 🤪
colorFrom: pink
colorTo: purple
sdk: gradio
sdk_version: 5.42.0
app_file: app.py
pinned: false
license: apache-2.0
---

# FollowYourEmoji WebUI

This is a fork of [FollowYourEmoji-Webui](https://github.com/daswer123/FollowYourEmoji-Webui) adapted for Hugging Face Spaces.

## About this fork

This fork implements the FollowYourEmoji functionality in a web UI, modified to expose as many settings as possible for convenient use in Hugging Face Spaces.

You can see sample videos in the example folder: https://github.com/daswer123/FollowYourEmoji-Webui/tree/main/example

## Features

Here is a short list of what has been added to the web UI:

1. **Convenient Upload**: Ability to conveniently upload a reference picture and video
2. **Face Cropping Tool**: A tool to crop the reference picture so that it fits the video perfectly
3. **Crop Preview**: Ability to see a preview of the cropped picture, zoom in or shift the cropping
4. **Video Processing**: The ability to upload any video without the need for additional processing (the interface itself processes everything)
5. **NPY File Support**: Ability to upload .npy file, as well as choose from a folder. Each processed video is added to the folder, which allows you to select the same video without re-processing
6. **Animation Preview**: Ability to see how the animation will look like before generation
7. **Extensive Settings**: Many different settings, both custom and official
8. **Custom FPS**: Ability to specify the FPS of the output video
9. **Anomaly Detection**: Mechanism to remove "Anomalous frames" in automatic mode
10. **Frame Archive**: Possibility to get all frames in the archive in addition to video

And many more small improvements that will allow you to work conveniently in one interface.

## Screenshot

![image](https://github.com/user-attachments/assets/5d5bce76-4dfe-4012-bfee-58fac3e63c29)

## Original Project

This is a fork of the original [Follow-Your-Emoji](https://github.com/mayuelala/FollowYourEmoji) project:

**Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation**

[Yue Ma*](https://mayuelala.github.io/), [Hongyu Liu*](https://kumapowerliu.github.io/), [Hongfa Wang*](https://github.com/mayuelala/FollowYourEmoji), [Heng Pan*](https://github.com/mayuelala/FollowYourEmoji), [Yingqing He](https://github.com/YingqingHe), [Junkun Yuan](https://0-scholar-google-com.brum.beds.ac.uk/citations?user=j3iFVPsAAAAJ&hl=zh-CN), [Ailing Zeng](https://ailingzeng.site/), [Chengfei Cai](https://github.com/mayuelala/FollowYourEmoji), [Heung-Yeung Shum](https://scholar.google.com.hk/citations?user=9akH-n8AAAAJ&hl=en), [Wei Liu](https://scholar.google.com/citations?user=AjxoEpIAAAAJ&hl=zh-CN) and [Qifeng Chen](https://cqf.io)

<a href='https://arxiv.org/abs/2406.01900'><img src='https://img.shields.io/badge/ArXiv-2406.01900-red'></a> 
<a href='https://follow-your-emoji.github.io/'><img src='https://img.shields.io/badge/Project-Page-Green'></a> <a href='assets/wechat_group.png'><img src='https://badges.aleen42.com/src/wechat.svg'></a> ![visitors](https://visitor-badge.laobi.icu/badge?page_id=mayuelala.FollowYourEmoji&left_color=green&right_color=red) [![GitHub](https://img.shields.io/github/stars/mayuelala/FollowYourEmoji?style=social)](https://github.com/mayuelala/FollowYourEmoji)

## Citation

If you find Follow-Your-Emoji useful for your research, welcome to 🌟 this repo and cite our work using the following BibTeX:

```bibtex
@article{ma2024follow,
  title={Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation},
  author={Ma, Yue and Liu, Hongyu and Wang, Hongfa and Pan, Heng and He, Yingqing and Yuan, Junkun and Zeng, Ailing and Cai, Chengfei and Shum, Heung-Yeung and Liu, Wei and others},
  journal={arXiv preprint arXiv:2406.01900},
  year={2024}
}
```

## Follow Family

- [Follow-Your-Pose](https://github.com/mayuelala/FollowYourPose): Pose-Guided text-to-Video Generation
- [Follow-Your-Click](https://github.com/mayuelala/FollowYourClick): Open-domain Regional image animation via Short Prompts
- [Follow-Your-Handle](https://github.com/mayuelala/FollowYourHandle): Controllable Video Editing via Control Handle Transformations
- [Follow-Your-Emoji](https://github.com/mayuelala/FollowYourEmoji): Fine-Controllable and Expressive Freestyle Portrait Animation