README.md

---
title: ROSE
emoji: 🚀
colorFrom: blue
colorTo: pink
sdk: gradio
sdk_version: 5.35.0
short_description: 'ROSE: Remove Objects with Side Effects in Videos'
app_file: app.py
pinned: false
---

## Get Started
1. Install ROSE Dependencies

   You can follow the [Dependencies and Installation](https://github.com/Kunbyte-AI/ROSE?tab=readme-ov-file#dependencies-and-installation).

3. Install Demo Dependencies
```shell
cd hugging_face/

# install python dependencies 
pip3 install -r requirements.txt

# Run the demo
python app.py
```

## Usage Guidance
* Step 1: Upload your video and click the `Get video info` button.


* Step 2: 
   1. *[Optional]* Specify the tracking period for the currently added mask by dragging the `Track start frame` or `Track end frame`.
   2. Click the image on the left to select the mask area.
   3. - Click `Add mask` if you are satisfied with the mask, or
      - *[Optional]* Click `Clear clicks` if you want to reselect the mask area, or
      - *[Optional]* Click `Remove mask` to remove all masks.
   4. *[Optional]* Go back to step 2.1 to add another mask.

   
* Step 3: 
   1. Click the `Tracking` button to track the masks for the whole video.
   2. Then click `Inpainting` to get the inpainting results.


*You can always refer to the `Highlighted Text` box on the page for guidance on the next step!*


## Citation
If you find our repo useful for your research, please consider citing our paper:
```bibtex
@article{miao2025rose,
      title={ROSE: Remove Objects with Side Effects in Videos}, 
      author={Miao, Chenxuan and Feng, Yutong and Zeng, Jianshu and Gao, Zixiang and Liu, Hantang and Yan, Yunfeng and Qi, Donglian and Chen, Xi and Wang, Bin and Zhao, Hengshuang},
      journal={arXiv preprint arXiv:2508.18633},
      year={2025}
}
```



## Acknowledgements

The project harnesses the capabilities from [Track Anything](https://github.com/gaomingqi/Track-Anything), [Segment Anything](https://github.com/facebookresearch/segment-anything) and [Cutie](https://github.com/hkchengrex/Cutie). Also the gradio demo page is based on [ProPainter's huggingface demo page](https://github.com/sczhou/ProPainter/tree/main/web-demos/hugging_face). Thanks for their awesome works.