Spaces:
Running
on
Zero
Running
on
Zero
File size: 1,988 Bytes
a189727 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 |
## client side setup
clone
```
https://github.com/hugofloresgarcia/unsound-objects.git
git checkout unloop
```
install
```
conda create -n unsound python=3.10
conda activate unsound
pip install -r requirements.txt
```
## server side setup
ssh into malleus
```
ssh bryan@malleus.cs.northwestern.edu -L 7860:localhost:7860
```
then leave the malleus window open and start up a new local window
(kindly ask hugo to launch the gradio on port 7860)
you can verify that the gradio is running by opening `http://localhost:7860` on your browser
## launch the gradio server (vampnet)
you have to run the gradio server running vampnet model.
(on the remote machine)
```bash
conda create -n vampnet python=3.10
git clone https://github.com/huggingface.co/spaces/hugggof/vampnet-music.git
pip install -e .
CUDA_VISIBLE_DEVICES=0 python app.py
```
### launch the gradio server (s2s)
you have to run the gradio server running audit model.
(on the remote machine)
```bash
conda create -n audit python=3.10
cd audit
pip install -r requirements.txt
CUDA_VISIBLE_DEVICES=0 python scripts/text2sfx/demo.py ckpts/adobe-soda/checkpoints/seethara/text2sfx/25-02-18-256ch-8s/ --model latest_ema.pth
```
or for audit-old
```
CUDA_VISIBLE_DEVICES=0 python scripts/cdit/demos/voice2sfx.py ckpts/rms-centroid-ppg/latest.pth
```
## launch the client (laptop)
then launch the client from your local terminal
```
python client.py --vampnet_url <VAMPNET_URL> --s2s_url http://localhost:7860
```
## max setup
Then...make sure you have installed (in Max)
```
flucoma
```
MAKE SURE YOU ARE RUNNING MAX 8. It is not compatible with Max 9.
Now open up the right max patch `./max/sound-objects.maxpat`.
### text prompts
NOTE: text prompts are from the list here
https://universalcategorysystem.com/
https://www.dropbox.com/scl/fo/lw1i20cgsm4edsvj3awn1/AP_ZhzG3LlpfFLbX309FbOU?dl=0&e=1&preview=UCS+v8.2.1+Full+List.xlsx&rlkey=wa2onzo0difpew1nze6odztlp
*** HUGO make an empty 'audio' directory in the repo! ***
|