File size: 1,988 Bytes
a189727
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
## client side setup
clone
```
https://github.com/hugofloresgarcia/unsound-objects.git
git checkout unloop
```

install
```
conda create -n unsound python=3.10
conda activate unsound
pip install -r requirements.txt
```

## server side setup
ssh into malleus
```
ssh bryan@malleus.cs.northwestern.edu -L 7860:localhost:7860
```

then leave the malleus window open and start up a new local window

(kindly ask hugo to launch the gradio on port 7860)

you can verify that the gradio is running by opening `http://localhost:7860` on your browser

## launch the gradio server (vampnet)
you have to run the gradio server running vampnet model.
(on the remote machine)
```bash
conda create -n vampnet python=3.10
git clone https://github.com/huggingface.co/spaces/hugggof/vampnet-music.git
pip install -e .
CUDA_VISIBLE_DEVICES=0 python app.py
```

### launch the gradio server (s2s)
you have to run the gradio server running audit model.

(on the remote machine)
```bash
conda create -n audit python=3.10
cd audit
pip install -r requirements.txt
CUDA_VISIBLE_DEVICES=0 python scripts/text2sfx/demo.py ckpts/adobe-soda/checkpoints/seethara/text2sfx/25-02-18-256ch-8s/ --model latest_ema.pth
```

or for audit-old
```
CUDA_VISIBLE_DEVICES=0 python scripts/cdit/demos/voice2sfx.py ckpts/rms-centroid-ppg/latest.pth
```

## launch the client (laptop)
then launch the client from your local terminal
```
python client.py --vampnet_url <VAMPNET_URL> --s2s_url http://localhost:7860
```

## max setup
Then...make sure you have installed (in Max)
```
flucoma
```

MAKE SURE YOU ARE RUNNING MAX 8.  It is not compatible with Max 9.

Now open up the right max patch `./max/sound-objects.maxpat`. 

### text prompts
NOTE: text prompts are from the list here
https://universalcategorysystem.com/
https://www.dropbox.com/scl/fo/lw1i20cgsm4edsvj3awn1/AP_ZhzG3LlpfFLbX309FbOU?dl=0&e=1&preview=UCS+v8.2.1+Full+List.xlsx&rlkey=wa2onzo0difpew1nze6odztlp
*** HUGO make an empty 'audio' directory in the repo! ***