Spaces:

likewendy
/

phi-4

Runtime error

likewendy commited on Jan 7

Commit

9d87021

1 Parent(s): ea5db48

code

Files changed (1) hide show

app.py CHANGED Viewed

@@ -11,7 +11,7 @@ os.environ['PYTORCH_CUDA_ALLOC_CONF'] = 'expandable_segments:True'
 model = AutoModelForCausalLM.from_pretrained(
     "NyxKrage/Microsoft_Phi-4",
-    device_map="cuda",
     torch_dtype="auto",
     trust_remote_code=True,
 )

 model = AutoModelForCausalLM.from_pretrained(
     "NyxKrage/Microsoft_Phi-4",
+    device_map="auto",
     torch_dtype="auto",
     trust_remote_code=True,
 )