Spaces:

Srikesh
/

pdf_chat

Running

Srikesh commited on 14 days ago

Commit

0983622

verified ·

1 Parent(s): cc6595c

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -41,6 +41,7 @@ def initialize_models():
     model = AutoModelForCausalLM.from_pretrained(
         model_name,
         torch_dtype=torch.float32,
         trust_remote_code=True
     )

     model = AutoModelForCausalLM.from_pretrained(
         model_name,
         torch_dtype=torch.float32,
+        low_cpu_mem_usage=True,
         trust_remote_code=True
     )