fireworks-ai
/

firefunction-v1

Text Generation

function-calling

text-generation-inference

Model card Files Files and versions

pgarbacki commited on Feb 17, 2024

Commit

c086cc0

·

verified ·

1 Parent(s): 5a86ab7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -89,7 +89,7 @@ messages = [
 model_inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to(model.device)
-generated_ids = model.generate(model_inputs, max_new_tokens=1000, do_sample=True)
 decoded = tokenizer.batch_decode(generated_ids)
 print(decoded[0])
 ```

 model_inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to(model.device)
+generated_ids = model.generate(model_inputs, max_new_tokens=128)
 decoded = tokenizer.batch_decode(generated_ids)
 print(decoded[0])
 ```