ayushadarsh7's picture
Create Hyper_Params.md
bf44a78 verified

Finetuning complete language module

HyperParameters of this model

lr: 2e-5

epochs: 18

batch size: 1

grad acumulation step: 4