File size: 287 Bytes
ef13bf1 |
1 2 3 4 5 6 7 8 9 |
---
license: cc-by-4.0
---
PowerCoder-3B is a retrained StarCoder2-3B, metamorphasized to use power retention with p=2.
The retraining dataset was the-stack-smol-v2 with FIM, reweighted to sample Python more frequently.
To get the power retention kernels, use `pip install retention`. |