| license: cc-by-4.0 | |
| PowerCoder-3B is a retrained StarCoder2-3B, metamorphasized to use power retention with p=2. | |
| The retraining dataset was the-stack-smol-v2 with FIM, reweighted to sample Python more frequently. | |
| To get the power retention kernels, use `pip install retention`. |