| # js-tokens | |
| The tiny, regex powered, lenient, _almost_ spec-compliant JavaScript tokenizer that never fails. | |
| ```js | |
| const jsTokens = require("js-tokens"); | |
| const jsString = 'JSON.stringify({k:3.14**2}, null /*replacer*/, "\\t")'; | |
| Array.from(jsTokens(jsString), (token) => token.value).join("|"); | |
| // JSON|.|stringify|(|{|k|:|3.14|**|2|}|,| |null| |/*replacer*/|,| |"\t"|) | |
| ``` | |
| **[➡️ Full readme](https://github.com/lydell/js-tokens/)** |