alasdairforsythe/tokenmonster
GoMITactive
Health
Ungreedy subword tokenizer and vocabulary trainer for Python, Go, C++ & Javascript
Health Breakdown
Activity25
Community25
Maintenance13
Popularity25
#text-tokenization#tokenisation#tokenization#tokenize#tokenizer#tokenizing#vocabulary#vocabulary-builder#vocabulary-generator
Should you contribute to alasdairforsythe/tokenmonster?
alasdairforsythe/tokenmonster has a FoundDev health score of 88/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.
Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Go, so prior Go experience will shorten ramp-up.
Licensed under MIT, a standard OSI-approved license — safe to contribute to under normal employer IP policies.
Community
GoMIT
active
0d ago
