← Back to Discover
ml-rust

ml-rust/splintr

RustMITactive
85Health

A high-performance tokenizer (BPE + SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.

Stars60
Forks5
Open Issues0
Contributors5
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
14
Popularity
21
#huggingface#llm#machine-learning#openai#rust#tokenizer
View on GitHub ↗Issues (0) ↗Pull Requests ↗Wiki ↗

Should you contribute to ml-rust/splintr?

ml-rust/splintr has a FoundDev health score of 85/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Rust, so prior Rust experience will shorten ramp-up.

Licensed under MIT, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

ml-rust85

A high-performance tokenizer (BPE + SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.

active
605 contributors
0d ago

More Rust repos

MystenLabs
MystenLabs/sui
Sui, a next-generation smart contract platform with high throughput, low latency, and an asset-oriented programming model powered by the Move programming language
7.7k97
tsouth89
tsouth89/toolport
Local-first MCP gateway. One port for every tool and every AI client: lazy discovery (~90% token savings), tool integrity + quarantine, secrets in the OS keychain.
14091
genomoncology
genomoncology/biomcp
BioMCP: Biomedical Model Context Protocol
58490