← Back to Discover
BlinkDL

BlinkDL/RWKV-LM

PythonApache-2.0activepopular
88Health

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Stars14.6k
Forks1.0k
Open Issues150
Contributors1.0k
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
14
Popularity
25
#attention-mechanism#chatgpt#deep-learning#gpt#gpt-2#gpt-3#language-model#linear-attention#lstm#pytorch#rnn#rwkv#transformer#transformers
View on GitHub ↗Issues (150) ↗Pull Requests ↗Wiki ↗

Should you contribute to BlinkDL/RWKV-LM?

BlinkDL/RWKV-LM has a FoundDev health score of 88/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Python, so prior Python experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

BlinkDL
BlinkDL/RWKV-LM
PythonApache 2.0
88

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

activepopular
14.6k1.0k contributors150 issues
0d ago

More Python repos

earthians
earthians/marley
Open Source, Enterprise and Modern Health Information System
50494
YoungCan-Wang
YoungCan-Wang/WyckoffTradingAgent
Open-source Wyckoff trading agent and AI stock screener for volume-price analysis, A-share screening, CLI workflows, and MCP tools.灵感来自秋生trader @Hoyooyoo
49292
make-all
make-all/tuya-local
Local support for Tuya devices in Home Assistant
3.0k92