← Back to Discover
NVIDIA

NVIDIA/TransformerEngine

PythonApache-2.0active
88Health

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

Stars3.4k
Forks777
Open Issues312
Contributors777
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
13
Popularity
25
#cuda#deep-learning#fp4#fp8#gpu#jax#machine-learning#python#pytorch
View on GitHub ↗Issues (312) ↗Pull Requests ↗

Should you contribute to NVIDIA/TransformerEngine?

NVIDIA/TransformerEngine has a FoundDev health score of 88/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Python, so prior Python experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

NVIDIA
NVIDIA/TransformerEngine
PythonApache 2.0
88

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

active
3.4k777 contributors312 issues
0d ago

More Python repos

openstack
openstack/glance
OpenStack Image Management (Glance). Mirror of code maintained at opendev.org.
53394
GoogleCloudPlatform
GoogleCloudPlatform/professional-services
Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.
3.0k93
openstack
openstack/manila
Shared filesystem management project for OpenStack. Mirror of code maintained at opendev.org.
17392