Skip to content
View njhill's full-sized avatar

Organizations

@netty @kserve @vllm-project @llm-d @Inferact

Block or report njhill

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Showing results

Early-stage Rust drop-in alternative frontend for vLLM

Rust 73 9 Updated May 22, 2026

Tools for Python coroutines and advanced scheduling for `asyncio`

Python 20 1 Updated Nov 2, 2026

Moving to vllm-project/vllm-jax. TPU inference for vLLM, with unified JAX and PyTorch support.

Python 481 360 Updated Nov 18, 2026

State of the art inference performance with modern accelerators on Kubernetes

Python 5,296 937 Updated Nov 18, 2026

A high-throughput and memory-efficient inference and serving engine for LLMs

Python 97,130 24,954 Updated Nov 18, 2026

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python 169,304 35,280 Updated Nov 18, 2026

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Rust 11,253 1,264 Updated Nov 18, 2026

Distributed Model Serving Framework

Java 190 82 Updated Apr 14, 2026

Controller for ModelMesh

Go 245 138 Updated Apr 14, 2026

Fake XRandR configurations for multi-head setups with crappy video drivers, like fakexinerama but with xrandr

Python 273 38 Updated Apr 29, 2024
Java 3,888 595 Updated Nov 11, 2026

Netty project - an event-driven asynchronous network application framework

Java 35,067 16,331 Updated Nov 18, 2026

The Java gRPC implementation. HTTP/2 based RPC

Java 12,078 4,016 Updated Nov 17, 2026