Lists (3)
Stars
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cl…
Building the self-learning layer next-gen agents will ship with, learning skills from real work.
Next Generation Agentic Proxy for AI Agents and MCP servers
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
AgentENV (AENV) is a distributed platform for running agent environments at scale.
From-scratch, heavily-annotated CUDA inference runtime for Qwen2.5-Coder-7B on H100 (sm_90). Custom INT4 packer, fused GEMV, paged KV, split-KV attention, CUDA graph decode — every hot path comment…
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
An Open Component Model Based AI Model Server
Declaratively deploy your Kubernetes manifests, Kustomize configs, and Charts as Helm releases. Generate all-in-one manifests for use with ArgoCD.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr…
SGLang is a high-performance serving framework for large language models and multimodal models.
Talos Linux is a modern Linux distribution built for Kubernetes.
All parts of Claude Code's system prompt, 27 builtin tool descriptions, sub agent prompts (Plan/Explore/Task), utility prompts (CLAUDE.md, compact, statusline, magic docs, WebFetch, Bash cmd, secur…
Backstage is an open framework for building developer portals
A lightweight alternative to OpenClaw that runs in containers for security. Connects to WhatsApp, Telegram, Slack, Discord, Gmail and other messaging apps,, has memory, scheduled jobs, and runs dir…
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare…
Beads - A memory upgrade for your coding agent
Gateway API Inference Extension
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
CloudBot - The simple, fast, expandable, open-source Python IRC Bot!
Optimized primitives for collective multi-GPU communication
Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling
NVSentinel detects and remediates GPU faults on Kubernetes nodes