Tabby: The Open-Source GitHub Copilot

What’s New?
Tabby is an open-source, self-hosted AI coding assistant, positioning itself as a practical alternative to GitHub Copilot. It allows teams to effortlessly leverage any Coding LLM, ensuring flexibility and compatibility in code completion tasks.

Core Features
Compatibility: Integrates seamlessly with major Coding LLMs like CodeLlama, StarCoder, and CodeGen, accommodating both smaller models (under 400M parameters) for CPU and larger ones (1B parameters and above) for GPU inference.
Efficiency: Powered by Rust, Tabby is able to deliver fast coding experiences and achieves code completion in under a second with adaptive caching.
Optimized Stack: Optimizes the entire stack, from IDE extensions to model serving. This enables fast code completions and effective prompts in real-world applications.