SpecForge Documentation

SpecForge is an ecosystem project developed by the SGLang team. It is a framework for training speculative decoding models so that you can smoothly port them over to the SGLang serving framework to speed up your inference.

Get Started

• 📦 Installation

Basic Usage

• 📝 Data Preparation
• 🚀 Training
• 🤖 Benchmarking On SGLang

Examples

• Eagle3 for Llama3

Advanced Features

• 💡 Customize Your Own Training