Skip to main content

Ctrl+K

Getting Started

Install SGLang
Quick Start: Sending Requests

Backend Tutorial

OpenAI APIs - Completions
OpenAI APIs - Vision
OpenAI APIs - Embedding
Native APIs
Offline Engine API
Structured Outputs
Server Arguments

Frontend Tutorial

Frontend: Structured Generation Language (SGLang)
Choices Methods in SGLang

SGLang Router

Router for Data Parallelism

References

Supported Models
Sampling Parameters in SGLang Runtime
Guide on Hyperparameter Tuning
Benchmark and Profiling
Custom Chat Template in SGLang Runtime
DeepSeek Model Optimizations
Run Llama 3.1 405B
Use Models From ModelScope
Contribution Guide
Troubleshooting
Frequently Asked Questions
Learn more

Repository
Open issue

Search

Ctrl+K

By SGLang Team

© Copyright 2023-2024, SGLang.

Last updated on Jan 13, 2025.