Skip to main content

Ctrl+K

Installation

Install SGLang

Backend Tutorial

Llama4 Usage
DeepSeek Usage
Sending Requests
OpenAI APIs - Completions
OpenAI APIs - Vision
OpenAI APIs - Embedding
SGLang Native APIs
Offline Engine API
Server Arguments
Sampling Parameters
Hyperparameter Tuning
Structured Outputs For Reasoning Models

Supported Models

Large Language Models
Vision Language Models
Embedding Models
Reward Models
How to Support New Models

Advanced Features

Speculative Decoding
Structured Outputs
Tool and Function Calling
Reasoning Parser
Custom Chat Template
Quantization

Frontend Tutorial

SGLang Frontend Language
Choices Methods in SGLang

SGLang Router

Router for Data Parallelism

References

General Guidance
Hardware Supports
- SGLang on AMD
- Apply SGLang on NVIDIA Jetson Orin
Multi-Node Deployment
Performance Tuning

Repository
Show source
Suggest edit
Open issue

.rst

Hardware Supports

Hardware Supports#

SGLang on AMD
Apply SGLang on NVIDIA Jetson Orin

previous

Production Metrics

next

SGLang on AMD

By SGLang Team

© Copyright 2023-2025, SGLang.

Last updated on Apr 13, 2025.