SGLang native option reference
Use these names under [miles]. Defaults below come from the pinned parser before structured, backend and model-dependent resolution. Some inherited options are inapplicable to Core; see the restrictions column and run controls. Parser acceptance does not mean the Core trainer implements an option. Source help describes the upstream runtime, which may mention other backends.
Reference index and provenance.
This build uses the compact parser schema and reviewed integration descriptions. Full upstream help and value defaults were not captured; boolean defaults remain available from the schema.
| TOML key | Native flags | Type/action | Choices | Parser default | Core restriction | Help (source or reviewed supplement) |
|---|---|---|---|---|---|---|
| sglang_router_ip | --sglang-router-ip | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_router_port | --sglang-router-port | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_router_policy | --sglang-router-policy | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_router_request_timeout_secs | --sglang-router-request-timeout-secs | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_server_concurrency | --sglang-server-concurrency | int | — | Not captured | Parser option; subject to Core/model/runtime validation | End-to-end HTTP permits per engine, including response transport/processing. Structured async configs default to twice max running requests; GPU batch, graph and cache limits remain separate. |
| sglang_tokenizer_path | --sglang-tokenizer-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tokenizer_mode | --sglang-tokenizer-mode | str | ["auto", "slow"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tokenizer_backend | --sglang-tokenizer-backend | str | ["fastokens", "huggingface"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tokenizer_worker_num | --sglang-tokenizer-worker-num | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_detokenizer_worker_num | --sglang-detokenizer-worker-num | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_skip_tokenizer_init | --sglang-skip-tokenizer-init | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_load_format | --sglang-load-format | str | ["auto", "bitsandbytes", "dummy", "expert_pack", "fastsafetensors", "flash_rl", "gguf", "layered", "mistral", "npcache", "presharded", "private", "pt", "remote", "remote_instance", "runai_streamer", "safetensors", "sharded_state"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_model_loader_extra_config | --sglang-model-loader-extra-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_context_length | --sglang-context-length | human_readable_int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_is_embedding | --sglang-is-embedding | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_multimodal | --sglang-enable-multimodal | switch | — | null | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_revision | --sglang-revision | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_model_impl | --sglang-model-impl | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_model_config_parser | --sglang-model-config-parser | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_json_model_override_args | --sglang-json-model-override-args | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dtype | --sglang-dtype | str | ["auto", "bfloat16", "float", "float16", "float32", "half"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_quantization | --sglang-quantization | str | ["auto-round", "auto-round-int8", "awq", "awq_marlin", "bitsandbytes", "compressed-tensors", "fp8", "gguf", "gptq", "gptq_marlin", "humming", "mlx_q4", "mlx_q8", "modelopt", "modelopt_fp4", "modelopt_fp8", "modelopt_mixed", "modelslim", "moe_wna16", "mxfp4", "mxfp8", "mxfp_w4a8", "nvfp4_online", "petit_nvfp4", "quark", "quark_int4fp8_moe", "quark_mxfp4", "unquant", "w4afp8", "w8a8_fp8", "w8a8_int8"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_quantization_param_path | --sglang-quantization-param-path | nullable_str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kv_cache_dtype | --sglang-kv-cache-dtype | str | ["auto", "bf16", "bfloat16", "fp4_mx_block16", "fp8_e4m3", "fp8_e5m2", "mxfp8", "nvfp4"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_fp32_lm_head | --sglang-enable-fp32-lm-head | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_modelopt_quant | --sglang-modelopt-quant | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_modelopt_checkpoint_restore_path | --sglang-modelopt-checkpoint-restore-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_modelopt_checkpoint_save_path | --sglang-modelopt-checkpoint-save-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_modelopt_export_path | --sglang-modelopt-export-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_quantize_and_serve | --sglang-quantize-and-serve | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_rl_quant_profile | --sglang-rl-quant-profile | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_tf32_matmul | --sglang-enable-tf32-matmul | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mem_fraction_static | --sglang-mem-fraction-static | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_running_requests | --sglang-max-running-requests | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_queued_requests | --sglang-max-queued-requests | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_total_tokens | --sglang-max-total-tokens | human_readable_int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_chunked_prefill_size | --sglang-chunked-prefill-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_decode_interval | --sglang-prefill-decode-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_dynamic_chunking | --sglang-enable-dynamic-chunking | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_prefill_tokens | --sglang-max-prefill-tokens | human_readable_int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_max_requests | --sglang-prefill-max-requests | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_schedule_policy | --sglang-schedule-policy | str | ["dfs-weight", "fcfs", "hrrn", "lof", "lpm", "priority", "random", "routing-key", "shortest-prefill-first"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_priority_scheduling | --sglang-enable-priority-scheduling | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_priority_preemption | --sglang-disable-priority-preemption | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_default_priority_value | --sglang-default-priority-value | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_abort_on_priority_when_disabled | --sglang-abort-on-priority-when-disabled | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_schedule_low_priority_values_first | --sglang-schedule-low-priority-values-first | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_priority_scheduling_preemption_threshold | --sglang-priority-scheduling-preemption-threshold | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_retraction_policy | --sglang-retraction-policy | str | ["length", "priority"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_schedule_conservativeness | --sglang-schedule-conservativeness | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_page_size | --sglang-page-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_c128_page_size | --sglang-c128-page-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_swa_full_tokens_ratio | --sglang-swa-full-tokens-ratio | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_hybrid_swa_memory | --sglang-disable-hybrid-swa-memory | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_radix_eviction_policy | --sglang-radix-eviction-policy | str | ["lfu", "lru", "priority", "slru", "tlru"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_radix_eviction_policy_config | --sglang-radix-eviction-policy-config | loads | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_only_disable_kv_cache | --sglang-prefill-only-disable-kv-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_radix_cache | --sglang-disable-radix-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_page_major_kv_layout | --sglang-enable-page-major-kv-layout | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_unified_memory | --sglang-enable-unified-memory | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_chunked_prefix_cache | --sglang-disable-chunked-prefix-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_overlap_schedule | --sglang-disable-overlap-schedule | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_num_continuous_decode_steps | --sglang-num-continuous-decode-steps | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_scheduler_recv_interval | --sglang-scheduler-recv-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_mixed_chunk | --sglang-enable-mixed-chunk | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dist_timeout | --sglang-dist-timeout | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tp_size | --sglang-tp-size, --sglang-tensor-parallel-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dcp_size | --sglang-dcp-size, --sglang-decode-context-parallel-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_pp_size | --sglang-pp-size, --sglang-pipeline-parallel-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_pp_max_micro_batch_size | --sglang-pp-max-micro-batch-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_pp_async_batch_depth | --sglang-pp-async-batch-depth | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dp_size | --sglang-dp-size, --sglang-data-parallel-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_load_balance_method | --sglang-load-balance-method | str | ["auto", "follow_bootstrap_room", "round_robin", "total_requests", "total_tokens"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_attn_cp_size | --sglang-attn-cp-size, --sglang-attention-context-parallel-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_moe_dp_size | --sglang-moe-dp-size, --sglang-moe-data-parallel-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dwdp_size | --sglang-dwdp-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dcp_comm_backend | --sglang-dcp-comm-backend | str | ["a2a", "ag_rs", "fi_a2a"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dcp_replicate_q_proj | --sglang-dcp-replicate-q-proj, --no-sglang-dcp-replicate-q-proj | boolean | — | null | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_prefill_cp | --sglang-enable-prefill-cp | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cp_strategy | --sglang-cp-strategy | str | ["interleave", "zigzag"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_dsa_cache_layer_split | --sglang-enable-dsa-cache-layer-split | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_cp_decode_attn_tp | --sglang-enable-cp-decode-attn-tp | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_dp_attention | --sglang-enable-dp-attention | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_dp_attention_local_control_broadcast | --sglang-enable-dp-attention-local-control-broadcast | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_dp_lm_head | --sglang-enable-dp-lm-head | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_tp_lm_head_all_to_all | --sglang-enable-tp-lm-head-all-to-all, --no-sglang-enable-tp-lm-head-all-to-all | boolean | — | null | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_attn_tp_input_scattered | --sglang-enable-attn-tp-input-scattered | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_shared_experts_attn_tp | --sglang-enable-shared-experts-attn-tp | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_shared_experts_tp_size | --sglang-shared-experts-tp-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_dense_mlp_attn_tp | --sglang-enable-dense-mlp-attn-tp | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_layernorm_sp | --sglang-enable-layernorm-sp | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_attn_tp_gather | --sglang-disable-attn-tp-gather | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_p2p_check | --sglang-enable-p2p-check | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_device | --sglang-device | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mlx_enable_sampling | --sglang-mlx-enable-sampling | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_watchdog_timeout | --sglang-watchdog-timeout | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_soft_watchdog_timeout | --sglang-soft-watchdog-timeout | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_sleep_on_idle | --sglang-sleep-on-idle | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_use_ray | --sglang-use-ray | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_numa_node | --sglang-numa-node | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_gc_threshold | --sglang-gc-threshold | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_host | --sglang-host | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_fastapi_root_path | --sglang-fastapi-root-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_smg_grpc_mode | --sglang-smg-grpc-mode | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_grpc_mode | --sglang-grpc-mode | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_grpc_port | --sglang-grpc-port | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_sidecar | --sglang-sidecar | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_sidecar_args | --sglang-sidecar-args | json_list_type | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_warmups | --sglang-warmups | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_http2 | --sglang-enable-http2 | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_http2_max_concurrent_streams | --sglang-http2-max-concurrent-streams | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_http2_initial_connection_window_size | --sglang-http2-initial-connection-window-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ssl_keyfile | --sglang-ssl-keyfile | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ssl_certfile | --sglang-ssl-certfile | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ssl_ca_certs | --sglang-ssl-ca-certs | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ssl_keyfile_password | --sglang-ssl-keyfile-password | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_ssl_refresh | --sglang-enable-ssl-refresh | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_api_key | --sglang-api-key | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_admin_api_key | --sglang-admin-api-key | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_served_model_name | --sglang-served-model-name | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_weight_version | --sglang-weight-version | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_chat_template | --sglang-chat-template | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_trust_request_chat_template | --sglang-trust-request-chat-template | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hf_chat_template_name | --sglang-hf-chat-template-name | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_completion_template | --sglang-completion-template | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_file_storage_path | --sglang-file-storage-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_cache_report | --sglang-enable-cache-report | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_return_input_ids | --sglang-return-input-ids | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_return_output_ids | --sglang-return-output-ids | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_default_chat_template_kwargs | --sglang-default-chat-template-kwargs | loads | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_strip_thinking_cache | --sglang-strip-thinking-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_strict_thinking | --sglang-enable-strict-thinking | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tool_server | --sglang-tool-server | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_sampling_defaults | --sglang-sampling-defaults | str | ["model", "openai"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_asr_max_buffer_seconds | --sglang-asr-max-buffer-seconds | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_asr_max_concurrent_sessions | --sglang-asr-max-concurrent-sessions | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_preferred_sampling_params | --sglang-preferred-sampling-params | loads | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_allow_auto_truncate | --sglang-allow-auto-truncate | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_stream_interval | --sglang-stream-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_batch_notify_size | --sglang-batch-notify-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_stream_response_default_include_usage | --sglang-stream-response-default-include-usage | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_incremental_streaming_output | --sglang-incremental-streaming-output | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_streaming_session | --sglang-enable-streaming-session | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_session_radix_cache | --sglang-enable-session-radix-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_log_level | --sglang-log-level | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_log_level_http | --sglang-log-level-http | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_log_requests | --sglang-log-requests | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_log_requests_level | --sglang-log-requests-level | int | [0, 1, 2, 3] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_log_requests_format | --sglang-log-requests-format | str | ["json", "text"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_log_requests_target | --sglang-log-requests-target | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_uvicorn_access_log_exclude_prefixes | --sglang-uvicorn-access-log-exclude-prefixes | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_crash_dump_folder | --sglang-crash-dump-folder | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_show_time_cost | --sglang-show-time-cost | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_metrics | --sglang-enable-metrics | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_smg_http_sidecar_port | --sglang-smg-http-sidecar-port, --sglang-grpc-http-sidecar-port | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_mfu_metrics | --sglang-enable-mfu-metrics | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_metrics_for_all_schedulers | --sglang-enable-metrics-for-all-schedulers | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_load_snapshot_publish_interval | --sglang-load-snapshot-publish-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tokenizer_metrics_custom_labels_header | --sglang-tokenizer-metrics-custom-labels-header | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tokenizer_metrics_allowed_custom_labels | --sglang-tokenizer-metrics-allowed-custom-labels | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_extra_metric_labels | --sglang-extra-metric-labels | loads | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_bucket_time_to_first_token | --sglang-bucket-time-to-first-token | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_bucket_inter_token_latency | --sglang-bucket-inter-token-latency | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_bucket_e2e_request_latency | --sglang-bucket-e2e-request-latency | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prompt_tokens_buckets | --sglang-prompt-tokens-buckets | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_generation_tokens_buckets | --sglang-generation-tokens-buckets | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_gc_warning_threshold_secs | --sglang-gc-warning-threshold-secs | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_decode_log_interval | --sglang-decode-log-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_request_time_stats_logging | --sglang-enable-request-time-stats-logging | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kv_events_config | --sglang-kv-events-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_load_publish_endpoint | --sglang-load-publish-endpoint | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_forward_pass_metrics | --sglang-enable-forward-pass-metrics | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_forward_pass_metrics_worker_id | --sglang-forward-pass-metrics-worker-id | str | — | Not captured | Parser option; subject to Core/model/runtime validation | Worker identity used by SGLang forward-pass metrics. |
| sglang_forward_pass_metrics_ipc_name | --sglang-forward-pass-metrics-ipc-name | str | — | Not captured | Parser option; subject to Core/model/runtime validation | IPC channel name used by SGLang forward-pass metrics. |
| sglang_enable_trace | --sglang-enable-trace | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_trace_modules | --sglang-trace-modules | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_otlp_traces_endpoint | --sglang-otlp-traces-endpoint | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_export_metrics_to_file | --sglang-export-metrics-to-file | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_export_metrics_to_file_dir | --sglang-export-metrics-to-file-dir | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_constrained_json_whitespace_pattern | --sglang-constrained-json-whitespace-pattern | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_constrained_json_disable_any_whitespace | --sglang-constrained-json-disable-any-whitespace | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_constrained_json_max_whitespace_cnt | --sglang-constrained-json-max-whitespace-cnt | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_attention_backend | --sglang-attention-backend | str | ["aiter", "ascend", "compressed", "cutedsl_mla", "dsa", "dsv4", "fa3", "fa4", "flashinfer", "flashmla", "flex_attention", "hpc_ops", "intel_amx", "intel_xpu", "minicpm_flashattn", "minicpm_flashinfer", "nsa", "qsa", "tokenspeed_mla", "torch_native", "triton", "trtllm_mha", "trtllm_mla", "wave"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_decode_attention_backend | --sglang-decode-attention-backend | str | ["aiter", "ascend", "compressed", "cutedsl_mla", "dsa", "dsv4", "fa3", "fa4", "flashinfer", "flashmla", "flex_attention", "hpc_ops", "intel_amx", "intel_xpu", "minicpm_flashattn", "minicpm_flashinfer", "nsa", "qsa", "tokenspeed_mla", "torch_native", "triton", "trtllm_mha", "trtllm_mla", "wave"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_lean_attention | --sglang-enable-lean-attention | switch | — | null | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_attention_backend | --sglang-prefill-attention-backend | str | ["aiter", "ascend", "compressed", "cutedsl_mla", "dsa", "dsv4", "fa3", "fa4", "flashinfer", "flashmla", "flex_attention", "hpc_ops", "intel_amx", "intel_xpu", "minicpm_flashattn", "minicpm_flashinfer", "nsa", "qsa", "tokenspeed_mla", "torch_native", "triton", "trtllm_mha", "trtllm_mla", "wave"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_grammar_backend | --sglang-grammar-backend | str | ["llguidance", "none", "outlines", "xgrammar"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_radix_cache_backend | --sglang-radix-cache-backend | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mm_attention_backend | --sglang-mm-attention-backend | str | ["aiter_attn", "amx_attn", "ascend_attn", "fa3", "fa4", "flashinfer_cudnn", "sdpa", "triton_attn", "xpu_attn"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_fp8_gemm_runner_backend | --sglang-fp8-gemm-backend | str | ["aiter", "auto", "cutlass", "deep_gemm", "flashinfer_cutedsl", "flashinfer_cutlass", "flashinfer_deepgemm", "flashinfer_trtllm", "triton"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_fp4_gemm_runner_backend | --sglang-fp4-gemm-backend | str | ["auto", "flashinfer_cudnn", "flashinfer_cutedsl", "flashinfer_cutlass", "flashinfer_trtllm", "marlin"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_bf16_gemm_backend | --sglang-bf16-gemm-backend | str | ["auto", "cutedsl", "gemv", "torch"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dsa_prefill_backend | --sglang-dsa-prefill-backend | str | ["aiter", "fa3", "flashinfer_sparse_mla", "flashmla_auto", "flashmla_kv", "flashmla_sparse", "flashmla_sparse_q8", "tilelang", "triton", "trtllm"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dsv4_prefill_backend | --sglang-dsv4-prefill-backend | str | ["auto", "flashmla_sparse", "flashmla_sparse_q8"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dsa_decode_backend | --sglang-dsa-decode-backend | str | ["aiter", "fa3", "flashinfer_sparse_mla", "flashmla_auto", "flashmla_kv", "flashmla_sparse", "flashmla_sparse_q8", "tilelang", "triton", "trtllm"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dsa_paged_mqa_logits_backend | --sglang-dsa-paged-mqa-logits-backend | str | ["aiter", "auto", "cutedsl", "deepgemm"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dsa_topk_backend | --sglang-dsa-topk-backend | str | ["flashinfer", "sgl-kernel", "torch"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_flashinfer_autotune | --sglang-disable-flashinfer-autotune | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_flashinfer_autotune_skip_ops | --sglang-flashinfer-autotune-skip-ops | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mamba_backend | --sglang-mamba-backend | str | ["flashinfer", "triton"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_config | --sglang-cuda-graph-config | parse_cuda_graph_config_arg | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_backend_decode | --sglang-cuda-graph-backend-decode | str | ["breakable", "disabled", "full", "tc_piecewise"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_backend_prefill | --sglang-cuda-graph-backend-prefill | str | ["breakable", "disabled", "full", "tc_piecewise"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_max_bs_decode | --sglang-cuda-graph-max-bs-decode | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_max_bs_prefill | --sglang-cuda-graph-max-bs-prefill | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_bs_decode | --sglang-cuda-graph-bs-decode | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_bs_prefill | --sglang-cuda-graph-bs-prefill | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_prefill_max_context | --sglang-cuda-graph-prefill-max-context, --sglang-context-bucket | human_readable_int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_tc_compiler | --sglang-cuda-graph-tc-compiler | str | ["eager", "inductor"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_prefill_cuda_graph | --sglang-disable-prefill-cuda-graph | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_decode_cuda_graph | --sglang-disable-decode-cuda-graph | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_cuda_graph_padding | --sglang-disable-cuda-graph-padding | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_profile_cuda_graph | --sglang-enable-profile-cuda-graph | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_cudagraph_gc | --sglang-enable-cudagraph-gc | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_debug_cuda_graph | --sglang-debug-cuda-graph | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_layerwise_nvtx_marker | --sglang-enable-layerwise-nvtx-marker | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_nccl_nvls | --sglang-enable-nccl-nvls | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_symm_mem | --sglang-enable-symm-mem | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_triton_attention_reduce_in_fp32 | --sglang-triton-attention-reduce-in-fp32 | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_triton_attention_num_kv_splits | --sglang-triton-attention-num-kv-splits | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_triton_attention_split_tile_size | --sglang-triton-attention-split-tile-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_flashinfer_mla_disable_ragged | --sglang-flashinfer-mla-disable-ragged | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_fused_qk_norm_rope | --sglang-enable-fused-qk-norm-rope | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_precise_embedding_interpolation | --sglang-enable-precise-embedding-interpolation | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_fused_moe_sum_all_reduce | --sglang-enable-fused-moe-sum-all-reduce | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_deepseek_v4_fp4_indexer | --sglang-enable-deepseek-v4-fp4-indexer | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_custom_all_reduce | --sglang-disable-custom-all-reduce | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_mscclpp | --sglang-enable-mscclpp | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_torch_symm_mem | --sglang-enable-torch-symm-mem | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_scattered_sconv | --sglang-enable-scattered-sconv | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_pre_warm_nccl | --sglang-pre-warm-nccl | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_boundary_reduction | --sglang-boundary-reduction | str | ["ar", "auto", "rs", "rs+rsv", "rsv"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_quant_communications | --sglang-enable-quant-communications | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enforce_disable_flashinfer_allreduce_fusion | --sglang-enforce-disable-flashinfer-allreduce-fusion | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_flashinfer_allreduce_fusion_backend | --sglang-flashinfer-allreduce-fusion-backend | str | ["auto", "cutedsl", "mnnvl", "trtllm"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_aiter_allreduce_fusion | --sglang-enable-aiter-allreduce-fusion | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_torch_compile | --sglang-enable-torch-compile | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_torch_compile_debug_mode | --sglang-enable-torch-compile-debug-mode | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_torch_compile_max_bs | --sglang-torch-compile-max-bs | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_algorithm | --sglang-speculative-algorithm | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_uno_lora_path | --sglang-uno-lora-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_draft_model_path | --sglang-speculative-draft-model-path, --sglang-speculative-draft-model | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_draft_model_revision | --sglang-speculative-draft-model-revision | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_draft_load_format | --sglang-speculative-draft-load-format | str | ["auto", "bitsandbytes", "dummy", "expert_pack", "fastsafetensors", "flash_rl", "gguf", "layered", "mistral", "npcache", "presharded", "private", "pt", "remote", "remote_instance", "runai_streamer", "safetensors", "sharded_state"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_num_steps | --sglang-speculative-num-steps | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_eagle_topk | --sglang-speculative-eagle-topk | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_num_draft_tokens | --sglang-speculative-num-draft-tokens | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_dflash_block_size | --sglang-speculative-dflash-block-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_dspark_block_size | --sglang-speculative-dspark-block-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_dspark_sps_table_path | --sglang-speculative-dspark-sps-table-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_dspark_confidence_sts_path | --sglang-speculative-dspark-confidence-sts-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_dspark_align_verify_tokens_to_graph_tier | --sglang-speculative-dspark-align-verify-tokens-to-graph-tier | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_accept_threshold_single | --sglang-speculative-accept-threshold-single | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_accept_threshold_acc | --sglang-speculative-accept-threshold-acc | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_use_rejection_sampling | --sglang-speculative-use-rejection-sampling | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_token_map | --sglang-speculative-token-map | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_attention_mode | --sglang-speculative-attention-mode | str | ["decode", "prefill"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_draft_attention_backend | --sglang-speculative-draft-attention-backend | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_dsa_topk_backend | --sglang-speculative-dsa-topk-backend | str | ["flashinfer", "sgl-kernel", "torch"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_draft_kv_cache_dtype | --sglang-speculative-draft-kv-cache-dtype | str | ["auto", "bf16", "bfloat16", "fp8_e4m3", "fp8_e5m2"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_draft_window_size | --sglang-speculative-draft-window-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | Speculative-decoding draft-window size; requires a compatible serving mode/model. |
| sglang_speculative_moe_runner_backend | --sglang-speculative-moe-runner-backend | str | ["aiter", "auto", "cutlass", "deep_gemm", "experimental_sgl_marlin", "experimental_sgl_trtllm", "flashinfer_cutedsl", "flashinfer_cutlass", "flashinfer_megamoe", "flashinfer_mxfp4", "flashinfer_trtllm", "flashinfer_trtllm_routed", "hpc_ops", "humming", "intel_xpu", "marlin", "megamoe", "triton", "triton_kernel"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_moe_a2a_backend | --sglang-speculative-moe-a2a-backend | str | ["ascend_fuseep", "ascend_tp", "deepep", "deepep_v2", "flashinfer", "megamoe", "mooncake", "mori", "nixl", "none", "pplx"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_draft_model_quantization | --sglang-speculative-draft-model-quantization | str | ["auto-round", "auto-round-int8", "awq", "awq_marlin", "bitsandbytes", "compressed-tensors", "fp8", "gguf", "gptq", "gptq_marlin", "humming", "mlx_q4", "mlx_q8", "modelopt", "modelopt_fp4", "modelopt_fp8", "modelopt_mixed", "modelslim", "moe_wna16", "mxfp4", "mxfp8", "mxfp_w4a8", "nvfp4_online", "petit_nvfp4", "quark", "quark_int4fp8_moe", "quark_mxfp4", "unquant", "w4afp8", "w8a8_fp8", "w8a8_int8"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_skip_dp_mlp_sync | --sglang-speculative-skip-dp-mlp-sync | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_multi_layer_eagle | --sglang-enable-multi-layer-eagle | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_adaptive | --sglang-speculative-adaptive | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_adaptive_config | --sglang-speculative-adaptive-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_decoupled_spec_bind_endpoint | --sglang-decoupled-spec-bind-endpoint | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_decoupled_spec_connect_endpoints | --sglang-decoupled-spec-connect-endpoints | json_list_type | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_decoupled_spec_rank | --sglang-decoupled-spec-rank | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_decoupled_spec_role | --sglang-decoupled-spec-role | str | ["drafter", "null", "verifier"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_spec_trace_dir | --sglang-spec-trace-dir | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_ngram_min_bfs_breadth | --sglang-speculative-ngram-min-bfs-breadth | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_ngram_max_bfs_breadth | --sglang-speculative-ngram-max-bfs-breadth | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_ngram_match_type | --sglang-speculative-ngram-match-type | str | ["BFS", "PROB"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_ngram_max_trie_depth | --sglang-speculative-ngram-max-trie-depth | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_ngram_capacity | --sglang-speculative-ngram-capacity | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_ngram_external_corpus_path | --sglang-speculative-ngram-external-corpus-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_ngram_external_sam_budget | --sglang-speculative-ngram-external-sam-budget | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_ngram_external_corpus_max_tokens | --sglang-speculative-ngram-external-corpus-max-tokens | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ep_size | --sglang-ep-size, --sglang-expert-parallel-size, --sglang-ep | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_moe_a2a_backend | --sglang-moe-a2a-backend | str | ["ascend_fuseep", "ascend_tp", "deepep", "deepep_v2", "flashinfer", "flashinfer_megamoe", "megamoe", "mooncake", "mori", "nixl", "none", "pplx"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_w4a4_mxfp4_megamoe | --sglang-enable-w4a4-mxfp4-megamoe | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_deepep_v2_mode | --sglang-deepep-v2-mode | str | ["direct", "hybrid"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_moe_runner_backend | --sglang-moe-runner-backend | str | ["aiter", "auto", "cutlass", "deep_gemm", "experimental_sgl_marlin", "experimental_sgl_trtllm", "flashinfer_cutedsl", "flashinfer_cutlass", "flashinfer_megamoe", "flashinfer_mxfp4", "flashinfer_trtllm", "flashinfer_trtllm_routed", "hpc_ops", "humming", "intel_xpu", "marlin", "megamoe", "triton", "triton_kernel"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_flashinfer_mxfp4_moe_precision | --sglang-flashinfer-mxfp4-moe-precision | str | ["bf16", "default", "fp8"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_deepep_mode | --sglang-deepep-mode | str | ["auto", "low_latency", "normal"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_fuseep_mode | --sglang-fuseep-mode | int | [1, 2] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_deepep_dispatcher_output_dtype | --sglang-deepep-dispatcher-output-dtype | str | ["auto", "bf16", "fp8", "int8", "nvfp4"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ep_num_redundant_experts | --sglang-ep-num-redundant-experts | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ep_dispatch_algorithm | --sglang-ep-dispatch-algorithm | str | ["dynamic", "fake", "lp", "static"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_init_expert_location | --sglang-init-expert-location | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_eplb | --sglang-enable-eplb | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_eplb_algorithm | --sglang-eplb-algorithm | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_eplb_rebalance_num_iterations | --sglang-eplb-rebalance-num-iterations | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_eplb_rebalance_layers_per_chunk | --sglang-eplb-rebalance-layers-per-chunk | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_eplb_min_rebalancing_utilization_threshold | --sglang-eplb-min-rebalancing-utilization-threshold | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_expert_distribution_recorder_mode | --sglang-expert-distribution-recorder-mode | str | ["per_pass", "per_token", "stat", "stat_approx"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_expert_distribution_recorder_buffer_size | --sglang-expert-distribution-recorder-buffer-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_expert_balancedness_report_mode | --sglang-expert-balancedness-report-mode | str | ["both", "off", "prometheus", "server_log"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_deepep_config | --sglang-deepep-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_moe_dense_tp_size | --sglang-moe-dense-tp-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_elastic_ep_backend | --sglang-elastic-ep-backend | str | ["mooncake", "nixl", "none"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_elastic_expert_backup | --sglang-enable-elastic-expert-backup | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mooncake_ib_device | --sglang-mooncake-ib-device | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_waterfill | --sglang-enable-waterfill | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ep_join_mode | --sglang-elastic-ep-join-mode | str | ["recover", "scale"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ep_join_rank_offset | --sglang-elastic-ep-join-rank-offset | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_elastic_ep_initial_size | --sglang-elastic-ep-initial-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_ep_size | --sglang-max-ep-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_elastic_ep_scale_timeout | --sglang-elastic-ep-scale-timeout | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_flashinfer_cutlass_moe_fp4_allgather | --sglang-disable-flashinfer-cutlass-moe-fp4-allgather | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_shared_experts_fusion | --sglang-disable-shared-experts-fusion | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enforce_shared_experts_fusion | --sglang-enforce-shared-experts-fusion | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_mamba_cache_size | --sglang-max-mamba-cache-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mamba_ssm_dtype | --sglang-mamba-ssm-dtype | str | ["bfloat16", "float16", "float32"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mamba_max_states_per_path | --sglang-mamba-max-states-per-path | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_mamba_cache_stochastic_rounding | --sglang-enable-mamba-cache-stochastic-rounding | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mamba_cache_philox_rounds | --sglang-mamba-cache-philox-rounds | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mamba_full_memory_ratio | --sglang-mamba-full-memory-ratio | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mamba_radix_cache_strategy | --sglang-mamba-radix-cache-strategy | str | ["auto", "extra_buffer", "extra_buffer_lazy", "no_buffer"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mamba_track_interval | --sglang-mamba-track-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_int8_mamba_checkpoint | --sglang-enable-int8-mamba-checkpoint | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_int8_mamba_ckpt_size | --sglang-int8-mamba-ckpt-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_linear_attn_backend | --sglang-linear-attn-backend | str | ["cutedsl", "flashinfer", "flashkda", "helion", "intel_xpu", "nvidia_kda", "ptx_kda", "triton"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_linear_attn_decode_backend | --sglang-linear-attn-decode-backend | str | ["cutedsl", "flashinfer", "flashkda", "helion", "intel_xpu", "nvidia_kda", "ptx_kda", "triton"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_linear_attn_prefill_backend | --sglang-linear-attn-prefill-backend | str | ["cutedsl", "flashinfer", "flashkda", "helion", "intel_xpu", "nvidia_kda", "ptx_kda", "triton"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_linear_attn_verify_backend | --sglang-linear-attn-verify-backend | str | ["cutedsl", "flashinfer", "flashkda", "helion", "intel_xpu", "nv_cutedsl", "nvidia_kda", "ptx_kda", "triton"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_linear_replayssm | --sglang-enable-linear-replayssm | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_linear_replayssm_cache_len | --sglang-linear-replayssm-cache-len | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_linear_replayssm_spec | --sglang-enable-linear-replayssm-spec | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_hierarchical_cache | --sglang-enable-hierarchical-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_host_memory_mode | --sglang-hicache-host-memory-mode | str | ["buffer_only", "cache"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_ratio | --sglang-hicache-ratio | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_size | --sglang-hicache-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_write_policy | --sglang-hicache-write-policy | str | ["write_back", "write_through", "write_through_selective"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_io_backend | --sglang-hicache-io-backend | str | ["direct", "kernel", "kernel_ascend"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_mem_layout | --sglang-hicache-mem-layout | str | ["layer_first", "page_first", "page_first_direct", "page_first_kv_split", "page_head"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_storage_backend | --sglang-hicache-storage-backend | str | ["aibrix", "dynamic", "eic", "file", "hf3fs", "mooncake", "mori", "nixl", "npu_memcache", "shm", "sim", "simm", "tensorcast"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_storage_prefetch_policy | --sglang-hicache-storage-prefetch-policy | str | ["best_effort", "timeout", "wait_complete"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_storage_backend_extra_config | --sglang-hicache-storage-backend-extra-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_storage_prefetch_retry_poll_interval | --sglang-hicache-storage-prefetch-retry-poll-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_storage_prefetch_retry_max_attempts | --sglang-hicache-storage-prefetch-retry-max-attempts | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_unified_cache_external_linker | --sglang-enable-unified-cache-external-linker | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_unified_cache_external_linker_backend | --sglang-unified-cache-external-linker-backend | str | ["mooncake", "mori"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_hisparse | --sglang-enable-hisparse | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hisparse_config | --sglang-hisparse-config, --sglang-hierarchical-sparse-attention-extra-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_broadcast_mm_inputs_process | --sglang-enable-broadcast-mm-inputs-process | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_prefix_mm_cache | --sglang-enable-prefix-mm-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mm_enable_dp_encoder | --sglang-mm-enable-dp-encoder | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mm_process_config | --sglang-mm-process-config | loads | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mm_processor_worker_num | --sglang-mm-processor-worker-num | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mm_io_worker_num | --sglang-mm-io-worker-num | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_allowed_media_domains | --sglang-allowed-media-domains | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_media_url_max_file_size_mb | --sglang-media-url-max-file-size-mb | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mm_preprocess_cache_size_mb | --sglang-mm-preprocess-cache-size-mb | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_trust_mm_content_hashes | --sglang-trust-mm-content-hashes | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_limit_mm_data_per_request | --sglang-limit-mm-data-per-request | loads | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_mm_global_cache | --sglang-enable-mm-global-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_image_processor_backend | --sglang-image-processor-backend | str | ["auto", "pil", "torchvision"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mm_global_cache_backend | --sglang-mm-global-cache-backend | str | ["mooncake"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_fast_image_processor | --sglang-disable-fast-image-processor | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_mm_feature_transport | --sglang-mm-feature-transport | str | ["cpu", "cuda_ipc", "cuda_vmm"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_lora | --sglang-enable-lora | switch | — | null | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_lora_overlap_loading | --sglang-enable-lora-overlap-loading | switch | — | null | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_lora_rank | --sglang-max-lora-rank | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_target_modules | --sglang-lora-target-modules | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_paths | --sglang-lora-paths | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_loaded_loras | --sglang-max-loaded-loras | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_loras_per_batch | --sglang-max-loras-per-batch | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_eviction_policy | --sglang-lora-eviction-policy | str | ["fifo", "lru"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_backend | --sglang-lora-backend | str | ["ascend", "csgmv", "torch_native", "triton"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_max_lora_chunk_size | --sglang-max-lora-chunk-size | int | [128, 16, 32, 64] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_experts_shared_outer_loras | --sglang-experts-shared-outer-loras, --no-sglang-experts-shared-outer-loras | boolean | — | null | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_use_virtual_experts | --sglang-lora-use-virtual-experts | switch | — | true | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_strict_loading | --sglang-lora-strict-loading, --no-sglang-lora-strict-loading | boolean | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_no_cpu_backup | --sglang-lora-no-cpu-backup | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_drain_wait_threshold | --sglang-lora-drain-wait-threshold | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_two_batch_overlap | --sglang-enable-two-batch-overlap | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_single_batch_overlap | --sglang-enable-single-batch-overlap | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tbo_token_distribution_threshold | --sglang-tbo-token-distribution-threshold | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cpu_offload_gb | --sglang-cpu-offload-gb | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_offload_group_size | --sglang-offload-group-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_offload_num_in_group | --sglang-offload-num-in-group | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_offload_prefetch_step | --sglang-offload-prefetch-step | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_offload_mode | --sglang-offload-mode | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_lmcache | --sglang-enable-lmcache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lmcache_config_file | --sglang-lmcache-config-file | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_flexkv | --sglang-enable-flexkv | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_flexkv_config_file | --sglang-flexkv-config-file | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kt_weight_path | --sglang-kt-weight-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kt_method | --sglang-kt-method | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kt_cpuinfer | --sglang-kt-cpuinfer | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kt_threadpool_count | --sglang-kt-threadpool-count | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kt_num_gpu_experts | --sglang-kt-num-gpu-experts | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kt_max_deferred_experts_per_token | --sglang-kt-max-deferred-experts-per-token | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dllm_algorithm | --sglang-dllm-algorithm | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dllm_algorithm_config | --sglang-dllm-algorithm-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dllm_fdfo | --sglang-dllm-fdfo, --no-sglang-dllm-fdfo | boolean | — | true | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_mode | --sglang-disaggregation-mode | str | ["decode", "null", "prefill"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_transfer_backend | --sglang-disaggregation-transfer-backend | str | ["ascend", "fake", "mooncake", "mooncake_tcp", "mori", "nixl"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_bootstrap_port | --sglang-disaggregation-bootstrap-port | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_ib_device | --sglang-disaggregation-ib-device | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_decode_enable_radix_cache | --sglang-disaggregation-decode-enable-radix-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_decode_enable_offload_kvcache | --sglang-disaggregation-decode-enable-offload-kvcache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_decode_retraction_backup | --sglang-disaggregation-decode-retraction-backup | str | ["cpu_tensor", "host_pool", "none"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_num_reserved_decode_tokens | --sglang-num-reserved-decode-tokens | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_decode_extra_slots | --sglang-disaggregation-decode-extra-slots | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_decode_polling_interval | --sglang-disaggregation-decode-polling-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_optimistic_prefill_attempts | --sglang-optimistic-prefill-attempts | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_encoder_only | --sglang-encoder-only | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_language_only | --sglang-language-only | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_language_model_only | --sglang-language-model-only | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_encoder_transfer_backend | --sglang-encoder-transfer-backend | str | ["auto", "mooncake", "zmq_to_scheduler", "zmq_to_tokenizer"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_encoder_urls | --sglang-encoder-urls | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_encoder_bootstrap_port | --sglang-encoder-bootstrap-port | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_encoder_register_urls | --sglang-encoder-register-urls | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_adaptive_dispatch_to_encoder | --sglang-enable-adaptive-dispatch-to-encoder | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_pdmux | --sglang-enable-pdmux | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_pdmux_config_path | --sglang-pdmux-config-path | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_sm_group_num | --sglang-sm-group-num | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_startup_weight_load_mode | --sglang-startup-weight-load-mode | str | ["overlap", "serial"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_custom_weight_loader | --sglang-custom-weight-loader | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_weight_loader_disable_mmap | --sglang-weight-loader-disable-mmap | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_weight_loader_prefetch_checkpoints | --sglang-weight-loader-prefetch-checkpoints | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_weight_loader_prefetch_num_threads | --sglang-weight-loader-prefetch-num-threads | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_weight_loader_drop_cache_after_load | --sglang-weight-loader-drop-cache-after-load | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_remote_instance_weight_loader_seed_instance_ip | --sglang-remote-instance-weight-loader-seed-instance-ip | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_remote_instance_weight_loader_seed_instance_service_port | --sglang-remote-instance-weight-loader-seed-instance-service-port | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_remote_instance_weight_loader_send_weights_group_ports | --sglang-remote-instance-weight-loader-send-weights-group-ports | json_list_type | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_remote_instance_weight_loader_backend | --sglang-remote-instance-weight-loader-backend | str | ["modelexpress", "nccl", "transfer_engine"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_remote_instance_weight_loader_start_seed_via_transfer_engine | --sglang-remote-instance-weight-loader-start-seed-via-transfer-engine | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_engine_info_bootstrap_port | --sglang-engine-info-bootstrap-port | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_modelexpress_config | --sglang-modelexpress-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_download_dir | --sglang-download-dir | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_model_checksum | --sglang-model-checksum | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_delete_ckpt_after_loading | --sglang-delete-ckpt-after-loading | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_decrypted_config_file | --sglang-decrypted-config-file | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_decrypted_draft_config_file | --sglang-decrypted-draft-config-file | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_checkpoint_engine_wait_weights_before_ready | --sglang-checkpoint-engine-wait-weights-before-ready | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_prefill_delayer | --sglang-enable-prefill-delayer | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_delayer_max_delay_passes | --sglang-prefill-delayer-max-delay-passes | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_delayer_token_usage_low_watermark | --sglang-prefill-delayer-token-usage-low-watermark | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_delayer_forward_passes_buckets | --sglang-prefill-delayer-forward-passes-buckets | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_delayer_wait_seconds_buckets | --sglang-prefill-delayer-wait-seconds-buckets | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_delayer_queue_min_ratio | --sglang-prefill-delayer-queue-min-ratio | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_delayer_max_delay_ms | --sglang-prefill-delayer-max-delay-ms | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_min_free_slots_delay | --sglang-min-free-slots-delay | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_deterministic_inference | --sglang-enable-deterministic-inference | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_rl_on_policy_target | --sglang-rl-on-policy-target | str | ["fsdp", "fsdp_tp"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kv_canary | --sglang-kv-canary | str | ["log", "none", "raise"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kv_canary_sweep_interval | --sglang-kv-canary-sweep-interval | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_dynamic_batch_tokenizer | --sglang-enable-dynamic-batch-tokenizer | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dynamic_batch_tokenizer_batch_size | --sglang-dynamic-batch-tokenizer-batch-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dynamic_batch_tokenizer_batch_timeout | --sglang-dynamic-batch-tokenizer-batch-timeout | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_tokenizer_batch_encode | --sglang-enable-tokenizer-batch-encode | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_tokenizer_batch_decode | --sglang-disable-tokenizer-batch-decode | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_debug_tensor_dump_output_folder | --sglang-debug-tensor-dump-output-folder | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_debug_tensor_dump_layers | --sglang-debug-tensor-dump-layers | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_debug_tensor_dump_input_file | --sglang-debug-tensor-dump-input-file | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_weights_cpu_backup | --sglang-enable-weights-cpu-backup | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_draft_weights_cpu_backup | --sglang-enable-draft-weights-cpu-backup | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_custom_logit_processor | --sglang-enable-custom-logit-processor | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_return_hidden_states | --sglang-enable-return-hidden-states | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_return_hidden_states_mode | --sglang-return-hidden-states-mode | str | ["full", "last"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_sampling_mask_max_tokens | --sglang-sampling-mask-max-tokens | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_outlines_disk_cache | --sglang-disable-outlines-disk-cache | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_mis | --sglang-enable-mis | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_weight_cache_mode | --sglang-weight-cache-mode | str | ["client", "daemon", "off"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_weight_cache_socket | --sglang-weight-cache-socket | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_weight_cache_timeout | --sglang-weight-cache-timeout | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_forward_hooks | --sglang-forward-hooks | json_list_type | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_msprobe_dump_config | --sglang-msprobe-dump-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ple_offload_embedding | --sglang-ple-offload-embedding, --no-sglang-ple-offload-embedding | boolean | — | null | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ple_offload_backend | --sglang-ple-offload-backend | str | ["file", "pinned"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_ple_offload_dir | --sglang-ple-offload-dir | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_enable_kv_checksum | --sglang-disaggregation-enable-kv-checksum | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_pd_role_switch | --sglang-enable-pd-role-switch | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_domino_candidate_pool_size | --sglang-speculative-domino-candidate-pool-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_flashinfer_a2a_dispatch_type | --sglang-flashinfer-a2a-dispatch-type | str | ["auto", "bf16", "mxfp8", "nvfp4"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_cuda_graph_max_seq_len_prefill | --sglang-cuda-graph-max-seq-len-prefill | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_prefill_kv_cache_dequant_dtype | --sglang-prefill-kv-cache-dequant-dtype | str | ["auto", "fp8_e4m3", "nvfp4"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_dsv4_attn_backend | --sglang-dsv4-attn-backend | str | ["auto", "flashmla", "trtllm"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_otlp_service_name | --sglang-otlp-service-name | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_hicache_host_memory_fraction | --sglang-hicache-host-memory-fraction | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_linker_mla_dedup | --sglang-enable-linker-mla-dedup | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_swa_prefix_tails | --sglang-swa-prefix-tails | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_encoder_swa_bounded_replay | --sglang-enable-encoder-swa-bounded-replay | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_decoder_swa_bounded_replay | --sglang-enable-decoder-swa-bounded-replay | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_response_store | --sglang-enable-response-store | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disaggregation_decode_host_receive_threshold | --sglang-disaggregation-decode-host-receive-threshold | float | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_custom_pull_weights_pre_read_hook | --sglang-custom-pull-weights-pre-read-hook | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_engine_info_bootstrap | --sglang-enable-engine-info-bootstrap | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_rdt_weight_sync | --sglang-enable-rdt-weight-sync | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_prefill_only_deterministic_inference | --sglang-enable-prefill-only-deterministic-inference | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_true_on_policy_contract | --sglang-true-on-policy-contract | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_speculative_draft_sink_size | --sglang-speculative-draft-sink-size | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_aiter_allreduce_fusion_in_prefill | --sglang-disable-aiter-allreduce-fusion-in-prefill | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_aiter_allreduce_fusion_in_decode | --sglang-disable-aiter-allreduce-fusion-in-decode | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_draft_cuda_graph | --sglang-disable-draft-cuda-graph | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_grpc_response_timeout_secs | --sglang-grpc-response-timeout-secs | int | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_sampling_backend | --sglang-sampling-backend | str | ["ascend", "flashinfer", "intel_xpu", "pytorch"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_reasoning_parser | --sglang-reasoning-parser | str | ["apertus2509", "auto", "cohere_command4", "deepseek-r1", "deepseek-v3", "deepseek-v4", "deepseek-v41", "dots", "gemma4", "gigachat35", "glm45", "gpt-oss", "granite_thinking_parser", "hunyuan", "inkling", "interns1", "iquest_q1", "k2_horizon", "kimi", "kimi_k2", "kimi_k3", "ling3", "mimo", "minimax", "minimax-append-think", "minimax-m3", "mistral", "muse", "nanbeige", "nemotron_3", "poolside_v1", "qwen3", "qwen3-thinking", "step3", "step3p5"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_tool_call_parser | --sglang-tool-call-parser | str | ["apertus2509", "auto", "cohere_command4", "deepseekv3", "deepseekv31", "deepseekv32", "deepseekv4", "deepseekv41", "dots", "gemma4", "gigachat3", "gigachat35", "glm", "glm45", "glm47", "gpt-oss", "hermes", "hunyuan", "inkling", "interns1", "iquest_q1", "k2_horizon", "kimi_k2", "kimi_k3", "lfm2", "ling3", "llama3", "mimo", "minicpm5", "minimax-m2", "minimax-m3", "mistral", "muse", "nanbeige", "poolside_v1", "pythonic", "qwen", "qwen25", "qwen3_coder", "spark25", "step3", "step3p5", "trinity"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_kv_canary_real_data | --sglang-kv-canary-real-data | str | ["all", "none", "partial"] | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_disable_cuda_graph | --sglang-disable-cuda-graph | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_enable_flashinfer_allreduce_fusion | --sglang-enable-flashinfer-allreduce-fusion | switch | — | false | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_config | --sglang-config | str | — | Not captured | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |
| sglang_lora_use_virtual_experts | --no-sglang-lora-use-virtual-experts | switch | — | true | Parser option; subject to Core/model/runtime validation | See pinned runtime help. |