Skip to content

MILES native option reference

Use these names under [miles]. Defaults below come from the pinned parser before structured, backend and model-dependent resolution. Some inherited options are inapplicable to Core; see the restrictions column and run controls. Parser acceptance does not mean the Core trainer implements an option. Source help describes the upstream runtime, which may mention other backends.

Reference index and provenance.

This build uses the compact parser schema and reviewed integration descriptions. Full upstream help and value defaults were not captured; boolean defaults remain available from the schema.

TOML key Native flags Type/action Choices Parser default Core restriction Help (source or reviewed supplement)
config --config str — Not captured Invalid configuration: Adapter-owned; cannot override See pinned runtime help.
optimizer --optimizer str — Not captured Not implemented: Required value: "adam" An implementation with tests is welcome; please contribute support for this configuration. Optimizer selection; Core supports adam.
lr --lr float — Not captured Parser option; subject to Core/model/runtime validation Initial optimizer learning rate.
lr_warmup_init --lr-warmup-init float — Not captured Parser option; subject to Core/model/runtime validation Initial learning rate at the start of warmup.
min_lr --min-lr float — Not captured Parser option; subject to Core/model/runtime validation Minimum learning rate at the end of decay.
lr_decay_style --lr-decay-style str — Not captured Parser option; subject to Core/model/runtime validation Learning-rate schedule family; supported choices are listed in the parser metadata.
lr_decay_iters --lr-decay-iters int — Not captured Parser option; subject to Core/model/runtime validation Number of optimizer iterations used by the selected LR decay schedule.
lr_warmup_iters --lr-warmup-iters int — Not captured Parser option; subject to Core/model/runtime validation Warmup optimizer iteration count.
lr_warmup_fraction --lr-warmup-fraction float — Not captured Parser option; subject to Core/model/runtime validation Warmup as a fraction of the schedule; use consistently with explicit warmup iterations.
lr_wsd_decay_iters --lr-wsd-decay-iters int — Not captured Parser option; subject to Core/model/runtime validation Decay iteration count for the warmup-stable-decay schedule.
lr_wsd_decay_style --lr-wsd-decay-style str — Not captured Parser option; subject to Core/model/runtime validation Decay shape used by the warmup-stable-decay schedule.
use_checkpoint_lr_scheduler --use-checkpoint-lr-scheduler, --no-use-checkpoint-lr-scheduler boolean — true Not implemented: Required value: true An implementation with tests is welcome; please contribute support for this configuration. Restore checkpoint scheduler state; Core requires true when present.
override_lr_scheduler --override-lr-scheduler, --no-override-lr-scheduler boolean — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. Replace loaded scheduler configuration; Core requires false when present.
weight_decay --weight-decay float — Not captured Parser option; subject to Core/model/runtime validation Adam weight-decay coefficient.
adam_beta1 --adam-beta1 float — Not captured Parser option; subject to Core/model/runtime validation Adam first-moment decay coefficient.
adam_beta2 --adam-beta2 float — Not captured Parser option; subject to Core/model/runtime validation Adam second-moment decay coefficient.
adam_eps --adam-eps float — Not captured Parser option; subject to Core/model/runtime validation Adam denominator epsilon.
warmup_ratio --warmup-ratio float — Not captured Invalid configuration: Rejected; use miles.lr_warmup_fraction Inherited FSDP option; rejected in favor of miles.lr_warmup_fraction.
attn_implementation --attn-implementation str — Not captured Invalid configuration: Rejected; use core.attention_backend Inherited FSDP attention selector; Core rejects it in favor of core.attention_backend.
kernel_backend --kernel-backend str — Not captured Parser option; subject to Core/model/runtime validation Inherited HF/FSDP compute-kernel provider: native or hub; does not select Core kernels.
kernel_mapping_path --kernel-mapping-path str — Not captured Parser option; subject to Core/model/runtime validation Inherited HF/FSDP dotted path to a Hub-kernel mapping provider; applies with kernel_backend=hub.
kernel_strict --kernel-strict, --no-kernel-strict boolean — false Parser option; subject to Core/model/runtime validation Inherited HF/FSDP Hub-kernel policy: fail instead of falling back to native kernels.
wandb_project --wandb-project str — Not captured Parser option; subject to Core/model/runtime validation W&B project name.
wandb_run_name --wandb-run-name str — Not captured Parser option; subject to Core/model/runtime validation Human-readable W&B run name.
bf16 --bf16, --no-bf16 boolean — true Parser option; subject to Core/model/runtime validation Inherited FSDP BF16 precision flag; Core precision is selected by core.param_dtype.
fp16 --fp16, --no-fp16 boolean — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. Inherited FP16 training switch; Core requires false.
gradient_checkpointing --gradient-checkpointing, --no-gradient-checkpointing boolean — false Invalid configuration: Rejected; use core.activation_checkpointing Inherited FSDP setting; rejected in favor of core.activation_checkpointing.
recompute_granularity --recompute-granularity str — Not captured Parser option; subject to Core/model/runtime validation Inherited FSDP whole-layer recomputation switch (full); Core recomputation is configured separately.
keep_fp32_master --keep-fp32-master, --no-keep-fp32-master boolean — true Not implemented: Required value: true An implementation with tests is welcome; please contribute support for this configuration. Retain FP32 optimizer master weights; Core requires true.
fsdp_state_dict_cpu_offload --fsdp-state-dict-cpu-offload, --no-fsdp-state-dict-cpu-offload boolean — true Parser option; subject to Core/model/runtime validation Inherited FSDP state-dict policy; does not select the native Core checkpoint writer.
fsdp_cpu_offload --fsdp-cpu-offload, --no-fsdp-cpu-offload boolean — false Not implemented: Required value: false; no Core implementation An implementation with tests is welcome; please contribute support for this configuration. Inherited MILES FSDP CPU offload control; Core trainer offload is unsupported.
fsdp_cpu_backend --fsdp-cpu-backend str — Not captured Parser option; subject to Core/model/runtime validation Inherited MILES FSDP CPU process-group backend; not a Core trainer backend selector.
dp_replicate_size --dp-replicate-size int — Not captured Not implemented: Required value: 1 An implementation with tests is welcome; please contribute support for this configuration. Inherited FSDP replication dimension; Core requires one.
deterministic_mode --deterministic-mode, --no-deterministic-mode boolean — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. Inherited trainer determinism mode; Core rejects enabling it. Serving determinism controls are separate.
context_parallel_size --context-parallel-size int — Not captured Not implemented: Required value: 1; trainer TP/PP/CP > 1 is not implemented An implementation with tests is welcome; please contribute support for this configuration. Trainer context-parallel size; this adapter requires one.
record_memory_history --record-memory-history, --no-record-memory-history boolean — false Parser option; subject to Core/model/runtime validation Enable inherited PyTorch memory-history capture; distinct from Core diagnostic_interval.
memory_snapshot_path --memory-snapshot-path str — Not captured Parser option; subject to Core/model/runtime validation Path for inherited PyTorch memory snapshot output.
use_pytorch_profiler --use-pytorch-profiler, --no-use-pytorch-profiler boolean — false Parser option; subject to Core/model/runtime validation Enable inherited PyTorch profiling; verify the intended actor supports it before interpreting absent traces.
profile_step_start --profile-step-start int — Not captured Parser option; subject to Core/model/runtime validation First step selected by the inherited profiler.
profile_step_end --profile-step-end int — Not captured Parser option; subject to Core/model/runtime validation Last step selected by the inherited profiler.
tensorboard_dir --tensorboard-dir str — Not captured Parser option; subject to Core/model/runtime validation Native TensorBoard output directory.
run_uuid --run-uuid str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
cluster_backend --cluster-backend str ["kubernetes", "ray"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
worker_comm_backend --worker-comm-backend str ["ray", "rpc"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
deploy_component --deploy-component str ["all", "inference", "primary", "trainer"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
deploy_instance_id --deploy-instance-id str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
init_expected_num_cells --init-expected-num-cells int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
trainer_controller_addrs --trainer-controller-addrs str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
inference_controller_addr --inference-controller-addr str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
actor_num_nodes --actor-num-nodes int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
actor_num_gpus_per_node --actor-num-gpus-per-node int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
critic_num_nodes --critic-num-nodes int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
critic_num_gpus_per_node --critic-num-gpus-per-node int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_num_gpus --rollout-num-gpus int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_num_gpus_per_engine --rollout-num-gpus-per-engine int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
num_gpus_per_node --num-gpus-per-node int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
colocate --colocate switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
offload --offload switch — false Not implemented: Required value: false; no Core implementation An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
offload_train --offload-train, --no-offload-train boolean — null Not validated: Core trainer offload has not been qualified; set offload_train=false Help validate this configuration with a focused run and share the results. See pinned runtime help.
clear_quantized_weight_workspaces_on_offload --clear-quantized-weight-workspaces-on-offload, --no-clear-quantized-weight-workspaces-on-offload boolean — true Parser option; subject to Core/model/runtime validation See pinned runtime help.
offload_rollout --offload-rollout, --no-offload-rollout boolean — null Parser option; subject to Core/model/runtime validation See pinned runtime help.
offload_rollout_level --offload-rollout-level str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
offload_train_target --offload-train-target str ["cpu", "disk"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
stream_optimizer_state_to_disk --stream-optimizer-state-to-disk switch — false Not implemented: Required value: false; no Core implementation An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
stream_optimizer_state_moment_dtype --stream-optimizer-state-moment-dtype str ["bf16", "fp16", "fp32", "fp8e4m3", "fp8e5m2"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
offload_train_disk_dir --offload-train-disk-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
offload_train_disk_chunk_mb --offload-train-disk-chunk-mb int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
colocate_memory_peak_device --colocate-memory-peak-device str ["cpu", "gpu"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
distributed_backend --distributed-backend str — Not captured Parser option; subject to Core/model/runtime validation Distributed process-group backend requested by MILES runtime helpers.
distributed_timeout_minutes --distributed-timeout-minutes int — Not captured Parser option; subject to Core/model/runtime validation Distributed process-group timeout in minutes.
train_backend --train-backend str ["fsdp", "megatron", "olmo_core", "torchtitan"] Not captured Invalid configuration: Adapter-owned; cannot override See pinned runtime help.
qkv_format --qkv-format str ["bshd", "thd"] Not captured Invalid configuration: Use thd with sequence_packing; bshd otherwise See pinned runtime help.
linear_attention_backend --linear-attention-backend str ["fla", "flashqla"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
true_on_policy_mode --true-on-policy-mode switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
recompute_logprobs_via_prefill --recompute-logprobs-via-prefill switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
train_env_vars --train-env-vars loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
train_memory_margin_bytes --train-memory-margin-bytes int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
debug_skip_weight_update --debug-skip-weight-update switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
debug_disable_optimizer --debug-disable-optimizer switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
rematerialize_param_from_master_weight --rematerialize-param-from-master-weight switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
check_rematerialize_param_from_master_weight --check-rematerialize-param-from-master-weight switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
megatron_to_hf_mode --megatron-to-hf-mode value ["bridge", "raw"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dsa_attention_backend --dsa-attention-backend value ["megatron", "tilelang"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
extra_high_precision_layers_hf --extra-high-precision-layers-hf str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
extra_high_precision_layers_megatron --extra-high-precision-layers-megatron str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_model_provider_path --custom-model-provider-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
recompute_loss_function --recompute-loss-function switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
log_probs_chunk_size --log-probs-chunk-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
indep_dp --indep-dp switch — false Not implemented: Required value: false; no Core implementation An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
delay_split_train_data_by_dp --delay-split-train-data-by-dp switch — false Parser option; subject to Core/model/runtime validation Inherited data-parallel split timing control; do not assume it changes Core sample partitioning.
allgather_cp --allgather-cp switch — false Parser option; subject to Core/model/runtime validation Inherited context-parallel gather control; Core trainer CP must be one.
low_memory_resume --low-memory-resume switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
mfu_peak_tflops --mfu-peak-tflops float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
hf_checkpoint --hf-checkpoint str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
model_name --model-name str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_function_path --rollout-function-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
fully_async --fully-async switch — false Not implemented: Async Core training requires resident disaggregated rollout engines; set miles.colocate=false and miles.offload_rollout=false. An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
rollout_temperature --rollout-temperature float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_top_p --rollout-top-p float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_top_k --rollout-top-k int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_top_logprobs_num --rollout-top-logprobs-num int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_max_context_len --rollout-max-context-len int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_max_prompt_len --rollout-max-prompt-len int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_max_response_len --rollout-max-response-len int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_skip_special_tokens --rollout-skip-special-tokens switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_stop --rollout-stop str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_stop_token_ids --rollout-stop-token-ids int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_shuffle --rollout-shuffle switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_seed --rollout-seed int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
object_store_backend --object-store-backend str ["mooncake", "ray"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
mooncake_store_init_kwargs --mooncake-store-init-kwargs loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
mooncake_replica_num --mooncake-replica-num int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
over_sampling_batch_size --over-sampling-batch-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dynamic_sampling_filter_path --dynamic-sampling-filter-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_submission_granularity --rollout-submission-granularity str ["group", "sample"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
partial_rollout --partial-rollout switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
mask_offpolicy_in_partial_rollout --mask-offpolicy-in-partial-rollout switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
max_weight_staleness --max-weight-staleness int — Not captured Invalid configuration: miles.max_weight_staleness must equal core.max_policy_lag (optimizer steps) See pinned runtime help.
async_max_concurrent_samples --async-max-concurrent-samples int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
async_data_buffer_capacity_factor --async-data-buffer-capacity-factor float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
async_unused_samples_handler --async-unused-samples-handler str ["drop", "retry"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_async_data_buffer_path --custom-async-data-buffer-path str — Not captured Invalid configuration: Adapter-owned; cannot override See pinned runtime help.
custom_generate_function_path --custom-generate-function-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_rollout_log_function_path --custom-rollout-log-function-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_eval_rollout_log_function_path --custom-eval-rollout-log-function-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
buffer_filter_path --buffer-filter-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
update_weight_buffer_size --update-weight-buffer-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
colocated_weight_update_pipeline_depth --colocated-weight-update-pipeline-depth int [1, 2] Not captured Not implemented: Required value: 1 An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
update_weights_interval --update-weights-interval int — Not captured Not implemented: Required value: 1 An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
pause_generation_mode --pause-generation-mode str ["abort", "in_place", "retract"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
keep_old_actor --keep-old-actor switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
rollout_data_postprocess_path --rollout-data-postprocess-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
pin_rollout_manager_to_head --pin-rollout-manager-to-head switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_external_engine_addrs --rollout-external-engine-addrs str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_external_router_pd --rollout-external-router-pd switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_inference_engine_provider_path --custom-inference-engine-provider-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
update_weight_transfer_mode --update-weight-transfer-mode value ["broadcast", "broadcast_packed", "disk-delta", "p2p"] Not captured Not implemented: Required value: "broadcast" An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
update_weight_disk_dir --update-weight-disk-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
update_weight_local_checkpoint_dir --update-weight-local-checkpoint-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
update_weight_delta_encoding --update-weight-delta-encoding value ["overwrite", "xor"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
update_weight_delta_checksum --update-weight-delta-checksum value ["adler32", "blake3", "xxh3-128"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_update_weight_post_write_path --custom-update-weight-post-write-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
p2p_transfer_num_workers --p2p-transfer-num-workers int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
p2p_transfer_timeout --p2p-transfer-timeout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_fault_tolerance --use-fault-tolerance switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
ft_components --ft-components value ["rollout", "train"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_health_check_interval --rollout-health-check-interval float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_health_check_timeout --rollout-health-check-timeout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_health_check_first_wait --rollout-health-check-first-wait float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_health_check_failure_threshold --rollout-health-check-failure-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
api_server_host --api-server-host str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
api_server_port --api-server-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
mini_ft_controller_enable --mini-ft-controller-enable, --no-mini-ft-controller-enable boolean — null Parser option; subject to Core/model/runtime validation See pinned runtime help.
mini_ft_controller_poll_interval --mini-ft-controller-poll-interval float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
mini_ft_controller_resume_delay --mini-ft-controller-resume-delay float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
trainer_heartbeat_checker_interval --trainer-heartbeat-checker-interval float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
trainer_heartbeat_checker_timeout --trainer-heartbeat-checker-timeout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
trainer_heartbeat_checker_first_wait --trainer-heartbeat-checker-first-wait float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
trainer_heartbeat_checker_failure_threshold --trainer-heartbeat-checker-failure-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
num_rollout --num-rollout int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
debug_exit_after_rollout --debug-exit-after-rollout int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
num_epoch --num-epoch int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_global_dataset --disable-rollout-global-dataset switch — true Parser option; subject to Core/model/runtime validation See pinned runtime help.
data_source_path --data-source-path str — Not captured Invalid configuration: Adapter-owned; cannot override See pinned runtime help.
prompt_data --prompt-data str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
apply_chat_template --apply-chat-template switch — false Parser option; subject to Core/model/runtime validation Render input messages through the model tokenizer chat template; avoid double rendering prepared prompts.
apply_chat_template_kwargs --apply-chat-template-kwargs loads — Not captured Parser option; subject to Core/model/runtime validation JSON arguments passed to chat-template rendering.
chat_template_path --chat-template-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
input_key --input-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
label_key --label-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
multimodal_keys --multimodal-keys loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
metadata_key --metadata-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
tool_key --tool-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
start_rollout_id --start-rollout-id int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_batch_size --rollout-batch-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
n_samples_per_prompt --n-samples-per-prompt int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
global_batch_size --global-batch-size int — Not captured Parser option; subject to Core/model/runtime validation Responses per optimizer update; must divide the collection and be divisible by trainer world size.
num_steps_per_rollout --num-steps-per-rollout int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
micro_batch_size --micro-batch-size int — Not captured Not implemented: Use micro_batch_size=1; Core accumulates unpadded response samples An implementation with tests is welcome; please contribute support for this configuration. Core requires one; use sequence_packing to combine document-isolated samples.
balance_data --balance-data switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
balance_by_flops --balance-by-flops switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
allow_partial_train_step --allow-partial-train-step switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_dynamic_batch_size --use-dynamic-batch-size switch — false Not implemented: Use micro_batch_size=1; Core accumulates unpadded response samples An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
max_tokens_per_gpu --max-tokens-per-gpu int — Not captured Invalid configuration: Rejected; use micro_batch_size=1 (Core dynamic batching is not implemented) See pinned runtime help.
log_probs_max_tokens_per_gpu --log-probs-max-tokens-per-gpu int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_function_path --eval-function-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_interval --eval-interval int — Not captured Parser option; subject to Core/model/runtime validation Collections between held-out evaluations; structured workflow requires eval data.
eval_prompt_data --eval-prompt-data str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_config --eval-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
skip_eval_before_train --skip-eval-before-train switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_input_key --eval-input-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_label_key --eval-label-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_tool_key --eval-tool-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
n_samples_per_eval_prompt --n-samples-per-eval-prompt int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_temperature --eval-temperature float — Not captured Parser option; subject to Core/model/runtime validation Evaluation sampling temperature; zero selects greedy evaluation.
eval_top_p --eval-top-p float — Not captured Parser option; subject to Core/model/runtime validation Evaluation nucleus-sampling probability threshold.
eval_top_k --eval-top-k int — Not captured Parser option; subject to Core/model/runtime validation Evaluation top-k sampling limit; native sentinel values retain native semantics.
eval_max_response_len --eval-max-response-len int — Not captured Parser option; subject to Core/model/runtime validation Evaluation generated-response token cap.
eval_max_prompt_len --eval-max-prompt-len int — Not captured Parser option; subject to Core/model/runtime validation Evaluation prompt token limit.
eval_min_new_tokens --eval-min-new-tokens int — Not captured Parser option; subject to Core/model/runtime validation Minimum new tokens during evaluation; may delay stopping.
eval_max_context_len --eval-max-context-len int — Not captured Parser option; subject to Core/model/runtime validation Evaluation total context token limit.
eval_num_gpus --eval-num-gpus int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_num_gpus_per_engine --eval-num-gpus-per-engine int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_hf_dir --eval-hf-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_max_in_flight --eval-max-in-flight int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_overflow_policy --eval-overflow-policy str ["backpressure", "skip"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_keep_snapshots --eval-keep-snapshots int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ref_load --ref-load str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ref_ckpt_step --ref-ckpt-step int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
load --load str — Not captured Parser option; subject to Core/model/runtime validation Native training checkpoint input for model/optimizer resume; distinct from hf_checkpoint input descriptor.
save --save str — Not captured Parser option; subject to Core/model/runtime validation Native checkpoint output directory; structured output.root supplies its default.
save_interval --save-interval int — Not captured Parser option; subject to Core/model/runtime validation Collections between native saves. Core saves synchronously.
async_save --async-save switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. Asynchronous native checkpoint writes; Core requires false.
no_save_optim --no-save-optim switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
save_hf --save-hf str — Not captured Not implemented: Core RL does not implement miles.save_hf; use miles.eval_hf_dir for snapshot evaluation or export the native checkpoint separately An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
save_trigger_sentinel --save-trigger-sentinel str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_megatron_post_save_hook_path --custom-megatron-post-save-hook-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
seed --seed int — Not captured Parser option; subject to Core/model/runtime validation Training/randomness seed; structured default comes from data.seed.
clip_grad --clip-grad float — Not captured Parser option; subject to Core/model/runtime validation Maximum gradient norm for clipping before optimizer update.
calculate_per_token_loss --calculate-per-token-loss switch — false Parser option; subject to Core/model/runtime validation Use token-count rather than response-count loss normalization; changes weighting across response lengths.
num_critic_only_steps --num-critic-only-steps int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
critic_load --critic-load str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
critic_save --critic-save str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
critic_lr --critic-lr float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
critic_lr_warmup_iters --critic-lr-warmup-iters int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eps_clip --eps-clip float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eps_clip_high --eps-clip-high float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eps_clip_c --eps-clip-c float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
value_clip --value-clip float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
kl_coef --kl-coef float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
loss_type --loss-type str ["custom_loss", "policy_loss", "score_centering", "sft_loss"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_loss_function_path --custom-loss-function-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
score_centering_is --score-centering-is value ["mis", "none", "tis"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
score_centering_tis_clip --score-centering-tis-clip float — Not captured Parser option; subject to Core/model/runtime validation Upper importance-weight clipping bound for the native score-centering loss with TIS; not a Core loss selector.
score_centering_mis_low --score-centering-mis-low float — Not captured Parser option; subject to Core/model/runtime validation Lower importance-weight acceptance bound for native score-centering MIS; not a Core loss selector.
score_centering_mis_high --score-centering-mis-high float — Not captured Parser option; subject to Core/model/runtime validation Upper importance-weight acceptance bound for native score-centering MIS; not a Core loss selector.
kl_loss_type --kl-loss-type str ["k1", "k2", "k3", "low_var_kl"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
advantage_estimator --advantage-estimator str ["grpo", "gspo", "ppo", "reinforce_plus_plus", "reinforce_plus_plus_baseline"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
compute_advantages_and_returns --disable-compute-advantages-and-returns switch — true Not implemented: Required value: true An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
use_kl_loss --use-kl-loss switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
kl_loss_coef --kl-loss-coef float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_unbiased_kl --use-unbiased-kl switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
ref_update_interval --ref-update-interval int — Not captured Not implemented: Core RL requires a fixed reference policy An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
entropy_coef --entropy-coef float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
gamma --gamma float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
lambd --lambd float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
normalize_advantages --normalize-advantages switch — false Parser option; subject to Core/model/runtime validation Normalize advantages in the shared objective; separate from within-group GRPO standard-deviation normalization.
grpo_std_normalization --disable-grpo-std-normalization switch — true Parser option; subject to Core/model/runtime validation See pinned runtime help.
rewards_normalization --disable-rewards-normalization switch — true Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_rollout_entropy --use-rollout-entropy switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
observe_training_entropy --observe-training-entropy switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
get_mismatch_metrics --get-mismatch-metrics switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
reset_optimizer_states --reset-optimizer-states switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
use_rollout_logprobs --use-rollout-logprobs switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
skip_actor_forward_only --skip-actor-forward-only switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
use_tis --use-tis switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
tis_clip --tis-clip float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
tis_clip_low --tis-clip-low float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_tis_function_path --custom-tis-function-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_pg_loss_reducer_function_path --custom-pg-loss-reducer-function-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_routing_replay --use-routing-replay switch — false Not implemented: Required value: false; no Core implementation An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
use_rollout_routing_replay --use-rollout-routing-replay switch — false Invalid configuration: The pinned SGLang router strips expert-ID requests; rollout replay requires use_miles_router See pinned runtime help.
use_indexer_replay --use-indexer-replay switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_rollout_indexer_replay --use-rollout-indexer-replay switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_opsm --use-opsm switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
opsm_delta --opsm-delta float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_opd --use-opd switch — false Not implemented: Required value: false; no Core implementation An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
opd_type --opd-type str ["megatron", "sglang"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_kl_coef --opd-kl-coef float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_log_prob_top_k --opd-log-prob-top-k int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_top_k_strategy --opd-top-k-strategy str ["intersection", "only-student", "only-teacher", "union", "xor"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_reward_weight_mode --opd-reward-weight-mode str ["none", "student_p", "teacher_p"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_topk_per_position --opd-topk-per-position switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_teacher_urls --opd-teacher-urls str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_teacher_key --opd-teacher-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_teacher_load --opd-teacher-load str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
opd_teacher_ckpt_step --opd-teacher-ckpt-step int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_wandb --use-wandb switch — false Parser option; subject to Core/model/runtime validation Enable Weights & Biases logging.
wandb_mode --wandb-mode str ["disabled", "offline", "online"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
wandb_dir --wandb-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
wandb_key --wandb-key str — Not captured Parser option; subject to Core/model/runtime validation Native W&B credential option; prefer WANDB_API_KEY through launch.secrets instead of storing a token here.
wandb_host --wandb-host str — Not captured Parser option; subject to Core/model/runtime validation W&B service host override.
wandb_team --wandb-team str — Not captured Parser option; subject to Core/model/runtime validation W&B entity/team name.
wandb_group --wandb-group str — Not captured Parser option; subject to Core/model/runtime validation W&B group for related runs.
wandb_random_suffix --disable-wandb-random-suffix switch — true Parser option; subject to Core/model/runtime validation See pinned runtime help.
wandb_always_use_train_step --wandb-always-use-train-step switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
log_multi_turn --log-multi-turn switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
log_passrate --log-passrate switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
log_reward_category --log-reward-category str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
log_correct_samples --log-correct-samples switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
wandb_run_id --wandb-run-id str — Not captured Parser option; subject to Core/model/runtime validation Existing W&B run identity for tracking continuation.
use_mlflow --use-mlflow switch — false Parser option; subject to Core/model/runtime validation Enable native MLflow reporting; requires its runtime service/dependencies.
mlflow_tracking_uri --mlflow-tracking-uri str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
mlflow_experiment_name --mlflow-experiment-name str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
mlflow_run_name --mlflow-run-name str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
mlflow_run_id --mlflow-run-id str — Not captured Parser option; subject to Core/model/runtime validation Existing MLflow run identifier for the native logging integration.
use_tensorboard --use-tensorboard switch — false Parser option; subject to Core/model/runtime validation Enable native TensorBoard reporting.
tb_project_name --tb-project-name str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
tb_experiment_name --tb-experiment-name str — Not captured Parser option; subject to Core/model/runtime validation Experiment name for native TensorBoard logging.
use_prometheus --use-prometheus switch — false Parser option; subject to Core/model/runtime validation Enable native Prometheus reporting where implemented.
prometheus_port --prometheus-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
prometheus_run_name --prometheus-run-name str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_miles_dashboard --use-miles-dashboard switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
dashboard_flush_interval --dashboard-flush-interval float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dashboard_gpu_sample_interval --dashboard-gpu-sample-interval float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dashboard_sglang_scrape_interval --dashboard-sglang-scrape-interval float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dashboard_sglang_scrape_mode --dashboard-sglang-scrape-mode str ["auto", "direct", "router"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dashboard_sglang_metrics --dashboard-sglang-metrics str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dashboard_forward_prometheus --dashboard-forward-prometheus switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_miles_router --use-miles-router switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
miles_router_timeout --miles-router-timeout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
miles_router_max_connections --miles-router-max-connections int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
miles_router_health_check_failure_threshold --miles-router-health-check-failure-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
worker_urls --worker-urls str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_policy --router-policy str ["cache_aware", "consistent_hashing", "manual", "power_of_two", "prefix_hash", "random", "round_robin"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_prefill_policy --router-prefill-policy str ["bucket", "cache_aware", "consistent_hashing", "manual", "power_of_two", "prefix_hash", "random", "round_robin"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_decode_policy --router-decode-policy str ["cache_aware", "consistent_hashing", "manual", "power_of_two", "prefix_hash", "random", "round_robin"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_cache_threshold --router-cache-threshold float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_balance_abs_threshold --router-balance-abs-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_balance_rel_threshold --router-balance-rel-threshold float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_bucket_adjust_interval_secs --router-bucket-adjust-interval-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_eviction_interval_secs --router-eviction-interval-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_max_tree_size --router-max-tree-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_max_idle_secs --router-max-idle-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_assignment_mode --router-assignment-mode str ["min_group", "min_load", "random"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_max_payload_size --router-max-payload-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_dp_aware --router-dp-aware switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_enable_igw --router-enable-igw switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_allow_requests_without_routing_key --router-allow-requests-without-routing-key switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_mini_lb --router-mini-lb switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_test_external_dp_routing --router-test-external-dp-routing switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_pd_disaggregation --router-pd-disaggregation switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_prefill --router-prefill append — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_decode --router-decode append — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_worker_startup_timeout_secs --router-worker-startup-timeout-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_worker_startup_check_interval --router-worker-startup-check-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_log_dir --router-log-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_log_level --router-log-level str ["debug", "error", "info", "warn"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_json_log --router-json-log switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_service_discovery --router-service-discovery switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_selector --router-selector str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_service_discovery_port --router-service-discovery-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_service_discovery_namespace --router-service-discovery-namespace str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_prefill_selector --router-prefill-selector str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_decode_selector --router-decode-selector str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_prometheus_port --router-prometheus-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_prometheus_host --router-prometheus-host str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_prometheus_duration_buckets --router-prometheus-duration-buckets float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_request_id_headers --router-request-id-headers str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_request_timeout_secs --router-request-timeout-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_shutdown_grace_period_secs --router-shutdown-grace-period-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_cors_allowed_origins --router-cors-allowed-origins str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_max_concurrent_requests --router-max-concurrent-requests int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_queue_size --router-queue-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_queue_timeout_secs --router-queue-timeout-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_rate_limit_tokens_per_second --router-rate-limit-tokens-per-second int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_retry_max_retries --router-retry-max-retries int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_retry_initial_backoff_ms --router-retry-initial-backoff-ms int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_retry_max_backoff_ms --router-retry-max-backoff-ms int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_retry_backoff_multiplier --router-retry-backoff-multiplier float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_retry_jitter_factor --router-retry-jitter-factor float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_disable_retries --router-disable-retries switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_cb_failure_threshold --router-cb-failure-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_cb_success_threshold --router-cb-success-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_cb_timeout_duration_secs --router-cb-timeout-duration-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_cb_window_duration_secs --router-cb-window-duration-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_disable_circuit_breaker --router-disable-circuit-breaker switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_health_failure_threshold --router-health-failure-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_health_success_threshold --router-health-success-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_health_check_timeout_secs --router-health-check-timeout-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_health_check_interval_secs --router-health-check-interval-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_health_check_endpoint --router-health-check-endpoint str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_disable_health_check --router-disable-health-check switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_model_path --router-model-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_tokenizer_path --router-tokenizer-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_chat_template --router-chat-template str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_tokenizer_cache_enable_l0 --router-tokenizer-cache-enable-l0 switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_tokenizer_cache_l0_max_entries --router-tokenizer-cache-l0-max-entries int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_tokenizer_cache_enable_l1 --router-tokenizer-cache-enable-l1 switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_tokenizer_cache_l1_max_memory --router-tokenizer-cache-l1-max-memory int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_reasoning_parser --router-reasoning-parser str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_tool_call_parser --router-tool-call-parser str ["deepseek", "glm45_moe", "glm47_moe", "json", "kimik2", "llama", "minimax_m2", "mistral", "passthrough", "pythonic", "qwen", "qwen_coder", "step3"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_mcp_config_path --router-mcp-config-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_backend --router-backend str ["openai", "sglang"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_history_backend --router-history-backend str ["memory", "none", "oracle", "postgres", "redis"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_oracle_wallet_path --router-oracle-wallet-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_oracle_tns_alias --router-oracle-tns-alias str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_oracle_connect_descriptor --router-oracle-connect-descriptor str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_oracle_username --router-oracle-username str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_oracle_password --router-oracle-password str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_oracle_pool_min --router-oracle-pool-min int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_oracle_pool_max --router-oracle-pool-max int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_oracle_pool_timeout_secs --router-oracle-pool-timeout-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_postgres_db_url --router-postgres-db-url str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_postgres_pool_max --router-postgres-pool-max int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_redis_url --router-redis-url str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_redis_pool_max --router-redis-pool-max int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_redis_retention_days --router-redis-retention-days int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_client_cert_path --router-client-cert-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_client_key_path --router-client-key-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_ca_cert_paths --router-ca-cert-paths str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_tls_cert_path --router-tls-cert-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_tls_key_path --router-tls-key-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_enable_trace --router-enable-trace switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_otlp_traces_endpoint --router-otlp-traces-endpoint str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_api_key --router-api-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_control_plane_api_keys --router-control-plane-api-keys str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_control_plane_audit_enabled --router-control-plane-audit-enabled switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_jwt_issuer --router-jwt-issuer str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_jwt_audience --router-jwt-audience str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_jwt_jwks_uri --router-jwt-jwks-uri str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
router_jwt_role_mapping --router-jwt-role-mapping str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
save_debug_rollout_data --save-debug-rollout-data str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_sample_rate --rollout-sample-rate float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
save_debug_trajectory_data --save-debug-trajectory-data str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
load_debug_rollout_data --load-debug-rollout-data str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
load_debug_rollout_data_subsample --load-debug-rollout-data-subsample float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
debug_rollout_only --debug-rollout-only switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
debug_train_only --debug-train-only switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
save_debug_train_data --save-debug-train-data str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
save_debug_event_data --save-debug-event-data str — Not captured Parser option; subject to Core/model/runtime validation Native debug event output; separate from retained Core contract and driver timing reports.
dump_details --dump-details str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dumper_enable --dumper-enable switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
dumper_dir --dumper-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dumper_inference --dumper-inference value — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dumper_fwd_only --dumper-fwd-only value — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dumper_fwd_bwd --dumper-fwd-bwd value — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dumper_source_patcher_config_inference --dumper-source-patcher-config-inference str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
dumper_source_patcher_config_train --dumper-source-patcher-config-train str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
memory_snapshot_dir --memory-snapshot-dir str — Not captured Parser option; subject to Core/model/runtime validation Directory for inherited memory snapshot output.
memory_snapshot_num_steps --memory-snapshot-num-steps int — Not captured Parser option; subject to Core/model/runtime validation Number of steps captured by the inherited memory snapshot facility.
profile_target --profile-target str ["train_actor", "train_log_probs", "train_overall"] Not captured Parser option; subject to Core/model/runtime validation Native profiling target selection; available targets depend on the installed runtime.
memory_recorder --memory-recorder str ["memray", "torch"] Not captured Parser option; subject to Core/model/runtime validation Inherited runtime memory-recording facility; separate from Core contract memory metrics.
check_weight_update_equal --check-weight-update-equal switch — false Parser option; subject to Core/model/runtime validation Startup serving-weight snapshot/reset/equality qualification; enabled in mechanics examples, opt-in for qualified learning runs. Required publication acknowledgments remain.
check_weight_update_selector --check-weight-update-selector str ["all", "draft", "target"] Not captured Not implemented: Core serving checks currently require check_weight_update_selector=all An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
check_weight_update_skip_list --check-weight-update-skip-list str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
check_weight_update_allow_quant_error --check-weight-update-allow-quant-error switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
save_local_weight_checksum --save-local-weight-checksum switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
enable_event_analyzer --enable-event-analyzer switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
enable_witness --enable-witness switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
witness_buffer_size --witness-buffer-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ci_ft_test_actions --ci-ft-test-actions str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ci_ft_test_actions_path --ci-ft-test-actions-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ci_inject_rollout_data_path --ci-inject-rollout-data-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ci_inject_rollout_data_start_rollout_id --ci-inject-rollout-data-start-rollout-id int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ci_inject_rollout_data_min_match_ratio --ci-inject-rollout-data-min-match-ratio float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
env_report --env-report str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
env_report_interval_seconds --env-report-interval-seconds float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
debug_unified_grad_fused_logprob --debug-unified-grad-fused-logprob switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
debug_deterministic_collective --debug-deterministic-collective switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tokenizer_path --eval-sglang-tokenizer-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tokenizer_mode --eval-sglang-tokenizer-mode str ["auto", "slow"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tokenizer_backend --eval-sglang-tokenizer-backend str ["fastokens", "huggingface"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tokenizer_worker_num --eval-sglang-tokenizer-worker-num int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_detokenizer_worker_num --eval-sglang-detokenizer-worker-num int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_skip_tokenizer_init --eval-sglang-skip-tokenizer-init, --no-eval-sglang-skip-tokenizer-init boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_load_format --eval-sglang-load-format str ["auto", "bitsandbytes", "dummy", "expert_pack", "fastsafetensors", "flash_rl", "gguf", "layered", "mistral", "npcache", "presharded", "private", "pt", "remote", "remote_instance", "runai_streamer", "safetensors", "sharded_state"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_model_loader_extra_config --eval-sglang-model-loader-extra-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_context_length --eval-sglang-context-length human_readable_int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_is_embedding --eval-sglang-is-embedding, --no-eval-sglang-is-embedding boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_multimodal --eval-sglang-enable-multimodal, --no-eval-sglang-enable-multimodal boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_revision --eval-sglang-revision str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_model_impl --eval-sglang-model-impl str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_model_config_parser --eval-sglang-model-config-parser str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_json_model_override_args --eval-sglang-json-model-override-args str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dtype --eval-sglang-dtype str ["auto", "bfloat16", "float", "float16", "float32", "half"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_quantization --eval-sglang-quantization str ["auto-round", "auto-round-int8", "awq", "awq_marlin", "bitsandbytes", "compressed-tensors", "fp8", "gguf", "gptq", "gptq_marlin", "humming", "mlx_q4", "mlx_q8", "modelopt", "modelopt_fp4", "modelopt_fp8", "modelopt_mixed", "modelslim", "moe_wna16", "mxfp4", "mxfp8", "mxfp_w4a8", "nvfp4_online", "petit_nvfp4", "quark", "quark_int4fp8_moe", "quark_mxfp4", "unquant", "w4afp8", "w8a8_fp8", "w8a8_int8"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_quantization_param_path --eval-sglang-quantization-param-path nullable_str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kv_cache_dtype --eval-sglang-kv-cache-dtype str ["auto", "bf16", "bfloat16", "fp4_mx_block16", "fp8_e4m3", "fp8_e5m2", "mxfp8", "nvfp4"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_fp32_lm_head --eval-sglang-enable-fp32-lm-head, --no-eval-sglang-enable-fp32-lm-head boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_modelopt_quant --eval-sglang-modelopt-quant str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_modelopt_checkpoint_restore_path --eval-sglang-modelopt-checkpoint-restore-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_modelopt_checkpoint_save_path --eval-sglang-modelopt-checkpoint-save-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_modelopt_export_path --eval-sglang-modelopt-export-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_quantize_and_serve --eval-sglang-quantize-and-serve, --no-eval-sglang-quantize-and-serve boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_rl_quant_profile --eval-sglang-rl-quant-profile str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_tf32_matmul --eval-sglang-enable-tf32-matmul, --no-eval-sglang-enable-tf32-matmul boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mem_fraction_static --eval-sglang-mem-fraction-static float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_running_requests --eval-sglang-max-running-requests int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_queued_requests --eval-sglang-max-queued-requests int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_total_tokens --eval-sglang-max-total-tokens human_readable_int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_chunked_prefill_size --eval-sglang-chunked-prefill-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_decode_interval --eval-sglang-prefill-decode-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_dynamic_chunking --eval-sglang-enable-dynamic-chunking, --no-eval-sglang-enable-dynamic-chunking boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_prefill_tokens --eval-sglang-max-prefill-tokens human_readable_int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_max_requests --eval-sglang-prefill-max-requests int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_schedule_policy --eval-sglang-schedule-policy str ["dfs-weight", "fcfs", "hrrn", "lof", "lpm", "priority", "random", "routing-key", "shortest-prefill-first"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_priority_scheduling --eval-sglang-enable-priority-scheduling, --no-eval-sglang-enable-priority-scheduling boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_priority_preemption --eval-sglang-disable-priority-preemption, --no-eval-sglang-disable-priority-preemption boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_default_priority_value --eval-sglang-default-priority-value int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_abort_on_priority_when_disabled --eval-sglang-abort-on-priority-when-disabled, --no-eval-sglang-abort-on-priority-when-disabled boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_schedule_low_priority_values_first --eval-sglang-schedule-low-priority-values-first, --no-eval-sglang-schedule-low-priority-values-first boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_priority_scheduling_preemption_threshold --eval-sglang-priority-scheduling-preemption-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_retraction_policy --eval-sglang-retraction-policy str ["length", "priority"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_schedule_conservativeness --eval-sglang-schedule-conservativeness float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_page_size --eval-sglang-page-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_c128_page_size --eval-sglang-c128-page-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_swa_full_tokens_ratio --eval-sglang-swa-full-tokens-ratio float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_hybrid_swa_memory --eval-sglang-disable-hybrid-swa-memory, --no-eval-sglang-disable-hybrid-swa-memory boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_radix_eviction_policy --eval-sglang-radix-eviction-policy str ["lfu", "lru", "priority", "slru", "tlru"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_radix_eviction_policy_config --eval-sglang-radix-eviction-policy-config loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_only_disable_kv_cache --eval-sglang-prefill-only-disable-kv-cache, --no-eval-sglang-prefill-only-disable-kv-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_radix_cache --eval-sglang-disable-radix-cache, --no-eval-sglang-disable-radix-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_page_major_kv_layout --eval-sglang-enable-page-major-kv-layout, --no-eval-sglang-enable-page-major-kv-layout boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_unified_memory --eval-sglang-enable-unified-memory, --no-eval-sglang-enable-unified-memory boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_chunked_prefix_cache --eval-sglang-disable-chunked-prefix-cache, --no-eval-sglang-disable-chunked-prefix-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_overlap_schedule --eval-sglang-disable-overlap-schedule, --no-eval-sglang-disable-overlap-schedule boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_num_continuous_decode_steps --eval-sglang-num-continuous-decode-steps int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_scheduler_recv_interval --eval-sglang-scheduler-recv-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_mixed_chunk --eval-sglang-enable-mixed-chunk, --no-eval-sglang-enable-mixed-chunk boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dist_timeout --eval-sglang-dist-timeout int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dcp_size --eval-sglang-dcp-size, --eval-sglang-decode-context-parallel-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_pp_size --eval-sglang-pp-size, --eval-sglang-pipeline-parallel-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_pp_max_micro_batch_size --eval-sglang-pp-max-micro-batch-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_pp_async_batch_depth --eval-sglang-pp-async-batch-depth int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dp_size --eval-sglang-dp-size, --eval-sglang-data-parallel-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_load_balance_method --eval-sglang-load-balance-method str ["auto", "follow_bootstrap_room", "round_robin", "total_requests", "total_tokens"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_attn_cp_size --eval-sglang-attn-cp-size, --eval-sglang-attention-context-parallel-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_moe_dp_size --eval-sglang-moe-dp-size, --eval-sglang-moe-data-parallel-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dwdp_size --eval-sglang-dwdp-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dcp_comm_backend --eval-sglang-dcp-comm-backend str ["a2a", "ag_rs", "fi_a2a"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dcp_replicate_q_proj --eval-sglang-dcp-replicate-q-proj, --no-eval-sglang-dcp-replicate-q-proj boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_prefill_cp --eval-sglang-enable-prefill-cp, --no-eval-sglang-enable-prefill-cp boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cp_strategy --eval-sglang-cp-strategy str ["interleave", "zigzag"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_dsa_cache_layer_split --eval-sglang-enable-dsa-cache-layer-split, --no-eval-sglang-enable-dsa-cache-layer-split boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_cp_decode_attn_tp --eval-sglang-enable-cp-decode-attn-tp, --no-eval-sglang-enable-cp-decode-attn-tp boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_dp_attention --eval-sglang-enable-dp-attention, --no-eval-sglang-enable-dp-attention boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_dp_attention_local_control_broadcast --eval-sglang-enable-dp-attention-local-control-broadcast, --no-eval-sglang-enable-dp-attention-local-control-broadcast boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_dp_lm_head --eval-sglang-enable-dp-lm-head, --no-eval-sglang-enable-dp-lm-head boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_tp_lm_head_all_to_all --eval-sglang-enable-tp-lm-head-all-to-all, --no-eval-sglang-enable-tp-lm-head-all-to-all boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_attn_tp_input_scattered --eval-sglang-enable-attn-tp-input-scattered, --no-eval-sglang-enable-attn-tp-input-scattered boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_shared_experts_attn_tp --eval-sglang-enable-shared-experts-attn-tp, --no-eval-sglang-enable-shared-experts-attn-tp boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_shared_experts_tp_size --eval-sglang-shared-experts-tp-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_dense_mlp_attn_tp --eval-sglang-enable-dense-mlp-attn-tp, --no-eval-sglang-enable-dense-mlp-attn-tp boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_layernorm_sp --eval-sglang-enable-layernorm-sp, --no-eval-sglang-enable-layernorm-sp boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_attn_tp_gather --eval-sglang-disable-attn-tp-gather, --no-eval-sglang-disable-attn-tp-gather boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_p2p_check --eval-sglang-enable-p2p-check, --no-eval-sglang-enable-p2p-check boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_device --eval-sglang-device str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mlx_enable_sampling --eval-sglang-mlx-enable-sampling, --no-eval-sglang-mlx-enable-sampling boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_watchdog_timeout --eval-sglang-watchdog-timeout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_soft_watchdog_timeout --eval-sglang-soft-watchdog-timeout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_sleep_on_idle --eval-sglang-sleep-on-idle, --no-eval-sglang-sleep-on-idle boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_use_ray --eval-sglang-use-ray, --no-eval-sglang-use-ray boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_numa_node --eval-sglang-numa-node int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_gc_threshold --eval-sglang-gc-threshold int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_host --eval-sglang-host str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_fastapi_root_path --eval-sglang-fastapi-root-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_smg_grpc_mode --eval-sglang-smg-grpc-mode, --no-eval-sglang-smg-grpc-mode boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_grpc_mode --eval-sglang-grpc-mode, --no-eval-sglang-grpc-mode boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_grpc_port --eval-sglang-grpc-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_sidecar --eval-sglang-sidecar str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_sidecar_args --eval-sglang-sidecar-args json_list_type — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_warmups --eval-sglang-warmups str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_http2 --eval-sglang-enable-http2, --no-eval-sglang-enable-http2 boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_http2_max_concurrent_streams --eval-sglang-http2-max-concurrent-streams int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_http2_initial_connection_window_size --eval-sglang-http2-initial-connection-window-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ssl_keyfile --eval-sglang-ssl-keyfile str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ssl_certfile --eval-sglang-ssl-certfile str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ssl_ca_certs --eval-sglang-ssl-ca-certs str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ssl_keyfile_password --eval-sglang-ssl-keyfile-password str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_ssl_refresh --eval-sglang-enable-ssl-refresh, --no-eval-sglang-enable-ssl-refresh boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_api_key --eval-sglang-api-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_admin_api_key --eval-sglang-admin-api-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_served_model_name --eval-sglang-served-model-name str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_weight_version --eval-sglang-weight-version str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_chat_template --eval-sglang-chat-template str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_trust_request_chat_template --eval-sglang-trust-request-chat-template, --no-eval-sglang-trust-request-chat-template boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hf_chat_template_name --eval-sglang-hf-chat-template-name str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_completion_template --eval-sglang-completion-template str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_file_storage_path --eval-sglang-file-storage-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_cache_report --eval-sglang-enable-cache-report, --no-eval-sglang-enable-cache-report boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_return_input_ids --eval-sglang-return-input-ids, --no-eval-sglang-return-input-ids boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_return_output_ids --eval-sglang-return-output-ids, --no-eval-sglang-return-output-ids boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_default_chat_template_kwargs --eval-sglang-default-chat-template-kwargs loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_strip_thinking_cache --eval-sglang-strip-thinking-cache, --no-eval-sglang-strip-thinking-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_strict_thinking --eval-sglang-enable-strict-thinking, --no-eval-sglang-enable-strict-thinking boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tool_server --eval-sglang-tool-server str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_sampling_defaults --eval-sglang-sampling-defaults str ["model", "openai"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_asr_max_buffer_seconds --eval-sglang-asr-max-buffer-seconds int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_asr_max_concurrent_sessions --eval-sglang-asr-max-concurrent-sessions int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_preferred_sampling_params --eval-sglang-preferred-sampling-params loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_allow_auto_truncate --eval-sglang-allow-auto-truncate, --no-eval-sglang-allow-auto-truncate boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_stream_interval --eval-sglang-stream-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_batch_notify_size --eval-sglang-batch-notify-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_stream_response_default_include_usage --eval-sglang-stream-response-default-include-usage, --no-eval-sglang-stream-response-default-include-usage boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_incremental_streaming_output --eval-sglang-incremental-streaming-output, --no-eval-sglang-incremental-streaming-output boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_streaming_session --eval-sglang-enable-streaming-session, --no-eval-sglang-enable-streaming-session boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_session_radix_cache --eval-sglang-enable-session-radix-cache, --no-eval-sglang-enable-session-radix-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_log_level --eval-sglang-log-level str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_log_level_http --eval-sglang-log-level-http str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_log_requests --eval-sglang-log-requests, --no-eval-sglang-log-requests boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_log_requests_level --eval-sglang-log-requests-level int [0, 1, 2, 3] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_log_requests_format --eval-sglang-log-requests-format str ["json", "text"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_log_requests_target --eval-sglang-log-requests-target str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_uvicorn_access_log_exclude_prefixes --eval-sglang-uvicorn-access-log-exclude-prefixes str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_crash_dump_folder --eval-sglang-crash-dump-folder str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_show_time_cost --eval-sglang-show-time-cost, --no-eval-sglang-show-time-cost boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_metrics --eval-sglang-enable-metrics, --no-eval-sglang-enable-metrics boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_smg_http_sidecar_port --eval-sglang-smg-http-sidecar-port, --eval-sglang-grpc-http-sidecar-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_mfu_metrics --eval-sglang-enable-mfu-metrics, --no-eval-sglang-enable-mfu-metrics boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_metrics_for_all_schedulers --eval-sglang-enable-metrics-for-all-schedulers, --no-eval-sglang-enable-metrics-for-all-schedulers boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_load_snapshot_publish_interval --eval-sglang-load-snapshot-publish-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tokenizer_metrics_custom_labels_header --eval-sglang-tokenizer-metrics-custom-labels-header str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tokenizer_metrics_allowed_custom_labels --eval-sglang-tokenizer-metrics-allowed-custom-labels str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_extra_metric_labels --eval-sglang-extra-metric-labels loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_bucket_time_to_first_token --eval-sglang-bucket-time-to-first-token float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_bucket_inter_token_latency --eval-sglang-bucket-inter-token-latency float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_bucket_e2e_request_latency --eval-sglang-bucket-e2e-request-latency float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prompt_tokens_buckets --eval-sglang-prompt-tokens-buckets str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_generation_tokens_buckets --eval-sglang-generation-tokens-buckets str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_gc_warning_threshold_secs --eval-sglang-gc-warning-threshold-secs float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_decode_log_interval --eval-sglang-decode-log-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_request_time_stats_logging --eval-sglang-enable-request-time-stats-logging, --no-eval-sglang-enable-request-time-stats-logging boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kv_events_config --eval-sglang-kv-events-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_load_publish_endpoint --eval-sglang-load-publish-endpoint str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_forward_pass_metrics --eval-sglang-enable-forward-pass-metrics, --no-eval-sglang-enable-forward-pass-metrics boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_forward_pass_metrics_worker_id --eval-sglang-forward-pass-metrics-worker-id str — Not captured Parser option; subject to Core/model/runtime validation Evaluation-server override of the forward-metrics worker identity.
eval_sglang_forward_pass_metrics_ipc_name --eval-sglang-forward-pass-metrics-ipc-name str — Not captured Parser option; subject to Core/model/runtime validation Evaluation-server override of the SGLang forward-metrics IPC channel name.
eval_sglang_enable_trace --eval-sglang-enable-trace, --no-eval-sglang-enable-trace boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_trace_modules --eval-sglang-trace-modules str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_otlp_traces_endpoint --eval-sglang-otlp-traces-endpoint str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_export_metrics_to_file --eval-sglang-export-metrics-to-file, --no-eval-sglang-export-metrics-to-file boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_export_metrics_to_file_dir --eval-sglang-export-metrics-to-file-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_constrained_json_whitespace_pattern --eval-sglang-constrained-json-whitespace-pattern str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_constrained_json_disable_any_whitespace --eval-sglang-constrained-json-disable-any-whitespace, --no-eval-sglang-constrained-json-disable-any-whitespace boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_constrained_json_max_whitespace_cnt --eval-sglang-constrained-json-max-whitespace-cnt int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_attention_backend --eval-sglang-attention-backend str ["aiter", "ascend", "compressed", "cutedsl_mla", "dsa", "dsv4", "fa3", "fa4", "flashinfer", "flashmla", "flex_attention", "hpc_ops", "intel_amx", "intel_xpu", "minicpm_flashattn", "minicpm_flashinfer", "nsa", "qsa", "tokenspeed_mla", "torch_native", "triton", "trtllm_mha", "trtllm_mla", "wave"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_decode_attention_backend --eval-sglang-decode-attention-backend str ["aiter", "ascend", "compressed", "cutedsl_mla", "dsa", "dsv4", "fa3", "fa4", "flashinfer", "flashmla", "flex_attention", "hpc_ops", "intel_amx", "intel_xpu", "minicpm_flashattn", "minicpm_flashinfer", "nsa", "qsa", "tokenspeed_mla", "torch_native", "triton", "trtllm_mha", "trtllm_mla", "wave"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_lean_attention --eval-sglang-enable-lean-attention, --no-eval-sglang-enable-lean-attention boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_attention_backend --eval-sglang-prefill-attention-backend str ["aiter", "ascend", "compressed", "cutedsl_mla", "dsa", "dsv4", "fa3", "fa4", "flashinfer", "flashmla", "flex_attention", "hpc_ops", "intel_amx", "intel_xpu", "minicpm_flashattn", "minicpm_flashinfer", "nsa", "qsa", "tokenspeed_mla", "torch_native", "triton", "trtllm_mha", "trtllm_mla", "wave"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_grammar_backend --eval-sglang-grammar-backend str ["llguidance", "none", "outlines", "xgrammar"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_radix_cache_backend --eval-sglang-radix-cache-backend str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mm_attention_backend --eval-sglang-mm-attention-backend str ["aiter_attn", "amx_attn", "ascend_attn", "fa3", "fa4", "flashinfer_cudnn", "sdpa", "triton_attn", "xpu_attn"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_fp8_gemm_runner_backend --eval-sglang-fp8-gemm-backend str ["aiter", "auto", "cutlass", "deep_gemm", "flashinfer_cutedsl", "flashinfer_cutlass", "flashinfer_deepgemm", "flashinfer_trtllm", "triton"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_fp4_gemm_runner_backend --eval-sglang-fp4-gemm-backend str ["auto", "flashinfer_cudnn", "flashinfer_cutedsl", "flashinfer_cutlass", "flashinfer_trtllm", "marlin"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_bf16_gemm_backend --eval-sglang-bf16-gemm-backend str ["auto", "cutedsl", "gemv", "torch"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dsa_prefill_backend --eval-sglang-dsa-prefill-backend str ["aiter", "fa3", "flashinfer_sparse_mla", "flashmla_auto", "flashmla_kv", "flashmla_sparse", "flashmla_sparse_q8", "tilelang", "triton", "trtllm"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dsv4_prefill_backend --eval-sglang-dsv4-prefill-backend str ["auto", "flashmla_sparse", "flashmla_sparse_q8"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dsa_decode_backend --eval-sglang-dsa-decode-backend str ["aiter", "fa3", "flashinfer_sparse_mla", "flashmla_auto", "flashmla_kv", "flashmla_sparse", "flashmla_sparse_q8", "tilelang", "triton", "trtllm"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dsa_paged_mqa_logits_backend --eval-sglang-dsa-paged-mqa-logits-backend str ["aiter", "auto", "cutedsl", "deepgemm"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dsa_topk_backend --eval-sglang-dsa-topk-backend str ["flashinfer", "sgl-kernel", "torch"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_flashinfer_autotune --eval-sglang-disable-flashinfer-autotune, --no-eval-sglang-disable-flashinfer-autotune boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_flashinfer_autotune_skip_ops --eval-sglang-flashinfer-autotune-skip-ops str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mamba_backend --eval-sglang-mamba-backend str ["flashinfer", "triton"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_config --eval-sglang-cuda-graph-config parse_cuda_graph_config_arg — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_backend_decode --eval-sglang-cuda-graph-backend-decode str ["breakable", "disabled", "full", "tc_piecewise"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_backend_prefill --eval-sglang-cuda-graph-backend-prefill str ["breakable", "disabled", "full", "tc_piecewise"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_max_bs_decode --eval-sglang-cuda-graph-max-bs-decode int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_max_bs_prefill --eval-sglang-cuda-graph-max-bs-prefill int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_bs_decode --eval-sglang-cuda-graph-bs-decode int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_bs_prefill --eval-sglang-cuda-graph-bs-prefill int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_prefill_max_context --eval-sglang-cuda-graph-prefill-max-context, --eval-sglang-context-bucket human_readable_int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_tc_compiler --eval-sglang-cuda-graph-tc-compiler str ["eager", "inductor"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_prefill_cuda_graph --eval-sglang-disable-prefill-cuda-graph, --no-eval-sglang-disable-prefill-cuda-graph boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_decode_cuda_graph --eval-sglang-disable-decode-cuda-graph, --no-eval-sglang-disable-decode-cuda-graph boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_cuda_graph_padding --eval-sglang-disable-cuda-graph-padding, --no-eval-sglang-disable-cuda-graph-padding boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_profile_cuda_graph --eval-sglang-enable-profile-cuda-graph, --no-eval-sglang-enable-profile-cuda-graph boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_cudagraph_gc --eval-sglang-enable-cudagraph-gc, --no-eval-sglang-enable-cudagraph-gc boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_debug_cuda_graph --eval-sglang-debug-cuda-graph, --no-eval-sglang-debug-cuda-graph boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_layerwise_nvtx_marker --eval-sglang-enable-layerwise-nvtx-marker, --no-eval-sglang-enable-layerwise-nvtx-marker boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_nccl_nvls --eval-sglang-enable-nccl-nvls, --no-eval-sglang-enable-nccl-nvls boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_symm_mem --eval-sglang-enable-symm-mem, --no-eval-sglang-enable-symm-mem boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_triton_attention_reduce_in_fp32 --eval-sglang-triton-attention-reduce-in-fp32, --no-eval-sglang-triton-attention-reduce-in-fp32 boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_triton_attention_num_kv_splits --eval-sglang-triton-attention-num-kv-splits int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_triton_attention_split_tile_size --eval-sglang-triton-attention-split-tile-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_flashinfer_mla_disable_ragged --eval-sglang-flashinfer-mla-disable-ragged, --no-eval-sglang-flashinfer-mla-disable-ragged boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_fused_qk_norm_rope --eval-sglang-enable-fused-qk-norm-rope, --no-eval-sglang-enable-fused-qk-norm-rope boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_precise_embedding_interpolation --eval-sglang-enable-precise-embedding-interpolation, --no-eval-sglang-enable-precise-embedding-interpolation boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_fused_moe_sum_all_reduce --eval-sglang-enable-fused-moe-sum-all-reduce, --no-eval-sglang-enable-fused-moe-sum-all-reduce boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_deepseek_v4_fp4_indexer --eval-sglang-enable-deepseek-v4-fp4-indexer, --no-eval-sglang-enable-deepseek-v4-fp4-indexer boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_custom_all_reduce --eval-sglang-disable-custom-all-reduce, --no-eval-sglang-disable-custom-all-reduce boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_mscclpp --eval-sglang-enable-mscclpp, --no-eval-sglang-enable-mscclpp boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_torch_symm_mem --eval-sglang-enable-torch-symm-mem, --no-eval-sglang-enable-torch-symm-mem boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_scattered_sconv --eval-sglang-enable-scattered-sconv, --no-eval-sglang-enable-scattered-sconv boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_pre_warm_nccl --eval-sglang-pre-warm-nccl, --no-eval-sglang-pre-warm-nccl boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_boundary_reduction --eval-sglang-boundary-reduction str ["ar", "auto", "rs", "rs+rsv", "rsv"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_quant_communications --eval-sglang-enable-quant-communications, --no-eval-sglang-enable-quant-communications boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enforce_disable_flashinfer_allreduce_fusion --eval-sglang-enforce-disable-flashinfer-allreduce-fusion, --no-eval-sglang-enforce-disable-flashinfer-allreduce-fusion boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_flashinfer_allreduce_fusion_backend --eval-sglang-flashinfer-allreduce-fusion-backend str ["auto", "cutedsl", "mnnvl", "trtllm"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_aiter_allreduce_fusion --eval-sglang-enable-aiter-allreduce-fusion, --no-eval-sglang-enable-aiter-allreduce-fusion boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_torch_compile --eval-sglang-enable-torch-compile, --no-eval-sglang-enable-torch-compile boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_torch_compile_debug_mode --eval-sglang-enable-torch-compile-debug-mode, --no-eval-sglang-enable-torch-compile-debug-mode boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_torch_compile_max_bs --eval-sglang-torch-compile-max-bs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_algorithm --eval-sglang-speculative-algorithm str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_uno_lora_path --eval-sglang-uno-lora-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_draft_model_path --eval-sglang-speculative-draft-model-path, --eval-sglang-speculative-draft-model str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_draft_model_revision --eval-sglang-speculative-draft-model-revision str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_draft_load_format --eval-sglang-speculative-draft-load-format str ["auto", "bitsandbytes", "dummy", "expert_pack", "fastsafetensors", "flash_rl", "gguf", "layered", "mistral", "npcache", "presharded", "private", "pt", "remote", "remote_instance", "runai_streamer", "safetensors", "sharded_state"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_num_steps --eval-sglang-speculative-num-steps int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_eagle_topk --eval-sglang-speculative-eagle-topk int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_num_draft_tokens --eval-sglang-speculative-num-draft-tokens int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_dflash_block_size --eval-sglang-speculative-dflash-block-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_dspark_block_size --eval-sglang-speculative-dspark-block-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_dspark_sps_table_path --eval-sglang-speculative-dspark-sps-table-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_dspark_confidence_sts_path --eval-sglang-speculative-dspark-confidence-sts-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_dspark_align_verify_tokens_to_graph_tier --eval-sglang-speculative-dspark-align-verify-tokens-to-graph-tier, --no-eval-sglang-speculative-dspark-align-verify-tokens-to-graph-tier boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_accept_threshold_single --eval-sglang-speculative-accept-threshold-single float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_accept_threshold_acc --eval-sglang-speculative-accept-threshold-acc float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_use_rejection_sampling --eval-sglang-speculative-use-rejection-sampling, --no-eval-sglang-speculative-use-rejection-sampling boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_token_map --eval-sglang-speculative-token-map str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_attention_mode --eval-sglang-speculative-attention-mode str ["decode", "prefill"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_draft_attention_backend --eval-sglang-speculative-draft-attention-backend str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_dsa_topk_backend --eval-sglang-speculative-dsa-topk-backend str ["flashinfer", "sgl-kernel", "torch"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_draft_kv_cache_dtype --eval-sglang-speculative-draft-kv-cache-dtype str ["auto", "bf16", "bfloat16", "fp8_e4m3", "fp8_e5m2"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_draft_window_size --eval-sglang-speculative-draft-window-size int — Not captured Parser option; subject to Core/model/runtime validation Evaluation-server speculative decoding draft-window override.
eval_sglang_speculative_moe_runner_backend --eval-sglang-speculative-moe-runner-backend str ["aiter", "auto", "cutlass", "deep_gemm", "experimental_sgl_marlin", "experimental_sgl_trtllm", "flashinfer_cutedsl", "flashinfer_cutlass", "flashinfer_megamoe", "flashinfer_mxfp4", "flashinfer_trtllm", "flashinfer_trtllm_routed", "hpc_ops", "humming", "intel_xpu", "marlin", "megamoe", "triton", "triton_kernel"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_moe_a2a_backend --eval-sglang-speculative-moe-a2a-backend str ["ascend_fuseep", "ascend_tp", "deepep", "deepep_v2", "flashinfer", "megamoe", "mooncake", "mori", "nixl", "none", "pplx"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_draft_model_quantization --eval-sglang-speculative-draft-model-quantization str ["auto-round", "auto-round-int8", "awq", "awq_marlin", "bitsandbytes", "compressed-tensors", "fp8", "gguf", "gptq", "gptq_marlin", "humming", "mlx_q4", "mlx_q8", "modelopt", "modelopt_fp4", "modelopt_fp8", "modelopt_mixed", "modelslim", "moe_wna16", "mxfp4", "mxfp8", "mxfp_w4a8", "nvfp4_online", "petit_nvfp4", "quark", "quark_int4fp8_moe", "quark_mxfp4", "unquant", "w4afp8", "w8a8_fp8", "w8a8_int8"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_skip_dp_mlp_sync --eval-sglang-speculative-skip-dp-mlp-sync, --no-eval-sglang-speculative-skip-dp-mlp-sync boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_multi_layer_eagle --eval-sglang-enable-multi-layer-eagle, --no-eval-sglang-enable-multi-layer-eagle boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_adaptive --eval-sglang-speculative-adaptive, --no-eval-sglang-speculative-adaptive boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_adaptive_config --eval-sglang-speculative-adaptive-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_decoupled_spec_bind_endpoint --eval-sglang-decoupled-spec-bind-endpoint str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_decoupled_spec_connect_endpoints --eval-sglang-decoupled-spec-connect-endpoints json_list_type — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_decoupled_spec_rank --eval-sglang-decoupled-spec-rank int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_decoupled_spec_role --eval-sglang-decoupled-spec-role str ["drafter", "null", "verifier"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_spec_trace_dir --eval-sglang-spec-trace-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_ngram_min_bfs_breadth --eval-sglang-speculative-ngram-min-bfs-breadth int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_ngram_max_bfs_breadth --eval-sglang-speculative-ngram-max-bfs-breadth int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_ngram_match_type --eval-sglang-speculative-ngram-match-type str ["BFS", "PROB"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_ngram_max_trie_depth --eval-sglang-speculative-ngram-max-trie-depth int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_ngram_capacity --eval-sglang-speculative-ngram-capacity int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_ngram_external_corpus_path --eval-sglang-speculative-ngram-external-corpus-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_ngram_external_sam_budget --eval-sglang-speculative-ngram-external-sam-budget int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_ngram_external_corpus_max_tokens --eval-sglang-speculative-ngram-external-corpus-max-tokens int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ep_size --eval-sglang-ep-size, --eval-sglang-expert-parallel-size, --eval-sglang-ep int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_moe_a2a_backend --eval-sglang-moe-a2a-backend str ["ascend_fuseep", "ascend_tp", "deepep", "deepep_v2", "flashinfer", "flashinfer_megamoe", "megamoe", "mooncake", "mori", "nixl", "none", "pplx"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_w4a4_mxfp4_megamoe --eval-sglang-enable-w4a4-mxfp4-megamoe, --no-eval-sglang-enable-w4a4-mxfp4-megamoe boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_deepep_v2_mode --eval-sglang-deepep-v2-mode str ["direct", "hybrid"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_moe_runner_backend --eval-sglang-moe-runner-backend str ["aiter", "auto", "cutlass", "deep_gemm", "experimental_sgl_marlin", "experimental_sgl_trtllm", "flashinfer_cutedsl", "flashinfer_cutlass", "flashinfer_megamoe", "flashinfer_mxfp4", "flashinfer_trtllm", "flashinfer_trtllm_routed", "hpc_ops", "humming", "intel_xpu", "marlin", "megamoe", "triton", "triton_kernel"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_flashinfer_mxfp4_moe_precision --eval-sglang-flashinfer-mxfp4-moe-precision str ["bf16", "default", "fp8"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_deepep_mode --eval-sglang-deepep-mode str ["auto", "low_latency", "normal"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_fuseep_mode --eval-sglang-fuseep-mode int [1, 2] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_deepep_dispatcher_output_dtype --eval-sglang-deepep-dispatcher-output-dtype str ["auto", "bf16", "fp8", "int8", "nvfp4"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ep_num_redundant_experts --eval-sglang-ep-num-redundant-experts int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ep_dispatch_algorithm --eval-sglang-ep-dispatch-algorithm str ["dynamic", "fake", "lp", "static"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_init_expert_location --eval-sglang-init-expert-location str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_eplb --eval-sglang-enable-eplb, --no-eval-sglang-enable-eplb boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_eplb_algorithm --eval-sglang-eplb-algorithm str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_eplb_rebalance_num_iterations --eval-sglang-eplb-rebalance-num-iterations int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_eplb_rebalance_layers_per_chunk --eval-sglang-eplb-rebalance-layers-per-chunk int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_eplb_min_rebalancing_utilization_threshold --eval-sglang-eplb-min-rebalancing-utilization-threshold float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_expert_distribution_recorder_mode --eval-sglang-expert-distribution-recorder-mode str ["per_pass", "per_token", "stat", "stat_approx"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_expert_distribution_recorder_buffer_size --eval-sglang-expert-distribution-recorder-buffer-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_expert_balancedness_report_mode --eval-sglang-expert-balancedness-report-mode str ["both", "off", "prometheus", "server_log"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_deepep_config --eval-sglang-deepep-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_moe_dense_tp_size --eval-sglang-moe-dense-tp-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_elastic_ep_backend --eval-sglang-elastic-ep-backend str ["mooncake", "nixl", "none"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_elastic_expert_backup --eval-sglang-enable-elastic-expert-backup, --no-eval-sglang-enable-elastic-expert-backup boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mooncake_ib_device --eval-sglang-mooncake-ib-device str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_waterfill --eval-sglang-enable-waterfill, --no-eval-sglang-enable-waterfill boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ep_join_mode --eval-sglang-elastic-ep-join-mode str ["recover", "scale"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ep_join_rank_offset --eval-sglang-elastic-ep-join-rank-offset int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_elastic_ep_initial_size --eval-sglang-elastic-ep-initial-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_ep_size --eval-sglang-max-ep-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_elastic_ep_scale_timeout --eval-sglang-elastic-ep-scale-timeout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_flashinfer_cutlass_moe_fp4_allgather --eval-sglang-disable-flashinfer-cutlass-moe-fp4-allgather, --no-eval-sglang-disable-flashinfer-cutlass-moe-fp4-allgather boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_shared_experts_fusion --eval-sglang-disable-shared-experts-fusion, --no-eval-sglang-disable-shared-experts-fusion boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enforce_shared_experts_fusion --eval-sglang-enforce-shared-experts-fusion, --no-eval-sglang-enforce-shared-experts-fusion boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_mamba_cache_size --eval-sglang-max-mamba-cache-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mamba_ssm_dtype --eval-sglang-mamba-ssm-dtype str ["bfloat16", "float16", "float32"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mamba_max_states_per_path --eval-sglang-mamba-max-states-per-path int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_mamba_cache_stochastic_rounding --eval-sglang-enable-mamba-cache-stochastic-rounding, --no-eval-sglang-enable-mamba-cache-stochastic-rounding boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mamba_cache_philox_rounds --eval-sglang-mamba-cache-philox-rounds int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mamba_full_memory_ratio --eval-sglang-mamba-full-memory-ratio float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mamba_radix_cache_strategy --eval-sglang-mamba-radix-cache-strategy str ["auto", "extra_buffer", "extra_buffer_lazy", "no_buffer"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mamba_track_interval --eval-sglang-mamba-track-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_int8_mamba_checkpoint --eval-sglang-enable-int8-mamba-checkpoint, --no-eval-sglang-enable-int8-mamba-checkpoint boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_int8_mamba_ckpt_size --eval-sglang-int8-mamba-ckpt-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_linear_attn_backend --eval-sglang-linear-attn-backend str ["cutedsl", "flashinfer", "flashkda", "helion", "intel_xpu", "nvidia_kda", "ptx_kda", "triton"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_linear_attn_decode_backend --eval-sglang-linear-attn-decode-backend str ["cutedsl", "flashinfer", "flashkda", "helion", "intel_xpu", "nvidia_kda", "ptx_kda", "triton"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_linear_attn_prefill_backend --eval-sglang-linear-attn-prefill-backend str ["cutedsl", "flashinfer", "flashkda", "helion", "intel_xpu", "nvidia_kda", "ptx_kda", "triton"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_linear_attn_verify_backend --eval-sglang-linear-attn-verify-backend str ["cutedsl", "flashinfer", "flashkda", "helion", "intel_xpu", "nv_cutedsl", "nvidia_kda", "ptx_kda", "triton"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_linear_replayssm --eval-sglang-enable-linear-replayssm, --no-eval-sglang-enable-linear-replayssm boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_linear_replayssm_cache_len --eval-sglang-linear-replayssm-cache-len int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_linear_replayssm_spec --eval-sglang-enable-linear-replayssm-spec, --no-eval-sglang-enable-linear-replayssm-spec boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_hierarchical_cache --eval-sglang-enable-hierarchical-cache, --no-eval-sglang-enable-hierarchical-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_host_memory_mode --eval-sglang-hicache-host-memory-mode str ["buffer_only", "cache"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_ratio --eval-sglang-hicache-ratio float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_size --eval-sglang-hicache-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_write_policy --eval-sglang-hicache-write-policy str ["write_back", "write_through", "write_through_selective"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_io_backend --eval-sglang-hicache-io-backend str ["direct", "kernel", "kernel_ascend"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_mem_layout --eval-sglang-hicache-mem-layout str ["layer_first", "page_first", "page_first_direct", "page_first_kv_split", "page_head"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_storage_backend --eval-sglang-hicache-storage-backend str ["aibrix", "dynamic", "eic", "file", "hf3fs", "mooncake", "mori", "nixl", "npu_memcache", "shm", "sim", "simm", "tensorcast"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_storage_prefetch_policy --eval-sglang-hicache-storage-prefetch-policy str ["best_effort", "timeout", "wait_complete"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_storage_backend_extra_config --eval-sglang-hicache-storage-backend-extra-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_storage_prefetch_retry_poll_interval --eval-sglang-hicache-storage-prefetch-retry-poll-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_storage_prefetch_retry_max_attempts --eval-sglang-hicache-storage-prefetch-retry-max-attempts int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_unified_cache_external_linker --eval-sglang-enable-unified-cache-external-linker, --no-eval-sglang-enable-unified-cache-external-linker boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_unified_cache_external_linker_backend --eval-sglang-unified-cache-external-linker-backend str ["mooncake", "mori"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_hisparse --eval-sglang-enable-hisparse, --no-eval-sglang-enable-hisparse boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hisparse_config --eval-sglang-hisparse-config, --eval-sglang-hierarchical-sparse-attention-extra-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_broadcast_mm_inputs_process --eval-sglang-enable-broadcast-mm-inputs-process, --no-eval-sglang-enable-broadcast-mm-inputs-process boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_prefix_mm_cache --eval-sglang-enable-prefix-mm-cache, --no-eval-sglang-enable-prefix-mm-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mm_enable_dp_encoder --eval-sglang-mm-enable-dp-encoder, --no-eval-sglang-mm-enable-dp-encoder boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mm_process_config --eval-sglang-mm-process-config loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mm_processor_worker_num --eval-sglang-mm-processor-worker-num int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mm_io_worker_num --eval-sglang-mm-io-worker-num int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_allowed_media_domains --eval-sglang-allowed-media-domains str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_media_url_max_file_size_mb --eval-sglang-media-url-max-file-size-mb int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mm_preprocess_cache_size_mb --eval-sglang-mm-preprocess-cache-size-mb int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_trust_mm_content_hashes --eval-sglang-trust-mm-content-hashes, --no-eval-sglang-trust-mm-content-hashes boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_limit_mm_data_per_request --eval-sglang-limit-mm-data-per-request loads — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_mm_global_cache --eval-sglang-enable-mm-global-cache, --no-eval-sglang-enable-mm-global-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_image_processor_backend --eval-sglang-image-processor-backend str ["auto", "pil", "torchvision"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mm_global_cache_backend --eval-sglang-mm-global-cache-backend str ["mooncake"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_fast_image_processor --eval-sglang-disable-fast-image-processor, --no-eval-sglang-disable-fast-image-processor boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_mm_feature_transport --eval-sglang-mm-feature-transport str ["cpu", "cuda_ipc", "cuda_vmm"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_lora --eval-sglang-enable-lora, --no-eval-sglang-enable-lora boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_lora_overlap_loading --eval-sglang-enable-lora-overlap-loading, --no-eval-sglang-enable-lora-overlap-loading boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_lora_rank --eval-sglang-max-lora-rank int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lora_target_modules --eval-sglang-lora-target-modules str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lora_paths --eval-sglang-lora-paths str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_loaded_loras --eval-sglang-max-loaded-loras int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_loras_per_batch --eval-sglang-max-loras-per-batch int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lora_eviction_policy --eval-sglang-lora-eviction-policy str ["fifo", "lru"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lora_backend --eval-sglang-lora-backend str ["ascend", "csgmv", "torch_native", "triton"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_max_lora_chunk_size --eval-sglang-max-lora-chunk-size int [128, 16, 32, 64] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_experts_shared_outer_loras --eval-sglang-experts-shared-outer-loras, --no-eval-sglang-experts-shared-outer-loras boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lora_use_virtual_experts --eval-sglang-lora-use-virtual-experts, --no-eval-sglang-lora-use-virtual-experts boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lora_strict_loading --eval-sglang-lora-strict-loading, --no-eval-sglang-lora-strict-loading boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lora_no_cpu_backup --eval-sglang-lora-no-cpu-backup, --no-eval-sglang-lora-no-cpu-backup boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lora_drain_wait_threshold --eval-sglang-lora-drain-wait-threshold float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_two_batch_overlap --eval-sglang-enable-two-batch-overlap, --no-eval-sglang-enable-two-batch-overlap boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_single_batch_overlap --eval-sglang-enable-single-batch-overlap, --no-eval-sglang-enable-single-batch-overlap boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tbo_token_distribution_threshold --eval-sglang-tbo-token-distribution-threshold float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cpu_offload_gb --eval-sglang-cpu-offload-gb int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_offload_group_size --eval-sglang-offload-group-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_offload_num_in_group --eval-sglang-offload-num-in-group int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_offload_prefetch_step --eval-sglang-offload-prefetch-step int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_offload_mode --eval-sglang-offload-mode str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_lmcache --eval-sglang-enable-lmcache, --no-eval-sglang-enable-lmcache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_lmcache_config_file --eval-sglang-lmcache-config-file str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_flexkv --eval-sglang-enable-flexkv, --no-eval-sglang-enable-flexkv boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_flexkv_config_file --eval-sglang-flexkv-config-file str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kt_weight_path --eval-sglang-kt-weight-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kt_method --eval-sglang-kt-method str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kt_cpuinfer --eval-sglang-kt-cpuinfer int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kt_threadpool_count --eval-sglang-kt-threadpool-count int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kt_num_gpu_experts --eval-sglang-kt-num-gpu-experts int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kt_max_deferred_experts_per_token --eval-sglang-kt-max-deferred-experts-per-token int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dllm_algorithm --eval-sglang-dllm-algorithm str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dllm_algorithm_config --eval-sglang-dllm-algorithm-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dllm_fdfo --eval-sglang-dllm-fdfo, --no-eval-sglang-dllm-fdfo boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_mode --eval-sglang-disaggregation-mode str ["decode", "null", "prefill"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_transfer_backend --eval-sglang-disaggregation-transfer-backend str ["ascend", "fake", "mooncake", "mooncake_tcp", "mori", "nixl"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_bootstrap_port --eval-sglang-disaggregation-bootstrap-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_ib_device --eval-sglang-disaggregation-ib-device str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_decode_enable_radix_cache --eval-sglang-disaggregation-decode-enable-radix-cache, --no-eval-sglang-disaggregation-decode-enable-radix-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_decode_enable_offload_kvcache --eval-sglang-disaggregation-decode-enable-offload-kvcache, --no-eval-sglang-disaggregation-decode-enable-offload-kvcache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_decode_retraction_backup --eval-sglang-disaggregation-decode-retraction-backup str ["cpu_tensor", "host_pool", "none"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_num_reserved_decode_tokens --eval-sglang-num-reserved-decode-tokens int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_decode_extra_slots --eval-sglang-disaggregation-decode-extra-slots int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_decode_polling_interval --eval-sglang-disaggregation-decode-polling-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_optimistic_prefill_attempts --eval-sglang-optimistic-prefill-attempts int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_encoder_only --eval-sglang-encoder-only, --no-eval-sglang-encoder-only boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_language_only --eval-sglang-language-only, --no-eval-sglang-language-only boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_language_model_only --eval-sglang-language-model-only, --no-eval-sglang-language-model-only boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_encoder_transfer_backend --eval-sglang-encoder-transfer-backend str ["auto", "mooncake", "zmq_to_scheduler", "zmq_to_tokenizer"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_encoder_urls --eval-sglang-encoder-urls str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_encoder_bootstrap_port --eval-sglang-encoder-bootstrap-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_encoder_register_urls --eval-sglang-encoder-register-urls str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_adaptive_dispatch_to_encoder --eval-sglang-enable-adaptive-dispatch-to-encoder, --no-eval-sglang-enable-adaptive-dispatch-to-encoder boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_pdmux --eval-sglang-enable-pdmux, --no-eval-sglang-enable-pdmux boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_pdmux_config_path --eval-sglang-pdmux-config-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_sm_group_num --eval-sglang-sm-group-num int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_startup_weight_load_mode --eval-sglang-startup-weight-load-mode str ["overlap", "serial"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_custom_weight_loader --eval-sglang-custom-weight-loader str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_weight_loader_disable_mmap --eval-sglang-weight-loader-disable-mmap, --no-eval-sglang-weight-loader-disable-mmap boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_weight_loader_prefetch_checkpoints --eval-sglang-weight-loader-prefetch-checkpoints, --no-eval-sglang-weight-loader-prefetch-checkpoints boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_weight_loader_prefetch_num_threads --eval-sglang-weight-loader-prefetch-num-threads int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_weight_loader_drop_cache_after_load --eval-sglang-weight-loader-drop-cache-after-load, --no-eval-sglang-weight-loader-drop-cache-after-load boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_remote_instance_weight_loader_seed_instance_ip --eval-sglang-remote-instance-weight-loader-seed-instance-ip str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_remote_instance_weight_loader_seed_instance_service_port --eval-sglang-remote-instance-weight-loader-seed-instance-service-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_remote_instance_weight_loader_send_weights_group_ports --eval-sglang-remote-instance-weight-loader-send-weights-group-ports json_list_type — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_remote_instance_weight_loader_backend --eval-sglang-remote-instance-weight-loader-backend str ["modelexpress", "nccl", "transfer_engine"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_remote_instance_weight_loader_start_seed_via_transfer_engine --eval-sglang-remote-instance-weight-loader-start-seed-via-transfer-engine, --no-eval-sglang-remote-instance-weight-loader-start-seed-via-transfer-engine boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_engine_info_bootstrap_port --eval-sglang-engine-info-bootstrap-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_modelexpress_config --eval-sglang-modelexpress-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_download_dir --eval-sglang-download-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_model_checksum --eval-sglang-model-checksum str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_delete_ckpt_after_loading --eval-sglang-delete-ckpt-after-loading, --no-eval-sglang-delete-ckpt-after-loading boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_decrypted_config_file --eval-sglang-decrypted-config-file str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_decrypted_draft_config_file --eval-sglang-decrypted-draft-config-file str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_checkpoint_engine_wait_weights_before_ready --eval-sglang-checkpoint-engine-wait-weights-before-ready, --no-eval-sglang-checkpoint-engine-wait-weights-before-ready boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_prefill_delayer --eval-sglang-enable-prefill-delayer, --no-eval-sglang-enable-prefill-delayer boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_delayer_max_delay_passes --eval-sglang-prefill-delayer-max-delay-passes int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_delayer_token_usage_low_watermark --eval-sglang-prefill-delayer-token-usage-low-watermark float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_delayer_forward_passes_buckets --eval-sglang-prefill-delayer-forward-passes-buckets float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_delayer_wait_seconds_buckets --eval-sglang-prefill-delayer-wait-seconds-buckets float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_delayer_queue_min_ratio --eval-sglang-prefill-delayer-queue-min-ratio float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_delayer_max_delay_ms --eval-sglang-prefill-delayer-max-delay-ms float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_min_free_slots_delay --eval-sglang-min-free-slots-delay int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_deterministic_inference --eval-sglang-enable-deterministic-inference, --no-eval-sglang-enable-deterministic-inference boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_rl_on_policy_target --eval-sglang-rl-on-policy-target str ["fsdp", "fsdp_tp"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kv_canary --eval-sglang-kv-canary str ["log", "none", "raise"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kv_canary_sweep_interval --eval-sglang-kv-canary-sweep-interval int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_dynamic_batch_tokenizer --eval-sglang-enable-dynamic-batch-tokenizer, --no-eval-sglang-enable-dynamic-batch-tokenizer boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dynamic_batch_tokenizer_batch_size --eval-sglang-dynamic-batch-tokenizer-batch-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dynamic_batch_tokenizer_batch_timeout --eval-sglang-dynamic-batch-tokenizer-batch-timeout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_tokenizer_batch_encode --eval-sglang-enable-tokenizer-batch-encode, --no-eval-sglang-enable-tokenizer-batch-encode boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_tokenizer_batch_decode --eval-sglang-disable-tokenizer-batch-decode, --no-eval-sglang-disable-tokenizer-batch-decode boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_debug_tensor_dump_output_folder --eval-sglang-debug-tensor-dump-output-folder str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_debug_tensor_dump_layers --eval-sglang-debug-tensor-dump-layers int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_debug_tensor_dump_input_file --eval-sglang-debug-tensor-dump-input-file str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_weights_cpu_backup --eval-sglang-enable-weights-cpu-backup, --no-eval-sglang-enable-weights-cpu-backup boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_draft_weights_cpu_backup --eval-sglang-enable-draft-weights-cpu-backup, --no-eval-sglang-enable-draft-weights-cpu-backup boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_custom_logit_processor --eval-sglang-enable-custom-logit-processor, --no-eval-sglang-enable-custom-logit-processor boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_return_hidden_states --eval-sglang-enable-return-hidden-states, --no-eval-sglang-enable-return-hidden-states boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_return_hidden_states_mode --eval-sglang-return-hidden-states-mode str ["full", "last"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_sampling_mask_max_tokens --eval-sglang-sampling-mask-max-tokens int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_outlines_disk_cache --eval-sglang-disable-outlines-disk-cache, --no-eval-sglang-disable-outlines-disk-cache boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_mis --eval-sglang-enable-mis, --no-eval-sglang-enable-mis boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_weight_cache_mode --eval-sglang-weight-cache-mode str ["client", "daemon", "off"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_weight_cache_socket --eval-sglang-weight-cache-socket str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_weight_cache_timeout --eval-sglang-weight-cache-timeout int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_forward_hooks --eval-sglang-forward-hooks json_list_type — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_msprobe_dump_config --eval-sglang-msprobe-dump-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ple_offload_embedding --eval-sglang-ple-offload-embedding, --no-eval-sglang-ple-offload-embedding boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ple_offload_backend --eval-sglang-ple-offload-backend str ["file", "pinned"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_ple_offload_dir --eval-sglang-ple-offload-dir str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_enable_kv_checksum --eval-sglang-disaggregation-enable-kv-checksum, --no-eval-sglang-disaggregation-enable-kv-checksum boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_pd_role_switch --eval-sglang-enable-pd-role-switch, --no-eval-sglang-enable-pd-role-switch boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_domino_candidate_pool_size --eval-sglang-speculative-domino-candidate-pool-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_flashinfer_a2a_dispatch_type --eval-sglang-flashinfer-a2a-dispatch-type str ["auto", "bf16", "mxfp8", "nvfp4"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_cuda_graph_max_seq_len_prefill --eval-sglang-cuda-graph-max-seq-len-prefill int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_prefill_kv_cache_dequant_dtype --eval-sglang-prefill-kv-cache-dequant-dtype str ["auto", "fp8_e4m3", "nvfp4"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_dsv4_attn_backend --eval-sglang-dsv4-attn-backend str ["auto", "flashmla", "trtllm"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_otlp_service_name --eval-sglang-otlp-service-name str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_hicache_host_memory_fraction --eval-sglang-hicache-host-memory-fraction float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_linker_mla_dedup --eval-sglang-enable-linker-mla-dedup, --no-eval-sglang-enable-linker-mla-dedup boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_swa_prefix_tails --eval-sglang-swa-prefix-tails int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_encoder_swa_bounded_replay --eval-sglang-enable-encoder-swa-bounded-replay, --no-eval-sglang-enable-encoder-swa-bounded-replay boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_decoder_swa_bounded_replay --eval-sglang-enable-decoder-swa-bounded-replay, --no-eval-sglang-enable-decoder-swa-bounded-replay boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_response_store --eval-sglang-enable-response-store, --no-eval-sglang-enable-response-store boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disaggregation_decode_host_receive_threshold --eval-sglang-disaggregation-decode-host-receive-threshold float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_custom_pull_weights_pre_read_hook --eval-sglang-custom-pull-weights-pre-read-hook str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_engine_info_bootstrap --eval-sglang-enable-engine-info-bootstrap, --no-eval-sglang-enable-engine-info-bootstrap boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_rdt_weight_sync --eval-sglang-enable-rdt-weight-sync, --no-eval-sglang-enable-rdt-weight-sync boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_prefill_only_deterministic_inference --eval-sglang-enable-prefill-only-deterministic-inference, --no-eval-sglang-enable-prefill-only-deterministic-inference boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_true_on_policy_contract --eval-sglang-true-on-policy-contract str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_speculative_draft_sink_size --eval-sglang-speculative-draft-sink-size int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_aiter_allreduce_fusion_in_prefill --eval-sglang-disable-aiter-allreduce-fusion-in-prefill, --no-eval-sglang-disable-aiter-allreduce-fusion-in-prefill boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_aiter_allreduce_fusion_in_decode --eval-sglang-disable-aiter-allreduce-fusion-in-decode, --no-eval-sglang-disable-aiter-allreduce-fusion-in-decode boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_draft_cuda_graph --eval-sglang-disable-draft-cuda-graph, --no-eval-sglang-disable-draft-cuda-graph boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_grpc_response_timeout_secs --eval-sglang-grpc-response-timeout-secs int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_sampling_backend --eval-sglang-sampling-backend str ["ascend", "flashinfer", "intel_xpu", "pytorch"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_reasoning_parser --eval-sglang-reasoning-parser str ["apertus2509", "auto", "cohere_command4", "deepseek-r1", "deepseek-v3", "deepseek-v4", "deepseek-v41", "dots", "gemma4", "gigachat35", "glm45", "gpt-oss", "granite_thinking_parser", "hunyuan", "inkling", "interns1", "iquest_q1", "k2_horizon", "kimi", "kimi_k2", "kimi_k3", "ling3", "mimo", "minimax", "minimax-append-think", "minimax-m3", "mistral", "muse", "nanbeige", "nemotron_3", "poolside_v1", "qwen3", "qwen3-thinking", "step3", "step3p5"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_tool_call_parser --eval-sglang-tool-call-parser str ["apertus2509", "auto", "cohere_command4", "deepseekv3", "deepseekv31", "deepseekv32", "deepseekv4", "deepseekv41", "dots", "gemma4", "gigachat3", "gigachat35", "glm", "glm45", "glm47", "gpt-oss", "hermes", "hunyuan", "inkling", "interns1", "iquest_q1", "k2_horizon", "kimi_k2", "kimi_k3", "lfm2", "ling3", "llama3", "mimo", "minicpm5", "minimax-m2", "minimax-m3", "mistral", "muse", "nanbeige", "poolside_v1", "pythonic", "qwen", "qwen25", "qwen3_coder", "spark25", "step3", "step3p5", "trinity"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_kv_canary_real_data --eval-sglang-kv-canary-real-data str ["all", "none", "partial"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_disable_cuda_graph --eval-sglang-disable-cuda-graph switch — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_sglang_enable_flashinfer_allreduce_fusion --eval-sglang-enable-flashinfer-allreduce-fusion, --no-eval-sglang-enable-flashinfer-allreduce-fusion boolean — "==SUPPRESS==" Parser option; subject to Core/model/runtime validation See pinned runtime help.
lora_rank --lora-rank int — Not captured Not implemented: Core RL does not implement LoRA; miles.lora_rank must be nonpositive An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
lora_alpha --lora-alpha int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
lora_dropout --lora-dropout float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
lora_type --lora-type str ["canonical_lora", "lora"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
target_modules --target-modules str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
exclude_modules --exclude-modules str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
lora_adapter_path --lora-adapter-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
lora_sync_from_tensor --lora-sync-from-tensor switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
lora_base_cpu_backup --lora-base-cpu-backup switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
lora_train_only --lora-train-only switch — false Not implemented: Required value: false An implementation with tests is welcome; please contribute support for this configuration. See pinned runtime help.
experts_shared_outer_loras --experts-shared-outer-loras switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
multi_lora_n_adapters --multi-lora-n-adapters int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
check_lora_weight_equal --check-lora-weight-equal switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_session_server --use-session-server value — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
session_server_workers --session-server-workers int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
session_server_ip --session-server-ip str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
session_server_external_host --session-server-external-host str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
session_server_port --session-server-port int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
tito_model --tito-model str ["deepseekv4", "deepseekv41", "default", "glm47", "glm53", "inkling", "kimi25", "kimi26", "minimax_m25", "minimax_m27", "nemotron3", "qwen3", "qwen35", "qwen36", "qwen38small", "qwen4exp", "qwennext"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
session_message_matcher --session-message-matcher str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
session_sample_picker_path --session-sample-picker-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
session_sample_postprocessor_path --session-sample-postprocessor-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
http_proxy --http-proxy str — Not captured Parser option; subject to Core/model/runtime validation HTTP proxy URL for runtime network requests; keep credentials in secrets, not TOML.
use_distributed_post --use-distributed-post switch — false Parser option; subject to Core/model/runtime validation Native distributed HTTP request dispatch switch; not a trainer parallelism selector.
rm_type --rm-type str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
reward_key --reward-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
eval_reward_key --eval-reward-key str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
group_rm --group-rm switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
rm_url --rm-url str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_rm_path --custom-rm-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_reward_post_process_path --custom-reward-post-process-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
custom_convert_samples_to_train_data_path --custom-convert-samples-to-train-data-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_buffer_url --rollout-buffer-url str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
fetch_trajectory_retry_times --fetch-trajectory-retry-times int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
min_batch_collection_ratio --min-batch-collection-ratio float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_task_type --rollout-task-type str — Not captured Parser option; subject to Core/model/runtime validation Native rollout task type selector; does not register unsupported Open Instruct tasks/verifiers.
loss_mask_type --loss-mask-type str ["distill_qwen", "qwen", "qwen3"] Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
data_pad_size_multiplier --data-pad-size-multiplier int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_sample_filter_path --rollout-sample-filter-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
rollout_all_samples_process_path --rollout-all-samples-process-path str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
disable_rollout_trim_samples --disable-rollout-trim-samples switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
use_dynamic_global_batch_size --use-dynamic-global-batch-size switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
mtp_num_layers --mtp-num-layers int — Not captured Parser option; subject to Core/model/runtime validation Inherited multi-token-prediction layer count; no Core MTP training support is implied.
mtp_loss_scaling_factor --mtp-loss-scaling-factor float — Not captured Parser option; subject to Core/model/runtime validation Inherited multi-token-prediction auxiliary coefficient; no Core MTP training support is implied.
enable_mtp_training --enable-mtp-training switch — false Parser option; subject to Core/model/runtime validation See pinned runtime help.
prefill_num_servers --prefill-num-servers int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ci_test --ci-test switch — false Parser option; subject to Core/model/runtime validation Enable inherited MILES CI behavior; use dedicated Core audits to establish Core correctness.
ci_tito_special_token_count_threshold --ci-tito-special-token-count-threshold float — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ci_disable_kl_checker --ci-disable-kl-checker switch — false Parser option; subject to Core/model/runtime validation Inherited CI switch disabling the KL checker; does not disable Core policy checks.
ci_disable_logprobs_checker --ci-disable-logprobs-checker switch — false Parser option; subject to Core/model/runtime validation Inherited CI switch disabling its log-probability checker; separate from Core contract guards.
ci_disable_weight_update_checker --ci-disable-weight-update-checker switch — false Parser option; subject to Core/model/runtime validation Inherited CI checker override; not a substitute for Core publication checks.
ci_metric_checker_key --ci-metric-checker-key str — Not captured Parser option; subject to Core/model/runtime validation Metric key inspected by the inherited CI threshold checker.
ci_metric_checker_threshold --ci-metric-checker-threshold float — Not captured Parser option; subject to Core/model/runtime validation Threshold used by the inherited CI metric checker.
ci_metric_checker_expect_num --ci-metric-checker-expect-num int — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
ci_save_grad_norm --ci-save-grad-norm str — Not captured Parser option; subject to Core/model/runtime validation Inherited CI gradient-norm reference output.
ci_load_grad_norm --ci-load-grad-norm str — Not captured Parser option; subject to Core/model/runtime validation Inherited CI gradient-norm reference input.
ci_save_model_hash --ci-save-model-hash switch — false Parser option; subject to Core/model/runtime validation Inherited CI model-hash reference output.
ci_check_model_hash --ci-check-model-hash switch — false Parser option; subject to Core/model/runtime validation Inherited CI model-hash verification; not an ordinary Core training check.
freeze_indexer --freeze-indexer switch — false Parser option; subject to Core/model/runtime validation Inherited model indexer freezing control; no generic Core model support is implied.
custom_megatron_init_path --custom-megatron-init-path str — Not captured Parser option; subject to Core/model/runtime validation Megatron initialization hook; not called by the Core adapter.
custom_megatron_before_log_prob_hook_path --custom-megatron-before-log-prob-hook-path str — Not captured Parser option; subject to Core/model/runtime validation Megatron scoring hook; not called by the Core adapter.
custom_megatron_before_train_step_hook_path --custom-megatron-before-train-step-hook-path str — Not captured Parser option; subject to Core/model/runtime validation Megatron training-step hook; not called by the Core adapter.
custom_config_path --custom-config-path str — Not captured Invalid configuration: Adapter-owned; cannot override See pinned runtime help.
megatron_config --megatron-config str — Not captured Parser option; subject to Core/model/runtime validation See pinned runtime help.
padded_vocab_size --padded-vocab-size int — Not captured Parser option; subject to Core/model/runtime validation Inherited model vocabulary padding control; cannot substitute for a compatible HF/Core descriptor.
olmo_core_config --olmo-core-config value — Not captured Invalid configuration: Adapter-owned; cannot override Serialized CoreConfig injected by the adapter; cannot override directly.