Compartir comentarios
Las respuestas se generan en base a la documentación.

docker model start-runner

DescripciónStart Docker Model Runner (Docker Engine only)
Usodocker model start-runner

Descripción

This command starts the Docker Model Runner without pulling container images. Use this command to start the runner when you already have the required images locally.

For the first-time setup or to ensure you have the latest images, use docker model install-runner instead.

Opciones

OpciónPredeterminadoDescripción
--backendSpecify backend (llama.cpp|vllm|diffusers). Default: llama.cpp
--debugEnable debug logging
--do-not-trackDo not track models usage in Docker Model Runner
--gpuautoSpecify GPU support (none|auto|cuda|rocm|musa|cann)
--host127.0.0.1Host address to bind Docker Model Runner
--portDocker container port for Docker Model Runner (default: 12434 for Docker Engine, 12435 for Cloud mode)
--proxy-certPath to a CA certificate file for proxy SSL inspection
--tlsEnable TLS/HTTPS for Docker Model Runner API
--tls-certPath to TLS certificate file (auto-generated if not provided)
--tls-keyPath to TLS private key file (auto-generated if not provided)
--tls-portTLS port for Docker Model Runner (default: 12444 for Docker Engine, 12445 for Cloud mode)