# docker model bench

**Descripción:** Benchmark a model's performance at different concurrency levels

**Uso:** `docker model bench MODEL`










## Descripción

Benchmark a model's performance showing tokens per second at different concurrency levels.

This command runs a series of benchmarks with 1, 2, 4, and 8 concurrent requests by default,
measuring the tokens per second (TPS) that the model can generate.


## Opciones

| Opción                                                        | Predeterminado                                        | Descripción                                                                                                                                    |
| ------------------------------------------------------------- | ----------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|  | `--concurrency` | `[1,2,4,8]` |  Concurrency levels to test |

 | `--duration` | `30s` |  Duration to run each concurrency test |

 | `--json` |  |  Output results in JSON format |

 | `--prompt` | `Write a comprehensive 100 word summary on whales and their impact on society.
` |  Prompt to use for benchmarking |

 | `--timeout` | `5m0s` |  Timeout for each individual request |