← Packages
python-optimum-benchmark
unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers
- Current
- 0.6.0
- License
- Apache-2.0
RuntimeDeps
| Dependency | Observed source | Current requirement |
|---|---|---|
1.13.0 | ||
6.10.1 | ||
5.0.1 | ||
0.5.0 | ||
1.5.1 | ||
1.16.0 | ||
1.3.8 | ||
13.595.45 | ||
2.3.1 | ||
3.0.1 | ||
7.2.2 | ||
15.0.0 | ||
5.12.1 | ||
4.16.0 | ||
3.14.9 |
Optional RuntimeDeps
| Dependency | Observed source | Current requirement |
|---|---|---|
bitsandbytesUnmapped | — | |
3.2.6 | ||
0.19.6 | ||
0.38.0 | ||
flash-attnUnmapped | — | |
gptqmodelUnmapped | — | |
1.16.0 | ||
hydra-joblib-launcherUnmapped | — | |
intel-extension-for-pytorchUnmapped | — | |
llama-cpp-pythonUnmapped | — | |
4.0.3 | ||
2.1.0 | ||
2.1.0 | ||
2.1.0 | ||
2.1.0 | ||
2.1.0 | ||
0.19.1 | ||
py-txiUnmapped | — | |
9.0.3 | ||
ruffUnmapped | — | |
5.4.1 | ||
1.0.28 | ||
2.13.0 | ||
torchaoUnmapped | — | |
torchcodecUnmapped | — | |
0.27.1 |
Dependency conditions
- Applies when (any)
- extra == "bitsandbytes"
- Applies when (any)
- extra == "codecarbon"extra == "dev"
- Applies when (any)
- extra == "deepspeed"
- Applies when (any)
- extra == "diffusers"
- Applies when (any)
- extra == "flash-attn"
- Applies when (any)
- extra == "gptqmodel"
- Applies when (any)
- extra == "tensorrt-llm"
- Applies when (any)
- extra == "dev"
- Applies when (any)
- extra == "ipex"
- Applies when (any)
- extra == "llama-cpp"
- Applies when (any)
- extra == "dev"
- Applies when (any)
- extra == "gptqmodel"
- Applies when (any)
- extra == "ipex"
- Applies when (any)
- extra == "onnxruntime"
- Applies when (any)
- extra == "onnxruntime-gpu"
- Applies when (any)
- extra == "openvino"
- Applies when (any)
- extra == "peft"
- Applies when (any)
- extra == "py-txi"
- Applies when (any)
- extra == "dev"
- Applies when (any)
- extra == "dev"
- Applies when (any)
- extra == "sentence-transformers"
- Applies when (any)
- extra == "timm"
- Applies when (any)
- extra == "ipex"
- Applies when (any)
- extra == "torchao"
- Applies when (any)
- sys_platform != "win32" and extra == "dev"
- Applies when (any)
- extra == "vllm"
Description
Optimum-Benchmark is a unified multi-backend utility for benchmarking Transformers, Timm, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
Changelog
PR · 1
Checks
| Monitor | Observation | Last checked |
|---|---|---|
Checked | ||
Checked | ||
Checked | ||
Checked | ||
Not configured No reliable monitor identity/configuration. | — | |
Not applicable No confirmed version upgrade; this monitor is not run. | — | |
Checked | Last attempted | |
Checked Current source component only; local patches, build options, bundled dependencies and binary artifacts are not evaluated. | ||
Checked |