CLICK-EXTRA-TEST-SUITE(1) CLICK-EXTRA-TEST-SUITE(1)

click-extra test-suite - Run declarative CLI test cases against a command or binary.

click-extra test-suite [OPTIONS]

Run declarative CLI test cases against a command or binary.

Resolves the suite by precedence: --suite-file or --suite-envvar, then the [tool.click-extra.test-suite] config (cases, then file), then a built-in default. Each case invokes the target with its parameters and checks the exit code and output.

Cases run in parallel by default (see --jobs): each is an independent process invocation, so they overlap well. Pass --jobs max to use every logical core, or --jobs 1 for sequential execution, which lets --exit-on-error stop on the first failure.

On an interactive terminal a spinner reports how many cases have finished. It stays silent in pipes and CI logs, and --no-progress or --accessible turns it off.

Path to the binary file to test, or a command line to be executed.
[required]
Path to a test suite file; its format is taken from the extension (YAML, TOML, JSON, JSON5, JSONC, Hjson). Repeat to run multiple suites in sequence. Without any suite source, a built-in default suite runs.
Name of an environment variable holding a test suite in YAML. Repeat to collect multiple suites.
Only run the cases with these 1-based numbers. Repeat to select several; omit to run them all.
Skip cases on these platforms. Repeat to skip several.
Exit instantly on the first failed case (sequential runs only).
Default timeout for each CLI call, unless the case sets its own.
Show the execution trace of failed cases.
Print the worker summary and the result tally.
Measure and print elapsed execution time.
Location of the configuration file. Supports local path with glob patterns or remote URL.
Ignore all configuration files and only use command line parameters and environment variables.
Validate the configuration file and exit.
Export the configuration in the selected format to <stdout>, then exit.
Accessibility mode: disable colors and render tables in a plain, screen-reader-friendly format.
Colorize the output. A bare --color is the same as --color=always.
Disable colorization (alias of --color=never).
Show progress indicators during long operations. Disabled for non-interactive output (pipes, dumb terminals, CI) and by --accessible.
Color theme used for help screens.
Show all CLI parameters, their provenance, defaults and value, then exit.
Rendering style of tables.
Either CRITICAL, ERROR, WARNING, INFO, DEBUG.
Show the command's man page (roff) and exit.
Show the version and exit.
Number of parallel jobs. Accepts an integer, 'auto' (one fewer than the host's logical CPUs) or 'max' (all logical CPUs). 0 runs sequentially.
Show this message and exit.

Path to the binary file to test, or a command line to be executed.
Path to a test suite file; its format is taken from the extension (YAML, TOML, JSON, JSON5, JSONC, Hjson). Repeat to run multiple suites in sequence. Without any suite source, a built-in default suite runs.
Name of an environment variable holding a test suite in YAML. Repeat to collect multiple suites.
Only run the cases with these 1-based numbers. Repeat to select several; omit to run them all.
Skip cases on these platforms. Repeat to skip several.
Exit instantly on the first failed case (sequential runs only).
Default timeout for each CLI call, unless the case sets its own.
Show the execution trace of failed cases.
Print the worker summary and the result tally.
Measure and print elapsed execution time.
Location of the configuration file. Supports local path with glob patterns or remote URL.
Validate the configuration file and exit.
Export the configuration in the selected format to <stdout>, then exit.
Accessibility mode: disable colors and render tables in a plain, screen-reader-friendly format.
Colorize the output. A bare --color is the same as --color=always.
Disable colorization (alias of --color=never).
Show progress indicators during long operations. Disabled for non-interactive output (pipes, dumb terminals, CI) and by --accessible.
Color theme used for help screens.
Show all CLI parameters, their provenance, defaults and value, then exit.
Rendering style of tables.
Either CRITICAL, ERROR, WARNING, INFO, DEBUG.
Show the command's man page (roff) and exit.
Show the version and exit.
Number of parallel jobs. Accepts an integer, 'auto' (one fewer than the host's logical CPUs) or 'max' (all logical CPUs). 0 runs sequentially.
Show this message and exit.

~/.config/click-extra/{*.toml,*.yaml,*.yml,*.json,*.json5,*.jsonc,*.hjson,*.ini,*.xml,pyproject.toml}

0
Success.
1
A runtime error, or an aborted prompt (Ctrl-C, a declined confirmation).
2
A usage error: unknown option, invalid value, missing operand, or an unparsable configuration file.

Kevin Deldycke

2026-07-07 8.3.0.dev0