bind9/bin/tests/system/pytest.ini

# Copyright (C) Internet Systems Consortium, Inc. ("ISC")
#
# SPDX-License-Identifier: MPL-2.0
#
# This Source Code Form is subject to the terms of the Mozilla Public
# License, v. 2.0.  If a copy of the MPL was not distributed with this
# file, you can obtain one at https://mozilla.org/MPL/2.0/.
#
# See the COPYRIGHT file distributed with this work for additional
# information regarding copyright ownership.

[pytest]
addopts = --tb=short -rA -vv
log_format = %(asctime)s %(levelname)s:%(name)s %(message)s
log_date_format = %Y-%m-%d %H:%M:%S
log_cli = 1
log_level = INFO
python_files = tests_*.py
junit_logging = log
junit_log_passing_tests = 0
markers =
    requires_zones_loaded: ensures the test does not start until the specified named instances load all configured zones
    algorithm_set: use to select desired algorithms from isctest/vars/algorithms.py
    extra_artifacts: list of files (globs) that are expected to appear in the test directory after the test is run
Collect existing tests in pytest runner Ensure pytest picks up our python test modules, since we're using tests_*.py convention, which is different from the default. Configure pytest logging to display the output from all tests (even the ones that passed). This ensures we have sufficient amount of information to debug test post-mortem just from the artifacts. 2023-01-12 10:26:25 -05:00			`# Copyright (C) Internet Systems Consortium, Inc. ("ISC")`
			`#`
			`# SPDX-License-Identifier: MPL-2.0`
			`#`
			`# This Source Code Form is subject to the terms of the Mozilla Public`
			`# License, v. 2.0. If a copy of the MPL was not distributed with this`
			`# file, you can obtain one at https://mozilla.org/MPL/2.0/.`
			`#`
			`# See the COPYRIGHT file distributed with this work for additional`
			`# information regarding copyright ownership.`

			`[pytest]`
Make pytest a bit more verbose The "-vv" option gives us full untruncated diffs of compared data strustures. 2024-02-21 12:02:05 -05:00			`addopts = --tb=short -rA -vv`
Collect existing tests in pytest runner Ensure pytest picks up our python test modules, since we're using tests_*.py convention, which is different from the default. Configure pytest logging to display the output from all tests (even the ones that passed). This ensures we have sufficient amount of information to debug test post-mortem just from the artifacts. 2023-01-12 10:26:25 -05:00			`log_format = %(asctime)s %(levelname)s:%(name)s %(message)s`
			`log_date_format = %Y-%m-%d %H:%M:%S`
			`log_cli = 1`
			`log_level = INFO`
			`python_files = tests_*.py`
Include logs from failing tests in JUnit output 2023-03-17 08:20:59 -04:00			`junit_logging = log`
			`junit_log_passing_tests = 0`
Add wait_for_zones_loaded fixture The wait_for_zones_loaded fixture waits for the "all zones loaded" message in the named log file before the test function can proceed. 2023-12-19 09:58:36 -05:00			`markers =`
			`requires_zones_loaded: ensures the test does not start until the specified named instances load all configured zones`
Move test algorithm configuration to isctest Instead of invoking get_algorithms.py script repeatedly (which may yield different results), move the algorithm configuration to an isctest module. This ensures the variables are consistent across the entire test run. 2024-01-04 11:27:32 -05:00			`algorithm_set: use to select desired algorithms from isctest/vars/algorithms.py`
Add pytest fixture for checking test artifacts Prior to introducing the pytest runner, clean.sh files were used as a list of files that the test is expected to leave around as artifacts and check that no extra files were created. With the pytest runner, those scripts are no longer used, but the ability to detect extraneous files is still useful. Add a new "extra_artifacts" mark which can be used for the same purpose. 2024-08-19 12:49:08 -04:00			`extra_artifacts: list of files (globs) that are expected to appear in the test directory after the test is run`