upstream/bind9
1
0
Fork 0
mirror of https://github.com/isc-projects/bind9.git synced 2026-04-15 22:09:31 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
bind9/bin/tests/system/Makefile.am

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

205 lines
3.2 KiB
Makefile
Raw Normal View History

Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
include $(top_srcdir)/Makefile.top
Fix "make dist" Make various adjustments necessary to enable "make dist" to build a BIND source tarball whose contents are complete enough to build binaries, run unit & system tests, and generate documentation on Unix systems. Known outstanding issues: - "make distcheck" does not work yet. - Tests do not work for out-of-tree source-tarball-based builds. - Source tarballs are not complete enough for building on Windows. All of the above will be addressed in due course.
2020-06-04 13:02:27 -04:00
EXTRA_DIST = .
# Source tarballs must not contain configure/build artifacts.
dist-hook:
git clean -n -x -d | \
grep -v "Makefile.in$$" | \
sed -n "s|^Would remove \(.*\)|$(distdir)/\1|p" | \
xargs -I{} rm -rf "{}"
create system test with asynchronous plugin the test-async plugin uses ns_query_hookasync() at the NS_QUERY_DONE_SEND hook point to call an asynchronous function. the only effect is to change the query response code to "NOTIMP", so we can confirm that the hook ran and resumed correctly.
2020-11-19 20:58:45 -05:00
SUBDIRS = dyndb/driver dlzexternal/driver hooks/driver
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
AM_CPPFLAGS += \
import libdummyrpz test library for DNSRPS libdummyrpz is a limited version of the fastrpz library for use in testing the dnsrps API.
2023-03-13 15:47:00 -04:00
$(LIBISC_CFLAGS) \
$(LIBDNS_CFLAGS)
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
Move the include Makefile.tests to the bottom of Makefile.am(s) The Makefile.tests was modifying global AM_CFLAGS and LDADD and could accidentally pull /usr/include to be listed before the internal libraries, which is known to cause problems if the headers from the previous version of BIND 9 has been installed on the build machine.
2021-04-21 08:22:18 -04:00
LDADD += \
import libdummyrpz test library for DNSRPS libdummyrpz is a limited version of the fastrpz library for use in testing the dnsrps API.
2023-03-13 15:47:00 -04:00
$(LIBISC_LIBS) \
$(LIBDNS_LIBS)
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
if HAVE_PERL
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
if HAVE_PYTHON
if HAVE_PYTEST
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
Compile system test binaries during make Using check_PROGRAMS would postpone compiling the binaries needed by system tests until `make check` would be called. Since it's preferable to invoke pytest directly to run the system test suite, compile these binaries without installing them during `make all` instead by using noinst_PROGRAMS. This removes the need to use TESTS= make -e check hack invoked from pytest to work around this issue.
2023-08-07 10:59:11 -04:00
noinst_PROGRAMS = \
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
feature-test \
makejournal \
pipelined/pipequeries \
Remove DNSRPS implementation DNSRPS was the API for a commercial implementation of Response-Policy Zones that was supposedly better. However, it was never open-sourced and has only ever been available from a single vendor. This goes against the principle that the open-source edition of BIND 9 should contain only features that are generally available and universal. This commit removes the DNSRPS implementation from BIND 9. It may be reinstated in the subscription edition if there's enough interest from customers, but it would have to be rewritten as a plugin (hook) instead of hard-wiring it again in so many places.
2024-08-19 11:19:21 -04:00
rndc/gencheck
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
feature_test_CPPFLAGS = \
$(AM_CPPFLAGS) \
Add --have-fips-dh to feature-test Diffie-Hellman key echange doesn't appear to work in FIPS mode for OpenSSL 1.x.x. Add feature test (--have-fips-dh) to identify builds where DH key exchanges work (non FIPS builds and OpenSSL 3.0.0+) and exclude test that would otherwise fail.
2021-12-22 22:55:50 -05:00
$(LIBDNS_CFLAGS) \
$(OPENSSL_CFLAGS)
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
Add FIPS-detecting option to feature-test helper The '--have-fips' option of feature-test detects FIPS mode.
2020-10-20 06:12:00 -04:00
feature_test_LDADD = \
$(LDADD) \
$(LIBDNS_LIBS) \
$(OPENSSL_LIBS)
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
makejournal_CPPFLAGS = \
$(AM_CPPFLAGS) \
$(LIBDNS_CFLAGS)
makejournal_LDADD = \
$(LDADD) \
$(LIBDNS_LIBS)
pipelined_pipequeries_CPPFLAGS = \
$(AM_CPPFLAGS) \
$(LIBDNS_CFLAGS)
pipelined_pipequeries_LDADD = \
$(LDADD) \
$(LIBDNS_LIBS)
move samples/resolve.c to bin/tests/system "resolve" is used by the resolver system tests, and I'm not certain whether delv exercises the same code, so rather than remove it, I moved it to bin/tests/system.
2021-03-22 21:40:21 -04:00
Prioritize long-running system tests for legacy runner Synchronize the test priority with the pytest runner (which handles the prioritization in conftest.py).
2023-09-04 10:08:06 -04:00
# Longer running tests are listed (and executed) first to take the most
# advantage of parallel execution.
Use prereq.sh for rpzrecurse system test
2023-09-04 10:03:05 -04:00
TESTS = \
Prioritize long-running system tests for legacy runner Synchronize the test priority with the pytest runner (which handles the prioritization in conftest.py).
2023-09-04 10:08:06 -04:00
rpz \
rpzrecurse \
serve-stale \
timeouts \
upforwd \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
acl \
additional \
addzone \
allow-query \
auth \
autosign \
builtin \
cacheclean \
Add a CAMP test case This adds a new test directory specifically for CAMP attacks. This first test in this test directory follows multiple CNAME chains, restarting the max-recursion-queries counter, but should bail when the global maximum quota max-query-count is reached.
2024-11-25 10:27:21 -05:00
camp \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
case \
catz \
cds \
Use prereq.sh for chain system test
2023-09-04 10:05:10 -04:00
chain \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
checkconf \
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
checkds \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
checknames \
checkzone \
Use prereq.sh for qmin, cookie system tests
2023-09-04 09:34:05 -04:00
cookie \
Follow the number of CPU set by taskset/cpuset Administrators may wish to constrain the set of cores that BIND 9 runs on via the 'taskset', 'cpuset' or 'numactl' programs (or equivalent on other O/S), for example to achieve higher (or more stable) performance by more closely associating threads with individual NIC rx queues. If the admin has used taskset, it follows that BIND ought to automatically use the given number of CPUs rather than the system wide count. Co-Authored-By: Ray Bellis <ray@isc.org>
2024-08-22 11:23:09 -04:00
cpu \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
database \
Use prereq.sh for digdelv, dnssec, forward system tests
2023-09-04 09:38:25 -04:00
digdelv \
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
dispatch \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
dlzexternal \
dns64 \
Use prereq.sh for digdelv, dnssec, forward system tests
2023-09-04 09:38:25 -04:00
dnssec \
Remove redundant dependency checks for system tests Dependencies for these tests are already checked in prereq.sh - if the dependencies are missing, these tests will be skipped. The extra dependency check in Makefile.am is extraneous and only applied for the legacy test runner.
2023-09-04 07:41:09 -04:00
dnstap \
doth \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
dsdigest \
dyndb \
ecdsa \
Enable eddsa test It should be fixed now.
2021-02-03 05:33:31 -05:00
eddsa \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
ednscompliance \
emptyzones \
Rename engine_pkcs11 system test In order to have a common naming convention for system tests, rename the only outlier "engine_pkcs11" to "enginepkcs11", which was the only system test using an underscore in its name. The only allowed word separators for system test names are either dash or no separator.
2022-12-02 10:51:36 -05:00
enginepkcs11 \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
filter-aaaa \
Add prereq.sh scripts for system tests requiring perl mod DNS prereq.sh mechanism for dependency detection is preferred since it works for both legacy and pytest runner.
2023-09-04 07:56:28 -04:00
fetchlimit \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
formerr \
Use prereq.sh for digdelv, dnssec, forward system tests
2023-09-04 09:38:25 -04:00
forward \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
geoip2 \
glue \
idna \
Added test for the fix This test ensures that named will correctly shutdown when receiving multiple control connections after processing of either "rncd stop" or "kill -SIGTERM" commands. Before the fix, named was crashing due to a race condition happening between two threads, one running shutdown logic in named/server.c and other handling control logic in controlconf.c. This test tries to reproduce the above scenario by issuing multiple queries to a target named instance, issuing either rndc stop or kill -SIGTERM command to the same named instance, then starting multiple rndc status connections to ensure it is not crashing anymore.
2020-05-25 14:03:32 -04:00
include-multiplecfg \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
inline \
integrity \
Add prereq.sh scripts for system tests requiring perl mod DNS prereq.sh mechanism for dependency detection is preferred since it works for both legacy and pytest runner.
2023-09-04 07:56:28 -04:00
ixfr \
create system test with asynchronous plugin the test-async plugin uses ns_query_hookasync() at the NS_QUERY_DONE_SEND hook point to call an asynchronous function. the only effect is to change the query response code to "NOTIMP", so we can confirm that the hook ran and resumed correctly.
2020-11-19 20:58:45 -05:00
hooks \
Add checks for 'host'
2022-12-04 18:08:54 -05:00
host \
create 'journal' system test tests that version 1 journal files containing version 1 transaction headers are rolled forward correctly on server startup, then updated into version 2 journals. also checks journal file consistency and 'max-journal-size' behavior.
2021-02-22 18:17:54 -05:00
journal \
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
kasp \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
keepalive \
Add system test for dnssec-keyfromlabel Add missing system test for dnssec-keyfromlabel. Test for various algorithms that we can generate key files from a key that is stored in a HSM, and that those keys can be used for signing with dnssec-signzone.
2021-11-15 04:23:04 -05:00
keyfromlabel \
Add ksr system test Add a system test for testing dnssec-ksr, initally for the keygen command. This should be able to create or select key files given a DNSSEC policy and a time window.
2023-08-09 08:04:54 -04:00
ksr \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
legacy \
limits \
logfileconfig \
masterfile \
masterformat \
metadata \
mirror \
mkeys \
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
multisigner \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
names \
notify \
Support for NSEC3 in dnssec-policy Implement support for NSEC3 in dnssec-policy. Store the configuration in kasp objects. When configuring a zone, call 'dns_zone_setnsec3param' to queue an nsec3param event. This will ensure that any previous chains will be removed and a chain according to the dnssec-policy is created. Add tests for dnssec-policy zones that uses the new 'nsec3param' option, as well as changing to new values, changing to NSEC, and changing from NSEC.
2020-10-13 08:39:21 -04:00
nsec3 \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
nslookup \
Add prereq.sh scripts for system tests requiring perl mod DNS prereq.sh mechanism for dependency detection is preferred since it works for both legacy and pytest runner.
2023-09-04 07:56:28 -04:00
nsupdate \
Remove redundant dependency checks for system tests Dependencies for these tests are already checked in prereq.sh - if the dependencies are missing, these tests will be skipped. The extra dependency check in Makefile.am is extraneous and only applied for the legacy test runner.
2023-09-04 07:41:09 -04:00
nzd2nzf \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
padding \
pending \
System test for PROXYv2 This commit adds a system test suite for PROXYv2. The idea on which it is based is simple: 1. Firstly we check that 'allow-proxy' and 'allow-proxy-on' (whatever is using the new 'isc_nmhandle_real_localaddr/peeraddr()') do what they intended to do. 2. Anything else that needs an interface or peer address (ACL functionality, for example) is using the old 'isc_nmhandle_localaddr/peeraddr()' - which are now returning addresses received via PROXY (if any) instead of the real connection addresses. The beauty of it that we DO NOT need to verify every bit of the code relying on these functions: whatever works in one place will work everywhere else, as these were the only functions that allowed any higher level code to get peer and interface addresses. This way it is relatively easy to see if PROXYv2 works as intended.
2023-11-14 11:19:12 -05:00
proxy \
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
pipelined \
Use prereq.sh for qmin, cookie system tests
2023-09-04 09:34:05 -04:00
qmin \
Add a none parameter to query-source[-v6] This change adds a "none" parameter to the query-source[-v6] options in named.conf, which forbid the usage of IPv4 or IPv6 addresses when doing upstream queries.
2024-11-05 07:40:55 -05:00
query-source \
Use prereq.sh for reclimit system test
2023-09-04 09:15:34 -04:00
reclimit \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
redirect \
Add prereq.sh scripts for system tests requiring perl mod DNS prereq.sh mechanism for dependency detection is preferred since it works for both legacy and pytest runner.
2023-09-04 07:56:28 -04:00
resolver \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
rndc \
rootkeysentinel \
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
rpzextra \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
rrchecker \
rrl \
rrsetorder \
rsabigexponent \
runtime \
sfcache \
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
shutdown \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
smartsign \
spf \
staticstub \
Add prereq.sh scripts for system tests requiring perl mod DNS prereq.sh mechanism for dependency detection is preferred since it works for both legacy and pytest runner.
2023-09-04 07:56:28 -04:00
statistics \
Use prereq.sh for statschannel system test
2023-09-04 08:32:06 -04:00
statschannel \
Add prereq.sh scripts for system tests requiring perl mod DNS prereq.sh mechanism for dependency detection is preferred since it works for both legacy and pytest runner.
2023-09-04 07:56:28 -04:00
stress \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
stub \
synthfromdnssec \
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
tcp \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
tools \
Add transport-acl system test This commit adds a new system-test: transport-acl system test. It is intended to test the new, extended syntax for ACLs, the one where port or transport protocol can be specified. Currently, it includes the tests only using allow-transfer statement, as this extended syntax is used only there, at least for now.
2021-11-29 05:50:35 -05:00
transport-acl \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
tsig \
tsiggss \
ttl \
unknown \
verify \
views \
wildcard \
Use prereq.sh for xfer system test
2023-09-04 09:00:12 -04:00
xfer \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
xferquota \
Add prereq.sh scripts for system tests requiring perl mod DNS prereq.sh mechanism for dependency detection is preferred since it works for both legacy and pytest runner.
2023-09-04 07:56:28 -04:00
zero \
Add missing system test in Makefile Add the missing tests in the Makefile (include-multiplecfg kasp pkcs11 ttl). Also put them in alphabetical order.
2020-04-30 03:28:21 -04:00
zonechecks
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
else !HAVE_PYTEST
check:
echo pytest is not available, no tests were ran
exit 1
endif !HAVE_PYTEST
else !HAVE_PYTHON
check:
echo Python is not available, no tests were ran
exit 1
endif !HAVE_PYTHON
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
else !HAVE_PERL
check:
echo Perl is not available, no tests were ran
exit 1
endif !HAVE_PERL
Improve the LOG_DRIVER and LOG_COMPILER for the system tests There are several improvements over the default/previous behaviour of the test log driver and log compiler: * The system-test-driver.sh was dropped (it was used incorrectly) * The run.sh script is now both log compiler and cli script to run individual tests * The custom-test-driver was added as extended version of the automake test-driver with capability to tee the test output to stdout when `--verbose yes` is passed to it (you can use LOG_DRIVER_FLAGS to add the option by default) * Makefile.am has been extended to honor V=1 for the system tests test-driver (e.g. V=1 adds `--verbose yes` to AM_LOG_DRIVER_FLAGS)
2020-04-24 09:29:54 -04:00
LOG_DRIVER_V = $(LOG_DRIVER_V_@AM_V@)
LOG_DRIVER_V_ = $(LOG_DRIVER_V_@AM_DEFAULT_V@)
LOG_DRIVER_V_0 = --verbose no
LOG_DRIVER_V_1 = --verbose yes
Move custom-test-driver to bin/tests/system where it belongs
2020-05-06 08:47:57 -04:00
LOG_DRIVER = $(srcdir)/custom-test-driver
Improve the LOG_DRIVER and LOG_COMPILER for the system tests There are several improvements over the default/previous behaviour of the test log driver and log compiler: * The system-test-driver.sh was dropped (it was used incorrectly) * The run.sh script is now both log compiler and cli script to run individual tests * The custom-test-driver was added as extended version of the automake test-driver with capability to tee the test output to stdout when `--verbose yes` is passed to it (you can use LOG_DRIVER_FLAGS to add the option by default) * Makefile.am has been extended to honor V=1 for the system tests test-driver (e.g. V=1 adds `--verbose yes` to AM_LOG_DRIVER_FLAGS)
2020-04-24 09:29:54 -04:00
AM_LOG_DRIVER_FLAGS = $(LOG_DRIVER_V)
Use pytest runner for make check Make python & pytest required dependencies to run system tests and invoke the pytest runner from the makefile.
2023-08-31 07:15:24 -04:00
LOG_COMPILER = $(srcdir)/run.sh
Complete rewrite the BIND 9 build system The rewrite of BIND 9 build system is a large work and cannot be reasonable split into separate merge requests. Addition of the automake has a positive effect on the readability and maintainability of the build system as it is more declarative, it allows conditional and we are able to drop all of the custom make code that BIND 9 developed over the years to overcome the deficiencies of autoconf + custom Makefile.in files. This squashed commit contains following changes: - conversion (or rather fresh rewrite) of all Makefile.in files to Makefile.am by using automake - the libtool is now properly integrated with automake (the way we used it was rather hackish as the only official way how to use libtool is via automake - the dynamic module loading was rewritten from a custom patchwork to libtool's libltdl (which includes the patchwork to support module loading on different systems internally) - conversion of the unit test executor from kyua to automake parallel driver - conversion of the system test executor from custom make/shell to automake parallel driver - The GSSAPI has been refactored, the custom SPNEGO on the basis that all major KRB5/GSSAPI (mit-krb5, heimdal and Windows) implementations support SPNEGO mechanism. - The various defunct tests from bin/tests have been removed: bin/tests/optional and bin/tests/pkcs11 - The text files generated from the MD files have been removed, the MarkDown has been designed to be readable by both humans and computers - The xsl header is now generated by a simple sed command instead of perl helper - The <irs/platform.h> header has been removed - cleanups of configure.ac script to make it more simpler, addition of multiple macros (there's still work to be done though) - the tarball can now be prepared with `make dist` - the system tests are partially able to run in oot build Here's a list of unfinished work that needs to be completed in subsequent merge requests: - `make distcheck` doesn't yet work (because of system tests oot run is not yet finished) - documentation is not yet built, there's a different merge request with docbook to sphinx-build rst conversion that needs to be rebased and adapted on top of the automake - msvc build is non functional yet and we need to decide whether we will just cross-compile bind9 using mingw-w64 or fix the msvc build - contributed dlz modules are not included neither in the autoconf nor automake
2018-08-07 10:46:53 -04:00
Restore behaviour of "make test" and "make unit" Add recursive "test" and "unit" rules, which execute "make check" in specific directories - "make test" runs the system tests, and "make unit" runs the unit tests.
2020-04-23 19:22:21 -04:00
test-local: check
Add clean-local target to clean pytest runner artifacts The command finds all directories in bin/tests/system which contain an underscore. Underscore indicates either a temporary directory (_tmp_), a symlink to test artifacts (TESTNAME_MODULENAME), or a python-related cache. Using underscore for a system test name is invalid and a hyphen must be used instead.
2023-08-16 04:38:09 -04:00
clean-local::
Treat bin/tests/system/_common as non-temp directory The _common directory is a special case directory which contains shared files for other system test directories. Make sure it's tracked in git and not deleted during temporary directory cleanup.
2023-09-18 11:20:01 -04:00
-find -L . -mindepth 1 -maxdepth 1 -type d -name "*_*" -and -not -name "_common" -exec rm -rf {} \;
Reference in a new issue Copy permalink