certbot/tests
Brad Warren 8b684e9b95
Enable test farm tests in Travis (#7072)
You can see the full test suite running at https://travis-ci.com/certbot/certbot/builds/112291892.

A few noteworthy things:

--fast is included because without, the tests would sometimes reach Travis' 50 minute timeout even with 1 test script per Travis build.
The only script that is run at release time which is not being run here is https://github.com/certbot/certbot/blob/master/tests/letstest/scripts/test_tests.sh because that script runs tests on the packages installed by certbot-auto which won't be updated until midway through a release.
We check TRAVIS_PULL_REQUEST and error out if it is not false for simplicity which should be fine because these tests are never run on PRs. The reason it's more complex to run test farm tests on PRs is the test farm tests need a named branch to pull from and Travis effectively merges the PR into the target branch before running tests complicating this.
I don't think this should block this PRs, but the one final change we may want to make to the current setup is #7071.

* Add encrypted private key.

* Add test farm tests to tox and travis.

* Change magic profile name.

* Further split test farm tests.

* Build local branch.

* more depth
2019-05-17 16:30:20 -07:00
..
integration [Unix] Create a framework for certbot integration tests: PART 5-FINAL (#6989) 2019-05-14 13:56:32 -07:00
letstest Enable test farm tests in Travis (#7072) 2019-05-17 16:30:20 -07:00
boulder-fetch.sh Remove tls-sni integration tests (#6852) 2019-03-13 15:42:07 -07:00
lock_test.py Fix the Nginx configuration during integration tests (#6801) 2019-03-01 13:54:09 -08:00
modification-check.py Fail-fast in test/cover/lint scripts (#6487) 2018-11-14 13:57:40 -08:00
pebble-fetch.sh [Unix] Create a framework for certbot integration tests: PART 5-FINAL (#6989) 2019-05-14 13:56:32 -07:00