Commit graph

280 commits

Author SHA1 Message Date
Jacob Hoffman-Andrews
d5f1edf2bb Dump Boulder logs on integration test failures. (#4442)
Might help debug #4363.

Also:

make "bash" vs "sh" explicit
move the paranoia flags (-ex) from the shebang into the body
add -u (fail on unset variables)
change _common to work with -u
remove some env vars that were no longer used
remove shebang from _common.sh because it's meant to be sourced, not run
2017-03-29 16:48:08 -07:00
Yen Chi Hsuan
6fb78dab67 Fix Docker IP detection with different ifconfig output formats (#4376) 2017-03-29 13:34:09 -07:00
Brad Warren
5e6a6f51d3 Fix test_leauto_upgrades.sh (#4278)
* fix-test-leauto-upgrades

* redirect stderr

* redirect stderr part 2
2017-03-02 10:31:37 -08:00
Brad Warren
0d8a4b4ebd Make mod-check more flexible (#4268)
* fixes #4166

* Run mod-check from anywhere

* pass TRAVIS_BRANCH through in tox
2017-02-28 15:17:07 -08:00
Erica Portnoy
52ce335ff0 lineage_for_certname should return None if there is no existing renewal file (#4243)
* lineage_for_certname should return None if there is no existing renewal file

* add unit test

* add regression test to integration test

* revent boulder-start to boulder-fetch
2017-02-23 18:31:23 -08:00
Jacob Hoffman-Andrews
ebf5170d12 Update testing docs. (#4211)
Recommend faster-running commands with clearer output first, building up to
slow, noisy, `tox` last.

Remove outdated Boulder testing advice, and outdated Boulder testing scripts
(Vagrantfile, mac-bootstrap.sh, boulder-start.sh). Update Boulder testing
section.

Fill out "directory structure" section of contributing guide a little better.
2017-02-16 12:39:17 -08:00
Jacob Hoffman-Andrews
94aa562cf2 Use latest Boulder for Travis tests. (#4180) 2017-02-14 21:19:18 -08:00
Brad Warren
7f3c732bbf Cleanup test farm tests and add test_sdists (#4089)
* add get_certbot_version.sh

* Use get_certbot_version.sh in build.py

* make test_leauto_upgrades.sh more robust

* auto upgrades break tests

* OCSP experimental is not needed anymore

* Add test_sdists.sh

* Use LE_AUTO_VERSION, not repo version

* install OS deps earlier

* use readlink not realpath

* undo changes to build.py

* Factor out version code from build.py

* Use version.py in test_sdists

* Remove get_certbot_version

* workaround setuptools breakage
2017-01-30 19:37:23 -08:00
Josh Soref
6a39a42f45 Spelling (#4101)
* spelling: action

* spelling: artifacts

* spelling: asymmetric

* spelling: attempts

* spelling: bizarre

* spelling: certbot

* spelling: certificate

* spelling: certainly

* spelling: challenge

* spelling: client

* spelling: collated

* spelling: correct

* spelling: considered

* spelling: custom

* spelling: distinguish

* spelling: encoding

* spelling: enhancement

* spelling: equivalent

* spelling: execution

* spelling: existence

* spelling: failed

* spelling: handshake

* spelling: hyphen

* spelling: initialized

* spelling: initialization

* spelling: interpretation

* spelling: letsencrypt

* spelling: multiline

* spelling: multipart

* spelling: necessary

* spelling: otherwise

* spelling: output

* spelling: overridden

* spelling: positives

* spelling: preferable

* spelling: progress

* spelling: recommended

* spelling: referring

* spelling: relativity

* spelling: request

* spelling: requiring

* spelling: separate

* spelling: source

* spelling: specified

* spelling: standard

* spelling: successfully

* spelling: unparseable

* spelling: useful
2017-01-26 16:21:54 -08:00
Brad Warren
fe03c5a14c fix integration tests (#4111) 2017-01-26 14:08:22 -08:00
Brad Warren
4d860b37b0 Preserve preferred-challenges on renewal (#4112)
* use challenge type strings, not objectS

* Factor out parse_preferred_challenges

* restore pref_challs

* save pref_challs

* Make CheckCertCount more flexible

* improve integration tests

* Make pref_challs more flexible
2017-01-25 18:40:22 -08:00
Brad Warren
44f2d4aa20 Fix modification-check.sh (#4091)
* Run build.py

* Restore letsencrypt-auto after running build

* Remove temp_dir before exiting

* add missing $
2017-01-24 14:37:41 -08:00
Craig Smith
fe358600ab Add cleanup trap to integration test script (#4075)
The integration test script spins up Python webservers. This trap will
ensure that those webservers are shutdown at exit.
2017-01-18 10:41:53 -08:00
Blake Griffith
49d46ef99a Impelment account deactivation [revision requested] (#3571)
Impelment account deactivation
2017-01-17 16:00:07 -08:00
Craig Smith
94c23479e2 Add option to specify revocation reason (#3242) (#3988)
This includes two new tests in the integration test script to check that
boulder gets the correct code. The encoding is specified in RFC5280
5.3.1. The codes that boulder will accept are a subset of that,
specified in `boulder.revocation.reasons.go`.
2017-01-11 18:26:55 -08:00
Lipis
bba5d7d950 Rename OS X -> macOS (#3965)
* Rename OS X -> macOS

* Revert *-auto
2017-01-10 12:24:15 -08:00
Brad Warren
13ed5c06ea Merge pull request #3956 from certbot/ocsp
Further OCSP improvements
2017-01-05 16:05:19 -05:00
Brad Warren
2e23a295d3 Use sudo... 2017-01-05 11:47:28 -08:00
Brad Warren
3b460cea71 cleanup test scripts 2017-01-05 11:40:59 -08:00
Brad Warren
6923e2eb03 change != to -ne 2017-01-05 11:17:20 -08:00
Brad Warren
f6289dbba8 Correct path to venv 2017-01-05 11:12:36 -08:00
Peter Eckersley
3e7f64dfe8 Pre-release variant of OCSP testing 2017-01-04 17:53:41 -08:00
Brad Warren
05afb54522 Fix and cleanup CheckHooks 2017-01-04 13:39:46 -08:00
Brad Warren
7fb4e6627c HOOK_TEST++ 2017-01-04 13:12:50 -08:00
Brad Warren
42b0188519 Merge branch 'master' into save-more-hooks 2017-01-04 12:24:53 -08:00
Peter Eckersley
f4baf1fc39 Fix test 2016-12-23 10:48:14 -08:00
Peter Eckersley
b02ce53354 Test farm tests for openssl-based revocation checking 2016-12-23 00:20:38 -08:00
Peter Eckersley
0bcbf1d0a7 WIP 2016-12-22 23:07:00 -08:00
Brad Warren
39f5551305 Merge the manual and script plugins (#3890)
* Start of combined manual/script plugin

* Return str from hooks.execute, not bytes

* finish manual/script rewrite

* delete old manual and script plugins

* manually specify we want chall.token

* use consistent quotes

* specify chall for uri

* s/script/hook

* fix spacing on instructions

* remove unneeded response argument

* make achall more helpful

* simplify perform

* remove old test files

* add start of manual_tests

* fix ParseTest.test_help

* stop using manual_test_mode in cli tests

* Revert "make achall more helpful"

This reverts commit 54b01cea30.

* use bad response/validation methods on achalls

* simplify perform and cleanup environment

* finish manual tests

* Add HTTP manual hook integration test

* add manual http scripts

* Add manual DNS script integration test

* remove references to the script plugin

* they're hooks, not scripts

* add --manual-public-ip-logging-ok to integration tests

* use --pref-chall for dns integration

* does dns work?

* validate hooks

* test hook validation

* Revert "does dns work?"

This reverts commit 1224cc2961.

* busy wait in manual-http-auth

* remove DNS script test for now

* Fix challenge prefix and add trailing .

* Add comment about universal_newlines

* Fix typo from 0464ba2c4

* fix nits and typos

* Generalize HookCOmmandNotFound error

* Add verify_exe_exists

* Don't duplicate code in hooks.py

* Revert changes to hooks.py

* Use consistent hook error messages
2016-12-22 08:24:08 -08:00
Brad Warren
ae379568b1 Mitigate problems for people who run without -n (#3916)
* CLI flag for forcing interactivity

* add --force-interactive

* Add force_interactive error checking and tests

* Add force_interactive parameter to FileDisplay

* add _can_interact

* Add _return_default

* Add **unused_kwargs to NoninteractiveDisplay

* improve _return_default assertion

* Change IDisplay calls and write tests

* Document force_interactive in interfaces.py

* Don't force_interactive with a new prompt

* Warn when skipping an interaction for the first time

* add specific logger.debug message
2016-12-19 12:45:40 -08:00
Peter Eckersley
0c2dc60484 Integration tests for hooks 2016-12-15 17:28:16 -08:00
Peter Eckersley
93f0846fa4 Testfarm test new leauto (#3845)
Test farm tests should test the version of letsencrypt-auto that's in the git tree, not the one from the previous release.


* Test the new leauto, not the previously released one
2016-12-05 09:09:43 -08:00
Amjad Mashaal
88a2c5a8f6 Testing the output of build.py against lea-source/lea (#3460)
* Testing the output of build.py against lea-source/lea

* Replacing realpath with readlink
2016-10-28 10:50:07 -07:00
Jacob Hoffman-Andrews
88076e46c7 Improve debug logs. (#3126)
Print request and response bodies with newlines, rather than all on one line.
Remove "Omitted empty field" log, which gets logged meaninglessly for every JSON
serialization.
Remove duplicated logging of responses.
Log the base64 version of the nonce, rather than turning it into bytes and
logging the backslash-escaped version of those bytes.
Only pass -vv in tests.
2016-10-26 18:07:33 -07:00
Erica Portnoy
d54cb76432 Remove the curses dialog, thereby deprecating the --help and --dialog command line options (#3665)
* Remove the curses dialog, thereby deprecating the --help and --dialog command line options

* Deprecate --dialog and suppress --text
2016-10-21 15:45:57 -07:00
Brad Warren
91deb6ec53 Add test_tests.sh (#3633) 2016-10-17 13:11:24 -07:00
Brad Warren
a5df9e5a0e Only verify required ports are available (#3608)
* only verify port is available when you actually need it

* refactor code to create achalls

* Test port checks are based on achall

* test that only the port for the requested challenge is checked in standalone
2016-10-10 18:44:39 -07:00
Peter Eckersley
3c85ecbfee Test farm test fixes (#3582) 2016-10-04 16:45:24 -07:00
Brad Warren
a54d9061ba Merge pull request #3342 from TheNavigat/test-modification
Adding modification check against the current /letsencrypt-auto
2016-08-29 10:16:20 -07:00
Amjad Mashaal
cd5b91e4ae Adding root certbot-auto to modification check 2016-08-27 19:14:42 +02:00
Brad Warren
fd1629e347 Make letstest docker ip more robust 2016-08-10 11:51:12 -07:00
Brad Warren
dd1de2bc9e Fix travis 2016-08-10 11:49:55 -07:00
Amjad Mashaal
1fdf41e636 Adding modification check against the current /letsencrypt-auto 2016-08-04 14:22:20 +02:00
Ben Irving
61b77766c2 Add integration test cases for must staple and ECDSA (#3158) 2016-06-14 11:28:29 -07:00
Jacob Hoffman-Andrews
0fb3704dce Use a real branch name. 2016-05-25 15:43:54 -07:00
Jacob Hoffman-Andrews
94588b1a91 Check out a specific version of Boulder.
A recent Boulder change broke integration tests, this fixes it.
2016-05-25 15:23:56 -07:00
bmw
dda48b50b0 Merge pull request #3009 from sagi/fix_cert_path
certonly subcommand - If cert_path provided - do not uniquify  it
2016-05-25 12:47:56 -07:00
Jacob Hoffman-Andrews
c01e2c259a Check out Boulder master instead of branch. 2016-05-24 15:38:03 -07:00
sagi
b54497d814 Fix chain filename 2016-05-24 19:33:13 +00:00
Jacob Hoffman-Andrews
2cfcfd6988 Run Boulder via docker-compose in tests.
This removes a lot of setup code we used to need in order to get Boulder to run,
and should reduce brittleness of tests based on Boulder changes.

This also unblocks Boulder from upgrading to MariaDB 10.1 in integration tests,
since changing to 10.1 syntax for user creation would break the current certbot
integration tests (which run 10.0).
2016-05-23 18:40:25 -07:00
sagi
c0228ef1aa Boulder integration scripts provides a cert_path 2016-05-16 22:11:15 +00:00
Brad Warren
5c0eabcd76 Rename LETSENCRYPT_PATH to CERTBOT_PATH 2016-05-06 17:42:25 -07:00
Brad Warren
4627971dc6 s/--letsencrypt/--certbot 2016-05-06 17:30:18 -07:00
Brad Warren
3780d068d1 Fix test farm tests 2016-04-19 14:11:17 -04:00
Noah Swartz
842b609dad Merge pull request #2841 from letsencrypt/module-rename
Module rename
2016-04-14 17:35:09 -07:00
Brad Warren
e353f8fabc letstest is a Certbot integration test tool 2016-04-14 17:16:48 -07:00
Brad Warren
b4f6ed8470 rename letstest stuff 2016-04-14 17:10:27 -07:00
Brad Warren
75a1d81458 More stray ncrypt reference cleanup 2016-04-14 17:04:23 -07:00
Brad Warren
ae6f1c62f1 Rename misc files 2016-04-14 10:20:23 -07:00
Brad Warren
7228c0c9ed 'co' is not a git command 2016-04-14 08:57:34 -07:00
Brad Warren
a43fac3277 s/letsencrypt/certbot letsencrypt-nginx tests 2016-04-13 16:45:54 -07:00
Eric Engestrom
2f3035de0e Fix spelling mistakes 2016-04-02 15:50:09 +01:00
Kane York
902ab9afdf Work around leap day bug in parsedatetime 2016-02-29 10:58:14 -08:00
Peter Eckersley
f4c33656a2 Try to finally prevent dangling AWS volumes 2016-02-23 12:08:01 -08:00
Peter Eckersley
607c48d0a3 [test farm] Fix use of the newleauto in test_letsencrypt_auto_certonly_standalone.sh 2016-02-15 12:08:20 -08:00
Peter Eckersley
29737ab2ca More hacky fixes 2016-02-10 19:24:25 -08:00
Peter Eckersley
1f31cf1a30 Quick test farm fix 2016-02-10 19:09:05 -08:00
Peter Eckersley
0513af83f4 Test CLI flag setting from renewal integration tests
Closes: #2411
2016-02-09 16:09:02 -08:00
Peter Eckersley
3a3d778f3d Merge pull request #2383 from erikrose/replace-le-auto
Make the new letsencrypt-auto script the main one. [requires minor revision]
2016-02-09 09:21:49 -08:00
Brad Warren
0fa61f4192 Use common and add verb 2016-02-08 18:46:24 -08:00
Brad Warren
8b613eed8f Pass additional args to letsencrypt_test_no_force_renew 2016-02-08 18:39:59 -08:00
Brad Warren
2170c8d7d2 Move * outside of " 2016-02-08 18:35:44 -08:00
Brad Warren
e798b62d2e Testing cleanup 2016-02-08 18:18:48 -08:00
Brad Warren
7a902daa9f duplication-- 2016-02-08 18:14:29 -08:00
Brad Warren
70402790a3 Use --non-interactive instead of --text 2016-02-08 18:07:56 -08:00
Brad Warren
8eb889d942 Make CheckCertCount check cert counts 2016-02-08 17:55:28 -08:00
Brad Warren
38a6d44279 Remove round echos 2016-02-08 17:54:39 -08:00
Brad Warren
bb2f054f1b Take boulder-integration.sh from #2398 2016-02-08 17:54:02 -08:00
Seth Schoen
fd3d2fa822 Make _no_force_renew not force renewal 2016-02-05 17:19:39 -08:00
Seth Schoen
8b02f485b0 Have a way not to force renewal in integration test 2016-02-05 17:13:30 -08:00
Seth Schoen
09337517d3 Try to distinguish renew and non-renew in integration test 2016-02-05 16:57:41 -08:00
Erik Rose
505e66b57c Move the venv setup scripts to the tools folder.
They were the last things left in the bootstrap folder, and they were lonely.
2016-02-05 18:31:41 -05:00
Erik Rose
192c3faf7e Make the new letsencrypt-auto script the main one.
Remove the old bootstrap scripts, which have been subsumed into letsencrypt-auto-source/pieces/bootstrappers. They no longer need to be dispatched among manually: everyone can just run letsencrypt-auto --os-packages-only, regardless of OS.

Make the root-level le-auto a symlink to the canonical version. It should thus still work for people running le-auto from a git checkout.
2016-02-05 15:28:11 -05:00
Seth Schoen
375543eb32 Hoping to see if integration test is really renewing 2016-02-04 14:43:05 -08:00
Noah Swartz
dc9a51b2e6 make a robust test script 2016-02-04 09:38:45 -08:00
Noah Swartz
8fdcb772d9 return failure 2016-02-04 09:29:11 -08:00
Noah Swartz
1c52e1982c made test for renew verb 2016-02-03 17:49:08 -08:00
Brad Warren
fd4d390ac2 No renewer test 2016-02-03 14:52:23 -08:00
Seth Schoen
a706f5c8c0 Try to add the new renew verb to integration testing 2016-02-03 13:53:42 -08:00
Roy Wellington Ⅳ
9c28364477 Make exception syntax Python 3 compatible.
Translate all except and raise statements that are in the old form to
the Python 3 compatible format.
2016-01-30 19:53:50 -08:00
Peter Eckersley
b7c33ceeb8 Merge branch 'master' into leauto-upgrades 2016-01-27 15:35:46 -08:00
Peter Eckersley
904f44864e rm stray print 2016-01-22 16:44:54 -08:00
Peter Eckersley
b8281fdd34 Retry in case of ephemeral errors 2016-01-20 14:25:01 -08:00
Peter Eckersley
122a36ebd2 the || isn't right for update 2016-01-20 14:22:28 -08:00
Peter Eckersley
15cc9e1826 [test_leauto_upgrades] actually use everything from v0.1.0 for setup 2016-01-20 14:17:24 -08:00
Peter Eckersley
fffe965d68 Merge pull request #2018 from letsencrypt/faster-testfarm
[letstest] create and reuse a persistent boulder AMI
2016-01-07 07:40:42 -08:00
Peter Eckersley
b6531afb8d Merge pull request #1992 from letsencrypt/apache-conf-test
Apache conf tests in travis
2016-01-02 17:49:38 -08:00
Peter Eckersley
df56e850d3 Merge remote-tracking branch 'origin/master' into faster-testfarm 2015-12-25 11:38:43 -08:00
Peter Eckersley
3e1bc19e0f Optional flag for faster AMIs 2015-12-25 10:43:52 -08:00
Peter Eckersley
6029bd5fe4 Merge pull request #2013 from letsencrypt/testfarm
Fixes to test farm scripts
2015-12-25 03:20:15 -08:00