Commit graph

232 commits

Author SHA1 Message Date
Brad Warren
00e143d369 Serialize coverage tests (#3919)
* Serialize coverage tests

* add py27_install env

* Separate cover from integration tests

* Add docker to py27 integration tests
2016-12-20 16:24:33 -08:00
Peter Eckersley
59c602d9ca Parallalelise nosetests from tox (#3836)
* Parallalelise nosetests from tox

* Parallelise even more things, break even more things

* Now unbreak all the tests that aren't ready for ||ism

* Try to pass tests!

 - Remove non-working hack in reporter_test
 - also be selective about ||ism in the cover environment

* Try again

* certbot-apache tests also work, given enough time

* Nginx may need more time in Travis's cloud

* Unbreak reporter_test under ||ism

* More timeout

* Working again?

* This goes way faster

* Another big win

* Split a couple more large test suites

* A last improvement

* More ||ism!

* ||ise lint too

* Allow nosetests to figure out how many cores to use

* simplify merge

* Mark the new CLI tests as ||izable

* Simplify reporter_test changes

* Rationalise ||ism flags

* Re-up coverage

* Clean up reporter tests

* Stop modifying testdata during tests

* remove unused os
2016-12-06 20:39:16 -08:00
Brad Warren
edbb3a73c6 Take advantage of urllib3 pyopenssl rewrite (#3805)
* pin requests version in py26-oldest

* Determine requests security deps dynamically

Starting with requests 2.12, pyasn1 and ndg-httpsclient are no longer
needed to inject pyopenssl into urllib3. This change allows us to
determine whether or not these dependencies are required at install
time. If an older version of requests is used, these packages are
still installed. If a new version of requests is used, they are not
reducing the number of dependencies we have.

* Bump requests version in certbot-auto

* Use pkg_resources in activate test

Due to pip's lack of dependency resolution, the change to use
requests[extras] causes errors in acme.util_test because pkg_resources
accurately detects the "missing" dependency.

There isn't a real problem here. The problem comes from a brand new
requests and ancient pyopenssl as well as a unit test for
functionality we plan to remove in our next release. I modified
the unit test to fix the problem for now.

* Use six instead of pkg_resources for test

* Require requests<=2.11.1 in py27-oldest test

If we don't do this, we get test failures for the certbot package
which is actually a good thing! pkg_resources is catching the
unlikely but possible problem I describe in #3803 and erroring out
saying it is missing the necessary dependencies to run certbot.
Good job package resources.

* Undo changes to acme.util_test
2016-12-01 10:47:08 -08:00
Brad Warren
494c305b04 pin requests version in py26-oldest (#3803) 2016-11-21 17:56:22 -08:00
Amjad Mashaal
1e27e43c14 Expanding tests for le-auto, adding CentOS test suite (#2671)
* Adding Dockerfile for CentOS 6

* Adding CentOS 7 to LEA tests

* Enabling CentOS 6 LEA test

* Removing CentOS 7

* Fixing nits

* Using yum to install epel-release
2016-11-10 15:05:03 -08:00
Amjad Mashaal
c89bd421da Expanding tests for le-auto, adding Debian test suite (#2635)
* Adding Debian 7 (Wheezy) to LE tests

* Adding Debian 8 (Jessie) to LE tests

* Fixing Debian Wheezy certificate addition error

* Adding packages to LEA Debian Jessie test and refining the code commenting

* Adding installing OpenSSL to the Debian Wheezy LEA test script

* Removing LEA tests for Debian Jessie

* Fixing nits
2016-11-10 14:01:15 -08:00
Amjad Mashaal
469fc3775f Expanding tests for le-auto, adding Ubuntu test suite (#2548)
* Adding Ubuntu Wily to LEA testing

* Setting up certs correctly for Ubuntu 15.10

* Adding 12.04

* Removing redundant update-ca-certificates from 12.04 le-auto testing script

* Fixing OpenSSL on Precise

* Adding Vivid to le_auto tests

* Cleaning up LEA tests configuration for Trusty

* Ordering LEA test entries in .travis.yml and renaming them correctly

* Removing Ubuntu Vivid

* Refining comments

* Removing Ubuntu Wily since it reached EOL

* Removing .travis.yml duplicates

* Fixing nits
2016-11-10 13:15:17 -08:00
Amjad Mashaal
3534e4cb1f Allowing modification check to run using "tox" (#3704)
#3337 and #3338 should ideally run when the user type tox. This allows them to catch the problem locally before they make a PR.
2016-10-28 15:05:25 -07:00
Erica Portnoy
d54cb76432 Remove the curses dialog, thereby deprecating the --help and --dialog command line options (#3665)
* Remove the curses dialog, thereby deprecating the --help and --dialog command line options

* Deprecate --dialog and suppress --text
2016-10-21 15:45:57 -07:00
Brad Warren
cd74a07edf Fix Travis tests due to cffi error 2016-09-14 10:31:31 -07:00
Brad Warren
cb982af635 put dnspython in alphabetical order 2016-09-14 10:27:39 -07:00
Brad Warren
a54d9061ba Merge pull request #3342 from TheNavigat/test-modification
Adding modification check against the current /letsencrypt-auto
2016-08-29 10:16:20 -07:00
Brad Warren
8aadacbbb3 Merge pull request #3375 from yan12125/python3-certbot-unittests
Enable unit tests of certbot core on Python 3
2016-08-12 17:55:50 -07:00
Brad Warren
df96798642 Merge pull request #3393 from certbot/nginx-compatibility-test
Nginx compatibility test
2016-08-10 17:52:05 -07:00
Brad Warren
f864cd0cfe Add nginxroundtrip to tox 2016-08-10 16:43:15 -07:00
Brad Warren
fc86f869a7 add compatibility tests to travis 2016-08-10 16:33:56 -07:00
Joona Hoikkala
3591667d02
Fix tox tests 2016-08-10 10:43:54 +03:00
Yen Chi Hsuan
fe76d558ed Enable unit tests of certbot core on Python 3 2016-08-06 21:09:43 +08:00
Amjad Mashaal
1fdf41e636 Adding modification check against the current /letsencrypt-auto 2016-08-04 14:22:20 +02:00
Wilfried Teiken
827c93510c Merge branch 'add_dns01_challenge' of github.com:wteiken/letsencrypt into add_dns01_challenge 2016-07-31 20:13:36 -04:00
bmw
950710bdce Merge pull request #3042 from TheNavigat/envlist
Limiting tox envlist to really needed tests
2016-06-17 12:37:17 -07:00
Jacob Hoffman-Andrews
91cd19158e Improve user experience for linting.
Don't run pep8 for directories that we don't actually enforce pep8 on.
Install dependencies with -q.
Don't print reports, they make it hard to find the actual errors.
Remove deprecated fields from acme .pylintrc, they cause unnecessary messages
about deprecation.
2016-06-04 22:53:51 -07:00
Amjad Mashaal
4a8f71277c Limiting tox envlist to really needed tests 2016-05-28 02:03:51 +02:00
Wilfried Teiken
6196cf0aa7 Merge branch 'master' into add_dns01_challenge 2016-04-25 00:40:27 -04:00
Brad Warren
214343ed6a rename letshelp-letsencrypt 2016-04-13 17:42:19 -07:00
Brad Warren
4fab8751b2 s/letsencrypt/certbot letsencrypt-compatibility-test 2016-04-13 16:58:21 -07:00
Brad Warren
a43fac3277 s/letsencrypt/certbot letsencrypt-nginx tests 2016-04-13 16:45:54 -07:00
Brad Warren
2002511f81 s/letsencrypt/certbot letsencrypt-apache 2016-04-13 16:30:57 -07:00
Brad Warren
3961b70deb s/letsencrypt/certbot 2016-04-13 16:03:59 -07:00
Jakub Warmuz
3516b70884
apacheconftest: toxinidir instead of . 2016-04-10 18:45:08 +00:00
Jakub Warmuz
df2baae476
apacheconf: sane sudo letsencrypt (fixes #2800)
- hardcoded
  `LETSENCRYPT=/home/travis/build/letsencrypt/letsencrypt/.tox/apacheconftest/bin/letsencrypt`
  causes Travis tests to fail if running under any other Travis user
  (from e.g. a fork)

- `sudo env "PATH=$PATH" letsencrypt` should make sure that sudo can
  find letsencrypt binary from virtualenv; realpath is not necessary

- sudo is called already from within the test script, no need to sudo
  the entire script
2016-04-10 17:57:21 +00:00
Roy Wellington Ⅳ
af22467e07 Newline at end of tox.ini. 2016-02-26 21:53:31 -08:00
Wilfried Teiken
e8d09ea994 Merge remote-tracking branch 'upstream/master' into add_dns01_challenge 2016-02-12 23:32:34 -05:00
Brad Warren
45ee1eb889 Merge branch 'testing-dev-extras' 2016-02-12 16:19:57 -08:00
Erik Rose
aefd5b25e1 Revert switch to python setup.py test in tox.ini.
This had more of a purpose when we were moving mock to test_requires. I'll reintroduce this in the separate PR for that.

Also bring back the testing extra in tox for now.
2016-01-19 16:10:17 -05:00
Wilfried Teiken
b9dafc203f Merge branch 'master' into add_dns01_challenge 2016-01-14 23:01:06 -05:00
Erik Rose
ed562645e0 Master master into letsencrypt-auto-release so Travis will build it. 2016-01-11 21:45:16 -05:00
Erik Rose
6c05197a43 Remove mock as an install requirement.
The motivation is to free us of a reliance on a rather modern version of setuptools, which caused le-auto failures for people on Wheezy and other older distros. (The alternative would have been to forcibly upgrade setuptools as the old le-auto did, but less is more.)

Mock is used only in tests, so we move it to tests_require. It will still be installed automatically when setup.py test is run. Give all packages a test_suite so this works.

The "testing" extra remains for optional packages not required for the nose tests but used in tox. However, the extra is much less useful now and is a candidate for deletion. We could roll the list of packages therein into the tox config so as not to favor any particular package.

Remove tests_require=install_requires, which I don't think does anything useful, since install requirements are implicitly installed when running setup.py test.

Fix tests to pass with mock removed. We had to stop them pulling down LE from PyPI, since the current version there (0.1.1) requires mock and explodes when `letsencrypt` is run.
2016-01-11 21:26:41 -05:00
Jakub Warmuz
86d6d27045
Clean up dev/testing extras messup (fixes #2140). 2016-01-10 18:37:41 +00:00
Jakub Warmuz
3cddb15023
Merge remote-tracking branch 'github/letsencrypt/master' into pyopenssl 2016-01-10 11:25:12 +00:00
Wilfried Teiken
e7ce5e9f53 Merge branch 'master' into add_dns01_challenge 2016-01-09 15:19:47 -05:00
Erik Rose
5512838377 Get le-auto tests running on Travis. 2016-01-08 17:39:51 -05:00
Jakub Warmuz
dba69d079f
Separate pylintrc for acme 2016-01-07 22:20:46 +00:00
Brad Warren
a815ddbafd Remove excessive newline 2016-01-07 10:05:33 -05:00
Brad Warren
94508b00df Don't pin pyparsing version 2016-01-06 21:57:15 -05:00
Brad Warren
90f0b15c9d Add old dependency test 2016-01-06 21:51:42 -05:00
Brad Warren
2f569f7783 Tox fanciness 2016-01-06 21:40:26 -05:00
Wilfried Teiken
6bc3060fbb More fixes for travis tests 2016-01-06 03:11:09 -05:00
Wilfried Teiken
b8a9c2597c add dns environment to pyXX 2016-01-06 02:57:53 -05:00
Wilfried Teiken
e61e83f7e2 tox.ini fix 2016-01-06 02:46:29 -05:00
Wilfried Teiken
cead22f4a7 Add dns env to lint/cover 2016-01-06 02:45:20 -05:00
Wilfried Teiken
52c487f462 Add new 'test' extras and update tox.ini accordingly. 2016-01-06 02:44:19 -05:00
Peter Eckersley
b6531afb8d Merge pull request #1992 from letsencrypt/apache-conf-test
Apache conf tests in travis
2016-01-02 17:49:38 -08:00
Peter Eckersley
e41ddd2cc7 Rename hackishapachetest -> apacheconftest
Reenable other travis tests as well as this one
2015-12-22 15:50:48 -08:00
Peter Eckersley
8d71b2d6c3 Install Apache modules in travis 2015-12-21 16:09:46 -08:00
Peter Eckersley
7a16e2e248 Wrangle things to actually run in travis 2015-12-21 16:09:26 -08:00
Peter Eckersley
d777e7faba This sort of works in tox; travis is unlikely due to sudo 2015-12-21 16:09:26 -08:00
Peter Eckersley
03fdd03a87 Experimentally try travis with the hackish-apache-test 2015-12-21 16:09:25 -08:00
Marius Gedminas
e268e718a0 Remove py26reqs.txt
ConfigArgParse 0.10 from PyPI supports Python 2.6, so there's no more
need to install a fixed version directly from a git branch.
2015-12-03 10:07:31 +02:00
Felix Yan
324ebf468d Update tox.ini to run acme tests with Python 3.5 2015-11-14 21:09:03 +08:00
Jakub Warmuz
6f5d37fc21
requirements.txt: rename to py26reqs.txt and remove it from deps where possible.
When people see requirements.txt they tend to `pip install -r`
straight way
(c.f. https://github.com/letsencrypt/letsencrypt/issues/1252). It's
only necessary for Python2.6.
2015-10-31 12:22:42 +00:00
Jakub Warmuz
b06f614e4a
Merge remote-tracking branch 'github/letsencrypt/master' into py2.6-3 2015-10-17 16:06:45 +00:00
Jakub Warmuz
09fa1153d9
Merge remote-tracking branch 'github/letsencrypt/master' into py2.6-3 2015-10-17 07:28:04 +00:00
Jakub Warmuz
86cd5af76e
Add comment about downstream deps fix 2015-10-16 22:17:31 +00:00
Jakub Warmuz
408903b732
tox: bring back test for letshelp_letsencrypt 2015-10-16 22:04:52 +00:00
Jakub Warmuz
fd4528baa3
tox: pip install -e 2015-10-16 22:04:18 +00:00
Jakub Warmuz
2f3b6251c7
Tox: verbose nosetests 2015-10-16 21:33:02 +00:00
Jakub Warmuz
fd1103ccda
Tox tests detect downstream deps errors. 2015-10-16 21:33:02 +00:00
Jakub Warmuz
8a8dfd4bc3
More verbose tox python env tests 2015-10-14 18:48:43 +00:00
Jakub Warmuz
1802b87a12
Revert "Remove Python 2.6 support."
This reverts commit 31d37a3953.
2015-10-11 16:01:52 +00:00
Peter Eckersley
2945e0657d Don't run tox for temporarily-disabled python versions 2015-09-15 19:01:55 -07:00
Peter Eckersley
c7b4bebd23 Merge remote-tracking branch 'origin/master' into rm-py26 2015-09-15 18:08:14 -07:00
Jakub Warmuz
33c2aed021
Merge remote-tracking branch 'github/letsencrypt/master' into lint 2015-09-11 07:15:10 +00:00
Jakub Warmuz
0ebef62846
Travis: no fail on pep8 2015-09-11 07:12:49 +00:00
Jakub Warmuz
809f4966d6
Require pep8 in [testing] 2015-09-11 07:04:13 +00:00
Jakub Warmuz
fe3e8d7302
Travis: add pep8 checks 2015-09-06 09:22:34 +00:00
Jakub Warmuz
4d9db06083
Revert "Removed py3+ tests in tox"
This reverts commit 2c720b05ae.
2015-08-19 20:24:44 +00:00
James Kasten
c7aebfa26d Merge branch 'letshelp-apache' of git://github.com/bmw/lets-encrypt-preview into bmw-letshelp-apache
Conflicts:
	tox.ini
2015-08-13 21:24:26 -07:00
Brad Warren
7cb30ca838 Merge remote-tracking branch 'upstream/master' into letshelp-apache 2015-08-13 19:04:01 -07:00
Brad Warren
0aaf9f2be7 Updated tests to update challenge changes 2015-08-13 18:41:49 -07:00
Brad Warren
2c720b05ae Removed py3+ tests in tox 2015-08-11 13:37:49 -07:00
Jacob Hoffman-Andrews
35f81aeb6e Restore py26 toxenv for manual tests. 2015-08-06 10:31:57 -07:00
Brad Warren
12b9970787 Finished script besides commit and started unit tests 2015-07-27 19:26:28 -07:00
Jacob Hoffman-Andrews
31d37a3953 Remove Python 2.6 support.
Fixes https://github.com/letsencrypt/letsencrypt/issues/515
2015-07-23 10:20:47 -07:00
Jakub Warmuz
160a96052b
tox/Travis: test Python 3.3 2015-07-12 15:20:52 +00:00
Jakub Warmuz
596132292a
Travis: test Python 3.4. 2015-07-12 15:07:25 +00:00
Jakub Warmuz
7bc1cd4454
Remove shared tox venv 2015-07-12 15:04:01 +00:00
Jakub Warmuz
5d6d901655
Add py3 tox tests for acme.jose 2015-07-12 11:53:18 +00:00
Jakub Warmuz
a876a664df
Add py3 tox tests for acme.jose 2015-07-12 11:37:56 +00:00
Jakub Warmuz
a462e38cab
Update package references after subdirs rename. 2015-07-11 04:33:07 +00:00
Jakub Warmuz
db1e078c06
Shared tox envdir 2015-07-10 16:40:46 +00:00
Jakub Warmuz
b9df69af9f
Basic dev/test setup for separate package subdirectories. 2015-07-10 16:38:42 +00:00
Jakub Warmuz
b0c72410ba
Unified vector loading in letsencrypt. 2015-07-10 15:49:18 +00:00
Jakub Warmuz
887f91bdac
requirements.txt: no editable (-e) mode, no "." install. 2015-06-09 07:51:42 +00:00
Jakub Warmuz
5fbc5cee2e
Add tox.cover.sh for proper coveralls experience. 2015-05-10 16:53:22 +00:00
Jakub Warmuz
b103aae808
tox: split test/cover per pkg 2015-05-10 12:52:40 +00:00
Jakub Warmuz
d408ec5a95
Move plugins to top-level 2015-05-10 12:26:54 +00:00
Jakub Warmuz
3a6bd7123d
Move acme to top-level 2015-05-10 12:26:17 +00:00
Jakub Warmuz
a2df245567
Temporary fox for ConfigArgParse#17 2015-05-04 11:56:09 +00:00
James Kasten
016e10f415 100% test coverage, account, auth_handler 2015-04-23 19:12:15 -07:00
James Kasten
567cec1824 Fix gen_chall_path, add unittests 2015-03-27 21:08:14 -07:00
Jakub Warmuz
71d8999e7c
Bump up minimum coverage to 86% 2015-03-21 20:50:43 +00:00
Jakub Warmuz
d74ca1bbaa
tox: PYTHONHASHSEED=0 2015-03-18 15:04:27 +00:00
Jakub Warmuz
ba98b5cb22
Bump up coverage 2015-02-25 13:56:47 +00:00
James Kasten
f5c30b383a second round revisions 2015-02-23 23:18:07 -08:00
James Kasten
5d76c0feb1 Final cleanup for revoker/display 2015-02-19 22:30:11 -08:00
James Kasten
f77307c28b Finish revoker implementation and unittests 2015-02-18 04:01:49 -08:00
Jakub Warmuz
9476e7039b
Bump coverage to 73% 2015-02-11 16:41:01 +00:00
Jakub Warmuz
0849e2d21e
Merge remote-tracking branch 'github/letsencrypt/master' into acme
Conflicts:
	tox.ini
2015-02-08 22:54:40 +00:00
Jakub Warmuz
74c02363e7
tox: PYTHONPATH that includes linter_plugin 2015-02-08 12:59:47 +00:00
Jakub Warmuz
b1552052bb
tox: pip install -e (fixes #235) 2015-02-08 11:54:25 +00:00
Jakub Warmuz
9d44b10aff
Quickfix for #235 2015-02-08 10:01:36 +00:00
Jakub Warmuz
ec3bb4cf13
Merge remote-tracking branch 'github/letsencrypt/master' into acme
Conflicts:
	tox.ini
2015-02-07 22:30:24 +00:00
Jakub Warmuz
337974e675
No pylint in py2.6 tox 2015-02-06 23:41:28 +00:00
Jakub Warmuz
a990b0ff77
100% coverage for acme 2015-02-06 17:55:33 +00:00
Jakub Warmuz
0a44bbb7a1
Simpler Travis CI matrix 2015-01-28 12:56:12 +00:00
James Kasten
73b95c4307 Fix based on comments 2015-01-26 01:27:00 -08:00
Jakub Warmuz
982fa19628
Bump cover-min-percentage to 61 2015-01-24 14:33:19 +00:00
James Kasten
a0969b1f29 updated pylintrc file to 1.3.1 version. 2015-01-16 03:14:24 -08:00
James Kasten
ca7628caae Small changes/renaming 2015-01-09 22:25:36 -08:00
James Kasten
0bef6769ba cleanup challenge infrastructure 2015-01-09 05:30:15 -08:00
James Kasten
cc999d3654 Refactored/added tests 2014-12-19 15:49:29 -08:00
James Kasten
a272a0a6e9 Add pylintrc, remove docstring-req from test_ functions, start rising coverage requirement 2014-12-13 23:47:57 -08:00
James Kasten
52555c2337 Integrate rising test coverage requirement 2014-12-13 22:42:47 -08:00
Jakub Warmuz
dfd7e142c1 Do not use xunit. coverage instead of xcoverage. 2014-11-27 20:56:35 +01:00
Jakub Warmuz
9d5ab7dbcc Test coverage 2014-11-27 20:30:56 +01:00
Jakub Warmuz
f62ab0e351 tox.ini uses setup.py test -q 2014-11-27 20:26:30 +01:00
Jakub Warmuz
3f9a708789 tox.ini using setup.py dev 2014-11-27 20:13:21 +01:00
Jakub Warmuz
cd9e30ad7e python-augeas from PyPI
https://github.com/hercules-team/python-augeas/issues/2#issuecomment-64116945
2014-11-23 15:29:11 +01:00
Jakub Warmuz
e432d00e0a pylint dep for tox 2014-11-22 20:28:29 +01:00
Jakub Warmuz
1f844153fe Use tox for lint. 2014-11-22 15:12:33 +01:00
Jakub Warmuz
300a4f0b45 Use tox for tests 2014-11-22 15:04:36 +01:00