Commit graph

835 commits

Author SHA1 Message Date
TW
93cedbb761 Merge pull request #2993 from ThomasWaldmann/issue/2975-1.1
test_detect_attic_repo: don't test mount
2017-09-02 19:17:29 +02:00
TW
c77dd42302 Merge pull request #2992 from ThomasWaldmann/cleanup-log-1.1
add debug logging for repository cleanup
2017-09-02 18:52:05 +02:00
Marian Beermann
f85494d574 test_detect_attic_repo: don't test mount
since mount is not always available and if it works for all the other
commands, then it is likely it works for mount as well.

(cherry picked from commit a6be34f8f7)
2017-09-02 17:57:42 +02:00
Thomas Waldmann
9ca490ad5e add debug logging for repository cleanup
so we can know whether it did a cleanup and if so,
which and how many segments were cleaned up.

(cherry picked from commit 57f808e4bb)
2017-09-02 17:55:16 +02:00
Thomas Waldmann
9a362aecc4 recover_segment: use mmap(), fixes #2982
(cherry picked from commit 9fc4d00bf6)
2017-09-02 17:50:50 +02:00
Marian Beermann
35c8975a5c keymanager: don't depend on optional readline module
(cherry picked from commit b8793d9577)
2017-08-30 11:29:57 +02:00
TW
84d13f92b3 Merge pull request #2968 from ThomasWaldmann/fix-timestamp-option-1.1
borg create --timestamp: set start time, fixes #2957
2017-08-27 15:19:26 +02:00
TW
1b7b58e712 Merge pull request #2964 from ThomasWaldmann/detect-attic-repos-1.1
Detect non-upgraded Attic repositories
2017-08-27 14:52:53 +02:00
TW
143d82c640 Merge pull request #2965 from ThomasWaldmann/issue/2376-1.1
Issue/2376 PR backported to 1.1
2017-08-27 14:51:23 +02:00
Thomas Waldmann
ac404e3a74 borg create --timestamp: set start time, fixes #2957
(cherry picked from commit 8a299ae24c)
2017-08-25 04:38:24 +02:00
Marian Beermann
987a99dffe create: document exclusion through nodump
(cherry picked from commit 495f838d88)
2017-08-25 04:25:18 +02:00
Marian Beermann
d5697fb4a8 always use microseconds for ISO 8601 output
(cherry picked from commit ab4981eff6)
2017-08-25 04:20:06 +02:00
Marian Beermann
008571228f one datetime formatter to rule them all
(cherry picked from commit a836f451ab)
2017-08-25 04:00:26 +02:00
Marian Beermann
fa65c9b143 list: fix weird mixup of mtime/isomtime
(cherry picked from commit 2ff29891f1)
2017-08-25 03:38:30 +02:00
Lukas Fleischer
ff93b6b972 Detect non-upgraded Attic repositories
When opening a repository, always try to read the magic number of the
latest segment and compare it to the Attic segment magic (unless the
repository is opened for upgrading). If an Attic segment is detected,
raise a dedicated exception, telling the user to upgrade the repository
first.

Fixes #1933.

(cherry picked from commit 0943b322e3)
2017-08-25 03:30:31 +02:00
enkore
818e5c8e01 Merge pull request #2952 from enkore/f/killthreads
delete various nogil and threading related lines
2017-08-21 12:19:03 +02:00
Marian Beermann
dc6049cb73 delete various nogil and threading related lines 2017-08-20 21:30:41 +02:00
Thomas Waldmann
4eadb59c10 ignore corrupt files cache, fixes #2939
ignore the files cache when corrupt and emit a warning message
so the users notices that there is a problem.

(cherry picked from commit 5beaa5bd02)
2017-08-19 01:09:26 +02:00
Thomas Waldmann
09e3a02fbc migrate locks to child PID when daemonize is used
also:

increase platform api version due to change in get_process_id behaviour.

(cherry picked from commit 6f94949a36)
(cherry picked from commit 5bad764637)
2017-08-13 21:40:56 +02:00
Thomas Waldmann
eb7d473dc7 test json timestamps for iso format
(cherry picked from commit c3b0214e89)
2017-08-07 21:56:39 +02:00
Thomas Waldmann
74c9277d76 repo last_modified: use iso8601 timestamp format with --json
like yyyy-mm-ddThh:mm:ss - no tz yet, this likely needs more refactoring
to tz aware and utc datetime objects everywhere, currently there are
naive datetime objects and also localtime at quite some places.

(cherry picked from commit 32174dd9c8)
2017-08-07 21:56:28 +02:00
Thomas Waldmann
65940be21a archives list: use iso8601 timestamp format with --json
like yyyy-mm-ddThh:mm:ss - no tz yet, this likely needs more refactoring
to tz aware and utc datetime objects everywhere, currently there are
naive datetime objects and also localtime at quite some places.

(cherry picked from commit b64561fe6f)
2017-08-07 21:56:15 +02:00
Thomas Waldmann
d17553add6 archive listing: use iso8601 timestamp format with --json-lines
like yyyy-mm-ddThh:mm:ss - no tz yet, this likely needs more refactoring
to tz aware and utc datetime objects everywhere, currently there are
naive datetime objects and also localtime at quite some places.

(cherry picked from commit 043d794b91)
2017-08-07 21:56:02 +02:00
enkore
51bcba332b Merge pull request #2921 from ThomasWaldmann/fix-serve-exitcode-1.1
fix exitcode of borg serve, fixes #2910
2017-08-07 12:21:58 +02:00
Thomas Waldmann
68d505c974 fix exitcode of borg serve, fixes #2910
(cherry picked from commit 583de3eeb1)
2017-08-06 17:34:10 +02:00
Simon Frei
a1bffc193b Only compare contents when chunker params match (fixes #2899) 2017-08-06 01:24:53 +02:00
enkore
daa88e07f2 Merge pull request #2877 from Alexander-N/pylint-rules
Activate more linting rules in .coafile
2017-07-25 09:56:25 +02:00
enkore
c1d7cd9b90 Merge pull request #2873 from enkore/issue/2869
with-lock, info docs
2017-07-24 23:50:51 +02:00
Marian Beermann
b4b58e7225 info: explain max. archive size 2017-07-24 23:50:18 +02:00
Marian Beermann
24de8514fa with-lock: fix help text 2017-07-24 23:50:18 +02:00
enkore
836bc33a4d Merge pull request #2876 from enkore/issue/2628
cache: write_archive_index: truncate_and_unlink on error
2017-07-24 21:22:24 +02:00
Marian Beermann
2fe37dba7f umount: try fusermount, then try umount 2017-07-24 13:55:32 +02:00
Alexander-N
eff492a8d8 Replace assert_true(False) with fail and don't ignore pylint rule W1503
assert_true(False) violates W1503 (redundant-unittest-assert) and is less clear than using fail().
2017-07-24 13:30:35 +02:00
Marian Beermann
2623e330a4 cache: write_archive_index: truncate_and_unlink on error 2017-07-24 10:45:57 +02:00
Thomas Waldmann
2edbcd7703 chunk_incref: compute "_size or size" only once 2017-07-23 13:53:48 +02:00
Thomas Waldmann
fc3498ac53 chunk_incref: use "size" for public api 2017-07-23 13:53:48 +02:00
Thomas Waldmann
663d3c544a chunk_incref size assertion: fail early 2017-07-23 13:53:48 +02:00
Thomas Waldmann
186123cb68 give known chunk size to chunk_incref, fixes #2853
chunk_incref was called when dealing with part files without giving the
known chunk size in the size_ parameter.

adjusted LocalCache.chunk_incref to have same signature.
2017-07-23 13:53:47 +02:00
Thomas Waldmann
199f192a65 archive: closely wrap next() called from generator
lgtm:
Calling next() in a generator may cause unintended early termination of
an iteration.

It seems that lgtm did not detect the more loose wrapping that we used
before.
2017-07-23 02:00:55 +02:00
Thomas Waldmann
5cc2b900ee constants: avoid comparing constants
lgtm:
Comparison of constants is always constant, but is harder to read than
a simple constant.
2017-07-23 02:00:55 +02:00
Thomas Waldmann
b7b428edc2 repository: fix assert expression to not have a side effect
lgtm:
This 'assert' statement contains an expression which may have side effects.
2017-07-22 01:51:19 +02:00
Radu Ciorba
12e0f55991 replace modulo with if to check for wraparound in hashmap
Integer division is slow, and this improves the speed of all operations on the hashmap.

Benchmarked this patch on the rciorba/master-bench branch:
9e5d61e03c/results.html
2017-07-20 13:22:34 +03:00
TW
ffe7bdb88c Merge pull request #2838 from milkey-mouse/fix2834
Use archive creation time as mtime for FUSE mount (fixes #2834)
2017-07-19 02:22:44 +02:00
TW
06f711e16d Merge pull request #2828 from milkey-mouse/fix2730
Reference list of status chars in borg recreate --filter description
2017-07-19 01:41:07 +02:00
Milkey Mouse
6ef5c9c960
Use archive creation time as mtime for FUSE mount (fixes #2834) 2017-07-18 15:07:59 -07:00
Milkey Mouse
bcbf80287c
Add list of status chars to borg create --filter help text 2017-07-18 14:31:15 -07:00
Alexander-N
f7c843fd21 Enable pylint check E0211 (method has no argument) in .coafile
Adapt Attic013Item in test_attic013_acl_bug so that as_dict takes `self` as
first argument. This was the only case where E0211 was violated.
2017-07-17 11:21:30 +02:00
Thomas Kluyver
ae2a1b8135 Name backup directories with 'before-upgrade'
Closes gh-2811
2017-07-15 16:23:08 +02:00
Marian Beermann
019a258709 create _endian.h 2017-07-11 19:12:19 +02:00
TW
e36be956f1 Merge pull request #2792 from ThomasWaldmann/comment-placeholder
support borg list repo --format {comment}, fixes #2081
2017-07-06 03:12:01 +02:00