Commit graph

4754 commits

Author SHA1 Message Date
Hallvard Furuseth
47393f4ea2 doxygen cleanup 2016-12-15 22:27:33 +01:00
Hallvard Furuseth
2c3b019e5a Note functions which must set MDB_TXN_ERROR on failure
Other functions depend on them to do so.
For mdb_node_read(), instead remove such a dependence.
2016-12-15 22:27:33 +01:00
Hallvard Furuseth
8de0788b9c Only set me_mfd if needed. Drop unused read access. 2016-12-15 22:27:33 +01:00
Hallvard Furuseth
e911ad64b9 ITS#8505 Clarify fork() caveat, mdb_env_get_fd(), flock->fcntl. 2016-12-15 22:27:33 +01:00
Hallvard Furuseth
6e81d4071b ITS#8505 Protect parent from fork()-pthread_exit() 2016-12-15 22:27:33 +01:00
Hallvard Furuseth
eb1a307e4a ITS#8505 Set FD_CLOEXEC for me_mfd,env_copy as well 2016-12-15 22:27:33 +01:00
Hallvard Furuseth
9c76e95dbe Move opening files to mdb_fopen()
No change in functionality.
2016-12-15 22:27:33 +01:00
Hallvard Furuseth
3faef632a0 Factor filename handling out to mdb_fname_*()
No change in functionality, except needs less mallocing.
2016-12-15 22:27:33 +01:00
Hallvard Furuseth
f2ecddbcf7 ITS#7992 Tighter utf8_to_utf16(), fix errcodes
The 0xFFFD check seems due to misleading MultiByteToWideChar() doc.
Bad UTF-8 gives 0xFFFD in the output string, not the return value.
2016-12-15 22:27:33 +01:00
Hallvard Furuseth
e674f8241c Clean up strange fcntl result check
...and check !MDB_CLOEXEC in an 'if' rather than '#if'
to match its non-zero usage.
2016-12-15 22:27:33 +01:00
Hallvard Furuseth
bffe2ebcba Drop spurious Errcode() call 2016-12-15 22:27:33 +01:00
Hallvard Furuseth
9036e261c4 ITS#7682 F_NOCACHE: Allow error, skip any O_DIRECT
We can run without F_NOCACHE if it fails. And we do not know
what combining it with O_DIRECT means, if a system has both.
2016-12-15 22:27:33 +01:00
Howard Chu
56b81e6d57 ITS#8489 reset cursor EOF flag in cursor_set
It usually gets done anyway, but one of the fastpath shortcuts
bypassed this step.
2016-12-15 22:27:33 +01:00
Hallvard Furuseth
38564c92da Clean up MDB_USE_ROBUST #defines
Make explicit and default nonzero equivalent. Parenthesize.
2016-12-15 22:27:33 +01:00
Hallvard Furuseth
590792f31b Fix mdb_page_list() message 2016-12-15 22:27:33 +01:00
Howard Chu
b95a2dc333 Fix mdb_audit() printf format 2016-12-15 22:27:32 +01:00
Howard Chu
831e70565e ITS#8481 make shared lib suffix overridable 2016-12-15 22:27:32 +01:00
Hallvard Furuseth
7dab84978c Comment MDB_page 2016-12-15 22:27:32 +01:00
Hallvard Furuseth
b92a4816bf Doc fixes: VALID_FLAGS, mm_last_pg, mt_loose_count 2016-12-15 22:27:32 +01:00
Hallvard Furuseth
b922a5a086 Silence warning for initializer "mdb_copy my = {0}"
1st struct member was not a scalar.
2016-12-15 22:27:32 +01:00
Hallvard Furuseth
14ca16034a ITS#8209 MDB_CP_COMPACT: Handle empty or broken DB
Preserve DB flags (use metapage#1) when main DB is empty.
Fail if metapage root != actual root in output file.
2016-12-15 22:27:32 +01:00
Hallvard Furuseth
1d86235047 ITS#8209 MDB_CP_COMPACT: Threading/error handling
Handle errors.  Fix cond_wait condition so mc_new
is the sole control var.  Drop specious cond_waits.
Do not look at 'mo' while copythr writes it.

Don't know if posix_memalign() pointer is defined after failure.
Some _aligned_free() doc seems to say arg NULL = user error.
2016-12-15 22:27:32 +01:00
Howard Chu
f24d7d2c83 Add MDB_PREV_MULTIPLE (collected mdb.master changes)
Logical counterpart to GET_MULTIPLE, NEXT_MULTIPLE
2016-12-15 22:27:32 +01:00
Hallvard Furuseth
fe2b1cd731 Factor out refreshing sub-page pointers 2016-12-15 22:27:32 +01:00
Howard Chu
6b1df0e4c7 More for ITS#8406 (xcursor fixups)
Revert excess cursor fixup
xcursor fixup depends on init state
2016-12-15 22:27:32 +01:00
Hallvard Furuseth
b8c1877be3 Cleanup: Add flag DB_DUPDATA, drop DB_DIRTY hack 2016-12-15 22:27:32 +01:00
Hallvard Furuseth
b57bb99fa6 Pass cursor to mdb_page_get(), mdb_node_read().
No change in behavior.
2016-12-01 21:56:49 +01:00
Hallvard Furuseth
7a8d0f6953 Fix comment: SysV semaphores -> Posix semaphores 2016-12-01 21:56:49 +01:00
Howard Chu
369b99a460 WIN64 needs off_t redefined too 2016-06-15 20:40:07 +02:00
Hallvard Furuseth
c2f6f04dba lmdb.h Caveats: Reserved vs. actual mem/disk usage 2016-06-15 20:37:56 +02:00
Howard Chu
7a30ce8c08 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2016-06-15 11:44:41 +01:00
Howard Chu
13ecac78cd ITS#8339, #8424 2016-06-15 11:43:46 +01:00
Hallvard Furuseth
d886593193 mdb_env_setup_locks: Plug mutexattr leak on error 2016-06-15 11:41:14 +01:00
Howard Chu
21ed2bd4c9 ITS#8339 Solaris 10/11 robust mutex fixes
Check for PTHREAD_MUTEX_ROBUST_NP definition (this doesn't work
on Linux/glibc because they used an enum). Zero out mutex before
initing.
2016-06-15 11:34:35 +01:00
Howard Chu
b785bfbe61 ITS#8424 init cursor in mdb_env_cwalk 2016-06-15 11:33:53 +01:00
Hallvard Furuseth
09e74f9056 Comment ovpage code in mdb_cursor_put() 2016-06-15 11:30:22 +01:00
Howard Chu
7e7ed7b171 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2016-05-04 10:48:34 +01:00
Howard Chu
27f6160db4 RE 0.9.19 2016-05-04 10:47:32 +01:00
Howard Chu
dda2ac0a1b ITS#8412 fix NEXT_DUP after cursor_del 2016-05-04 10:45:18 +01:00
Howard Chu
b46fc3e438 ITS#8406 fix xcursors after cursor_del
Don't leave them uninit'd if they now point at a valid DUP node
2016-05-04 10:45:06 +01:00
Howard Chu
f9cdc4f032 mdb_drop optimization
If we know there are no sub-DBs and no overflow pages, skip leaf scan.
2016-05-04 10:44:56 +01:00
Howard Chu
0820431975 ITS#8393 fix MDB_GET_BOTH on non-dup record 2016-05-04 10:44:46 +01:00
Howard Chu
798f020c59 Tweak Win32 errmsg buffer 2016-05-04 10:44:35 +01:00
Howard Chu
283f3ae171 ITS#8385 Fix use-after-free with GnuTLS 2016-03-12 11:03:29 +00:00
Howard Chu
ff24e57ad4 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2016-02-05 21:23:01 +00:00
Howard Chu
ad8488cfac Release 0.9.18 2016-02-05 21:22:15 +00:00
Howard Chu
b054c23c5d Merge remote-tracking branch 'origin/mdb.RE/0.9' 2016-02-04 17:36:48 +00:00
Hallvard Furuseth
60580aa678 ITS#7992 Fix memleak in prev change 2016-02-04 17:35:38 +00:00
Howard Chu
a27a95571d Merge remote-tracking branch 'origin/mdb.RE/0.9' 2016-02-02 19:42:40 +00:00
Howard Chu
6bb6d5e3c6 ITS#8353 more for OpenSSL 1.1 compat
tmp_rsa callback has been removed from OpenSSL 1.1
Use new X509_NAME accessor function to retrieve DER bytes
2016-01-31 03:29:28 +00:00
Howard Chu
ea7d99d970 Happy New Year 2016-01-30 12:55:03 +00:00
Quanah Gibson-Mount
6c4d6c880b Happy New Year! 2016-01-29 13:32:05 -06:00
Howard Chu
207a43dac2 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2016-01-29 00:57:31 +00:00
Howard Chu
eb5a99832b ITS#8363 2016-01-28 04:22:26 +00:00
Howard Chu
c322c4c76c ITS#8363 Fix off-by-one in mdb_midl_shrink 2016-01-28 04:21:56 +00:00
Howard Chu
f3a7bf79db ITS#8353 partial fix
Use newly added SSL_CTX_up_ref()
Still waiting for X509_NAME accessor
2016-01-26 18:06:46 +00:00
Howard Chu
528b256e09 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2016-01-24 11:39:13 +00:00
Howard Chu
c06c3c7732 ITS#8355, doc update 2016-01-24 11:38:35 +00:00
Howard Chu
6c0900c353 ITS#8355 fix subcursors
make sure C_DEL gets reset in subcursor after it moves.
2016-01-24 11:32:49 +00:00
Howard Chu
90a07a398b Update WRITEMAP doc 2016-01-23 16:56:46 +00:00
Howard Chu
f2d0aa7d22 ITS#8353 partial fixes
ERR_remove_state() is deprecated since OpenSSL 1.0.0
Use X509_NAME_ENTRY_get_object() instead of direct access.
2016-01-21 18:05:42 +00:00
Hallvard Furuseth
81d0d29bbc ITS#8334, mdb_copy 2016-01-09 09:10:55 +01:00
Howard Chu
05709ce6fa Fixups for env_copy with large files
wsize was being truncated to 32bits on Windows.
Only try to write 1GB at a time on Windows64;
larger writes fail with ERROR_WORKING_SET_QUOTA.
2016-01-09 09:03:44 +01:00
Howard Chu
935a90dfc4 MinGW warning cleanup: _MSC_VER -> _WIN32.
From 1ba5adb2ec "MDB_VL32 preparation".
2016-01-09 08:59:09 +01:00
Hallvard Furuseth
25fd09df6d ITS#8334 Fix MDB_APPENDDUP vs. rewrite(single item) 2016-01-06 20:52:48 +01:00
Howard Chu
13a8b6110a Merge remote-tracking branch 'origin/mdb.RE/0.9' 2016-01-04 19:37:49 +00:00
Howard Chu
03f1c12bbe ITS#8336 2016-01-04 19:35:40 +00:00
Howard Chu
fd7bfbc0df ITS#8336 fix page_search_root assert on FreeDB
Let "illegal" branch pages thru on the FreeDB - the condition
is only temporary and will be fixed by the time rebalance finishes.
2016-01-04 19:33:07 +00:00
Howard Chu
ac6947401b MDB_RESERVE doc
Add mdb_put text to mdb_cursor_put description for people who
fail to draw logical conclusions.
2015-12-22 18:32:37 +00:00
Howard Chu
71f1a1c320 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-12-19 23:09:33 +00:00
Howard Chu
e8760b474d ITS#7992 cleanup, new docs, mdb_dbi_open cleanup 2015-12-19 23:06:34 +00:00
Howard Chu
3fd0d5fb80 Add Getting Started doc 2015-12-19 23:03:55 +00:00
Howard Chu
ec32e90022 ITS#7992 cleanup
check for utf8_to_utf16 failures
2015-12-19 23:03:20 +00:00
Hallvard Furuseth
18caeaa70b mdb_dbi_open(): Catch strdup failure 2015-12-19 23:03:13 +00:00
Howard Chu
04ff967451 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-12-03 19:27:23 +00:00
Howard Chu
14ce42f434 ITS#8169, #8330 2015-12-03 19:14:11 +00:00
Sebastien Launay
19d135af54 ITS#8330 Fix robust mutex detection for glibc 2.10 and 2.11
pthread_mutexattr_setrobust and pthread_mutex_consistent are provided since 2.12 not 2.10:
https://sourceware.org/git/?p=glibc.git;a=commit;h=402cd98775db1478f64c9b0dbe00664b89eb2773
https://sourceware.org/git/?p=glibc.git;a=commit;h=78ee21859939ff75ccf8bbe00499b0c462df2e2d
2015-12-03 19:09:57 +00:00
Howard Chu
8738e5e306 ITS#8169 more Makefile tweaks
Fix prev commit, use all the same vars as main OpenLDAP makefiles
2015-12-03 19:09:47 +00:00
Howard Chu
99427fcab8 Return to releng 2015-12-03 19:08:00 +00:00
Howard Chu
9c1b3b247d Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-30 16:56:37 +00:00
Howard Chu
2011eb37c1 Release 0.9.17 2015-11-30 16:55:33 +00:00
Howard Chu
87927222fe Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-30 12:51:14 +00:00
Howard Chu
e4b84e79f8 ITS#8321 cleanup unused var
from da67af1a4b
2015-11-24 20:22:46 +00:00
Howard Chu
d490fd9f79 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-24 16:10:48 +00:00
Howard Chu
b617a3e804 ITS#8168, 8169 2015-11-24 16:08:53 +00:00
Heiko Becker
376aea80db ITS#8169 Allow passing mandir to make install
The motivation for this change is my distribution moving to a multiarch
layout. While the architecture specific stuff (binaries, libraries,
etc.) is installed under /usr/${host}/{bin,lib,...} architecture-independent
data should still be installed to /usr/share/.
2015-11-24 16:07:57 +00:00
Heiko Becker
16b82752fc ITS#8168 Allow passing AR to make
This is helpful when the ar executable is named differently, for
example with an arch specific prefix.
2015-11-24 16:03:25 +00:00
Howard Chu
9ec8e188fb ITS#8323 2015-11-24 16:01:25 +00:00
Howard Chu
00aae125be ITS#8321 fix ambiguity in cursor_put fixup
After delete/add of a node, other nodes may no longer be
pointing at the data they intended. This can confuse subsequent
fixups.
2015-11-24 16:00:45 +00:00
Howard Chu
e0316e0fae Cleanup C_DEL flag usage
Only set it if the cursor's current position was deleted
2015-11-24 16:00:37 +00:00
Howard Chu
46e3f46e76 ITS#8321 More cursor fixup
Based on page_touch fixup from ITS#7594 but expanded:
make sure sub-cursors agree with main cursors.
2015-11-24 16:00:29 +00:00
Howard Chu
2b89f4baf1 ITS#8321 page_touch - don't fixup the cursor we just touched 2015-11-24 16:00:21 +00:00
Howard Chu
8e7cd2269d ITS#8321 mdb_put cursor needs tracking too 2015-11-24 16:00:01 +00:00
Howard Chu
7881fd0fa7 ITS#8321 Fix mdb_cursor_set
Always reinit mc_pg[0] if cursor is not C_INITIALIZED
It might have a stale value when using nested txns
2015-11-24 15:59:52 +00:00
Howard Chu
00515babcc ITS#8321 deinit empty cursors
Always unset C_INIT flag if the cursor's target DB has been deleted
2015-11-24 15:59:43 +00:00
Howard Chu
75bca7f311 ITS#8323 Fix nested commit
Must remove our spilled pages from parent's dirty list
2015-11-24 15:59:35 +00:00
Hallvard Furuseth
c11ef29ffa CURSOR_TMP_[UN]TRACK() -> WITH_CURSOR_TRACKING() 2015-11-24 15:59:23 +00:00
Howard Chu
9e3101d31d ITS#8319, 8320 2015-11-23 02:02:36 +00:00
Orivej Desh
00f635d304 ITS#8320 mdb_load: fix loading data from simple text files
mdb_load -T was supposed to read escaped text, but 21b51cb7 "Add mdb_load"
made it read hex.
2015-11-23 02:00:49 +00:00
Orivej Desh
8297bfe028 ITS#8319 mdb_load: explain readline and mdb_cursor_put errors 2015-11-23 01:59:54 +00:00
Howard Chu
1ebc6faf87 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-23 01:52:30 +00:00
Howard Chu
b0851a13af ITS#8316, 8321 2015-11-23 01:51:45 +00:00
Howard Chu
d78ffc9517 ITS#8321 reorganize page_split fixups
DUPFIXED fixups needed to occur after separator update.
MDB_RESERVE handling moved after split fixup.
2015-11-23 01:50:29 +00:00
Howard Chu
8fdf79600a ITS#8321 simplify page_split fixups 2015-11-23 01:50:17 +00:00
Howard Chu
7a76ded030 ITS#8321 track temporary cursors
In rebalance/split operations, temporary cursors need to be visible
to propagate fixups
2015-11-23 01:50:03 +00:00
Howard Chu
5c7b84b465 ITS#8321 fix mdb_cursor_put
Ignore sub-cursors that shouldn't be fixed up
2015-11-23 01:49:49 +00:00
Howard Chu
94831f7c3f ITS#8321 fix mdb_cursor_shadow()
Set a valid txn so that cursor fixup code works on the shadows
2015-11-23 01:49:37 +00:00
Howard Chu
0ec3967e1d ITS#8321 fix mdb_cursor_chk()
It was reporting spurious errors due to uninit'd cursors
2015-11-23 01:49:24 +00:00
Howard Chu
8773a08c43 ITS#8321 don't skip fixups on splitting cursors
Adjustments can't be skipped, in recursive calls each level must
fixup their own level.
2015-11-23 01:49:10 +00:00
Howard Chu
91dc62506b ITS#8321 Fix del/dupsort
When deleting a dupsort key, if other cursors pointed at that key,
set them to uninit'd, not EOF. They no longer have anything to
point at.
2015-11-23 01:48:59 +00:00
Howard Chu
94e8009ca4 ITS#8300 more for prev commit
Just tell explicitly which direction we moved/merged from
2015-11-23 01:47:39 +00:00
Howard Chu
ba85adb52d Silence some valgrind uninit warnings 2015-11-23 01:47:39 +00:00
Howard Chu
bfe2088946 Refix root split check from 5da67968af 2015-11-23 01:47:39 +00:00
Oskari Timperi
f13b971960 ITS#7992 assume Windows paths are UTF-8 2015-11-23 01:47:39 +00:00
Howard Chu
28b57ba8b9 ITS#8316 cursor fixup in page_merge
Deleting the merged page requires bumping down other ki's
of the page's parent.
2015-11-23 01:47:39 +00:00
Howard Chu
657dbcc811 ITS#8312, 8313, 8315 2015-11-19 17:29:42 +00:00
Howard Chu
1edb0e3a42 ITS#8315 fix ovpage_free
Keep dirty_room sync'd with dirty_list
2015-11-19 17:28:33 +00:00
Howard Chu
2fb8219aa3 ITS#8313 more for ITS#8062
dummy flags must be init'd due to 3d46d550
2015-11-19 17:28:23 +00:00
Hallvard Furuseth
db510359c9 ITS#8312 Fix loose pages in commit(nested txn) 2015-11-19 17:28:15 +00:00
Howard Chu
dfca54e0c8 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-18 10:28:46 +00:00
Howard Chu
27f71b4dd3 ITS#8311 2015-11-18 10:27:50 +00:00
Howard Chu
71c07f0d60 ITS#8311 add comment 2015-11-18 10:24:41 +00:00
Howard Chu
f9d3dc8293 ITS#8311 fix page_split from update_key
Check for top of stack. Usually the cursor only has height 1 when
calling page_split, but not always.
2015-11-18 10:05:28 +00:00
Hallvard Furuseth
a9877f783a ITS#7209 2015-11-17 18:49:31 +01:00
Hallvard Furuseth
2a839d5dfa ITS#7209 Default MDB_DSYNC = O_SYNC if no O_DSYNC 2015-11-17 18:37:33 +01:00
Howard Chu
dec097f8b0 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-13 09:29:40 +00:00
Howard Chu
f6b7277e9a ITS#8310 2015-11-13 09:28:36 +00:00
Howard Chu
a90415f301 ITS#8310 fix mdb_rebalance cursor fixup
When collapsing root, must adjust entire cursor stack
2015-11-13 09:25:55 +00:00
Howard Chu
21330494c5 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-11 11:51:34 +00:00
Howard Chu
79b12bbd7b Tweak robust mutex detection for glibc 2015-11-11 11:51:07 +00:00
Howard Chu
b2a9cbc6eb Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-09 20:15:59 +00:00
Howard Chu
4e1ec79f0e ITS#8304 2015-11-09 20:11:10 +00:00
Howard Chu
5d8f9ddf7e ITS#8304 fix page_merge
Was using the pre-touch dst page pointer instead of the touched page
2015-11-09 20:10:51 +00:00
Howard Chu
83734af7cb Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-06 10:41:57 +00:00
Howard Chu
712942d392 ITS#8300 more for node_move
When moving a node from one page to another, make sure other cursors'
parent index gets adjusted too.
2015-11-06 10:19:49 +00:00
Howard Chu
1d4e37652c Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-05 12:17:36 +00:00
Howard Chu
8e77cfce92 ITS#8301 remove assert in ber_get_next
Just return error.
2015-11-05 12:11:21 +00:00
Howard Chu
7d022e05a8 ITS#8300 simplify 2015-11-04 22:46:04 +00:00
Howard Chu
994923dbc5 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-04 22:34:06 +00:00
Howard Chu
0db71b9f1a ITS#8300 more for node_move fixups
When moving a node from the right neighbor, a different
adjustment is needed.
2015-11-04 22:31:01 +00:00
Howard Chu
b18d33c548 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-04 21:04:57 +00:00
Howard Chu
e339fced30 ITS#8300 2015-11-04 21:03:22 +00:00
Howard Chu
9fc7c94aeb ITS#8300 fix node_move
Don't adjust other cursors when we added a node on the right.
2015-11-04 21:01:30 +00:00
Howard Chu
af45cf3a04 ITS#8300 fix rebalance after node_move
ITS#8258, ITS#7829 fixes checked parent index to see if we were moving
from a left neighbor. Should have just checked to see if current index
was 0, meaning we added on the left. (Parent index may not tell us
anything meaningful after a nested rebalance.)
2015-11-04 20:38:30 +00:00
Howard Chu
dc650034cf Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-04 18:18:36 +00:00
Howard Chu
4359ffe08f ITS#8238, #8299 2015-11-04 18:17:50 +00:00
Howard Chu
17aab561f2 ITS#8238 fix DUPFIXED page_split
Parent mc_ki wasn't adjusted if new_indx was > split point
2015-11-04 18:11:12 +00:00
Howard Chu
96fd7f2396 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-11-04 17:08:18 +00:00
Howard Chu
c62b77b661 ITS#8299 fix page_merge cursor fixup
The parent's mc_ki has changed. We need to fix that up as well
in other cursors.
2015-11-04 17:05:55 +00:00
Howard Chu
9f97c1d2ef Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-10-31 09:28:51 +00:00
Howard Chu
caca4d8be6 Use MDB_USE_ROBUST not MDB_NO_ROBUST 2015-10-31 02:27:31 +00:00
Howard Chu
447f552756 Add MDB_NO_ROBUST to disable Robust Mutexes 2015-10-31 02:12:31 +00:00
Howard Chu
597ce61000 ITS#8295 fix Windows microsecond timer
Also add ldap_pvt_gettimeofday() to
emulate gettimeofday on Windows
2015-10-28 13:49:25 +00:00
Howard Chu
65f3ad14d5 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-10-26 20:19:04 +00:00
Howard Chu
550df2a583 More misc updates 2015-10-26 20:18:19 +00:00
Hallvard Furuseth
f1e07f9d14 Fix typo in mdb_tassert().
No effect on current code.
2015-10-25 14:40:27 +01:00
Pavel Medvedev
56adc467a6 ITS#8069 char* strings on Windows are ASCII 2015-10-25 10:56:39 +01:00
Pavel Medvedev
22958b0f9e ITS#8067 add ssize_t typedef for MSVC 2015-10-25 10:56:39 +01:00
Hallvard Furuseth
de5b689308 Simpler mdb_env_write_meta() 2015-10-25 10:56:39 +01:00
Hallvard Furuseth
bde5c231bc Kill magic numbers for NUM_METAS, databases 2015-10-25 10:56:38 +01:00
Hallvard Furuseth
8901d9cfbc ITS#7377 Catch mdb_put() to blocked/read-only txns
...early enough that txn state is left unchanged.
2015-10-25 10:55:22 +01:00
Hallvard Furuseth
01342bd5d2 ITS#7377 Always notice env error on txn startup.
Move the check to the end of txn startup.  Catches env
breakage which happens while the new txn waits for a lock.
2015-10-25 10:55:22 +01:00
Hallvard Furuseth
602c978761 Cleanup: Drop !mt_dbxs hack, use MDB_TXN_FINISHED 2015-10-25 10:55:22 +01:00
Hallvard Furuseth
a3ae2e7db1 Catch most uses of finished/parent txns.
* Add MDB_TXN_FINISHED, MDB_TXN_HAS_CHILD, MDB_TXN_BLOCKED.
* Clear mt_numdbs in writers, for TXN_DBI_EXIST() to catch.
  We already do in readers.
2015-10-25 10:55:22 +01:00
Hallvard Furuseth
9266843fa6 Move code into mdb_txn_end(). Was mdb_txn_reset0.
Side effects:
* Clean txn up a bit even before freeing it.
* Tweak DEBUG output at txn end. Add DEBUG after commit(writer).
2015-10-25 10:55:22 +01:00
Hallvard Furuseth
0cfc0a9736 Factor me_metas[toggle] out to mdb_env_pick_meta() 2015-10-25 10:55:22 +01:00
Hallvard Furuseth
490243424c Simpler mdb_node_add() 2015-10-25 10:55:22 +01:00
Hallvard Furuseth
6318038138 More ESECT declarations 2015-10-25 10:55:22 +01:00
Hallvard Furuseth
110fba2ef1 Add DB_USRVALID, to avoid 'dbi == FREE_DBI' tests 2015-10-25 10:55:22 +01:00
Hallvard Furuseth
b6f0179683 Simpler flag/DBI checks and MDB_DEBUG 2015-10-25 10:55:22 +01:00
Hallvard Furuseth
06df0a4655 Simpler mdb_drop().
MDB_DBI_CHANGED(,MAIN_DBI) is never true.
2015-10-25 10:55:22 +01:00
Hallvard Furuseth
e5f41ce56b Simpler mdb_node_shrink() 2015-10-25 10:55:22 +01:00
Hallvard Furuseth
9d6c973f76 Simpler mdb_txn_commit().
mt_env is always set.
Commit(mt_child) resets mt_child, so parent need not.
2015-10-25 10:55:22 +01:00
Hallvard Furuseth
ee06adb311 mdb_txn_begin() cleanup 2015-10-25 10:55:22 +01:00
Hallvard Furuseth
cc2a50aca2 mdb_drop0(): Omit scanning DUPSORT sub-DB leaves 2015-10-25 10:55:21 +01:00
Hallvard Furuseth
70788bfe45 Use mdb_cmp_long() for FREE_DBI 2015-10-25 10:55:21 +01:00
Hallvard Furuseth
a36f7a7fc2 mdb_env_get_flags(): Hide internal flags 2015-10-25 10:55:21 +01:00
Hallvard Furuseth
600e2b6ce0 Support robust mutexes/locks. Add mdb_mutex_t etc. 2015-10-25 10:55:21 +01:00
Hallvard Furuseth
3a71450436 Add MDB_USE_POSIX_MUTEX.
So far just to help aligning mdb.master and mdb.RE.
We'll make it an option later.
2015-10-25 10:55:21 +01:00
Hallvard Furuseth
f25c4f0db9 Whitespace (align with mdb.master) 2015-10-25 10:55:21 +01:00
leo@yuriev.ru
086bc04cd2 ITS#7969 Use __sync_synchronize()
The rest of 9a80a8a8e8
plus commit a937740aa0.
2015-10-25 10:55:21 +01:00
Hallvard Furuseth
3f6fa7aece Set/clear mp_pad, md_pad (MDB_DUPFIXED data size).
mdb_xcursor_init1(): md_pad is only used when MDB_DUPFIXED.
mdb_page_split():    Copy mp_pad too. Used by mdb_page_list().
2015-10-25 10:55:21 +01:00
Hallvard Furuseth
c616689d9a Cleanup MDB_env.me_txn0.
More fallout from 4d02c741b1.
2015-10-25 10:55:21 +01:00
Hallvard Furuseth
c0170bc0ec Copy some env flags to txn. Factor out flags.
Taken from mdb_txn_begin(,,MDB_NOMETASYNC, MDB_NOSYNC,,)
without adding those two flags yet, to align with mdb.master:
Part of 54516639ac (Renumber...)
+ 8adee9464f (Fix per-txn...).
2015-10-25 10:55:21 +01:00
leo@yuriev.ru
c65ca298b9 ITS#7971 mdb_txn_renew0(): Fix new readers slots.
commit 9a8eb95674 (mdb_txn_renew0)
plus b2ab9910dd (reader allocation)
from mdb.master.
2015-10-25 10:55:21 +01:00
David Barbour
076b773d6b ITS#7994 Access to current transaction ID.
commit b660491d3f (mdb_txn_id())
plus c36c167cc4 (fix prev commit)
from mdb.master.
2015-10-25 10:55:21 +01:00
Hallvard Furuseth
f3d3f60e3d Try to avoid an invalid datafile after failed init 2015-10-25 10:55:21 +01:00
Hallvard Furuseth
aa10c98f3f For ITS#7789: Ensure mapsize >= pages in use.
Check new mapsizes against mm_last_pg.  Move
mdb_env_init_meta0() so it can set mm_last_pg earlier.
2015-10-25 10:55:21 +01:00
Howard Chu
015e8675fd Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-10-25 08:14:55 +00:00
Howard Chu
fc3514152f ITS#8263, 8264, 7771, 8270 2015-10-25 08:13:25 +00:00
Ignacio Casal Quinteiro
52446f93e7 ITS#8270 win32: fix conversion error with MSVC 2015-10-25 08:10:34 +00:00
Howard Chu
24add6589b ITS#7771 fix cursor tracking on fake pages
node_del shifts nodes around, cursors pointing at fake pages
need to have their mc_pg[0] corrected.
2015-10-25 08:10:13 +00:00
Hallvard Furuseth
448b4c815a ITS#8263 streamline prev patch 2015-10-25 08:09:16 +00:00
Howard Chu
7e3c532823 ITS#8263 fix cursor tracking in cursor_put 2015-10-25 08:09:06 +00:00
Howard Chu
9ed1e57440 ITS#8264 fix cursor_del cursor tracking
Some destination fixups need to happen immediately after nodes
are moved, before rebalancing
2015-10-25 08:08:53 +00:00
Howard Chu
28a02271f0 ITS#8273 Windows file:// URL fixup 2015-10-19 08:52:28 +01:00
Howard Chu
6f53771687 ITS#8258 2015-10-04 03:02:04 +01:00
Howard Chu
b6974ccd9f Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-10-04 02:50:50 +01:00
Howard Chu
8bdadf68c5 ITS#8258 fix rebalance/split
The tree height can also increase during rebalance, not just shrink.
This can happen if update_key needs to split a parent branch page.
2015-10-04 02:13:07 +01:00
Howard Chu
db3175eaba ITS#8262 more
extended ops
2015-10-02 05:14:53 +01:00
Howard Chu
34ccd14f3e ITS#8262 add ldap_build_*_req functions
Basic ops except abandon and unbind; since they get no reply
it's not important for the caller to know their msgID.
2015-10-02 05:02:15 +01:00
Howard Chu
eccea851ff ITS#8259 fix usage ordering 2015-09-30 18:11:49 +01:00
Howard Chu
94d6581b50 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-09-29 18:16:11 +01:00
Howard Chu
be1795a616 ITS#8221 fix typos 2015-09-29 17:32:25 +01:00
Howard Chu
92d3b0c598 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-09-27 22:38:18 +01:00
Howard Chu
bc7d3d9124 ITS#8221, #8256 2015-09-27 22:37:28 +01:00
Howard Chu
4b01cb3727 ITS#8221 don't merge branch pages needlessly 2015-09-27 22:35:54 +01:00
Luke Yeager
ddb7478e06 ITS#8256 Create install directories if needed 2015-09-27 22:35:24 +01:00
Howard Chu
faeaa3ae8f ITS#7377, 8237 2015-09-12 23:08:14 +01:00
Howard Chu
d84fae3fe3 ITS#8237 fix ITS#7589 regression 2015-09-12 23:07:16 +01:00
Hallvard Furuseth
7f151b1137 ITS#7377 mdb_env_init_meta(): Catch calloc error 2015-09-12 23:07:07 +01:00
Howard Chu
844ee7df82 Revert "Revert "ITS#8240 remove obsolete assert""
We have never documented our use of assert, so can't expect
builders to do the right thing.
This reverts commit 55dd4d3275.
2015-09-12 22:18:22 +01:00
Howard Chu
55dd4d3275 Revert "ITS#8240 remove obsolete assert"
Not a bug.
This reverts commit 6fe51a9ab0.
2015-09-12 10:07:27 +01:00
Howard Chu
6fe51a9ab0 ITS#8240 remove obsolete assert 2015-09-10 00:37:32 +01:00
Howard Chu
0dba4d2c9a Threadqueues - remove obsolete comment 2015-08-22 17:54:20 +01:00
Howard Chu
9a8d38a9de Doc tweak - MDB_RESERVE / DUPSORT incompat
For those people who insist on ignoring the obvious.
2015-08-22 14:01:07 +01:00
Howard Chu
ed2a625de6 More for threadqueues
Revert previous patch, just delete all the associated juggling.
No longer serves any purpose.
2015-08-22 13:50:40 +01:00
Howard Chu
d7e4e206ad Return to release engineering 2015-08-21 21:42:25 +01:00
Howard Chu
e55956a591 Another MDB_APPEND doc tweak
Missed this in 7ce29b9edb
2015-08-21 21:41:36 +01:00
Howard Chu
c034282b14 More for threadqueues
Catch threads that are finishing while pool was pausing
2015-08-21 21:37:37 +01:00
Howard Chu
7308f0675a Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-08-14 01:03:42 +01:00
Howard Chu
5d67c6aed1 Release 0.9.16 2015-08-14 01:00:38 +01:00
Howard Chu
94ddee1bca Avoid hex timestamp in middle of lines
Tweaks commit 8d74f717ff
Don't worry about threading/race conditions here, it's not important
2015-08-04 13:26:16 +01:00
Howard Chu
2000f771f6 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-07-30 00:55:37 +01:00
Howard Chu
d139771b43 ITS#8192 fix reference to EINTR on WIN32 from ITS#8106 2015-07-30 00:51:04 +01:00
Howard Chu
c4ae054bce Updated for ITS#8181, #8190, #8200 2015-07-28 15:20:43 +01:00
Howard Chu
99ea907e74 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-07-28 15:14:10 +01:00
Hallvard Furuseth
4b58502c77 ITS#8200 Fix mdb_midl_shrink() usage, return void 2015-07-28 15:13:22 +01:00
Hallvard Furuseth
1fd0341f76 ITS#8181 Verify that records are/aren't DBs.
Except we don't catch the user passing F_SUBDATA to
mdb_cursor_<put/del>, like an internal LMDB call.
2015-07-28 15:13:10 +01:00
Howard Chu
7513bd4618 ITS#8190 fix cursor EOF bug 2015-07-28 15:12:58 +01:00
Howard Chu
e75fbc953f ITS#8201 LDAPSTACKGUARD feature 2015-07-16 18:58:23 +01:00
Howard Chu
4796f01209 ITS#8195 fix ITS#7027 regression, port number sign bit overflow
Another bug from 5de85b922a
2015-07-12 11:14:33 +01:00
Howard Chu
1b6085cb9b Return to Release Engineering 2015-07-02 18:04:25 +01:00
Quanah Gibson-Mount
a23fc2fd94 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-06-20 19:18:13 -05:00
Howard Chu
56e4e20ebc Release 0.9.15 2015-06-19 14:10:32 +01:00
Hallvard Furuseth
562b9c461b ITS#8158 Fix sendto() address length for CLDAP 2015-06-15 19:57:48 +02:00
Quanah Gibson-Mount
10755b91dd Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-06-05 15:50:26 -05:00
Hallvard Furuseth
416ecc7827 Update for mdb_env_open 2015-06-02 21:07:33 +02:00
Hallvard Furuseth
6794d898f8 Clarify mdb_env_open() doc of 'mode' param 2015-06-02 21:04:52 +02:00
Quanah Gibson-Mount
5fb6dea198 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-06-01 16:28:24 -05:00
Hallvard Furuseth
249d2b84dc more CHANGES 2015-05-29 03:08:32 +02:00
Hallvard Furuseth
2a1dd5ae1c ITS#8156 2015-05-28 21:13:24 +02:00
Hallvard Furuseth
a0b96697c5 ITS#8156 Fix MDB_MAXKEYSIZE doc 2015-05-28 20:51:39 +02:00
Hallvard Furuseth
277e536ffa ITS#8157 2015-05-28 00:12:53 +02:00
Hallvard Furuseth
6bfadb9178 ITS#8157 mdb_txn_renew0(): init after error checks 2015-05-28 00:12:18 +02:00
Hallvard Furuseth
91743d66e6 mtest*.c: Fix MDB_NOOVERWRITE, plug cursor leak 2015-05-28 00:10:29 +02:00
Hallvard Furuseth
822b2d502f ITS#8117 Fix MDB_INTEGERDUP keysize doc + md_dcmp 2015-05-28 00:08:51 +02:00
Hallvard Furuseth
17853783df Silence warnings 2015-05-04 21:07:02 +02:00
Quanah Gibson-Mount
a6ea07dd63 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-05-04 11:36:27 -05:00
Howard Chu
6bd97d4286 ITS#8117 better fix
Don't change mc_dbx because we would need to undo the change if
the txn aborts. Make the fix (for get) match existing code for put.
2015-05-03 07:52:47 +01:00
Howard Chu
7127753244 Revert "ITS#8117 cleanup prev commit"
This reverts commit 47c4e747a0.

Revert "ITS#8117 fix INTEGERDUP compare"

This reverts commit ba45e0c05a.
2015-05-03 07:43:50 +01:00
Quanah Gibson-Mount
b500b9148c Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-04-29 19:02:39 -05:00
Howard Chu
0fd2214a8b ITS#8117 2015-04-29 17:30:02 +01:00
Howard Chu
47c4e747a0 ITS#8117 cleanup prev commit 2015-04-29 17:30:02 +01:00
Howard Chu
ba45e0c05a ITS#8117 fix INTEGERDUP compare 2015-04-29 17:12:40 +01:00
Quanah Gibson-Mount
bd1068204d Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-04-23 12:49:31 -05:00
Howard Chu
5cdde0c5b7 ITS#8109 2015-04-23 05:52:13 +01:00
Howard Chu
b7511480c5 ITS#8109 fix mdb_cursor_del0 on empty DB 2015-04-23 05:50:48 +01:00
Howard Chu
8cf73291fb ITS#8106 2015-04-23 03:27:33 +01:00
Howard Chu
32d46d4ea2 ITS#8106 retry writes on EINTR 2015-04-23 03:26:03 +01:00
Quanah Gibson-Mount
14815f318b Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-04-22 14:59:19 -05:00
Hallvard Furuseth
5c89827817 Cleanup mtest* and sample-*.
Fix mdb_txn_begin(&read-only txn) calls. Test mdb_env_set_maxreaders().
Rename DBI open/close functions. Move mdb_dbi_close() out of txn.
2015-04-19 03:07:53 +02:00
Hallvard Furuseth
1693012d57 Reformat mdb_dbi_open() doc for clarity 2015-04-19 03:07:53 +02:00
Hallvard Furuseth
f46b642b06 mdb_txn_renew(): Clear error from previous txn 2015-04-19 03:05:47 +02:00
Howard Chu
dce0911b17 ITS#8062 fix uninit'd cursor index 2015-04-19 03:05:47 +02:00
Hallvard Furuseth
2072ae6a3b Fix EACCES description 2015-04-19 03:05:47 +02:00
Quanah Gibson-Mount
dc52a6fcab Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-04-16 14:59:07 -05:00
Howard Chu
b0032feb85 ITS#8062 also handle subcursors 2015-04-16 00:19:40 +01:00
Howard Chu
ddc4aa1aa3 ITS#8062 2015-04-15 23:48:09 +01:00
Howard Chu
97c7b6151e ITS#8062 fix rebalance
(Probably fixes the ITS, definitely fixes a bug) when collapsing
the root page, fixups of other cursors was incomplete.
2015-04-15 23:30:52 +01:00
Mikko Auvinen
de76b8d1ce ITS#8093 add LDAP_X_CONNECTING error string 2015-04-01 20:54:54 +01:00
Howard Chu
7aefa46b37 ITS#8090 fix for async connect 2015-04-01 20:54:12 +01:00
Quanah Gibson-Mount
1add666e5a Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-03-23 11:14:16 -05:00
Quanah Gibson-Mount
dd58f3dde4 ITS#8066 2015-02-27 17:15:23 -06:00
Howard Chu
82b6a04bb7 ITS#8066 fix mdb_load with large values 2015-02-27 17:14:52 -06:00
Quanah Gibson-Mount
c127e78fb0 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-02-12 11:30:00 -06:00
Quanah Gibson-Mount
b7d1afad42 Happy New Year 2015-02-12 11:28:55 -06:00
Quanah Gibson-Mount
21a374f2d4 Happy New Year 2015-02-12 11:28:21 -06:00
Quanah Gibson-Mount
1705fa7e55 Happy New Year 2015-02-11 15:36:57 -06:00
Howard Chu
79d90c3935 ITS#8050 fix ldap_get_option(LDAP_OPT_SESSION_REFCNT) 2015-02-04 03:16:20 +00:00
Howard Chu
e2b4366044 ITS#8028 fix ldap_new_connection 2015-01-21 01:02:12 +00:00
Quanah Gibson-Mount
c2cb945c30 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-01-19 13:31:51 -06:00
Hallvard Furuseth
6586299f55 Restrictive mdb_copy file mode.
Copied from 58ddb5527b.
2015-01-15 07:19:30 +01:00
Howard Chu
7df548dc04 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-01-14 21:46:57 +00:00
leo@yuriev.ru
8230b1b630 ITS#7970 LMDB: Critical Heisenbug
Inconsistent reading & SIGSEGV due to the race condition.
2015-01-14 19:24:18 +01:00
leo@yuriev.ru
1e5d79831c ITS#7969 LMDB: volatile.
Globally shared fields of meta-data were not 'volatile'.
Code from 9a80a8a8e8,
except the unportable __synchronize().
2015-01-14 19:24:18 +01:00
Howard Chu
fccca0ead9 Minor cleanup (coverity) 2015-01-14 16:59:54 +00:00
Howard Chu
bf4ed09c5e Plug leak (coverity) 2015-01-14 14:16:24 +00:00
Howard Chu
04591c4706 Minor cleanup (coverity) 2015-01-14 14:04:03 +00:00
Howard Chu
9e69e0b559 Plug unlikely memleak (coverity) 2015-01-13 21:13:46 +00:00
Howard Chu
7d483f7aba Fix dangling lock (coverity) 2015-01-13 21:13:46 +00:00
Howard Chu
08f5aca7db Plug unlikely memleak (coverity) 2015-01-13 20:38:38 +00:00
Howard Chu
ea80418cfc Fix potential null deref (coverity) 2015-01-13 19:22:42 +00:00
Howard Chu
9710c2b17b Fix argument order for ucisprop (coverity) 2015-01-13 18:20:36 +00:00
Quanah Gibson-Mount
9328a41f49 Merge remote-tracking branch 'origin/mdb.RE/0.9' 2015-01-13 10:24:08 -06:00
Howard Chu
ae6347bac1 ITS#8022 an async connect may still succeed immediately 2015-01-12 22:27:58 +00:00
Hallvard Furuseth
0599dee9d4 ITS#8021 doc: Don't mix MDB_WRITEMAP + non-WRITEMAP 2015-01-12 12:20:31 +01:00
Howard Chu
bf3961e3c7 More cleanup for fdatasync hack 2015-01-12 10:41:32 +00:00
Howard Chu
e85c944a3a Tweak conditionals for fdatasync hack 2015-01-11 11:41:08 +00:00
Howard Chu
0b9f42d1f4 ITS#8021 env_sync is invalid in RDONLY env 2015-01-09 11:25:07 +00:00