Commit graph

1099 commits

Author SHA1 Message Date
Howard Chu
29ebd02efd MDB_VL32 support 64 bit DBs on 32 bit processors 2015-12-20 01:08:18 +00:00
Howard Chu
1ba5adb2ec MDB_VL32 preparation
Use 64 bit types consistently. This keeps database structures the
same size for MDB_VL32 and native 64 bit builds.
2015-12-20 00:19:12 +00:00
Howard Chu
86ae31ebf5 Fix typos 2015-12-19 22:57:00 +00:00
Howard Chu
2cc88d20cc Add Getting Started doc 2015-12-19 22:53:26 +00:00
Howard Chu
c7a786eb00 ITS#7992 cleanup
check for utf8_to_utf16 failures
2015-12-15 18:45:34 +00:00
Hallvard Furuseth
791badd096 mdb_dbi_open(): Catch strdup failure 2015-12-12 19:25:06 +01:00
Howard Chu
8b95e7d13e ITS#8324 fix for read-only envs 2015-12-08 19:35:59 +00:00
Howard Chu
58d1fd4c73 ITS#8336 fix page_search_root assert on FreeDB
Let "illegal" branch pages thru on the FreeDB - the condition
is only temporary and will be fixed by the time rebalance finishes.
2015-12-08 18:21:48 +00:00
Hallvard Furuseth
abb13ba176 ITS#8334 Fix MDB_APPENDDUP vs. rewrite(single item) 2015-12-08 16:43:55 +01:00
Howard Chu
c4e31434c7 ITS#8324 additional tweaks
VirtualAlloc is only needed with WRITEMAP. Regular writes
already extend the mmap implictly.
2015-12-06 20:54:23 +00:00
Sebastien Launay
4198bbde17 ITS#8330 Fix robust mutex detection for glibc 2.10 and 2.11
pthread_mutexattr_setrobust and pthread_mutex_consistent are provided since 2.12 not 2.10:
https://sourceware.org/git/?p=glibc.git;a=commit;h=402cd98775db1478f64c9b0dbe00664b89eb2773
https://sourceware.org/git/?p=glibc.git;a=commit;h=78ee21859939ff75ccf8bbe00499b0c462df2e2d
2015-12-03 19:03:47 +00:00
Howard Chu
45fe870c2e ITS#8169 more Makefile tweaks
Use all the same vars as main OpenLDAP makefiles
2015-12-01 14:10:12 +00:00
Howard Chu
50949b4606 ITS#8169 more for prev patch
Missed the mkdir command
2015-12-01 13:48:29 +00:00
Howard Chu
fb5a768a77 ITS#8324 incremental DB file growth for Windows 2015-11-30 18:46:19 +00:00
Howard Chu
dbbbfa10be ITS#8321 cleanup unused var
from da67af1a4b
2015-11-24 20:21:51 +00:00
Heiko Becker
6cff716f60 ITS#8169 Allow passing mandir to make install
The motivation for this change is my distribution moving to a multiarch
layout. While the architecture specific stuff (binaries, libraries,
etc.) is installed under /usr/${host}/{bin,lib,...} architecture-independent
data should still be installed to /usr/share/.
2015-11-24 16:07:10 +00:00
Heiko Becker
3a4fd79cbf ITS#8168 Allow passing AR to make
This is helpful when the ar executable is named differently, for
example with an arch specific prefix.
2015-11-24 16:04:01 +00:00
Howard Chu
da67af1a4b ITS#8321 fix ambiguity in cursor_put fixup
After delete/add of a node, other nodes may no longer be
pointing at the data they intended. This can confuse subsequent
fixups.
2015-11-24 15:17:28 +00:00
Howard Chu
50d96511f8 Cleanup C_DEL flag usage
Only set it if the cursor's current position was deleted
2015-11-24 15:17:28 +00:00
Howard Chu
1424aa06a6 ITS#8321 More cursor fixup
Based on page_touch fixup from ITS#7594 but expanded:
make sure sub-cursors agree with main cursors.
2015-11-24 15:17:23 +00:00
Howard Chu
69829288dc ITS#8321 page_touch - don't fixup the cursor we just touched 2015-11-24 15:17:19 +00:00
Howard Chu
db02a71dd8 ITS#8321 mdb_put cursor needs tracking too 2015-11-24 15:17:15 +00:00
Howard Chu
cf8677e1b8 ITS#8321 Fix mdb_cursor_set
Always reinit mc_pg[0] if cursor is not C_INITIALIZED
It might have a stale value when using nested txns
2015-11-24 15:17:10 +00:00
Howard Chu
b5ce8108e8 ITS#8321 deinit empty cursors
Always unset C_INIT flag if the cursor's target DB has been deleted
2015-11-24 15:17:06 +00:00
Howard Chu
83258ca81e ITS#8323 Fix nested commit
Must remove our spilled pages from parent's dirty list
2015-11-24 12:46:57 +00:00
Hallvard Furuseth
fae01c8df5 CURSOR_TMP_[UN]TRACK() -> WITH_CURSOR_TRACKING() 2015-11-23 13:03:09 +01:00
Orivej Desh
85d2f9804a ITS#8320 mdb_load: fix loading data from simple text files
mdb_load -T was supposed to read escaped text, but 21b51cb7 "Add mdb_load"
made it read hex.
2015-11-23 02:01:37 +00:00
Orivej Desh
e29cfa0b49 ITS#8319 mdb_load: explain readline and mdb_cursor_put errors 2015-11-23 02:01:21 +00:00
Howard Chu
6fdaea4165 ITS#8321 reorganize page_split fixups
DUPFIXED fixups needed to occur after separator update.
MDB_RESERVE handling moved after split fixup.
2015-11-23 01:40:56 +00:00
Howard Chu
fd598083a7 ITS#8321 simplify page_split fixups 2015-11-23 01:40:56 +00:00
Howard Chu
3a31dd5a8a ITS#8321 track temporary cursors
In rebalance/split operations, temporary cursors need to be visible
to propagate fixups
2015-11-23 01:40:56 +00:00
Howard Chu
828107eb63 ITS#8321 fix mdb_cursor_put
Ignore sub-cursors that shouldn't be fixed up
2015-11-23 01:40:56 +00:00
Howard Chu
0d5ebc508e ITS#8321 fix mdb_cursor_shadow()
Set a valid txn so that cursor fixup code works on the shadows
2015-11-23 01:40:56 +00:00
Howard Chu
88ac698707 ITS#8321 fix mdb_cursor_chk()
It was reporting spurious errors due to uninit'd cursors
2015-11-23 01:40:56 +00:00
Howard Chu
3b9f857d8b ITS#8321 don't skip fixups on splitting cursors
Adjustments can't be skipped, in recursive calls each level must
fixup their own level.
2015-11-23 01:40:56 +00:00
Howard Chu
f3eb26c9bb ITS#8321 Fix del/dupsort
When deleting a dupsort key, if other cursors pointed at that key,
set them to uninit'd, not EOF. They no longer have anything to
point at.
2015-11-23 01:40:45 +00:00
Howard Chu
f3e38565e4 ITS#8316 more for 60c34d14ec 2015-11-23 01:40:01 +00:00
Howard Chu
d6ae2553df ITS#8300 more for prev commit
Just tell explicitly which direction we moved/merged from
2015-11-23 01:02:57 +00:00
Howard Chu
946e4d3b21 Silence some valgrind uninit warnings 2015-11-20 09:47:56 +00:00
Howard Chu
1bfe7578bd Refix root split check from 5da67968af 2015-11-20 09:20:16 +00:00
Oskari Timperi
58ad1dd757 ITS#7992 assume Windows paths are UTF-8 2015-11-20 01:11:31 +00:00
Howard Chu
60c34d14ec ITS#8316 cursor fixup in page_merge
Deleting the merged page requires bumping down other ki's
of the page's parent.
2015-11-19 20:04:16 +00:00
Howard Chu
a98b74e6df ITS#8315 fix ovpage_free
Keep dirty_room sync'd with dirty_list
2015-11-19 10:01:59 +00:00
Howard Chu
f08b70d0df ITS#8313 more for ITS#8062
dummy flags must be init'd due to 3d46d550
2015-11-18 21:33:51 +00:00
Hallvard Furuseth
4d140b92ee ITS#8312 Fix loose pages in commit(nested txn) 2015-11-18 16:30:24 +01:00
Howard Chu
355f64ad07 ITS#8311 add comment 2015-11-18 10:24:58 +00:00
Howard Chu
6d63afb1d9 ITS#8311 fix page_split from update_key
Check for top of stack. Usually the cursor only has height 1 when
calling page_split, but not always.
2015-11-18 10:01:34 +00:00
Hallvard Furuseth
3360cbad66 ITS#7209 Default MDB_DSYNC = O_SYNC if no O_DSYNC 2015-11-17 18:22:25 +01:00
Howard Chu
c46119a545 ITS#8310 fix mdb_rebalance cursor fixup
When collapsing root, must adjust entire cursor stack
2015-11-13 09:27:07 +00:00
Howard Chu
c6d908075e Tweak robust mutex detection for glibc 2015-11-11 09:44:30 +00:00
Howard Chu
3c9786b5e8 ITS#8304 fix page_merge
Was using the pre-touch dst page pointer instead of the touched page
2015-11-09 20:09:10 +00:00
Howard Chu
0fdfdf320c ITS#8300 more for node_move
When moving a node from one page to another, make sure other cursors'
parent index gets adjusted too.
2015-11-06 10:12:45 +00:00
Howard Chu
3ff8a73704 ITS#8300 simplify 2015-11-04 22:45:38 +00:00
Howard Chu
b12bdaaade ITS#8300 more for node_move fixups
When moving a node from the right neighbor, a different
adjustment is needed.
2015-11-04 22:32:05 +00:00
Howard Chu
7a5a78ef0c ITS#8300 fix node_move
Don't adjust other cursors when we added a node on the right.
2015-11-04 21:02:44 +00:00
Howard Chu
0c777dfc99 ITS#8300 fix rebalance after node_move
ITS#8258, ITS#7829 fixes checked parent index to see if we were moving
from a left neighbor. Should have just checked to see if current index
was 0, meaning we added on the left. (Parent index may not tell us
anything meaningful after a nested rebalance.)
2015-11-04 21:02:32 +00:00
Howard Chu
eddd9b7537 ITS#8238 fix DUPFIXED page_split
Parent mc_ki wasn't adjusted if new_indx was > split point
2015-11-04 18:12:33 +00:00
Howard Chu
d372a2a199 ITS#8299 fix page_merge cursor fixup
The parent's mc_ki has changed. We need to fix that up as well
in other cursors.
2015-11-04 17:03:48 +00:00
Howard Chu
b9130d3d63 Use MDB_USE_ROBUST not MDB_NO_ROBUST 2015-10-31 02:28:12 +00:00
Howard Chu
2be6797534 Add MDB_NO_ROBUST to disable Robust Mutexes 2015-10-31 02:11:47 +00:00
Hallvard Furuseth
2ee9c4a30e Fix MDB_NOSYNC,MDB_NOMETASYNC thinko 2015-10-28 09:37:23 +01:00
Ignacio Casal Quinteiro
619ccdd3da ITS#8270 win32: fix conversion error with MSVC 2015-10-25 08:06:37 +00:00
Howard Chu
9411de60d2 ITS#7771 more for prev commit 2015-10-12 10:29:09 +01:00
Howard Chu
7c1baed4de ITS#7771 fix cursor tracking on fake pages
node_del shifts nodes around, cursors pointing at fake pages
need to have their mc_pg[0] corrected.
2015-10-12 00:08:41 +01:00
Hallvard Furuseth
e211b870d0 ITS#8263 streamline prev patch 2015-10-11 21:40:49 +01:00
Howard Chu
c456d219a9 ITS#8263 fix cursor tracking in cursor_put 2015-10-07 06:30:58 +01:00
Howard Chu
b42cd65193 ITS#8264 fix cursor_del cursor tracking
Some destination fixups need to happen immediately after nodes
are moved, before rebalancing
2015-10-06 08:02:03 +01:00
Howard Chu
8b46dcc26d ITS#8258 fix rebalance/split
The tree height can also increase during rebalance, not just shrink.
This can happen if update_key needs to split a parent branch page.
2015-10-04 02:14:29 +01:00
Hallvard Furuseth
436333b16c Fix typo in mdb_tassert().
No effect on current code.
2015-10-01 19:43:58 +02:00
Howard Chu
e034bd3d84 ITS#8259 fix usage ordering 2015-09-30 18:11:20 +01:00
Howard Chu
3cbbe3a0d8 ITS#8221 fix typos 2015-09-29 17:31:56 +01:00
Howard Chu
2247507bb8 ITS#8221 cleanup prev commit 2015-09-27 22:34:22 +01:00
Howard Chu
7267e0f566 ITS#8221 don't merge branch pages needlessly 2015-09-26 16:50:28 +01:00
Luke Yeager
62826b0965 ITS#8256 Create install directories if needed 2015-09-25 19:59:30 +01:00
Howard Chu
7e476e4983 ITS#8237 fix ITS#7589 regression 2015-09-06 20:38:58 +01:00
Hallvard Furuseth
e9e3c9fb51 ITS#7377 mdb_env_init_meta(): Catch calloc error 2015-08-23 11:12:45 +02:00
Howard Chu
bc4c177b91 Doc tweak - MDB_RESERVE / DUPSORT incompat
For those people who insist on ignoring the obvious.
2015-08-22 14:00:12 +01:00
Howard Chu
c77fbc6f35 Another MDB_APPEND doc tweak
Missed this in 7ce29b9edb
2015-08-21 21:40:33 +01:00
Pavel Medvedev
10c808e4f9 ITS#8069 char* strings on Windows are ASCII 2015-08-19 17:21:16 +01:00
Pavel Medvedev
8d198fdd5a ITS#8067 add ssize_t typedef for MSVC 2015-08-19 16:39:08 +01:00
Howard Chu
80e997a0eb Bump version to 0.9.16 2015-08-14 01:01:40 +01:00
Howard Chu
c9d45600cd ITS#8192 fix typo 2015-07-30 00:54:05 +01:00
Howard Chu
d4f9568249 ITS#8192 cleanup unused label on WIN32 2015-07-29 20:03:43 +01:00
Howard Chu
572aff7e80 ITS#8192 fix reference to EINTR on WIN32 from ITS#8106 2015-07-29 20:01:34 +01:00
Hallvard Furuseth
2c6c267a23 Simpler mdb_env_write_meta() 2015-07-26 07:20:19 +02:00
Hallvard Furuseth
af29f6a594 Kill magic numbers for NUM_METAS, databases 2015-07-26 07:16:41 +02:00
Hallvard Furuseth
4dea7d44fa ITS#7377 Catch mdb_put() to blocked/read-only txns
...early enough that txn state is left unchanged.
2015-07-19 21:44:02 +02:00
Hallvard Furuseth
d7db12ad77 ITS#7377 Always notice env error on txn startup.
Move the check to the end of txn startup.  Catches env
breakage which happens while the new txn waits for a lock.
2015-07-19 21:43:10 +02:00
Hallvard Furuseth
060b63a58d Cleanup: Drop !mt_dbxs hack, use MDB_TXN_FINISHED 2015-07-19 21:31:54 +02:00
Hallvard Furuseth
3e301ec400 Catch most uses of finished/parent txns.
* Add MDB_TXN_FINISHED, MDB_TXN_HAS_CHILD, MDB_TXN_BLOCKED.
* Clear mt_numdbs in writers, for TXN_DBI_EXIST() to catch.
  We already do in readers.
2015-07-19 21:31:25 +02:00
Hallvard Furuseth
b6973a3324 Move code into mdb_txn_end(). Was mdb_txn_reset0.
Side effects:
* Clean txn up a bit even before freeing it.
* Tweak DEBUG output at txn end. Add DEBUG after commit(writer).
2015-07-19 21:30:12 +02:00
Hallvard Furuseth
90f6fc4ba7 ITS#8200 Fix mdb_midl_shrink() usage, return void 2015-07-19 21:18:31 +02:00
Hallvard Furuseth
91fc43f17c Factor me_metas[toggle] out to mdb_env_pick_meta() 2015-07-11 21:10:33 +02:00
Hallvard Furuseth
62aabaa4aa Simpler mdb_node_add() 2015-07-11 21:09:36 +02:00
Hallvard Furuseth
45e405528b ITS#8181 Verify that records are/aren't DBs.
Except we don't catch the user passing F_SUBDATA to
mdb_cursor_<put/del>, like an internal LMDB call.
2015-07-11 21:01:40 +02:00
Howard Chu
749633e48a ITS#8190 fix cursor EOF bug 2015-07-07 13:42:41 +01:00
Hallvard Furuseth
ad87d6a3f4 More ESECT declarations 2015-07-04 13:50:21 +02:00
Hallvard Furuseth
ebb8b67109 Add DB_USRVALID, to avoid 'dbi == FREE_DBI' tests 2015-07-04 13:49:12 +02:00
Hallvard Furuseth
5cd5e928c1 Simpler flag/DBI checks and MDB_DEBUG 2015-07-04 13:48:07 +02:00
Hallvard Furuseth
4033f31acb Simpler mdb_drop().
MDB_DBI_CHANGED(,MAIN_DBI) is never true.
2015-07-04 13:48:06 +02:00