unbound/util
Wouter Wijngaards 218f5cfc92
Fast Reload Option (#1042)
* - fast-reload, add unbound-control fast_reload

* - fast-reload, make a thread to service the unbound-control command.

* - fast-reload, communication sockets for information transfer.

* - fast-reload, fix compile for unbound-dnstap-socket.

* - fast-reload, set nonblocking communication to keep the server thread
  responding to DNS requests.

* - fast-reload, poll routine to test for readiness, timeout fails connection.

* - fast-reload, detect loop in sock_poll_timeout routine.

* - fast-reload, send done and exited notification.

* - fast-reload, defines for constants in ipc.

* - fast-reload, ipc socket recv and send resists partial reads and writes and
  can continue byte by byte. Also it can continue after an interrupt.

* - fast-reload, send exit command to thread when done.

* - fast-reload, output strings for client on string list.

* - fast-reload, add newline to terminal output.

* - fast-reload, send client string to remote client.

* - fast-reload, better debug output.

* - fast-reload, print queue structure, for output to the remote client.

* - fast-reload, move print items to print queue from fast_reload_thread struct.

* - fast-reload, keep list of pending print queue items in daemon struct.

* - fast-reload, comment explains in_list for printq to print remainder.

* - fast-reload, unit test testdata/fast_reload_thread.tdir that tests the
  thread output.

* - fast-reload, fix test link for fast_reload_printq_list_delete function.

* - fast-reload, reread config file from disk.

* - fast-reload, unshare forwards, making the structure locked, with an rwlock.

* - fast-reload, for nonthreaded, the unbound-control commands forward,
  forward_add and forward_delete should be distributed to other processes,
  but when threaded, they should not be distributed to other threads because
  the structure is not thread specific any more.

* - fast-reload, unshared stub hints, making the structure locked, with an rwlock.

* - fast-reload, helpful comments for hints lookup function return value.

* - fast-reload, fix bug in fast reload printout, the strlist appendlist routine,
  and printout time statistics after the reload is done.

* - fast-reload, keep track of reloadtime and deletestime and print them.

* - fast-reload, keep track of constructtime and print it.

* - fast-reload, construct new items.

* - fast-reload, better comment.

* - fast-reload, reload the config and swap trees for forwards and stub hints.

* - fast-reload, in forwards_swap_tree set protection of trees with locks.

* - fast-reload, in hints_swap_tree also swap the node count of the trees.

* - fast-reload, reload ipc to stop and start threads.

* - fast-reload, unused forward declarations removed.

* - fast-reload, unit test that fast reload works with forwards and stubs.

* - fast-reload, fix clang analyzer warnings.

* - fast-reload, small documentation entry in unbound-control -h output.

* - fast-reload, printout memory use by fast reload, in bytes.

* - fast-reload, compile without threads.

* - fast-reload, document fast_reload in man page.

* - fast-reload, print ok when done successfully.

* - fast-reload, option for fast-reload commandline, +v verbosity option,
  with timing and memory use output.

* - fast-reload, option for fast-reload commandline, +p does not pause threads.

* - fast-reload, option for fast-reload commandline, +d drops mesh queries.

* - fast-reload, fix to poll every thread with nopause to make certain that
  resources are not held by the threads and can be deleted.

* - fast-reload, fix to use atomic store for config variables with nopause.

* - fast-reload, reload views.

* - fast-reload, when tag defines are different, it drops the queries.

* - fast-reload, fix tag define check.

* - fast-reload, document that tag change causes drop of queries.

* - fast-reload, fix space in documentation man page.

* - fast-reload, copy respip client information to query state, put views tree
  in module env for lookup.

* - fast-reload, nicer respip view comparison.

* - fast-reload, respip global set is in module env.

* - fast-reload, document that respip_client_info acl info is copied.

* - fast-reload, reload the respip_set.

* - fast-reload, document no pause and pick up of use_response_ip boolean.

* - fast-reload, fix test compile.

* - fast-reload, reload local zones.

* Update locking management for iter_fwd and iter_hints methods. (#1054)

fast reload, move most of the locking management to iter_fwd and
iter_hints methods. The caller still has the ability to handle its
own locking, if desired, for atomic operations on sets of different
structs.

Co-authored-by: Wouter Wijngaards <wcawijngaards@users.noreply.github.com>

* - fast-reload, reload access-control.

* - fast-reload, reload access control interface, such as interface-action.

* - fast-reload, reload tcp-connection-limit.

* - fast-reload, improve comments on acl_list and tcl_list swap tree.

* - fast-reload, fixup references to old tcp connection limits in open tcp
  connections.

* - fast-reload, fixup to clean tcp connection also for different linked order.

* - fast-reload, if no tcp connection limits existed, no need to remove
  references for that.

* - fast-reload, document more options that work and do not work.

* - fast-reload, reload auth_zone and rpz data.

* - fast-reload, fix auth_zones_get_mem.

* - fast-reload, fix compilation of testbound for the new comm_timer_get_mem
  reference in remote control.

* - fast-reload, change use_rpz with reload.

* - fast-reload, list changes in auth zones and stop zonemd callbacks for
  deleted auth zones.

* - fast-reload, note xtree is not swapped, and why it is not swapped.

* - fast-reload, for added auth zones, pick up zone transfer and zonemd tasks.

* - fast-reload, unlock xfr when done with transfer pick up.

* - fast-reload, unlock z when picking up the xfr for it during transfer task
  pick up.

* - fast-reload, pick up task changes for added, deleted and modified auth zones.

* - fast-reload, remove xfr of auth zone deletion without tasks.

* - fast-reload, pick up zone transfer config.

* - fast-reload, the main worker thread picks up the transfer tasks and also
  performs setup of the xfer struct.

* - fast-reload, keep writelock on newzone when auth zone changes.

* - fast-reload, change cachedb_enabled setting.

* - fast-reload, pick up edns-strings config.

* - fast-reload, note that settings are not updated.

* - fast-reload, pick up dnstap config.

* - fast-reload, dnstap options that need to be loaded without +p.

* - fast-reload, fix auth zone reload

* - fast-reload, remove debug for auth zone test.

* - fast-reload, fix auth zone reload with zone transfer.

* - fast-reload, fix auth zone reload lock order.

* - fast-reload, remove debug from fast reload test.

* - fast-reload, remove unused function.

* - fast-reload, fix the worker trust anchor probe timer lock acquisition in
  the probe answer callback routine for trust anchor probes.

* - fast-reload, reload trust anchors.

* - fast-reload, fix trust anchor reload lock on autr global data and test
  for trust anchor reload.

* - fast-reload, adjust cache sizes.

* - fast-reload, reload cache sizes when changed.

* - fast-reload, reload validator env changes.

* - fast-reload, reload mesh changes.

* - fast-reload, check for incompatible changes.

* - fast-reload, improve error text for incompatible change.

* - fast-reload, fix check config option compatibility.

* - fast-reload, improve error text for nopause change.

* - fast-reload, fix spelling of incompatible options.

* - fast-reload, reload target-fetch-policy, outbound-msg-retry, max-sent-count
  and max-query-restarts.

* - fast-reload, check nopause config change for target-fetch-policy.

* - fast-reload, reload do-not-query-address, private-address and capt-exempt.

* - fast-reload, check nopause config change for do-not-query-address,
  private-address and capt-exempt.

* - fast-reload, check fast reload not possible due to interface and
  outgoing-interface changes.

* - fast-reload, reload nat64 settings.

* - fast-reload, reload settings stored in the infra structure.

* - fast-reload, fix modstack lookup and remove outgoing-range check.

* - fast-reload, more explanation for config parse failure.

* - fast-reload, reload worker outside network changes.

* - fast-reload, detect incompatible changes in network settings.

* fast-reload, commit test files.

* - fast-reload, fix warnings for call types in windows compile.

* - fast-reload, fix warnings and comm_point_internal for tcp wouldblock calls.

* - fast-reload, extend lock checks for repeat thread ids.

* - fast-reload, additional test cases, cache change and tag changes.

* - fast-reload, fix documentation for auth_zone_verify_zonemd_with_key.

* - fast-reload, fix copy_cfg type casts and memory leak on config parse failure.

* - fast-reload, fix use of WSAPoll.

* Review comments for the fast reload feature (#1259)

* - fast-reload review, respip set can be null from a view.

* - fast-reload review, typos.

* - fast-reload review, keep clang static analyzer happy.

* - fast-reload review, don't forget to copy tag_actions.

* - fast-reload review, less indentation.

* - fast-reload review, don't leak respip_actions when reloading.

* - fast-reload review, protect NULL pointer dereference in get_mem
  functions.

* - fast-reload review, add fast_reload_most_options.tdir to test most
  options with high verbosity when fast reloading.

* - fast-reload review, don't skip new line on long error printouts.

* - fast-reload review, typo.

* - fast-reload review, use new_z for consistency.

* - fast-reload review, nit for unlock ordering to make eye comparison
  with the lock counterpart easier.

* - fast-reload review, in case of error the sockets are already closed.

* - fast-reload review, identation.

* - fast-reload review, add static keywords.

* - fast-reload review, update unbound-control usage text.

* - fast-reload review, updates to the man page.

* - fast-reload, the fast-reload command is experimental.

* - fast-reload, fix compile of doqclient for fast reload functions.

* Changelog comment for #1042
- Merge #1042: Fast Reload. The unbound-control fast_reload is added.
  It reads changed config in a thread, then only briefly pauses the
  service threads, that keep running. DNS service is only interrupted
  briefly, less than a second.

---------

Co-authored-by: Yorgos Thessalonikefs <yorgos@nlnetlabs.nl>
2025-03-31 15:25:24 +02:00
..
data - For #1175, the default value of serve-expired-ttl is set to 86400 2024-12-03 13:09:51 +01:00
shm_side check before use daemon->shm_info (#1229) 2025-01-21 15:47:51 +01:00
storage Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
alloc.c - Fix add reallocarray to alloc stats unit test, and disable 2024-10-10 10:43:23 +02:00
alloc.h - Fix that unbound-control reload frees the rrset keys and returns 2018-05-01 14:00:06 +00:00
as112.c And document the files. 2016-02-09 13:51:35 +00:00
as112.h And document the files. 2016-02-09 13:51:35 +00:00
config_file.c Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
config_file.h Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
configlexer.lex DNSoverQUIC (#871) 2024-10-09 10:32:03 +02:00
configparser.y - Fix to display warning if quic-port is set but dnsoverquic is not 2024-10-14 11:34:26 +02:00
configyyrename.h Prevent a few more yacc clashes. 2021-01-19 17:13:00 +01:00
edns.c Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
edns.h Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
fptr_wlist.c Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
fptr_wlist.h Call module init init again, and new function startup and destartup. 2024-07-01 16:10:07 +02:00
iana_ports.inc - iana portlist update. 2025-03-31 14:25:16 +02:00
locks.c - Fix to rename internally used types from _t to _type, because _t 2017-01-19 10:25:41 +00:00
locks.h DNSoverQUIC (#871) 2024-10-09 10:32:03 +02:00
log.c Do not shadow tm on line 236. (#1243) 2025-02-25 09:36:44 +01:00
log.h - Fix #1144: [FR] log timestamps in ISO8601 format with timezone. 2024-09-25 11:16:46 +02:00
mini_event.c Update mini_event.c 2021-08-06 12:00:56 +08:00
mini_event.h - Fix mini_event.h on OpenBSD cannot find fd_set. 2020-08-04 08:14:25 +02:00
module.c - For #1189, homogenize the input buffer size for dname_str(). 2024-12-02 11:53:56 +01:00
module.h Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
net_help.c Unique DoT and DoH SSL contexts to allow for different ALPN (#1222) 2025-01-20 15:43:44 +01:00
net_help.h Unique DoT and DoH SSL contexts to allow for different ALPN (#1222) 2025-01-20 15:43:44 +01:00
netevent.c Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
netevent.h Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
proxy_protocol.c - For #1110: Test for fallthrough attribute in configure and add 2024-07-23 09:47:42 +02:00
proxy_protocol.h proxy-protocol, review comments: 2023-09-29 17:31:52 +02:00
random.c Allow use of libbsd functions with configure option --with-libbsd 2020-01-26 19:09:43 -05:00
random.h - Fix Bad Randomness in Seed, reported by X41 D-Sec. 2019-11-20 14:40:50 +01:00
rbtree.c fixes for _t changes. 2017-01-19 14:11:59 +00:00
rbtree.h layout. 2017-01-20 16:09:37 +00:00
regional.c - Fix regional_alloc_init for potential unaligned source of the copy. 2023-08-17 15:22:54 +02:00
regional.h - Fix padding of struct regional for 32bit systems. 2020-11-24 17:06:54 +01:00
rfc_1982.c Prevent warnings from -Wmissing-prototypes. 2023-09-05 17:35:30 +02:00
rfc_1982.h - For #762: relocate RFC 1982 serial number arithmetic functions to their own 2023-08-01 17:26:14 +02:00
rtt.c Introduce infra-cache-max-rtt option to config max retransmit timeout 2022-07-16 01:46:18 -07:00
rtt.h Introduce infra-cache-max-rtt option to config max retransmit timeout 2022-07-16 01:46:18 -07:00
siphash.c - For #1110: Test for fallthrough attribute in configure and add 2024-07-23 09:47:42 +02:00
siphash.h - For #762: More generic integration for siphash.c 2023-06-22 11:45:08 +02:00
tcp_conn_limit.c Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
tcp_conn_limit.h Fast Reload Option (#1042) 2025-03-31 15:25:24 +02:00
timehist.c timeval_func: move all timeval manipulation to separate file 2023-04-26 03:23:41 -07:00
timehist.h - (for 1.6.3:) unbound.h exports the shm stats structures. They use 2017-04-13 12:47:29 +00:00
timeval_func.c - Fix for #882: small changes, date updated in Copyright for 2023-04-26 13:49:33 +02:00
timeval_func.h - Fix for #882: small changes, date updated in Copyright for 2023-04-26 13:49:33 +02:00
tube.c Fix heap corruption when calling ub_ctx_delete in Windows (#1157) 2024-11-01 16:26:05 +01:00
tube.h - Fix to log a verbose message at operational notice level if a 2022-09-01 15:14:20 +02:00
ub_event.c Fix typos 2021-11-13 16:56:15 +02:00
ub_event.h - Spelling fixes, from Phil Porada. 2017-09-15 14:29:28 +00:00
ub_event_pluggable.c Don't call a function which hasn't been defined 2021-07-15 17:55:33 +01:00
winsock_event.c - Fix to timeval_add for remaining second in microseconds. 2019-08-01 16:48:41 +02:00
winsock_event.h fixes for _t changes. 2017-01-19 14:11:59 +00:00