4 See also this page @ref{Новости, on russian}.
11 Fixed @command{nncp-bundle} workability.
14 Mistakenly @option{-mcd-wait} option was enabled by default in
20 @section Release 8.4.0
24 Multicast related interface names (@code{mcd-listen} and @code{mcd-send}
25 configuration options) are now regular expressions. By default
26 @command{nncp-cfgnew} uncomments them now with @code{.*} interface name.
29 @command{nncp-call} command has @option{-mcd-wait} option to wait for
30 multicast packet about node's address.
33 @command{nncp-file} command skips everything that is neither regular
34 file nor directory during pax-archive creation.
39 @section Release 8.3.0
43 Fixed building issues on 32-bit systems.
48 @section Release 8.2.0
52 Yggdrasil uses pure-Go IPv6+TCP network stack, instead of naked μTP
53 transport protocol, making it able to work as an ordinary TCP server
54 inside overlay network.
57 Yggdrasil's @code{prv;bind1,bind2;pub...}-like configuration strings are
58 replaced with URL-like ones (@code{yggdrasils://PRV?bind=BIND1&bind=BIND2&pub=PUB}).
61 Ability to pass multicast-related parameters to Yggdrasil configuration.
64 @command{nncp-daemon} is able to listen on both TCP and Yggdrasil-driven
65 sockets simultaneously.
68 @command{nncp-daemon}'s listening on peering endpoint socket is optional
69 -- you can be reached through the peers.
74 @section Release 8.1.0
78 @command{nncp-cfgdir} does not require @code{self} section existence in
82 Ability to act as Yggdrasil network client, using online protocol on top of it.
87 @section Release 8.0.2
91 Fixed sending ability to areas.
96 @section Release 8.0.1
100 Fixed incorrect @code{freq.chunked} value calculation. If it was missed,
101 then chunked transfer mode was forcefully turned on anyway.
104 Fixed incorrect full file's size calculation in @file{.nncp.meta}.
109 @section Release 8.0.0
113 @strong{Incompatible} encrypted packet format change: payload and pad
114 sizes are sent in-bound in the encrypted stream. That gives ability to
115 streamingly create encrypted packets, without knowing sizes in advance,
116 without creating temporary file or buffer data in memory.
119 Proper encrypted packet padding verification is done now. This is not
120 critical issue, but previously neither padding value, nor its size were
121 authenticated, giving ability to iteratively strip trailing bytes and
122 determine payload's size by observing the reaction of the encrypted
126 @command{nncp-exec} loses its @option{-use-tmp} option, because of
127 streaming-compatible encrypted packets format.
130 @command{nncp-file} and @command{nncp-exec} commands have
131 @option{-maxsize} option, limiting maximal resulting encrypted packet's
132 maximal size (returning error if it is exceeded). Could be useful,
133 because no payload size could be known in advance.
138 @section Release 7.7.0
142 Experimental @code{kqueue} and @code{inotify} based notifications
143 support about spool directory changes, for reducing their often reading
147 @file{.seen} and @file{.hdr} files moved to @file{seen/} and @file{hdr/}
148 subdirectories, for faster scanning of spool directories.
149 Current files migration required:
152 $ find $NNCPSPOOL -type f -name "*.hdr" -exec rm @{@} +
154 $ find $NNCPSPOOL -type d -name rx | while read rx ; do
157 find . -type f -name "*.seen" | while read fn ; do
158 mv $fn seen/$@{fn%.seen@}
162 $ find $NNCPSPOOL -type d -name area | while read area ; do
163 find $area -type f -name "*.seen" | while read fn ; do
172 @section Release 7.6.0
176 Logging may be done to specified opened file descriptor
177 (@env{$NNCPLOG=FD:5} for example).
178 That is friendly to use under @command{daemontools}.
181 Added additional checks of public keys existence in configuration file,
182 preventing some commands from failing.
187 @section Release 7.5.1
191 NNCP builds on NetBSD.
196 @section Release 7.5.0
200 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
201 will contain remote side's address (when running under appropriate
202 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
205 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
208 Do not exit if some of MCD network interfaces can not be listened --
209 only warn about that.
214 @section Release 7.4.0
218 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
223 @section Release 7.3.2
227 @command{hjson-cli} utility builds in vendor-mode now.
232 @section Release 7.3.1
236 Fixed possibly left opened file descriptor in online commands.
239 Severely decreased memory usage of MTH hashing.
244 @section Release 7.3.0
248 Fixed some workability problems on 32-bit systems with big files.
251 Ability to use directory with a bunch of files as a configuration.
252 @command{nncp-cfgdir} command appeared.
257 @section Release 7.2.1
261 Small optimizations in online commands.
266 @section Release 7.2.0
270 @command{nncp-trns} command appeared for manual transition packets creation.
273 If destination node of transitional packet has non empty @option{via}
274 route, then do not ignore, but use it.
277 Do not relay multicast packet to area message's originator, that
278 obviously has seen its own packet.
281 Much less memory usage during MTH hashing when offset is zero: when
282 packet is not resumed, but for example checked with @command{nncp-check}
288 @section Release 7.1.1
292 Fixed failing directories fsync after @file{.seen} file creation.
297 @section Release 7.1.0
301 Multicasting areas feature appeared. Implemented merely by an additional
302 plain packet type with @command{nncp-toss}, @command{nncp-file} and
303 @command{nncp-exec} commands modification.
306 Fixed workability of @command{nncp-file} and @command{nncp-exec}
307 commands, that use temporary file (stdin and @option{-use-tmp}).
310 Fixed disappearing bad return code in @command{nncp-exec} command.
313 Fixed invalid @file{.hdr} generation when transitional packets are used.
316 @option{-all} option appeared in @command{nncp-rm} command, applying to
317 all the nodes at once.
320 @option{-cycle} option appeared in @command{nncp-check} command, looping
321 the check in infinite cycle.
324 @command{nncp-rm} command can take node alias name.
327 @command{nncp-pkt} can parse @file{.hdr} files.
332 @section Release 7.0.0
336 Minimal required Go version 1.13.
339 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
340 Because of that, there are backward @strong{incompatible} changes of
341 encrypted files (everything laying in the spool directory) and
342 @file{.meta} files of chunked transfer.
344 Current implementation is far from being optimal: it lacks
345 parallelizable calculations and has higher memory consumption: nearly
346 512 KiB for each 1 GiB of file's data. Future performance and memory
347 size optimizations should not lead to packet's format change. But it is
348 still several times faster than BLAKE2b.
351 Resumed online downloads, because of MTH, require reading only of the
352 preceding part of file, not the whole one as was before.
355 @command{nncp-hash} utility appeared for calculating file's MTH hash.
358 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
359 packets. Lowering number of used primitives. Also, its encrypted
360 packet's header is used as an associated data during encryption.
363 MultiCast Discovery uses
364 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
367 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
370 @command{nncp-stat} reports about partly downloaded packets.
373 Updated dependencies.
378 @section Release 6.6.0
382 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
383 commands wait for all background checksummers completion after
384 connection is finished.
387 Added possibility of address determining through multicast announcement
388 in local area network, so called MCD (MultiCast Discovery).
393 @section Release 6.5.0
397 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
400 Fixed possible bad return code ignoring in automatic tosser.
403 Fixed race during file descriptors closing when online protocol call is
404 finished, that could lead to write error of received packet fragment.
407 Kill all packet transmission progress bars in @command{nncp-daemon},
408 @command{nncp-call} and @command{nncp-caller} when call is finished.
413 @section Release 6.4.0
417 Fixed possible race in online protocol, that lead to panic.
422 @section Release 6.3.0
426 Fixed possible panic while showing progress during online protocol.
431 @section Release 6.2.1
435 Three places in logs contained excess @code{%s}.
440 @section Release 6.2.0
444 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
447 Yet another logging refactoring and simplification.
448 Should be no visible differences to the end user.
453 @section Release 6.1.0
457 Optimization: most commands do not keep opened file descriptors now.
458 Previously you can exceed maximal number of opened files if you have got
459 many packets in the spool directory.
462 Optimization: do not close file descriptor of the file we download
463 online. Previously each chunk lead to expensive open/close calls.
466 Online downloaded files are saved with @file{.nock} (non-checksummed)
467 suffix, waiting either for @command{nncp-check}, or online daemons to
468 perform integrity check.
471 Optimization: files, that are not resumed, are checksummed immediately
472 during the online download, skipping @file{.nock}-intermediate step.
475 Ability to store encrypted packet's header in @file{.hdr} file, close to
476 the packet itself. That can greatly increase performance of packets
477 listing on filesystems with big block's size.
482 @section Release 6.0.0
486 Log uses human readable and easy machine parseable
487 @url{https://www.gnu.org/software/recutils/, recfile} format for the
488 records, instead of structured RFC 3339 lines. Old logs are not readable
489 by @command{nncp-log} anymore.
492 @option{-autotoss*} option workability with @command{nncp-daemon}'s
493 @option{-inetd} mode.
496 Call's @option{when-tx-exists} allows to make a call only when outbound
497 packets exists. Combined with seconds-aware cron expression that can be
498 used as some kind of auto dialler.
501 @command{nncp-cronexpr} command allows you to check validity and
502 expectations of specified cron expression.
507 @section Release 5.6.0
511 @option{-autotoss*} option runs tosser not after the call, but every
512 second while it is active.
515 @option{autotoss}, @option{autotoss-doseen},
516 @option{autotoss-nofile}, @option{autotoss-nofreq},
517 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
518 @option{calls} configuration section. You can configure per-call
519 automatic tosser options.
522 Use vendoring, instead of @env{$GOPATH} overriding during tarball
523 installation, because current minimal Go's version is 1.12 and it
529 @section Release 5.5.1
533 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
534 variables in @file{config} during installation.
539 @section Release 5.5.0
543 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
544 @command{nncp-bundle} and @command{nncp-stat}.
547 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
550 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
551 options now. Uncompressed packets are not compatible with previous NNCP
555 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
556 have @option{-autotoss*} options for running tosser after call is ended.
559 Updated dependencies. Minimal required Go version is 1.12.
564 @section Release 5.4.1
568 Fixed @code{SENDMAIL} variable usage during the build.
573 @section Release 5.4.0
577 Updated dependencies.
580 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
581 This should not influence package maintainers, because minimal @command{redo}
582 implementation is included in tarball.
587 @section Release 5.3.3
591 More various error checks.
594 Updated dependencies.
599 @section Release 5.3.2
603 Fixed incorrect logic of @option{onlinedeadline} timeout, where
604 connection won't take into account incoming packets events and will
605 forcefully disconnect.
610 @section Release 5.3.1
614 Fixed @option{onlinedeadline} workability with call addresses that use
615 external commands (@verb{#"|somecmd"#}).
618 @command{nncp-stat} has @option{-pkt} option displaying information
619 about each packet in the spool.
624 @section Release 5.3.0
628 Progress messages contain prefix, describing the running action.
631 Fixed not occurring handshake messages padding.
634 Finish all SP protocol related goroutines, less memory leak.
637 SP protocol generates less socket write calls, thus generating less TCP
641 Check @option{onlinedeadline} and @option{maxonlinetime} options every
642 second, independently from socket reads (up to 10 seconds).
645 Once per minute, if no other traffic exists, PING packets are sent in
646 SP-connection. That allows faster determining of connection unworkability.
649 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
654 @section Release 5.2.1
658 Fixed SP protocol error handling, sometimes causing program panic.
663 @section Release 5.2.0
667 Most commands by default show oneline operations progress.
668 @option{-progress}, @option{-noprogress} command line options,
669 @option{noprogress} configuration file option appeared.
672 Fixed incorrect @command{nncp-check} command return code, that returned
673 bad code when everything is good.
676 Free disk space check during @command{nncp-bundle -rx} call.
681 @section Release 5.1.2
685 @strong{Critical} vulnerability: remote peers authentication could lead
686 to incorrect identification of remote side, allowing foreign encrypted
690 Bugfix: private and public Noise keys were swapped in newly created
691 configuration files, that lead to inability to authenticate online peers.
694 Explicit directories fsync-ing for guaranteed files renaming.
699 @section Release 5.1.1
703 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
708 @section Release 5.1.0
712 @command{nncp-file} can send directories, automatically creating pax
716 Free disk space is checked during outbound packets creation.
719 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
720 file options replaced with the structure:
721 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
724 Added @option{freq.maxsize} configuration file option, forbidding of
725 freq sending larger than specified size.
728 Ability to notify about successfully executed commands (exec) with
729 @option{notify.exec} configuration file option.
734 @section Release 5.0.0
738 @strong{Incompatible} configuration file format change: YAML is
739 replaced with Hjson, due to its simplicity, without noticeable lack
740 of either functionality or convenience.
743 @strong{Incompatible} plain packet format changes. Older versions are
744 not supported. @code{zlib} compression is replaced with
745 @code{Zstandard}, due to its speed and efficiency, despite library
746 version is not mature enough.
749 Ability to call remote nodes via pipe call of external command, not only
753 @command{nncp-cfgnew} generates configuration file with many
754 comments. @option{-nocomments} option can be used for an old
758 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
759 avoid possible collisions with @file{.nncp.chunkCTR}.
762 Ability to override process umask through configuration file option.
765 Files and directories are created with 666/777 permissions by default,
766 allowing control with @command{umask}.
769 Updated dependencies.
772 Full usage of go modules for dependencies management
773 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
776 Forbid any later GNU GPL version autousage
777 (project's licence now is GNU GPLv3-only).
784 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
792 @strong{Incompatible} encrypted and eblob packet format change: AEAD
793 encryption mode with 128 KiB blocks is used now, because previously
794 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
795 decrypted data to external command. Older versions are not supported.
798 Available free space checking before copying in @command{nncp-xfer},
799 @command{nncp-daemon}, @command{nncp-call(er)}.
802 @command{nncp-call} has ability only to list packets on remote node,
803 without their transmission.
806 @command{nncp-call} has ability to transfer only specified packets.
809 Workability of @option{xxrate} preference in @option{calls}
810 configuration file section.
813 Dependant libraries are updated.
819 Begin using of @code{go.mod} subsystem.
826 @item @command{nncp-daemon} can be run as @command{inetd}-service.
834 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
835 if @file{.seen} exists and treat it like file was already downloaded.
836 Possibly it was transferred out-of-bound and remote side needs to be
840 If higher priority packet is spooled, then @command{nncp-daemon} will
841 queue its sending first, interrupting lower priority transmissions.
844 Simple packet rate limiter added to online-related tools
845 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
848 Ability to specify niceness with symbolic notation:
849 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
852 Changed default niceness levels:
853 for @command{nncp-exec} from 64 to 96,
854 for @command{nncp-freq} from 64 to 160,
855 for @command{nncp-file} from 196 to 224.
863 @strong{Incompatible} @emph{bundle} archive format changes and
864 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
865 valid tar archives, but Go 1.9 made them invalid because of long paths
866 inside. NNCP accidentally was dependant on that bug. Explicit adding of
867 @file{NNCP/} directory in archive restores workability with valid tar
875 Ability to disable relaying at all using @verb{|-via -|} command line option.
883 @strong{Incompatible} plain packet format changes. Older versions are
887 Ability to queue remote command execution, by configuring @option{exec}
888 option in configuration file and using @command{nncp-exec} command:
891 @command{nncp-mail} command is replaced with more flexible
892 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
893 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
895 @option{sendmail} configuration file option is replaced with
896 @option{exec}. @verb{|sendmail: [...]|} must be replaced with
897 @verb{|exec: sendmail: [...]|}.
901 Ability to override @option{via} configuration option for destination
902 node via @option{-via} command line option for following commands:
903 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
906 Chunked files, having size less than specified chunk size, will be sent
907 as an ordinary single file.
910 Exec commands are invoked with additional @env{$NNCP_NICE} and
911 @env{$NNCP_SELF} environment variables.
914 Files, that are sent as a reply to freq, have niceness level taken from
915 the freq packet. You can set desired niceness during @command{nncp-freq}
916 invocation using @option{-replynice} option.
919 @command{nncp-toss} command can ignore specified packet types during
920 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
924 @command{nncp-file} command uses
925 @option{FreqMinSize}/@option{FreqChunked} configuration file options
926 for @option{-minsize}/@option{-chunked} by default. You can turn this
927 off by specifying zero value.
936 @strong{Incompatible} encrypted/eblob packet format changes. Older
937 versions are not supported.
940 Twofish encryption algorithm is replaced with ChaCha20. It is much more
941 faster. One cryptographic primitive less.
944 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
945 another cryptographic primitive less (assuming that BLAKE2X is nearly
946 identical to BLAKE2).
955 @strong{Incompatible} encrypted packet format changes. Older versions
959 @command{nncp-bundle} command can either create stream of encrypted
960 packets, or digest it. It is useful when dealing with
961 @code{stdin}/@code{stdout} based transmission methods (like writing to
962 CD-ROM without intermediate prepared ISO image and working with tape
966 @command{nncp-toss} is able to create @file{.seen} files preventing
967 duplicate packets receiving.
970 Single background checksum verifier worker is allowed in
971 @command{nncp-call}. This is helpful when thousands of small inbound
972 packets could create many goroutines.
975 Ability to override path to spool directory and logfile through either
976 command line argument, or environment variable.
979 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
980 @file{.part}, @file{.lock} and temporary files.
985 @section Release 0.12
987 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
991 @section Release 0.11
993 @item @command{nncp-stat}'s command output is sorted by node name.
997 @section Release 0.10
1000 @command{nncp-freq}'s @file{DST} argument is optional now. Last
1001 @file{SRC} path's element will be used by default.
1005 @section Release 0.9
1008 Fix @option{-rx}/@option{-tx} arguments processing in
1009 @command{nncp-call} command. They were ignored.
1013 @section Release 0.8
1016 Little bugfix in @command{nncp-file} command, where @option{-minsize}
1017 option for unchunked transfer was not in KiBs, but in bytes.
1021 @section Release 0.7
1025 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
1026 encrypted temporary file for that.
1029 Chunked files transmission appeared with corresponding
1030 @command{nncp-reass} command and @option{freqchunked} configuration file
1031 entry. Useful for transferring big files over small storage devices.
1034 @option{freqminsize} configuration file option, analogue to
1035 @option{-minsize} one.
1038 @command{nncp-xfer}'s @option{-force} option is renamed to
1039 @option{-mkdir} for clarity.
1042 @option{-minsize} option is specified in KiBs, not bytes, for
1046 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
1047 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
1048 common prefix and are grouped together for convenience.
1051 @command{nncp-cfgenc} command appeared, allowing configuration file
1052 encryption/decryption, for keeping it safe without any either OpenPGP or
1053 similar tools usage.
1056 Cryptographic libraries (dependencies) are updated.
1061 @section Release 0.6
1063 @item Small @command{nncp-rm} command appeared.
1064 @item Cryptographic libraries (dependencies) are updated.
1068 @section Release 0.5
1071 Trivial small fix in default niceness level of @command{nncp-file}
1072 and @command{nncp-freq} commands.
1076 @section Release 0.4
1080 Small fix in @command{nncp-call}, @command{nncp-caller},
1081 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
1085 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
1086 and more convenient to use.
1089 @command{nncp-mincfg} command appeared: helper allowing to create
1090 minimalistic stripped down configuration file without private keys, that
1091 is useful during @command{nncp-xfer} usage.
1096 @section Release 0.3
1098 @item Fixed compatibility with Go 1.6.
1102 @section Release 0.2
1106 @strong{Incompatible} packet's format change (magic number is changed
1107 too): size field is encrypted and is not send in plaintext anymore.
1110 @option{-minsize} option gives ability to automatically pad outgoing
1111 packets to specified minimal size.
1114 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
1115 always check new @emph{tx} packets appearance in the background while
1116 connected. Remote side is immediately notified.
1119 @option{-onlinedeadline} option gives ability to configure timeout of
1120 inactivity of online connection, when it could be disconnected. It could
1121 be used to keep connection alive for a long time.
1124 @option{-maxonlinetime} option gives ability to set maximal allowable
1125 online connection aliveness time.
1128 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
1131 @command{nncp-pkt} command can decompress the data.