5 See also this page @ref{Новости, on russian}.
12 @command{nncp-ack} previously did not remove corresponding @file{hdr/} files.
17 @section Release 8.6.0
21 @command{nncp-xfer} checks if locally copied packet's checksum differs
22 from the source's one.
25 @command{nncp-call} has bad return code if its queues contain unfinished jobs.
28 @command{nncp-ack} command appeared, that sends explicit packet receipt
29 acknowledgement (ACK packet). That acknowledgement deletes referenced
30 packet from the outbound spool.
33 Ability to turn @code{fsync} operation off using @env{$NNCPNOSYNC=1}
37 Added various indices in documentation, that should help searching in it.
42 @section Release 8.5.0
46 Fixed @command{nncp-bundle} workability.
49 Mistakenly @option{-mcd-wait} option was enabled by default in
53 Ability to override internal default timeout for online protocol through
54 @env{$NNCPDEADLINE} environment variable. Can be useful for very high
58 NNCP builds on OpenBSD.
63 @section Release 8.4.0
67 Multicast related interface names (@code{mcd-listen} and @code{mcd-send}
68 configuration options) are now regular expressions. By default
69 @command{nncp-cfgnew} uncomments them now with @code{.*} interface name.
72 @command{nncp-call} command has @option{-mcd-wait} option to wait for
73 multicast packet about node's address.
76 @command{nncp-file} command skips everything that is neither regular
77 file nor directory during pax-archive creation.
82 @section Release 8.3.0
86 Fixed building issues on 32-bit systems.
91 @section Release 8.2.0
95 Yggdrasil uses pure-Go IPv6+TCP network stack, instead of naked μTP
96 transport protocol, making it able to work as an ordinary TCP server
97 inside overlay network.
100 Yggdrasil's @code{prv;bind1,bind2;pub@dots{}}-like configuration strings are
101 replaced with URL-like ones (@code{yggdrasils://PRV?bind=BIND1&bind=BIND2&pub=PUB}).
104 Ability to pass multicast-related parameters to Yggdrasil configuration.
107 @command{nncp-daemon} is able to listen on both TCP and Yggdrasil-driven
108 sockets simultaneously.
111 @command{nncp-daemon}'s listening on peering endpoint socket is optional
112 -- you can be reached through the peers.
117 @section Release 8.1.0
121 @command{nncp-cfgdir} does not require @code{self} section existence in
125 Ability to act as Yggdrasil network client, using online protocol on top of it.
130 @section Release 8.0.2
134 Fixed sending ability to areas.
139 @section Release 8.0.1
143 Fixed incorrect @code{freq.chunked} value calculation. If it was missed,
144 then chunked transfer mode was forcefully turned on anyway.
147 Fixed incorrect full file's size calculation in @file{.nncp.meta}.
152 @section Release 8.0.0
156 @strong{Incompatible} encrypted packet format change: payload and pad
157 sizes are sent in-bound in the encrypted stream. That gives ability to
158 streamingly create encrypted packets, without knowing sizes in advance,
159 without creating temporary file or buffer data in memory.
162 Proper encrypted packet padding verification is done now. This is not
163 critical issue, but previously neither padding value, nor its size were
164 authenticated, giving ability to iteratively strip trailing bytes and
165 determine payload's size by observing the reaction of the encrypted
169 @command{nncp-exec} loses its @option{-use-tmp} option, because of
170 streaming-compatible encrypted packets format.
173 @command{nncp-file} and @command{nncp-exec} commands have
174 @option{-maxsize} option, limiting maximal resulting encrypted packet's
175 maximal size (returning error if it is exceeded). Could be useful,
176 because no payload size could be known in advance.
181 @section Release 7.7.0
185 Experimental @code{kqueue} and @code{inotify} based notifications
186 support about spool directory changes, for reducing their often reading
190 @file{.seen} and @file{.hdr} files moved to @file{seen/} and @file{hdr/}
191 subdirectories, for faster scanning of spool directories.
192 Current files migration required:
195 $ find $NNCPSPOOL -type f -name "*.hdr" -exec rm @{@} +
197 $ find $NNCPSPOOL -type d -name rx | while read rx ; do
200 find . -type f -name "*.seen" | while read fn ; do
201 mv $fn seen/$@{fn%.seen@}
205 $ find $NNCPSPOOL -type d -name area | while read area ; do
206 find $area -type f -name "*.seen" | while read fn ; do
215 @section Release 7.6.0
219 Logging may be done to specified opened file descriptor
220 (@env{$NNCPLOG=FD:5} for example).
221 That is friendly to use under @command{daemontools}.
224 Added additional checks of public keys existence in configuration file,
225 preventing some commands from failing.
230 @section Release 7.5.1
234 NNCP builds on NetBSD.
239 @section Release 7.5.0
243 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
244 will contain remote side's address (when running under appropriate
245 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
248 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
251 Do not exit if some of MCD network interfaces can not be listened --
252 only warn about that.
257 @section Release 7.4.0
261 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
266 @section Release 7.3.2
270 @command{hjson-cli} utility builds in vendor-mode now.
275 @section Release 7.3.1
279 Fixed possibly left opened file descriptor in online commands.
282 Severely decreased memory usage of MTH hashing.
287 @section Release 7.3.0
291 Fixed some workability problems on 32-bit systems with big files.
294 Ability to use directory with a bunch of files as a configuration.
295 @command{nncp-cfgdir} command appeared.
300 @section Release 7.2.1
304 Small optimizations in online commands.
309 @section Release 7.2.0
313 @command{nncp-trns} command appeared for manual transition packets creation.
316 If destination node of transitional packet has non empty @option{via}
317 route, then do not ignore, but use it.
320 Do not relay multicast packet to area message's originator, that
321 obviously has seen its own packet.
324 Much less memory usage during MTH hashing when offset is zero: when
325 packet is not resumed, but for example checked with @command{nncp-check}
331 @section Release 7.1.1
335 Fixed failing directories @code{fsync} after @file{.seen} file creation.
340 @section Release 7.1.0
344 Multicasting areas feature appeared. Implemented merely by an additional
345 plain packet type with @command{nncp-toss}, @command{nncp-file} and
346 @command{nncp-exec} commands modification.
349 Fixed workability of @command{nncp-file} and @command{nncp-exec}
350 commands, that use temporary file (@code{stdin} and @option{-use-tmp}).
353 Fixed disappearing bad return code in @command{nncp-exec} command.
356 Fixed invalid @file{.hdr} generation when transitional packets are used.
359 @option{-all} option appeared in @command{nncp-rm} command, applying to
360 all the nodes at once.
363 @option{-cycle} option appeared in @command{nncp-check} command, looping
364 the check in infinite cycle.
367 @command{nncp-rm} command can take node alias name.
370 @command{nncp-pkt} can parse @file{.hdr} files.
375 @section Release 7.0.0
379 Minimal required Go version 1.13.
382 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
383 Because of that, there are backward @strong{incompatible} changes of
384 encrypted files (everything laying in the spool directory) and
385 @file{.meta} files of chunked transfer.
387 Current implementation is far from being optimal: it lacks
388 parallelizable calculations and has higher memory consumption: nearly
389 512 KiB for each 1 GiB of file's data. Future performance and memory
390 size optimizations should not lead to packet's format change. But it is
391 still several times faster than BLAKE2b.
394 Resumed online downloads, because of MTH, require reading only of the
395 preceding part of file, not the whole one as was before.
398 @command{nncp-hash} utility appeared for calculating file's MTH hash.
401 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
402 packets. Lowering number of used primitives. Also, its encrypted
403 packet's header is used as an associated data during encryption.
406 MultiCast Discovery uses
407 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
410 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
413 @command{nncp-stat} reports about partly downloaded packets.
416 Updated dependencies.
421 @section Release 6.6.0
425 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
426 commands wait for all background checksummers completion after
427 connection is finished.
430 Added possibility of address determining through multicast announcement
431 in local area network, so called MCD (MultiCast Discovery).
436 @section Release 6.5.0
440 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
443 Fixed possible bad return code ignoring in automatic tosser.
446 Fixed race during file descriptors closing when online protocol call is
447 finished, that could lead to write error of received packet fragment.
450 Kill all packet transmission progress bars in @command{nncp-daemon},
451 @command{nncp-call} and @command{nncp-caller} when call is finished.
456 @section Release 6.4.0
460 Fixed possible race in online protocol, that lead to panic.
465 @section Release 6.3.0
469 Fixed possible panic while showing progress during online protocol.
474 @section Release 6.2.1
478 Three places in logs contained excess @code{%s}.
483 @section Release 6.2.0
487 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
490 Yet another logging refactoring and simplification.
491 Should be no visible differences to the end user.
496 @section Release 6.1.0
500 Optimization: most commands do not keep opened file descriptors now.
501 Previously you can exceed maximal number of opened files if you have got
502 many packets in the spool directory.
505 Optimization: do not close file descriptor of the file we download
506 online. Previously each chunk lead to expensive open/close calls.
509 Online downloaded files are saved with @file{.nock} (non-checksummed)
510 suffix, waiting either for @command{nncp-check}, or online daemons to
511 perform integrity check.
514 Optimization: files, that are not resumed, are checksummed immediately
515 during the online download, skipping @file{.nock}-intermediate step.
518 Ability to store encrypted packet's header in @file{.hdr} file, close to
519 the packet itself. That can greatly increase performance of packets
520 listing on filesystems with big block's size.
525 @section Release 6.0.0
529 Log uses human readable and easy machine parseable
530 @url{https://www.gnu.org/software/recutils/, recfile} format for the
531 records, instead of structured RFC 3339 lines. Old logs are not readable
532 by @command{nncp-log} anymore.
535 @option{-autotoss*} option workability with @command{nncp-daemon}'s
536 @option{-inetd} mode.
539 Call's @option{when-tx-exists} allows to make a call only when outbound
540 packets exists. Combined with seconds-aware cron expression that can be
541 used as some kind of auto dialler.
544 @command{nncp-cronexpr} command allows you to check validity and
545 expectations of specified cron expression.
550 @section Release 5.6.0
554 @option{-autotoss*} option runs tosser not after the call, but every
555 second while it is active.
558 @option{autotoss}, @option{autotoss-doseen},
559 @option{autotoss-nofile}, @option{autotoss-nofreq},
560 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
561 @option{calls} configuration section. You can configure per-call
562 automatic tosser options.
565 Use vendoring, instead of @env{$GOPATH} overriding during tarball
566 installation, because current minimal Go's version is 1.12 and it
572 @section Release 5.5.1
576 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
577 variables in @file{config} during installation.
582 @section Release 5.5.0
586 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
587 @command{nncp-bundle} and @command{nncp-stat}.
590 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
593 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
594 options now. Uncompressed packets are not compatible with previous NNCP
598 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
599 have @option{-autotoss*} options for running tosser after call is ended.
602 Updated dependencies. Minimal required Go version is 1.12.
607 @section Release 5.4.1
611 Fixed @code{SENDMAIL} variable usage during the build.
616 @section Release 5.4.0
620 Updated dependencies.
623 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
624 This should not influence package maintainers, because minimal @command{redo}
625 implementation is included in tarball.
630 @section Release 5.3.3
634 More various error checks.
637 Updated dependencies.
642 @section Release 5.3.2
646 Fixed incorrect logic of @option{onlinedeadline} timeout, where
647 connection won't take into account incoming packets events and will
648 forcefully disconnect.
653 @section Release 5.3.1
657 Fixed @option{onlinedeadline} workability with call addresses that use
658 external commands (@verb{#"|somecmd"#}).
661 @command{nncp-stat} has @option{-pkt} option displaying information
662 about each packet in the spool.
667 @section Release 5.3.0
671 Progress messages contain prefix, describing the running action.
674 Fixed not occurring handshake messages padding.
677 Finish all SP protocol related goroutines, less memory leak.
680 SP protocol generates less socket write calls, thus generating less TCP
684 Check @option{onlinedeadline} and @option{maxonlinetime} options every
685 second, independently from socket reads (up to 10 seconds).
688 Once per minute, if no other traffic exists, PING packets are sent in
689 SP-connection. That allows faster determining of connection unworkability.
692 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
697 @section Release 5.2.1
701 Fixed SP protocol error handling, sometimes causing program panic.
706 @section Release 5.2.0
710 Most commands by default show oneline operations progress.
711 @option{-progress}, @option{-noprogress} command line options,
712 @option{noprogress} configuration file option appeared.
715 Fixed incorrect @command{nncp-check} command return code, that returned
716 bad code when everything is good.
719 Free disk space check during @command{nncp-bundle -rx} call.
724 @section Release 5.1.2
728 @strong{Critical} vulnerability: remote peers authentication could lead
729 to incorrect identification of remote side, allowing foreign encrypted
733 Bugfix: private and public Noise keys were swapped in newly created
734 configuration files, that lead to inability to authenticate online peers.
737 Explicit directories @code{fsync}-ing for guaranteed files renaming.
742 @section Release 5.1.1
746 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
751 @section Release 5.1.0
755 @command{nncp-file} can send directories, automatically creating pax
759 Free disk space is checked during outbound packets creation.
762 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
763 file options replaced with the structure:
764 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
767 Added @option{freq.maxsize} configuration file option, forbidding of
768 freq sending larger than specified size.
771 Ability to notify about successfully executed commands (exec) with
772 @option{notify.exec} configuration file option.
777 @section Release 5.0.0
781 @strong{Incompatible} configuration file format change: YAML is
782 replaced with Hjson, due to its simplicity, without noticeable lack
783 of either functionality or convenience.
786 @strong{Incompatible} plain packet format changes. Older versions are
787 not supported. @code{zlib} compression is replaced with
788 @code{Zstandard}, due to its speed and efficiency, despite library
789 version is not mature enough.
792 Ability to call remote nodes via pipe call of external command, not only
796 @command{nncp-cfgnew} generates configuration file with many
797 comments. @option{-nocomments} option can be used for an old
801 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
802 avoid possible collisions with @file{.nncp.chunkCTR}.
805 Ability to override process umask through configuration file option.
808 Files and directories are created with 666/777 permissions by default,
809 allowing control with @command{umask}.
812 Updated dependencies.
815 Full usage of go modules for dependencies management
816 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
819 Forbid any later GNU GPL version autousage
820 (project's licence now is GNU GPLv3-only).
827 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
835 @strong{Incompatible} encrypted and eblob packet format change: AEAD
836 encryption mode with 128 KiB blocks is used now, because previously
837 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
838 decrypted data to external command. Older versions are not supported.
841 Available free space checking before copying in @command{nncp-xfer},
842 @command{nncp-daemon}, @command{nncp-call(er)}.
845 @command{nncp-call} has ability only to list packets on remote node,
846 without their transmission.
849 @command{nncp-call} has ability to transfer only specified packets.
852 Workability of @option{xxrate} preference in @option{calls}
853 configuration file section.
856 Dependant libraries are updated.
862 Begin using of @code{go.mod} subsystem.
869 @item @command{nncp-daemon} can be run as @command{inetd}-service.
877 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
878 if @file{.seen} exists and treat it like file was already downloaded.
879 Possibly it was transferred out-of-bound and remote side needs to be
883 If higher priority packet is spooled, then @command{nncp-daemon} will
884 queue its sending first, interrupting lower priority transmissions.
887 Simple packet rate limiter added to online-related tools
888 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
891 Ability to specify niceness with symbolic notation:
892 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
895 Changed default niceness levels:
896 for @command{nncp-exec} from 64 to 96,
897 for @command{nncp-freq} from 64 to 160,
898 for @command{nncp-file} from 196 to 224.
906 @strong{Incompatible} @emph{bundle} archive format changes and
907 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
908 valid tar archives, but Go 1.9 made them invalid because of long paths
909 inside. NNCP accidentally was dependant on that bug. Explicit adding of
910 @file{NNCP/} directory in archive restores workability with valid tar
918 Ability to disable relaying at all using @verb{|-via -|} command line option.
926 @strong{Incompatible} plain packet format changes. Older versions are
930 Ability to queue remote command execution, by configuring @option{exec}
931 option in configuration file and using @command{nncp-exec} command:
934 @command{nncp-mail} command is replaced with more flexible
935 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
936 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
938 @option{sendmail} configuration file option is replaced with
939 @option{exec}. @code{sendmail: [@dots{}]} must be replaced with
940 @code{exec: sendmail: [@dots{}]}.
944 Ability to override @option{via} configuration option for destination
945 node via @option{-via} command line option for following commands:
946 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
949 Chunked files, having size less than specified chunk size, will be sent
950 as an ordinary single file.
953 Exec commands are invoked with additional @env{$NNCP_NICE} and
954 @env{$NNCP_SELF} environment variables.
957 Files, that are sent as a reply to freq, have niceness level taken from
958 the freq packet. You can set desired niceness during @command{nncp-freq}
959 invocation using @option{-replynice} option.
962 @command{nncp-toss} command can ignore specified packet types during
963 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
967 @command{nncp-file} command uses
968 @option{FreqMinSize}/@option{FreqChunked} configuration file options
969 for @option{-minsize}/@option{-chunked} by default. You can turn this
970 off by specifying zero value.
979 @strong{Incompatible} encrypted/eblob packet format changes. Older
980 versions are not supported.
983 Twofish encryption algorithm is replaced with ChaCha20. It is much more
984 faster. One cryptographic primitive less.
987 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
988 another cryptographic primitive less (assuming that BLAKE2X is nearly
989 identical to BLAKE2).
998 @strong{Incompatible} encrypted packet format changes. Older versions
1002 @command{nncp-bundle} command can either create stream of encrypted
1003 packets, or digest it. It is useful when dealing with
1004 @code{stdin}/@code{stdout} based transmission methods (like writing to
1005 CD-ROM without intermediate prepared ISO image and working with tape
1009 @command{nncp-toss} is able to create @file{.seen} files preventing
1010 duplicate packets receiving.
1013 Single background checksum verifier worker is allowed in
1014 @command{nncp-call}. This is helpful when thousands of small inbound
1015 packets could create many goroutines.
1018 Ability to override path to spool directory and logfile through either
1019 command line argument, or environment variable.
1022 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
1023 @file{.part}, @file{.lock} and temporary files.
1028 @section Release 0.12
1030 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
1034 @section Release 0.11
1036 @item @command{nncp-stat}'s command output is sorted by node name.
1040 @section Release 0.10
1043 @command{nncp-freq}'s @file{DST} argument is optional now. Last
1044 @file{SRC} path's element will be used by default.
1048 @section Release 0.9
1051 Fix @option{-rx}/@option{-tx} arguments processing in
1052 @command{nncp-call} command. They were ignored.
1056 @section Release 0.8
1059 Little bugfix in @command{nncp-file} command, where @option{-minsize}
1060 option for unchunked transfer was not in KiBs, but in bytes.
1064 @section Release 0.7
1068 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
1069 encrypted temporary file for that.
1072 Chunked files transmission appeared with corresponding
1073 @command{nncp-reass} command and @option{freqchunked} configuration file
1074 entry. Useful for transferring big files over small storage devices.
1077 @option{freqminsize} configuration file option, analogue to
1078 @option{-minsize} one.
1081 @command{nncp-xfer}'s @option{-force} option is renamed to
1082 @option{-mkdir} for clarity.
1085 @option{-minsize} option is specified in KiBs, not bytes, for
1089 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
1090 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
1091 common prefix and are grouped together for convenience.
1094 @command{nncp-cfgenc} command appeared, allowing configuration file
1095 encryption/decryption, for keeping it safe without any either OpenPGP or
1096 similar tools usage.
1099 Cryptographic libraries (dependencies) are updated.
1104 @section Release 0.6
1106 @item Small @command{nncp-rm} command appeared.
1107 @item Cryptographic libraries (dependencies) are updated.
1111 @section Release 0.5
1114 Trivial small fix in default niceness level of @command{nncp-file}
1115 and @command{nncp-freq} commands.
1119 @section Release 0.4
1123 Small fix in @command{nncp-call}, @command{nncp-caller},
1124 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
1128 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
1129 and more convenient to use.
1132 @command{nncp-mincfg} command appeared: helper allowing to create
1133 minimalistic stripped down configuration file without private keys, that
1134 is useful during @command{nncp-xfer} usage.
1139 @section Release 0.3
1141 @item Fixed compatibility with Go 1.6.
1145 @section Release 0.2
1149 @strong{Incompatible} packet's format change (magic number is changed
1150 too): size field is encrypted and is not send in plaintext anymore.
1153 @option{-minsize} option gives ability to automatically pad outgoing
1154 packets to specified minimal size.
1157 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
1158 always check new @emph{tx} packets appearance in the background while
1159 connected. Remote side is immediately notified.
1162 @option{-onlinedeadline} option gives ability to configure timeout of
1163 inactivity of online connection, when it could be disconnected. It could
1164 be used to keep connection alive for a long time.
1167 @option{-maxonlinetime} option gives ability to set maximal allowable
1168 online connection aliveness time.
1171 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
1174 @command{nncp-pkt} command can decompress the data.