5 See also this page @ref{Новости, on russian}.
12 @command{nncp-xfer} now correctly checks for @file{seen/} files for
18 @section Release 8.7.0
22 @command{nncp-ack} does not acknowledge ACK-packets, preventing an
26 @command{nncp-ack} previously did not remove corresponding @file{hdr/} files.
29 @command{nncp-rm} now takes list of packet from @code{stdin} when
30 @option{-pkt} option is used.
33 @command{nncp-ack} now generates list of ACK packets it created, that
34 could be used as an input to @command{nncp-rm} to remove outbound ACK
40 @section Release 8.6.0
44 @command{nncp-xfer} checks if locally copied packet's checksum differs
45 from the source's one.
48 @command{nncp-call} has bad return code if its queues contain unfinished jobs.
51 @command{nncp-ack} command appeared, that sends explicit packet receipt
52 acknowledgement (ACK packet). That acknowledgement deletes referenced
53 packet from the outbound spool.
56 Ability to turn @code{fsync} operation off using @env{$NNCPNOSYNC=1}
60 Added various indices in documentation, that should help searching in it.
65 @section Release 8.5.0
69 Fixed @command{nncp-bundle} workability.
72 Mistakenly @option{-mcd-wait} option was enabled by default in
76 Ability to override internal default timeout for online protocol through
77 @env{$NNCPDEADLINE} environment variable. Can be useful for very high
81 NNCP builds on OpenBSD.
86 @section Release 8.4.0
90 Multicast related interface names (@code{mcd-listen} and @code{mcd-send}
91 configuration options) are now regular expressions. By default
92 @command{nncp-cfgnew} uncomments them now with @code{.*} interface name.
95 @command{nncp-call} command has @option{-mcd-wait} option to wait for
96 multicast packet about node's address.
99 @command{nncp-file} command skips everything that is neither regular
100 file nor directory during pax-archive creation.
105 @section Release 8.3.0
109 Fixed building issues on 32-bit systems.
114 @section Release 8.2.0
118 Yggdrasil uses pure-Go IPv6+TCP network stack, instead of naked μTP
119 transport protocol, making it able to work as an ordinary TCP server
120 inside overlay network.
123 Yggdrasil's @code{prv;bind1,bind2;pub@dots{}}-like configuration strings are
124 replaced with URL-like ones (@code{yggdrasils://PRV?bind=BIND1&bind=BIND2&pub=PUB}).
127 Ability to pass multicast-related parameters to Yggdrasil configuration.
130 @command{nncp-daemon} is able to listen on both TCP and Yggdrasil-driven
131 sockets simultaneously.
134 @command{nncp-daemon}'s listening on peering endpoint socket is optional
135 -- you can be reached through the peers.
140 @section Release 8.1.0
144 @command{nncp-cfgdir} does not require @code{self} section existence in
148 Ability to act as Yggdrasil network client, using online protocol on top of it.
153 @section Release 8.0.2
157 Fixed sending ability to areas.
162 @section Release 8.0.1
166 Fixed incorrect @code{freq.chunked} value calculation. If it was missed,
167 then chunked transfer mode was forcefully turned on anyway.
170 Fixed incorrect full file's size calculation in @file{.nncp.meta}.
175 @section Release 8.0.0
179 @strong{Incompatible} encrypted packet format change: payload and pad
180 sizes are sent in-bound in the encrypted stream. That gives ability to
181 streamingly create encrypted packets, without knowing sizes in advance,
182 without creating temporary file or buffer data in memory.
185 Proper encrypted packet padding verification is done now. This is not
186 critical issue, but previously neither padding value, nor its size were
187 authenticated, giving ability to iteratively strip trailing bytes and
188 determine payload's size by observing the reaction of the encrypted
192 @command{nncp-exec} loses its @option{-use-tmp} option, because of
193 streaming-compatible encrypted packets format.
196 @command{nncp-file} and @command{nncp-exec} commands have
197 @option{-maxsize} option, limiting maximal resulting encrypted packet's
198 maximal size (returning error if it is exceeded). Could be useful,
199 because no payload size could be known in advance.
204 @section Release 7.7.0
208 Experimental @code{kqueue} and @code{inotify} based notifications
209 support about spool directory changes, for reducing their often reading
213 @file{.seen} and @file{.hdr} files moved to @file{seen/} and @file{hdr/}
214 subdirectories, for faster scanning of spool directories.
215 Current files migration required:
218 $ find $NNCPSPOOL -type f -name "*.hdr" -exec rm @{@} +
220 $ find $NNCPSPOOL -type d -name rx | while read rx ; do
223 find . -type f -name "*.seen" | while read fn ; do
224 mv $fn seen/$@{fn%.seen@}
228 $ find $NNCPSPOOL -type d -name area | while read area ; do
229 find $area -type f -name "*.seen" | while read fn ; do
238 @section Release 7.6.0
242 Logging may be done to specified opened file descriptor
243 (@env{$NNCPLOG=FD:5} for example).
244 That is friendly to use under @command{daemontools}.
247 Added additional checks of public keys existence in configuration file,
248 preventing some commands from failing.
253 @section Release 7.5.1
257 NNCP builds on NetBSD.
262 @section Release 7.5.0
266 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
267 will contain remote side's address (when running under appropriate
268 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
271 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
274 Do not exit if some of MCD network interfaces can not be listened --
275 only warn about that.
280 @section Release 7.4.0
284 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
289 @section Release 7.3.2
293 @command{hjson-cli} utility builds in vendor-mode now.
298 @section Release 7.3.1
302 Fixed possibly left opened file descriptor in online commands.
305 Severely decreased memory usage of MTH hashing.
310 @section Release 7.3.0
314 Fixed some workability problems on 32-bit systems with big files.
317 Ability to use directory with a bunch of files as a configuration.
318 @command{nncp-cfgdir} command appeared.
323 @section Release 7.2.1
327 Small optimizations in online commands.
332 @section Release 7.2.0
336 @command{nncp-trns} command appeared for manual transition packets creation.
339 If destination node of transitional packet has non empty @option{via}
340 route, then do not ignore, but use it.
343 Do not relay multicast packet to area message's originator, that
344 obviously has seen its own packet.
347 Much less memory usage during MTH hashing when offset is zero: when
348 packet is not resumed, but for example checked with @command{nncp-check}
354 @section Release 7.1.1
358 Fixed failing directories @code{fsync} after @file{.seen} file creation.
363 @section Release 7.1.0
367 Multicasting areas feature appeared. Implemented merely by an additional
368 plain packet type with @command{nncp-toss}, @command{nncp-file} and
369 @command{nncp-exec} commands modification.
372 Fixed workability of @command{nncp-file} and @command{nncp-exec}
373 commands, that use temporary file (@code{stdin} and @option{-use-tmp}).
376 Fixed disappearing bad return code in @command{nncp-exec} command.
379 Fixed invalid @file{.hdr} generation when transitional packets are used.
382 @option{-all} option appeared in @command{nncp-rm} command, applying to
383 all the nodes at once.
386 @option{-cycle} option appeared in @command{nncp-check} command, looping
387 the check in infinite cycle.
390 @command{nncp-rm} command can take node alias name.
393 @command{nncp-pkt} can parse @file{.hdr} files.
398 @section Release 7.0.0
402 Minimal required Go version 1.13.
405 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
406 Because of that, there are backward @strong{incompatible} changes of
407 encrypted files (everything laying in the spool directory) and
408 @file{.meta} files of chunked transfer.
410 Current implementation is far from being optimal: it lacks
411 parallelizable calculations and has higher memory consumption: nearly
412 512 KiB for each 1 GiB of file's data. Future performance and memory
413 size optimizations should not lead to packet's format change. But it is
414 still several times faster than BLAKE2b.
417 Resumed online downloads, because of MTH, require reading only of the
418 preceding part of file, not the whole one as was before.
421 @command{nncp-hash} utility appeared for calculating file's MTH hash.
424 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
425 packets. Lowering number of used primitives. Also, its encrypted
426 packet's header is used as an associated data during encryption.
429 MultiCast Discovery uses
430 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
433 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
436 @command{nncp-stat} reports about partly downloaded packets.
439 Updated dependencies.
444 @section Release 6.6.0
448 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
449 commands wait for all background checksummers completion after
450 connection is finished.
453 Added possibility of address determining through multicast announcement
454 in local area network, so called MCD (MultiCast Discovery).
459 @section Release 6.5.0
463 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
466 Fixed possible bad return code ignoring in automatic tosser.
469 Fixed race during file descriptors closing when online protocol call is
470 finished, that could lead to write error of received packet fragment.
473 Kill all packet transmission progress bars in @command{nncp-daemon},
474 @command{nncp-call} and @command{nncp-caller} when call is finished.
479 @section Release 6.4.0
483 Fixed possible race in online protocol, that lead to panic.
488 @section Release 6.3.0
492 Fixed possible panic while showing progress during online protocol.
497 @section Release 6.2.1
501 Three places in logs contained excess @code{%s}.
506 @section Release 6.2.0
510 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
513 Yet another logging refactoring and simplification.
514 Should be no visible differences to the end user.
519 @section Release 6.1.0
523 Optimization: most commands do not keep opened file descriptors now.
524 Previously you can exceed maximal number of opened files if you have got
525 many packets in the spool directory.
528 Optimization: do not close file descriptor of the file we download
529 online. Previously each chunk lead to expensive open/close calls.
532 Online downloaded files are saved with @file{.nock} (non-checksummed)
533 suffix, waiting either for @command{nncp-check}, or online daemons to
534 perform integrity check.
537 Optimization: files, that are not resumed, are checksummed immediately
538 during the online download, skipping @file{.nock}-intermediate step.
541 Ability to store encrypted packet's header in @file{.hdr} file, close to
542 the packet itself. That can greatly increase performance of packets
543 listing on filesystems with big block's size.
548 @section Release 6.0.0
552 Log uses human readable and easy machine parseable
553 @url{https://www.gnu.org/software/recutils/, recfile} format for the
554 records, instead of structured RFC 3339 lines. Old logs are not readable
555 by @command{nncp-log} anymore.
558 @option{-autotoss*} option workability with @command{nncp-daemon}'s
559 @option{-inetd} mode.
562 Call's @option{when-tx-exists} allows to make a call only when outbound
563 packets exists. Combined with seconds-aware cron expression that can be
564 used as some kind of auto dialler.
567 @command{nncp-cronexpr} command allows you to check validity and
568 expectations of specified cron expression.
573 @section Release 5.6.0
577 @option{-autotoss*} option runs tosser not after the call, but every
578 second while it is active.
581 @option{autotoss}, @option{autotoss-doseen},
582 @option{autotoss-nofile}, @option{autotoss-nofreq},
583 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
584 @option{calls} configuration section. You can configure per-call
585 automatic tosser options.
588 Use vendoring, instead of @env{$GOPATH} overriding during tarball
589 installation, because current minimal Go's version is 1.12 and it
595 @section Release 5.5.1
599 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
600 variables in @file{config} during installation.
605 @section Release 5.5.0
609 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
610 @command{nncp-bundle} and @command{nncp-stat}.
613 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
616 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
617 options now. Uncompressed packets are not compatible with previous NNCP
621 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
622 have @option{-autotoss*} options for running tosser after call is ended.
625 Updated dependencies. Minimal required Go version is 1.12.
630 @section Release 5.4.1
634 Fixed @code{SENDMAIL} variable usage during the build.
639 @section Release 5.4.0
643 Updated dependencies.
646 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
647 This should not influence package maintainers, because minimal @command{redo}
648 implementation is included in tarball.
653 @section Release 5.3.3
657 More various error checks.
660 Updated dependencies.
665 @section Release 5.3.2
669 Fixed incorrect logic of @option{onlinedeadline} timeout, where
670 connection won't take into account incoming packets events and will
671 forcefully disconnect.
676 @section Release 5.3.1
680 Fixed @option{onlinedeadline} workability with call addresses that use
681 external commands (@verb{#"|somecmd"#}).
684 @command{nncp-stat} has @option{-pkt} option displaying information
685 about each packet in the spool.
690 @section Release 5.3.0
694 Progress messages contain prefix, describing the running action.
697 Fixed not occurring handshake messages padding.
700 Finish all SP protocol related goroutines, less memory leak.
703 SP protocol generates less socket write calls, thus generating less TCP
707 Check @option{onlinedeadline} and @option{maxonlinetime} options every
708 second, independently from socket reads (up to 10 seconds).
711 Once per minute, if no other traffic exists, PING packets are sent in
712 SP-connection. That allows faster determining of connection unworkability.
715 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
720 @section Release 5.2.1
724 Fixed SP protocol error handling, sometimes causing program panic.
729 @section Release 5.2.0
733 Most commands by default show oneline operations progress.
734 @option{-progress}, @option{-noprogress} command line options,
735 @option{noprogress} configuration file option appeared.
738 Fixed incorrect @command{nncp-check} command return code, that returned
739 bad code when everything is good.
742 Free disk space check during @command{nncp-bundle -rx} call.
747 @section Release 5.1.2
751 @strong{Critical} vulnerability: remote peers authentication could lead
752 to incorrect identification of remote side, allowing foreign encrypted
756 Bugfix: private and public Noise keys were swapped in newly created
757 configuration files, that lead to inability to authenticate online peers.
760 Explicit directories @code{fsync}-ing for guaranteed files renaming.
765 @section Release 5.1.1
769 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
774 @section Release 5.1.0
778 @command{nncp-file} can send directories, automatically creating pax
782 Free disk space is checked during outbound packets creation.
785 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
786 file options replaced with the structure:
787 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
790 Added @option{freq.maxsize} configuration file option, forbidding of
791 freq sending larger than specified size.
794 Ability to notify about successfully executed commands (exec) with
795 @option{notify.exec} configuration file option.
800 @section Release 5.0.0
804 @strong{Incompatible} configuration file format change: YAML is
805 replaced with Hjson, due to its simplicity, without noticeable lack
806 of either functionality or convenience.
809 @strong{Incompatible} plain packet format changes. Older versions are
810 not supported. @code{zlib} compression is replaced with
811 @code{Zstandard}, due to its speed and efficiency, despite library
812 version is not mature enough.
815 Ability to call remote nodes via pipe call of external command, not only
819 @command{nncp-cfgnew} generates configuration file with many
820 comments. @option{-nocomments} option can be used for an old
824 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
825 avoid possible collisions with @file{.nncp.chunkCTR}.
828 Ability to override process umask through configuration file option.
831 Files and directories are created with 666/777 permissions by default,
832 allowing control with @command{umask}.
835 Updated dependencies.
838 Full usage of go modules for dependencies management
839 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
842 Forbid any later GNU GPL version autousage
843 (project's licence now is GNU GPLv3-only).
850 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
858 @strong{Incompatible} encrypted and eblob packet format change: AEAD
859 encryption mode with 128 KiB blocks is used now, because previously
860 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
861 decrypted data to external command. Older versions are not supported.
864 Available free space checking before copying in @command{nncp-xfer},
865 @command{nncp-daemon}, @command{nncp-call(er)}.
868 @command{nncp-call} has ability only to list packets on remote node,
869 without their transmission.
872 @command{nncp-call} has ability to transfer only specified packets.
875 Workability of @option{xxrate} preference in @option{calls}
876 configuration file section.
879 Dependant libraries are updated.
885 Begin using of @code{go.mod} subsystem.
892 @item @command{nncp-daemon} can be run as @command{inetd}-service.
900 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
901 if @file{.seen} exists and treat it like file was already downloaded.
902 Possibly it was transferred out-of-bound and remote side needs to be
906 If higher priority packet is spooled, then @command{nncp-daemon} will
907 queue its sending first, interrupting lower priority transmissions.
910 Simple packet rate limiter added to online-related tools
911 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
914 Ability to specify niceness with symbolic notation:
915 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
918 Changed default niceness levels:
919 for @command{nncp-exec} from 64 to 96,
920 for @command{nncp-freq} from 64 to 160,
921 for @command{nncp-file} from 196 to 224.
929 @strong{Incompatible} @emph{bundle} archive format changes and
930 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
931 valid tar archives, but Go 1.9 made them invalid because of long paths
932 inside. NNCP accidentally was dependant on that bug. Explicit adding of
933 @file{NNCP/} directory in archive restores workability with valid tar
941 Ability to disable relaying at all using @verb{|-via -|} command line option.
949 @strong{Incompatible} plain packet format changes. Older versions are
953 Ability to queue remote command execution, by configuring @option{exec}
954 option in configuration file and using @command{nncp-exec} command:
957 @command{nncp-mail} command is replaced with more flexible
958 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
959 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
961 @option{sendmail} configuration file option is replaced with
962 @option{exec}. @code{sendmail: [@dots{}]} must be replaced with
963 @code{exec: sendmail: [@dots{}]}.
967 Ability to override @option{via} configuration option for destination
968 node via @option{-via} command line option for following commands:
969 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
972 Chunked files, having size less than specified chunk size, will be sent
973 as an ordinary single file.
976 Exec commands are invoked with additional @env{$NNCP_NICE} and
977 @env{$NNCP_SELF} environment variables.
980 Files, that are sent as a reply to freq, have niceness level taken from
981 the freq packet. You can set desired niceness during @command{nncp-freq}
982 invocation using @option{-replynice} option.
985 @command{nncp-toss} command can ignore specified packet types during
986 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
990 @command{nncp-file} command uses
991 @option{FreqMinSize}/@option{FreqChunked} configuration file options
992 for @option{-minsize}/@option{-chunked} by default. You can turn this
993 off by specifying zero value.
1002 @strong{Incompatible} encrypted/eblob packet format changes. Older
1003 versions are not supported.
1006 Twofish encryption algorithm is replaced with ChaCha20. It is much more
1007 faster. One cryptographic primitive less.
1010 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
1011 another cryptographic primitive less (assuming that BLAKE2X is nearly
1012 identical to BLAKE2).
1017 @section Release 1.0
1021 @strong{Incompatible} encrypted packet format changes. Older versions
1025 @command{nncp-bundle} command can either create stream of encrypted
1026 packets, or digest it. It is useful when dealing with
1027 @code{stdin}/@code{stdout} based transmission methods (like writing to
1028 CD-ROM without intermediate prepared ISO image and working with tape
1032 @command{nncp-toss} is able to create @file{.seen} files preventing
1033 duplicate packets receiving.
1036 Single background checksum verifier worker is allowed in
1037 @command{nncp-call}. This is helpful when thousands of small inbound
1038 packets could create many goroutines.
1041 Ability to override path to spool directory and logfile through either
1042 command line argument, or environment variable.
1045 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
1046 @file{.part}, @file{.lock} and temporary files.
1051 @section Release 0.12
1053 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
1057 @section Release 0.11
1059 @item @command{nncp-stat}'s command output is sorted by node name.
1063 @section Release 0.10
1066 @command{nncp-freq}'s @file{DST} argument is optional now. Last
1067 @file{SRC} path's element will be used by default.
1071 @section Release 0.9
1074 Fix @option{-rx}/@option{-tx} arguments processing in
1075 @command{nncp-call} command. They were ignored.
1079 @section Release 0.8
1082 Little bugfix in @command{nncp-file} command, where @option{-minsize}
1083 option for unchunked transfer was not in KiBs, but in bytes.
1087 @section Release 0.7
1091 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
1092 encrypted temporary file for that.
1095 Chunked files transmission appeared with corresponding
1096 @command{nncp-reass} command and @option{freqchunked} configuration file
1097 entry. Useful for transferring big files over small storage devices.
1100 @option{freqminsize} configuration file option, analogue to
1101 @option{-minsize} one.
1104 @command{nncp-xfer}'s @option{-force} option is renamed to
1105 @option{-mkdir} for clarity.
1108 @option{-minsize} option is specified in KiBs, not bytes, for
1112 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
1113 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
1114 common prefix and are grouped together for convenience.
1117 @command{nncp-cfgenc} command appeared, allowing configuration file
1118 encryption/decryption, for keeping it safe without any either OpenPGP or
1119 similar tools usage.
1122 Cryptographic libraries (dependencies) are updated.
1127 @section Release 0.6
1129 @item Small @command{nncp-rm} command appeared.
1130 @item Cryptographic libraries (dependencies) are updated.
1134 @section Release 0.5
1137 Trivial small fix in default niceness level of @command{nncp-file}
1138 and @command{nncp-freq} commands.
1142 @section Release 0.4
1146 Small fix in @command{nncp-call}, @command{nncp-caller},
1147 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
1151 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
1152 and more convenient to use.
1155 @command{nncp-mincfg} command appeared: helper allowing to create
1156 minimalistic stripped down configuration file without private keys, that
1157 is useful during @command{nncp-xfer} usage.
1162 @section Release 0.3
1164 @item Fixed compatibility with Go 1.6.
1168 @section Release 0.2
1172 @strong{Incompatible} packet's format change (magic number is changed
1173 too): size field is encrypted and is not send in plaintext anymore.
1176 @option{-minsize} option gives ability to automatically pad outgoing
1177 packets to specified minimal size.
1180 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
1181 always check new @emph{tx} packets appearance in the background while
1182 connected. Remote side is immediately notified.
1185 @option{-onlinedeadline} option gives ability to configure timeout of
1186 inactivity of online connection, when it could be disconnected. It could
1187 be used to keep connection alive for a long time.
1190 @option{-maxonlinetime} option gives ability to set maximal allowable
1191 online connection aliveness time.
1194 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
1197 @command{nncp-pkt} command can decompress the data.