4 See also this page @ref{Новости, on russian}.
11 Multicast related interface names (@code{mcd-listen} and @code{mcd-send}
12 configuration options) are now regular expressions. By default
13 @command{nncp-cfgnew} uncomments them now with @code{.*} interface name.
16 @command{nncp-call} command has @option{-mcd-wait} option to wait for
17 multicast packet about node's address.
22 @section Release 8.3.0
26 Fixed building issues on 32-bit systems.
31 @section Release 8.2.0
35 Yggdrasil uses pure-Go IPv6+TCP network stack, instead of naked μTP
36 transport protocol, making it able to work as an ordinary TCP server
37 inside overlay network.
40 Yggdrasil's @code{prv;bind1,bind2;pub...}-like configuration strings are
41 replaced with URL-like ones (@code{yggdrasils://PRV?bind=BIND1&bind=BIND2&pub=PUB}).
44 Ability to pass multicast-related parameters to Yggdrasil configuration.
47 @command{nncp-daemon} is able to listen on both TCP and Yggdrasil-driven
48 sockets simultaneously.
51 @command{nncp-daemon}'s listening on peering endpoint socket is optional
52 -- you can be reached through the peers.
57 @section Release 8.1.0
61 @command{nncp-cfgdir} does not require @code{self} section existence in
65 Ability to act as Yggdrasil network client, using online protocol on top of it.
70 @section Release 8.0.2
74 Fixed sending ability to areas.
79 @section Release 8.0.1
83 Fixed incorrect @code{freq.chunked} value calculation. If it was missed,
84 then chunked transfer mode was forcefully turned on anyway.
87 Fixed incorrect full file's size calculation in @file{.nncp.meta}.
92 @section Release 8.0.0
96 @strong{Incompatible} encrypted packet format change: payload and pad
97 sizes are sent in-bound in the encrypted stream. That gives ability to
98 streamingly create encrypted packets, without knowing sizes in advance,
99 without creating temporary file or buffer data in memory.
102 Proper encrypted packet padding verification is done now. This is not
103 critical issue, but previously neither padding value, nor its size were
104 authenticated, giving ability to iteratively strip trailing bytes and
105 determine payload's size by observing the reaction of the encrypted
109 @command{nncp-exec} loses its @option{-use-tmp} option, because of
110 streaming-compatible encrypted packets format.
113 @command{nncp-file} and @command{nncp-exec} commands have
114 @option{-maxsize} option, limiting maximal resulting encrypted packet's
115 maximal size (returning error if it is exceeded). Could be useful,
116 because no payload size could be known in advance.
121 @section Release 7.7.0
125 Experimental @code{kqueue} and @code{inotify} based notifications
126 support about spool directory changes, for reducing their often reading
130 @file{.seen} and @file{.hdr} files moved to @file{seen/} and @file{hdr/}
131 subdirectories, for faster scanning of spool directories.
132 Current files migration required:
135 $ find $NNCPSPOOL -type f -name "*.hdr" -exec rm @{@} +
137 $ find $NNCPSPOOL -type d -name rx | while read rx ; do
140 find . -type f -name "*.seen" | while read fn ; do
141 mv $fn seen/$@{fn%.seen@}
145 $ find $NNCPSPOOL -type d -name area | while read area ; do
146 find $area -type f -name "*.seen" | while read fn ; do
155 @section Release 7.6.0
159 Logging may be done to specified opened file descriptor
160 (@env{$NNCPLOG=FD:5} for example).
161 That is friendly to use under @command{daemontools}.
164 Added additional checks of public keys existence in configuration file,
165 preventing some commands from failing.
170 @section Release 7.5.1
174 NNCP builds on NetBSD.
179 @section Release 7.5.0
183 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
184 will contain remote side's address (when running under appropriate
185 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
188 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
191 Do not exit if some of MCD network interfaces can not be listened --
192 only warn about that.
197 @section Release 7.4.0
201 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
206 @section Release 7.3.2
210 @command{hjson-cli} utility builds in vendor-mode now.
215 @section Release 7.3.1
219 Fixed possibly left opened file descriptor in online commands.
222 Severely decreased memory usage of MTH hashing.
227 @section Release 7.3.0
231 Fixed some workability problems on 32-bit systems with big files.
234 Ability to use directory with a bunch of files as a configuration.
235 @command{nncp-cfgdir} command appeared.
240 @section Release 7.2.1
244 Small optimizations in online commands.
249 @section Release 7.2.0
253 @command{nncp-trns} command appeared for manual transition packets creation.
256 If destination node of transitional packet has non empty @option{via}
257 route, then do not ignore, but use it.
260 Do not relay multicast packet to area message's originator, that
261 obviously has seen its own packet.
264 Much less memory usage during MTH hashing when offset is zero: when
265 packet is not resumed, but for example checked with @command{nncp-check}
271 @section Release 7.1.1
275 Fixed failing directories fsync after @file{.seen} file creation.
280 @section Release 7.1.0
284 Multicasting areas feature appeared. Implemented merely by an additional
285 plain packet type with @command{nncp-toss}, @command{nncp-file} and
286 @command{nncp-exec} commands modification.
289 Fixed workability of @command{nncp-file} and @command{nncp-exec}
290 commands, that use temporary file (stdin and @option{-use-tmp}).
293 Fixed disappearing bad return code in @command{nncp-exec} command.
296 Fixed invalid @file{.hdr} generation when transitional packets are used.
299 @option{-all} option appeared in @command{nncp-rm} command, applying to
300 all the nodes at once.
303 @option{-cycle} option appeared in @command{nncp-check} command, looping
304 the check in infinite cycle.
307 @command{nncp-rm} command can take node alias name.
310 @command{nncp-pkt} can parse @file{.hdr} files.
315 @section Release 7.0.0
319 Minimal required Go version 1.13.
322 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
323 Because of that, there are backward @strong{incompatible} changes of
324 encrypted files (everything laying in the spool directory) and
325 @file{.meta} files of chunked transfer.
327 Current implementation is far from being optimal: it lacks
328 parallelizable calculations and has higher memory consumption: nearly
329 512 KiB for each 1 GiB of file's data. Future performance and memory
330 size optimizations should not lead to packet's format change. But it is
331 still several times faster than BLAKE2b.
334 Resumed online downloads, because of MTH, require reading only of the
335 preceding part of file, not the whole one as was before.
338 @command{nncp-hash} utility appeared for calculating file's MTH hash.
341 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
342 packets. Lowering number of used primitives. Also, its encrypted
343 packet's header is used as an associated data during encryption.
346 MultiCast Discovery uses
347 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
350 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
353 @command{nncp-stat} reports about partly downloaded packets.
356 Updated dependencies.
361 @section Release 6.6.0
365 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
366 commands wait for all background checksummers completion after
367 connection is finished.
370 Added possibility of address determining through multicast announcement
371 in local area network, so called MCD (MultiCast Discovery).
376 @section Release 6.5.0
380 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
383 Fixed possible bad return code ignoring in automatic tosser.
386 Fixed race during file descriptors closing when online protocol call is
387 finished, that could lead to write error of received packet fragment.
390 Kill all packet transmission progress bars in @command{nncp-daemon},
391 @command{nncp-call} and @command{nncp-caller} when call is finished.
396 @section Release 6.4.0
400 Fixed possible race in online protocol, that lead to panic.
405 @section Release 6.3.0
409 Fixed possible panic while showing progress during online protocol.
414 @section Release 6.2.1
418 Three places in logs contained excess @code{%s}.
423 @section Release 6.2.0
427 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
430 Yet another logging refactoring and simplification.
431 Should be no visible differences to the end user.
436 @section Release 6.1.0
440 Optimization: most commands do not keep opened file descriptors now.
441 Previously you can exceed maximal number of opened files if you have got
442 many packets in the spool directory.
445 Optimization: do not close file descriptor of the file we download
446 online. Previously each chunk lead to expensive open/close calls.
449 Online downloaded files are saved with @file{.nock} (non-checksummed)
450 suffix, waiting either for @command{nncp-check}, or online daemons to
451 perform integrity check.
454 Optimization: files, that are not resumed, are checksummed immediately
455 during the online download, skipping @file{.nock}-intermediate step.
458 Ability to store encrypted packet's header in @file{.hdr} file, close to
459 the packet itself. That can greatly increase performance of packets
460 listing on filesystems with big block's size.
465 @section Release 6.0.0
469 Log uses human readable and easy machine parseable
470 @url{https://www.gnu.org/software/recutils/, recfile} format for the
471 records, instead of structured RFC 3339 lines. Old logs are not readable
472 by @command{nncp-log} anymore.
475 @option{-autotoss*} option workability with @command{nncp-daemon}'s
476 @option{-inetd} mode.
479 Call's @option{when-tx-exists} allows to make a call only when outbound
480 packets exists. Combined with seconds-aware cron expression that can be
481 used as some kind of auto dialler.
484 @command{nncp-cronexpr} command allows you to check validity and
485 expectations of specified cron expression.
490 @section Release 5.6.0
494 @option{-autotoss*} option runs tosser not after the call, but every
495 second while it is active.
498 @option{autotoss}, @option{autotoss-doseen},
499 @option{autotoss-nofile}, @option{autotoss-nofreq},
500 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
501 @option{calls} configuration section. You can configure per-call
502 automatic tosser options.
505 Use vendoring, instead of @env{$GOPATH} overriding during tarball
506 installation, because current minimal Go's version is 1.12 and it
512 @section Release 5.5.1
516 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
517 variables in @file{config} during installation.
522 @section Release 5.5.0
526 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
527 @command{nncp-bundle} and @command{nncp-stat}.
530 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
533 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
534 options now. Uncompressed packets are not compatible with previous NNCP
538 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
539 have @option{-autotoss*} options for running tosser after call is ended.
542 Updated dependencies. Minimal required Go version is 1.12.
547 @section Release 5.4.1
551 Fixed @code{SENDMAIL} variable usage during the build.
556 @section Release 5.4.0
560 Updated dependencies.
563 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
564 This should not influence package maintainers, because minimal @command{redo}
565 implementation is included in tarball.
570 @section Release 5.3.3
574 More various error checks.
577 Updated dependencies.
582 @section Release 5.3.2
586 Fixed incorrect logic of @option{onlinedeadline} timeout, where
587 connection won't take into account incoming packets events and will
588 forcefully disconnect.
593 @section Release 5.3.1
597 Fixed @option{onlinedeadline} workability with call addresses that use
598 external commands (@verb{#"|somecmd"#}).
601 @command{nncp-stat} has @option{-pkt} option displaying information
602 about each packet in the spool.
607 @section Release 5.3.0
611 Progress messages contain prefix, describing the running action.
614 Fixed not occurring handshake messages padding.
617 Finish all SP protocol related goroutines, less memory leak.
620 SP protocol generates less socket write calls, thus generating less TCP
624 Check @option{onlinedeadline} and @option{maxonlinetime} options every
625 second, independently from socket reads (up to 10 seconds).
628 Once per minute, if no other traffic exists, PING packets are sent in
629 SP-connection. That allows faster determining of connection unworkability.
632 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
637 @section Release 5.2.1
641 Fixed SP protocol error handling, sometimes causing program panic.
646 @section Release 5.2.0
650 Most commands by default show oneline operations progress.
651 @option{-progress}, @option{-noprogress} command line options,
652 @option{noprogress} configuration file option appeared.
655 Fixed incorrect @command{nncp-check} command return code, that returned
656 bad code when everything is good.
659 Free disk space check during @command{nncp-bundle -rx} call.
664 @section Release 5.1.2
668 @strong{Critical} vulnerability: remote peers authentication could lead
669 to incorrect identification of remote side, allowing foreign encrypted
673 Bugfix: private and public Noise keys were swapped in newly created
674 configuration files, that lead to inability to authenticate online peers.
677 Explicit directories fsync-ing for guaranteed files renaming.
682 @section Release 5.1.1
686 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
691 @section Release 5.1.0
695 @command{nncp-file} can send directories, automatically creating pax
699 Free disk space is checked during outbound packets creation.
702 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
703 file options replaced with the structure:
704 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
707 Added @option{freq.maxsize} configuration file option, forbidding of
708 freq sending larger than specified size.
711 Ability to notify about successfully executed commands (exec) with
712 @option{notify.exec} configuration file option.
717 @section Release 5.0.0
721 @strong{Incompatible} configuration file format change: YAML is
722 replaced with Hjson, due to its simplicity, without noticeable lack
723 of either functionality or convenience.
726 @strong{Incompatible} plain packet format changes. Older versions are
727 not supported. @code{zlib} compression is replaced with
728 @code{Zstandard}, due to its speed and efficiency, despite library
729 version is not mature enough.
732 Ability to call remote nodes via pipe call of external command, not only
736 @command{nncp-cfgnew} generates configuration file with many
737 comments. @option{-nocomments} option can be used for an old
741 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
742 avoid possible collisions with @file{.nncp.chunkCTR}.
745 Ability to override process umask through configuration file option.
748 Files and directories are created with 666/777 permissions by default,
749 allowing control with @command{umask}.
752 Updated dependencies.
755 Full usage of go modules for dependencies management
756 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
759 Forbid any later GNU GPL version autousage
760 (project's licence now is GNU GPLv3-only).
767 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
775 @strong{Incompatible} encrypted and eblob packet format change: AEAD
776 encryption mode with 128 KiB blocks is used now, because previously
777 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
778 decrypted data to external command. Older versions are not supported.
781 Available free space checking before copying in @command{nncp-xfer},
782 @command{nncp-daemon}, @command{nncp-call(er)}.
785 @command{nncp-call} has ability only to list packets on remote node,
786 without their transmission.
789 @command{nncp-call} has ability to transfer only specified packets.
792 Workability of @option{xxrate} preference in @option{calls}
793 configuration file section.
796 Dependant libraries are updated.
802 Begin using of @code{go.mod} subsystem.
809 @item @command{nncp-daemon} can be run as @command{inetd}-service.
817 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
818 if @file{.seen} exists and treat it like file was already downloaded.
819 Possibly it was transferred out-of-bound and remote side needs to be
823 If higher priority packet is spooled, then @command{nncp-daemon} will
824 queue its sending first, interrupting lower priority transmissions.
827 Simple packet rate limiter added to online-related tools
828 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
831 Ability to specify niceness with symbolic notation:
832 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
835 Changed default niceness levels:
836 for @command{nncp-exec} from 64 to 96,
837 for @command{nncp-freq} from 64 to 160,
838 for @command{nncp-file} from 196 to 224.
846 @strong{Incompatible} @emph{bundle} archive format changes and
847 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
848 valid tar archives, but Go 1.9 made them invalid because of long paths
849 inside. NNCP accidentally was dependant on that bug. Explicit adding of
850 @file{NNCP/} directory in archive restores workability with valid tar
858 Ability to disable relaying at all using @verb{|-via -|} command line option.
866 @strong{Incompatible} plain packet format changes. Older versions are
870 Ability to queue remote command execution, by configuring @option{exec}
871 option in configuration file and using @command{nncp-exec} command:
874 @command{nncp-mail} command is replaced with more flexible
875 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
876 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
878 @option{sendmail} configuration file option is replaced with
879 @option{exec}. @verb{|sendmail: [...]|} must be replaced with
880 @verb{|exec: sendmail: [...]|}.
884 Ability to override @option{via} configuration option for destination
885 node via @option{-via} command line option for following commands:
886 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
889 Chunked files, having size less than specified chunk size, will be sent
890 as an ordinary single file.
893 Exec commands are invoked with additional @env{$NNCP_NICE} and
894 @env{$NNCP_SELF} environment variables.
897 Files, that are sent as a reply to freq, have niceness level taken from
898 the freq packet. You can set desired niceness during @command{nncp-freq}
899 invocation using @option{-replynice} option.
902 @command{nncp-toss} command can ignore specified packet types during
903 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
907 @command{nncp-file} command uses
908 @option{FreqMinSize}/@option{FreqChunked} configuration file options
909 for @option{-minsize}/@option{-chunked} by default. You can turn this
910 off by specifying zero value.
919 @strong{Incompatible} encrypted/eblob packet format changes. Older
920 versions are not supported.
923 Twofish encryption algorithm is replaced with ChaCha20. It is much more
924 faster. One cryptographic primitive less.
927 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
928 another cryptographic primitive less (assuming that BLAKE2X is nearly
929 identical to BLAKE2).
938 @strong{Incompatible} encrypted packet format changes. Older versions
942 @command{nncp-bundle} command can either create stream of encrypted
943 packets, or digest it. It is useful when dealing with
944 @code{stdin}/@code{stdout} based transmission methods (like writing to
945 CD-ROM without intermediate prepared ISO image and working with tape
949 @command{nncp-toss} is able to create @file{.seen} files preventing
950 duplicate packets receiving.
953 Single background checksum verifier worker is allowed in
954 @command{nncp-call}. This is helpful when thousands of small inbound
955 packets could create many goroutines.
958 Ability to override path to spool directory and logfile through either
959 command line argument, or environment variable.
962 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
963 @file{.part}, @file{.lock} and temporary files.
968 @section Release 0.12
970 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
974 @section Release 0.11
976 @item @command{nncp-stat}'s command output is sorted by node name.
980 @section Release 0.10
983 @command{nncp-freq}'s @file{DST} argument is optional now. Last
984 @file{SRC} path's element will be used by default.
991 Fix @option{-rx}/@option{-tx} arguments processing in
992 @command{nncp-call} command. They were ignored.
999 Little bugfix in @command{nncp-file} command, where @option{-minsize}
1000 option for unchunked transfer was not in KiBs, but in bytes.
1004 @section Release 0.7
1008 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
1009 encrypted temporary file for that.
1012 Chunked files transmission appeared with corresponding
1013 @command{nncp-reass} command and @option{freqchunked} configuration file
1014 entry. Useful for transferring big files over small storage devices.
1017 @option{freqminsize} configuration file option, analogue to
1018 @option{-minsize} one.
1021 @command{nncp-xfer}'s @option{-force} option is renamed to
1022 @option{-mkdir} for clarity.
1025 @option{-minsize} option is specified in KiBs, not bytes, for
1029 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
1030 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
1031 common prefix and are grouped together for convenience.
1034 @command{nncp-cfgenc} command appeared, allowing configuration file
1035 encryption/decryption, for keeping it safe without any either OpenPGP or
1036 similar tools usage.
1039 Cryptographic libraries (dependencies) are updated.
1044 @section Release 0.6
1046 @item Small @command{nncp-rm} command appeared.
1047 @item Cryptographic libraries (dependencies) are updated.
1051 @section Release 0.5
1054 Trivial small fix in default niceness level of @command{nncp-file}
1055 and @command{nncp-freq} commands.
1059 @section Release 0.4
1063 Small fix in @command{nncp-call}, @command{nncp-caller},
1064 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
1068 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
1069 and more convenient to use.
1072 @command{nncp-mincfg} command appeared: helper allowing to create
1073 minimalistic stripped down configuration file without private keys, that
1074 is useful during @command{nncp-xfer} usage.
1079 @section Release 0.3
1081 @item Fixed compatibility with Go 1.6.
1085 @section Release 0.2
1089 @strong{Incompatible} packet's format change (magic number is changed
1090 too): size field is encrypted and is not send in plaintext anymore.
1093 @option{-minsize} option gives ability to automatically pad outgoing
1094 packets to specified minimal size.
1097 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
1098 always check new @emph{tx} packets appearance in the background while
1099 connected. Remote side is immediately notified.
1102 @option{-onlinedeadline} option gives ability to configure timeout of
1103 inactivity of online connection, when it could be disconnected. It could
1104 be used to keep connection alive for a long time.
1107 @option{-maxonlinetime} option gives ability to set maximal allowable
1108 online connection aliveness time.
1111 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
1114 @command{nncp-pkt} command can decompress the data.