4 See also this page @ref{Новости, on russian}.
11 Yggdrasil uses pure-Go IPv6+TCP network stack, instead of naked μTP
12 transport protocol, making it able to work as an ordinary TCP server
13 inside overlay network.
16 Yggdrasil's @code{prv;bind1,bind2;pub...}-like configuration strings are
17 replaced with URL-like ones (@code{yggdrasils://PRV?bind=BIND1&bind=BIND2&pub=PUB}).
20 Ability to pass multicast-related parameters to Yggdrasil configuration.
23 @command{nncp-daemon} is able to listen on both TCP and Yggdrasil-driven
24 sockets simultaneously.
27 @command{nncp-daemon}'s listening on peering endpoint socket is optional
28 -- you can be reached through the peers.
33 @section Release 8.1.0
37 @command{nncp-cfgdir} does not require @code{self} section existence in
41 Ability to act as Yggdrasil network client, using online protocol on top of it.
46 @section Release 8.0.2
50 Fixed sending ability to areas.
55 @section Release 8.0.1
59 Fixed incorrect @code{freq.chunked} value calculation. If it was missed,
60 then chunked transfer mode was forcefully turned on anyway.
63 Fixed incorrect full file's size calculation in @file{.nncp.meta}.
68 @section Release 8.0.0
72 @strong{Incompatible} encrypted packet format change: payload and pad
73 sizes are sent in-bound in the encrypted stream. That gives ability to
74 streamingly create encrypted packets, without knowing sizes in advance,
75 without creating temporary file or buffer data in memory.
78 Proper encrypted packet padding verification is done now. This is not
79 critical issue, but previously neither padding value, nor its size were
80 authenticated, giving ability to iteratively strip trailing bytes and
81 determine payload's size by observing the reaction of the encrypted
85 @command{nncp-exec} loses its @option{-use-tmp} option, because of
86 streaming-compatible encrypted packets format.
89 @command{nncp-file} and @command{nncp-exec} commands have
90 @option{-maxsize} option, limiting maximal resulting encrypted packet's
91 maximal size (returning error if it is exceeded). Could be useful,
92 because no payload size could be known in advance.
97 @section Release 7.7.0
101 Experimental @code{kqueue} and @code{inotify} based notifications
102 support about spool directory changes, for reducing their often reading
106 @file{.seen} and @file{.hdr} files moved to @file{seen/} and @file{hdr/}
107 subdirectories, for faster scanning of spool directories.
108 Current files migration required:
111 $ find $NNCPSPOOL -type f -name "*.hdr" -exec rm @{@} +
113 $ find $NNCPSPOOL -type d -name rx | while read rx ; do
116 find . -type f -name "*.seen" | while read fn ; do
117 mv $fn seen/$@{fn%.seen@}
121 $ find $NNCPSPOOL -type d -name area | while read area ; do
122 find $area -type f -name "*.seen" | while read fn ; do
131 @section Release 7.6.0
135 Logging may be done to specified opened file descriptor
136 (@env{$NNCPLOG=FD:5} for example).
137 That is friendly to use under @command{daemontools}.
140 Added additional checks of public keys existence in configuration file,
141 preventing some commands from failing.
146 @section Release 7.5.1
150 NNCP builds on NetBSD.
155 @section Release 7.5.0
159 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
160 will contain remote side's address (when running under appropriate
161 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
164 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
167 Do not exit if some of MCD network interfaces can not be listened --
168 only warn about that.
173 @section Release 7.4.0
177 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
182 @section Release 7.3.2
186 @command{hjson-cli} utility builds in vendor-mode now.
191 @section Release 7.3.1
195 Fixed possibly left opened file descriptor in online commands.
198 Severely decreased memory usage of MTH hashing.
203 @section Release 7.3.0
207 Fixed some workability problems on 32-bit systems with big files.
210 Ability to use directory with a bunch of files as a configuration.
211 @command{nncp-cfgdir} command appeared.
216 @section Release 7.2.1
220 Small optimizations in online commands.
225 @section Release 7.2.0
229 @command{nncp-trns} command appeared for manual transition packets creation.
232 If destination node of transitional packet has non empty @option{via}
233 route, then do not ignore, but use it.
236 Do not relay multicast packet to area message's originator, that
237 obviously has seen its own packet.
240 Much less memory usage during MTH hashing when offset is zero: when
241 packet is not resumed, but for example checked with @command{nncp-check}
247 @section Release 7.1.1
251 Fixed failing directories fsync after @file{.seen} file creation.
256 @section Release 7.1.0
260 Multicasting areas feature appeared. Implemented merely by an additional
261 plain packet type with @command{nncp-toss}, @command{nncp-file} and
262 @command{nncp-exec} commands modification.
265 Fixed workability of @command{nncp-file} and @command{nncp-exec}
266 commands, that use temporary file (stdin and @option{-use-tmp}).
269 Fixed disappearing bad return code in @command{nncp-exec} command.
272 Fixed invalid @file{.hdr} generation when transitional packets are used.
275 @option{-all} option appeared in @command{nncp-rm} command, applying to
276 all the nodes at once.
279 @option{-cycle} option appeared in @command{nncp-check} command, looping
280 the check in infinite cycle.
283 @command{nncp-rm} command can take node alias name.
286 @command{nncp-pkt} can parse @file{.hdr} files.
291 @section Release 7.0.0
295 Minimal required Go version 1.13.
298 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
299 Because of that, there are backward @strong{incompatible} changes of
300 encrypted files (everything laying in the spool directory) and
301 @file{.meta} files of chunked transfer.
303 Current implementation is far from being optimal: it lacks
304 parallelizable calculations and has higher memory consumption: nearly
305 512 KiB for each 1 GiB of file's data. Future performance and memory
306 size optimizations should not lead to packet's format change. But it is
307 still several times faster than BLAKE2b.
310 Resumed online downloads, because of MTH, require reading only of the
311 preceding part of file, not the whole one as was before.
314 @command{nncp-hash} utility appeared for calculating file's MTH hash.
317 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
318 packets. Lowering number of used primitives. Also, its encrypted
319 packet's header is used as an associated data during encryption.
322 MultiCast Discovery uses
323 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
326 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
329 @command{nncp-stat} reports about partly downloaded packets.
332 Updated dependencies.
337 @section Release 6.6.0
341 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
342 commands wait for all background checksummers completion after
343 connection is finished.
346 Added possibility of address determining through multicast announcement
347 in local area network, so called MCD (MultiCast Discovery).
352 @section Release 6.5.0
356 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
359 Fixed possible bad return code ignoring in automatic tosser.
362 Fixed race during file descriptors closing when online protocol call is
363 finished, that could lead to write error of received packet fragment.
366 Kill all packet transmission progress bars in @command{nncp-daemon},
367 @command{nncp-call} and @command{nncp-caller} when call is finished.
372 @section Release 6.4.0
376 Fixed possible race in online protocol, that lead to panic.
381 @section Release 6.3.0
385 Fixed possible panic while showing progress during online protocol.
390 @section Release 6.2.1
394 Three places in logs contained excess @code{%s}.
399 @section Release 6.2.0
403 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
406 Yet another logging refactoring and simplification.
407 Should be no visible differences to the end user.
412 @section Release 6.1.0
416 Optimization: most commands do not keep opened file descriptors now.
417 Previously you can exceed maximal number of opened files if you have got
418 many packets in the spool directory.
421 Optimization: do not close file descriptor of the file we download
422 online. Previously each chunk lead to expensive open/close calls.
425 Online downloaded files are saved with @file{.nock} (non-checksummed)
426 suffix, waiting either for @command{nncp-check}, or online daemons to
427 perform integrity check.
430 Optimization: files, that are not resumed, are checksummed immediately
431 during the online download, skipping @file{.nock}-intermediate step.
434 Ability to store encrypted packet's header in @file{.hdr} file, close to
435 the packet itself. That can greatly increase performance of packets
436 listing on filesystems with big block's size.
441 @section Release 6.0.0
445 Log uses human readable and easy machine parseable
446 @url{https://www.gnu.org/software/recutils/, recfile} format for the
447 records, instead of structured RFC 3339 lines. Old logs are not readable
448 by @command{nncp-log} anymore.
451 @option{-autotoss*} option workability with @command{nncp-daemon}'s
452 @option{-inetd} mode.
455 Call's @option{when-tx-exists} allows to make a call only when outbound
456 packets exists. Combined with seconds-aware cron expression that can be
457 used as some kind of auto dialler.
460 @command{nncp-cronexpr} command allows you to check validity and
461 expectations of specified cron expression.
466 @section Release 5.6.0
470 @option{-autotoss*} option runs tosser not after the call, but every
471 second while it is active.
474 @option{autotoss}, @option{autotoss-doseen},
475 @option{autotoss-nofile}, @option{autotoss-nofreq},
476 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
477 @option{calls} configuration section. You can configure per-call
478 automatic tosser options.
481 Use vendoring, instead of @env{$GOPATH} overriding during tarball
482 installation, because current minimal Go's version is 1.12 and it
488 @section Release 5.5.1
492 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
493 variables in @file{config} during installation.
498 @section Release 5.5.0
502 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
503 @command{nncp-bundle} and @command{nncp-stat}.
506 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
509 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
510 options now. Uncompressed packets are not compatible with previous NNCP
514 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
515 have @option{-autotoss*} options for running tosser after call is ended.
518 Updated dependencies. Minimal required Go version is 1.12.
523 @section Release 5.4.1
527 Fixed @code{SENDMAIL} variable usage during the build.
532 @section Release 5.4.0
536 Updated dependencies.
539 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
540 This should not influence package maintainers, because minimal @command{redo}
541 implementation is included in tarball.
546 @section Release 5.3.3
550 More various error checks.
553 Updated dependencies.
558 @section Release 5.3.2
562 Fixed incorrect logic of @option{onlinedeadline} timeout, where
563 connection won't take into account incoming packets events and will
564 forcefully disconnect.
569 @section Release 5.3.1
573 Fixed @option{onlinedeadline} workability with call addresses that use
574 external commands (@verb{#"|somecmd"#}).
577 @command{nncp-stat} has @option{-pkt} option displaying information
578 about each packet in the spool.
583 @section Release 5.3.0
587 Progress messages contain prefix, describing the running action.
590 Fixed not occurring handshake messages padding.
593 Finish all SP protocol related goroutines, less memory leak.
596 SP protocol generates less socket write calls, thus generating less TCP
600 Check @option{onlinedeadline} and @option{maxonlinetime} options every
601 second, independently from socket reads (up to 10 seconds).
604 Once per minute, if no other traffic exists, PING packets are sent in
605 SP-connection. That allows faster determining of connection unworkability.
608 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
613 @section Release 5.2.1
617 Fixed SP protocol error handling, sometimes causing program panic.
622 @section Release 5.2.0
626 Most commands by default show oneline operations progress.
627 @option{-progress}, @option{-noprogress} command line options,
628 @option{noprogress} configuration file option appeared.
631 Fixed incorrect @command{nncp-check} command return code, that returned
632 bad code when everything is good.
635 Free disk space check during @command{nncp-bundle -rx} call.
640 @section Release 5.1.2
644 @strong{Critical} vulnerability: remote peers authentication could lead
645 to incorrect identification of remote side, allowing foreign encrypted
649 Bugfix: private and public Noise keys were swapped in newly created
650 configuration files, that lead to inability to authenticate online peers.
653 Explicit directories fsync-ing for guaranteed files renaming.
658 @section Release 5.1.1
662 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
667 @section Release 5.1.0
671 @command{nncp-file} can send directories, automatically creating pax
675 Free disk space is checked during outbound packets creation.
678 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
679 file options replaced with the structure:
680 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
683 Added @option{freq.maxsize} configuration file option, forbidding of
684 freq sending larger than specified size.
687 Ability to notify about successfully executed commands (exec) with
688 @option{notify.exec} configuration file option.
693 @section Release 5.0.0
697 @strong{Incompatible} configuration file format change: YAML is
698 replaced with Hjson, due to its simplicity, without noticeable lack
699 of either functionality or convenience.
702 @strong{Incompatible} plain packet format changes. Older versions are
703 not supported. @code{zlib} compression is replaced with
704 @code{Zstandard}, due to its speed and efficiency, despite library
705 version is not mature enough.
708 Ability to call remote nodes via pipe call of external command, not only
712 @command{nncp-cfgnew} generates configuration file with many
713 comments. @option{-nocomments} option can be used for an old
717 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
718 avoid possible collisions with @file{.nncp.chunkCTR}.
721 Ability to override process umask through configuration file option.
724 Files and directories are created with 666/777 permissions by default,
725 allowing control with @command{umask}.
728 Updated dependencies.
731 Full usage of go modules for dependencies management
732 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
735 Forbid any later GNU GPL version autousage
736 (project's licence now is GNU GPLv3-only).
743 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
751 @strong{Incompatible} encrypted and eblob packet format change: AEAD
752 encryption mode with 128 KiB blocks is used now, because previously
753 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
754 decrypted data to external command. Older versions are not supported.
757 Available free space checking before copying in @command{nncp-xfer},
758 @command{nncp-daemon}, @command{nncp-call(er)}.
761 @command{nncp-call} has ability only to list packets on remote node,
762 without their transmission.
765 @command{nncp-call} has ability to transfer only specified packets.
768 Workability of @option{xxrate} preference in @option{calls}
769 configuration file section.
772 Dependant libraries are updated.
778 Begin using of @code{go.mod} subsystem.
785 @item @command{nncp-daemon} can be run as @command{inetd}-service.
793 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
794 if @file{.seen} exists and treat it like file was already downloaded.
795 Possibly it was transferred out-of-bound and remote side needs to be
799 If higher priority packet is spooled, then @command{nncp-daemon} will
800 queue its sending first, interrupting lower priority transmissions.
803 Simple packet rate limiter added to online-related tools
804 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
807 Ability to specify niceness with symbolic notation:
808 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
811 Changed default niceness levels:
812 for @command{nncp-exec} from 64 to 96,
813 for @command{nncp-freq} from 64 to 160,
814 for @command{nncp-file} from 196 to 224.
822 @strong{Incompatible} @emph{bundle} archive format changes and
823 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
824 valid tar archives, but Go 1.9 made them invalid because of long paths
825 inside. NNCP accidentally was dependant on that bug. Explicit adding of
826 @file{NNCP/} directory in archive restores workability with valid tar
834 Ability to disable relaying at all using @verb{|-via -|} command line option.
842 @strong{Incompatible} plain packet format changes. Older versions are
846 Ability to queue remote command execution, by configuring @option{exec}
847 option in configuration file and using @command{nncp-exec} command:
850 @command{nncp-mail} command is replaced with more flexible
851 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
852 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
854 @option{sendmail} configuration file option is replaced with
855 @option{exec}. @verb{|sendmail: [...]|} must be replaced with
856 @verb{|exec: sendmail: [...]|}.
860 Ability to override @option{via} configuration option for destination
861 node via @option{-via} command line option for following commands:
862 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
865 Chunked files, having size less than specified chunk size, will be sent
866 as an ordinary single file.
869 Exec commands are invoked with additional @env{$NNCP_NICE} and
870 @env{$NNCP_SELF} environment variables.
873 Files, that are sent as a reply to freq, have niceness level taken from
874 the freq packet. You can set desired niceness during @command{nncp-freq}
875 invocation using @option{-replynice} option.
878 @command{nncp-toss} command can ignore specified packet types during
879 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
883 @command{nncp-file} command uses
884 @option{FreqMinSize}/@option{FreqChunked} configuration file options
885 for @option{-minsize}/@option{-chunked} by default. You can turn this
886 off by specifying zero value.
895 @strong{Incompatible} encrypted/eblob packet format changes. Older
896 versions are not supported.
899 Twofish encryption algorithm is replaced with ChaCha20. It is much more
900 faster. One cryptographic primitive less.
903 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
904 another cryptographic primitive less (assuming that BLAKE2X is nearly
905 identical to BLAKE2).
914 @strong{Incompatible} encrypted packet format changes. Older versions
918 @command{nncp-bundle} command can either create stream of encrypted
919 packets, or digest it. It is useful when dealing with
920 @code{stdin}/@code{stdout} based transmission methods (like writing to
921 CD-ROM without intermediate prepared ISO image and working with tape
925 @command{nncp-toss} is able to create @file{.seen} files preventing
926 duplicate packets receiving.
929 Single background checksum verifier worker is allowed in
930 @command{nncp-call}. This is helpful when thousands of small inbound
931 packets could create many goroutines.
934 Ability to override path to spool directory and logfile through either
935 command line argument, or environment variable.
938 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
939 @file{.part}, @file{.lock} and temporary files.
944 @section Release 0.12
946 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
950 @section Release 0.11
952 @item @command{nncp-stat}'s command output is sorted by node name.
956 @section Release 0.10
959 @command{nncp-freq}'s @file{DST} argument is optional now. Last
960 @file{SRC} path's element will be used by default.
967 Fix @option{-rx}/@option{-tx} arguments processing in
968 @command{nncp-call} command. They were ignored.
975 Little bugfix in @command{nncp-file} command, where @option{-minsize}
976 option for unchunked transfer was not in KiBs, but in bytes.
984 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
985 encrypted temporary file for that.
988 Chunked files transmission appeared with corresponding
989 @command{nncp-reass} command and @option{freqchunked} configuration file
990 entry. Useful for transferring big files over small storage devices.
993 @option{freqminsize} configuration file option, analogue to
994 @option{-minsize} one.
997 @command{nncp-xfer}'s @option{-force} option is renamed to
998 @option{-mkdir} for clarity.
1001 @option{-minsize} option is specified in KiBs, not bytes, for
1005 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
1006 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
1007 common prefix and are grouped together for convenience.
1010 @command{nncp-cfgenc} command appeared, allowing configuration file
1011 encryption/decryption, for keeping it safe without any either OpenPGP or
1012 similar tools usage.
1015 Cryptographic libraries (dependencies) are updated.
1020 @section Release 0.6
1022 @item Small @command{nncp-rm} command appeared.
1023 @item Cryptographic libraries (dependencies) are updated.
1027 @section Release 0.5
1030 Trivial small fix in default niceness level of @command{nncp-file}
1031 and @command{nncp-freq} commands.
1035 @section Release 0.4
1039 Small fix in @command{nncp-call}, @command{nncp-caller},
1040 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
1044 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
1045 and more convenient to use.
1048 @command{nncp-mincfg} command appeared: helper allowing to create
1049 minimalistic stripped down configuration file without private keys, that
1050 is useful during @command{nncp-xfer} usage.
1055 @section Release 0.3
1057 @item Fixed compatibility with Go 1.6.
1061 @section Release 0.2
1065 @strong{Incompatible} packet's format change (magic number is changed
1066 too): size field is encrypted and is not send in plaintext anymore.
1069 @option{-minsize} option gives ability to automatically pad outgoing
1070 packets to specified minimal size.
1073 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
1074 always check new @emph{tx} packets appearance in the background while
1075 connected. Remote side is immediately notified.
1078 @option{-onlinedeadline} option gives ability to configure timeout of
1079 inactivity of online connection, when it could be disconnected. It could
1080 be used to keep connection alive for a long time.
1083 @option{-maxonlinetime} option gives ability to set maximal allowable
1084 online connection aliveness time.
1087 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
1090 @command{nncp-pkt} command can decompress the data.