5 See also this page @ref{Новости, on russian}.
12 @command{nncp-xfer} checks if locally copied packet's checksum differs
13 from the source's one.
16 @command{nncp-call} has bad return code if its queues contain unfinished jobs.
19 @command{nncp-ack} command appeared, that sends explicit packet receipt
20 acknowledgement (ACK packet). That acknowledgement deletes referenced
21 packet from the outbound spool.
24 Ability to turn @code{fsync} operation off using @env{$NNCPNOSYNC=1}
28 Added various indices in documentation, that should help searching in it.
33 @section Release 8.5.0
37 Fixed @command{nncp-bundle} workability.
40 Mistakenly @option{-mcd-wait} option was enabled by default in
44 Ability to override internal default timeout for online protocol through
45 @env{$NNCPDEADLINE} environment variable. Can be useful for very high
49 NNCP builds on OpenBSD.
54 @section Release 8.4.0
58 Multicast related interface names (@code{mcd-listen} and @code{mcd-send}
59 configuration options) are now regular expressions. By default
60 @command{nncp-cfgnew} uncomments them now with @code{.*} interface name.
63 @command{nncp-call} command has @option{-mcd-wait} option to wait for
64 multicast packet about node's address.
67 @command{nncp-file} command skips everything that is neither regular
68 file nor directory during pax-archive creation.
73 @section Release 8.3.0
77 Fixed building issues on 32-bit systems.
82 @section Release 8.2.0
86 Yggdrasil uses pure-Go IPv6+TCP network stack, instead of naked μTP
87 transport protocol, making it able to work as an ordinary TCP server
88 inside overlay network.
91 Yggdrasil's @code{prv;bind1,bind2;pub@dots{}}-like configuration strings are
92 replaced with URL-like ones (@code{yggdrasils://PRV?bind=BIND1&bind=BIND2&pub=PUB}).
95 Ability to pass multicast-related parameters to Yggdrasil configuration.
98 @command{nncp-daemon} is able to listen on both TCP and Yggdrasil-driven
99 sockets simultaneously.
102 @command{nncp-daemon}'s listening on peering endpoint socket is optional
103 -- you can be reached through the peers.
108 @section Release 8.1.0
112 @command{nncp-cfgdir} does not require @code{self} section existence in
116 Ability to act as Yggdrasil network client, using online protocol on top of it.
121 @section Release 8.0.2
125 Fixed sending ability to areas.
130 @section Release 8.0.1
134 Fixed incorrect @code{freq.chunked} value calculation. If it was missed,
135 then chunked transfer mode was forcefully turned on anyway.
138 Fixed incorrect full file's size calculation in @file{.nncp.meta}.
143 @section Release 8.0.0
147 @strong{Incompatible} encrypted packet format change: payload and pad
148 sizes are sent in-bound in the encrypted stream. That gives ability to
149 streamingly create encrypted packets, without knowing sizes in advance,
150 without creating temporary file or buffer data in memory.
153 Proper encrypted packet padding verification is done now. This is not
154 critical issue, but previously neither padding value, nor its size were
155 authenticated, giving ability to iteratively strip trailing bytes and
156 determine payload's size by observing the reaction of the encrypted
160 @command{nncp-exec} loses its @option{-use-tmp} option, because of
161 streaming-compatible encrypted packets format.
164 @command{nncp-file} and @command{nncp-exec} commands have
165 @option{-maxsize} option, limiting maximal resulting encrypted packet's
166 maximal size (returning error if it is exceeded). Could be useful,
167 because no payload size could be known in advance.
172 @section Release 7.7.0
176 Experimental @code{kqueue} and @code{inotify} based notifications
177 support about spool directory changes, for reducing their often reading
181 @file{.seen} and @file{.hdr} files moved to @file{seen/} and @file{hdr/}
182 subdirectories, for faster scanning of spool directories.
183 Current files migration required:
186 $ find $NNCPSPOOL -type f -name "*.hdr" -exec rm @{@} +
188 $ find $NNCPSPOOL -type d -name rx | while read rx ; do
191 find . -type f -name "*.seen" | while read fn ; do
192 mv $fn seen/$@{fn%.seen@}
196 $ find $NNCPSPOOL -type d -name area | while read area ; do
197 find $area -type f -name "*.seen" | while read fn ; do
206 @section Release 7.6.0
210 Logging may be done to specified opened file descriptor
211 (@env{$NNCPLOG=FD:5} for example).
212 That is friendly to use under @command{daemontools}.
215 Added additional checks of public keys existence in configuration file,
216 preventing some commands from failing.
221 @section Release 7.5.1
225 NNCP builds on NetBSD.
230 @section Release 7.5.0
234 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
235 will contain remote side's address (when running under appropriate
236 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
239 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
242 Do not exit if some of MCD network interfaces can not be listened --
243 only warn about that.
248 @section Release 7.4.0
252 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
257 @section Release 7.3.2
261 @command{hjson-cli} utility builds in vendor-mode now.
266 @section Release 7.3.1
270 Fixed possibly left opened file descriptor in online commands.
273 Severely decreased memory usage of MTH hashing.
278 @section Release 7.3.0
282 Fixed some workability problems on 32-bit systems with big files.
285 Ability to use directory with a bunch of files as a configuration.
286 @command{nncp-cfgdir} command appeared.
291 @section Release 7.2.1
295 Small optimizations in online commands.
300 @section Release 7.2.0
304 @command{nncp-trns} command appeared for manual transition packets creation.
307 If destination node of transitional packet has non empty @option{via}
308 route, then do not ignore, but use it.
311 Do not relay multicast packet to area message's originator, that
312 obviously has seen its own packet.
315 Much less memory usage during MTH hashing when offset is zero: when
316 packet is not resumed, but for example checked with @command{nncp-check}
322 @section Release 7.1.1
326 Fixed failing directories @code{fsync} after @file{.seen} file creation.
331 @section Release 7.1.0
335 Multicasting areas feature appeared. Implemented merely by an additional
336 plain packet type with @command{nncp-toss}, @command{nncp-file} and
337 @command{nncp-exec} commands modification.
340 Fixed workability of @command{nncp-file} and @command{nncp-exec}
341 commands, that use temporary file (stdin and @option{-use-tmp}).
344 Fixed disappearing bad return code in @command{nncp-exec} command.
347 Fixed invalid @file{.hdr} generation when transitional packets are used.
350 @option{-all} option appeared in @command{nncp-rm} command, applying to
351 all the nodes at once.
354 @option{-cycle} option appeared in @command{nncp-check} command, looping
355 the check in infinite cycle.
358 @command{nncp-rm} command can take node alias name.
361 @command{nncp-pkt} can parse @file{.hdr} files.
366 @section Release 7.0.0
370 Minimal required Go version 1.13.
373 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
374 Because of that, there are backward @strong{incompatible} changes of
375 encrypted files (everything laying in the spool directory) and
376 @file{.meta} files of chunked transfer.
378 Current implementation is far from being optimal: it lacks
379 parallelizable calculations and has higher memory consumption: nearly
380 512 KiB for each 1 GiB of file's data. Future performance and memory
381 size optimizations should not lead to packet's format change. But it is
382 still several times faster than BLAKE2b.
385 Resumed online downloads, because of MTH, require reading only of the
386 preceding part of file, not the whole one as was before.
389 @command{nncp-hash} utility appeared for calculating file's MTH hash.
392 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
393 packets. Lowering number of used primitives. Also, its encrypted
394 packet's header is used as an associated data during encryption.
397 MultiCast Discovery uses
398 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
401 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
404 @command{nncp-stat} reports about partly downloaded packets.
407 Updated dependencies.
412 @section Release 6.6.0
416 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
417 commands wait for all background checksummers completion after
418 connection is finished.
421 Added possibility of address determining through multicast announcement
422 in local area network, so called MCD (MultiCast Discovery).
427 @section Release 6.5.0
431 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
434 Fixed possible bad return code ignoring in automatic tosser.
437 Fixed race during file descriptors closing when online protocol call is
438 finished, that could lead to write error of received packet fragment.
441 Kill all packet transmission progress bars in @command{nncp-daemon},
442 @command{nncp-call} and @command{nncp-caller} when call is finished.
447 @section Release 6.4.0
451 Fixed possible race in online protocol, that lead to panic.
456 @section Release 6.3.0
460 Fixed possible panic while showing progress during online protocol.
465 @section Release 6.2.1
469 Three places in logs contained excess @code{%s}.
474 @section Release 6.2.0
478 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
481 Yet another logging refactoring and simplification.
482 Should be no visible differences to the end user.
487 @section Release 6.1.0
491 Optimization: most commands do not keep opened file descriptors now.
492 Previously you can exceed maximal number of opened files if you have got
493 many packets in the spool directory.
496 Optimization: do not close file descriptor of the file we download
497 online. Previously each chunk lead to expensive open/close calls.
500 Online downloaded files are saved with @file{.nock} (non-checksummed)
501 suffix, waiting either for @command{nncp-check}, or online daemons to
502 perform integrity check.
505 Optimization: files, that are not resumed, are checksummed immediately
506 during the online download, skipping @file{.nock}-intermediate step.
509 Ability to store encrypted packet's header in @file{.hdr} file, close to
510 the packet itself. That can greatly increase performance of packets
511 listing on filesystems with big block's size.
516 @section Release 6.0.0
520 Log uses human readable and easy machine parseable
521 @url{https://www.gnu.org/software/recutils/, recfile} format for the
522 records, instead of structured RFC 3339 lines. Old logs are not readable
523 by @command{nncp-log} anymore.
526 @option{-autotoss*} option workability with @command{nncp-daemon}'s
527 @option{-inetd} mode.
530 Call's @option{when-tx-exists} allows to make a call only when outbound
531 packets exists. Combined with seconds-aware cron expression that can be
532 used as some kind of auto dialler.
535 @command{nncp-cronexpr} command allows you to check validity and
536 expectations of specified cron expression.
541 @section Release 5.6.0
545 @option{-autotoss*} option runs tosser not after the call, but every
546 second while it is active.
549 @option{autotoss}, @option{autotoss-doseen},
550 @option{autotoss-nofile}, @option{autotoss-nofreq},
551 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
552 @option{calls} configuration section. You can configure per-call
553 automatic tosser options.
556 Use vendoring, instead of @env{$GOPATH} overriding during tarball
557 installation, because current minimal Go's version is 1.12 and it
563 @section Release 5.5.1
567 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
568 variables in @file{config} during installation.
573 @section Release 5.5.0
577 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
578 @command{nncp-bundle} and @command{nncp-stat}.
581 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
584 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
585 options now. Uncompressed packets are not compatible with previous NNCP
589 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
590 have @option{-autotoss*} options for running tosser after call is ended.
593 Updated dependencies. Minimal required Go version is 1.12.
598 @section Release 5.4.1
602 Fixed @code{SENDMAIL} variable usage during the build.
607 @section Release 5.4.0
611 Updated dependencies.
614 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
615 This should not influence package maintainers, because minimal @command{redo}
616 implementation is included in tarball.
621 @section Release 5.3.3
625 More various error checks.
628 Updated dependencies.
633 @section Release 5.3.2
637 Fixed incorrect logic of @option{onlinedeadline} timeout, where
638 connection won't take into account incoming packets events and will
639 forcefully disconnect.
644 @section Release 5.3.1
648 Fixed @option{onlinedeadline} workability with call addresses that use
649 external commands (@verb{#"|somecmd"#}).
652 @command{nncp-stat} has @option{-pkt} option displaying information
653 about each packet in the spool.
658 @section Release 5.3.0
662 Progress messages contain prefix, describing the running action.
665 Fixed not occurring handshake messages padding.
668 Finish all SP protocol related goroutines, less memory leak.
671 SP protocol generates less socket write calls, thus generating less TCP
675 Check @option{onlinedeadline} and @option{maxonlinetime} options every
676 second, independently from socket reads (up to 10 seconds).
679 Once per minute, if no other traffic exists, PING packets are sent in
680 SP-connection. That allows faster determining of connection unworkability.
683 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
688 @section Release 5.2.1
692 Fixed SP protocol error handling, sometimes causing program panic.
697 @section Release 5.2.0
701 Most commands by default show oneline operations progress.
702 @option{-progress}, @option{-noprogress} command line options,
703 @option{noprogress} configuration file option appeared.
706 Fixed incorrect @command{nncp-check} command return code, that returned
707 bad code when everything is good.
710 Free disk space check during @command{nncp-bundle -rx} call.
715 @section Release 5.1.2
719 @strong{Critical} vulnerability: remote peers authentication could lead
720 to incorrect identification of remote side, allowing foreign encrypted
724 Bugfix: private and public Noise keys were swapped in newly created
725 configuration files, that lead to inability to authenticate online peers.
728 Explicit directories @code{fsync}-ing for guaranteed files renaming.
733 @section Release 5.1.1
737 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
742 @section Release 5.1.0
746 @command{nncp-file} can send directories, automatically creating pax
750 Free disk space is checked during outbound packets creation.
753 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
754 file options replaced with the structure:
755 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
758 Added @option{freq.maxsize} configuration file option, forbidding of
759 freq sending larger than specified size.
762 Ability to notify about successfully executed commands (exec) with
763 @option{notify.exec} configuration file option.
768 @section Release 5.0.0
772 @strong{Incompatible} configuration file format change: YAML is
773 replaced with Hjson, due to its simplicity, without noticeable lack
774 of either functionality or convenience.
777 @strong{Incompatible} plain packet format changes. Older versions are
778 not supported. @code{zlib} compression is replaced with
779 @code{Zstandard}, due to its speed and efficiency, despite library
780 version is not mature enough.
783 Ability to call remote nodes via pipe call of external command, not only
787 @command{nncp-cfgnew} generates configuration file with many
788 comments. @option{-nocomments} option can be used for an old
792 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
793 avoid possible collisions with @file{.nncp.chunkCTR}.
796 Ability to override process umask through configuration file option.
799 Files and directories are created with 666/777 permissions by default,
800 allowing control with @command{umask}.
803 Updated dependencies.
806 Full usage of go modules for dependencies management
807 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
810 Forbid any later GNU GPL version autousage
811 (project's licence now is GNU GPLv3-only).
818 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
826 @strong{Incompatible} encrypted and eblob packet format change: AEAD
827 encryption mode with 128 KiB blocks is used now, because previously
828 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
829 decrypted data to external command. Older versions are not supported.
832 Available free space checking before copying in @command{nncp-xfer},
833 @command{nncp-daemon}, @command{nncp-call(er)}.
836 @command{nncp-call} has ability only to list packets on remote node,
837 without their transmission.
840 @command{nncp-call} has ability to transfer only specified packets.
843 Workability of @option{xxrate} preference in @option{calls}
844 configuration file section.
847 Dependant libraries are updated.
853 Begin using of @code{go.mod} subsystem.
860 @item @command{nncp-daemon} can be run as @command{inetd}-service.
868 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
869 if @file{.seen} exists and treat it like file was already downloaded.
870 Possibly it was transferred out-of-bound and remote side needs to be
874 If higher priority packet is spooled, then @command{nncp-daemon} will
875 queue its sending first, interrupting lower priority transmissions.
878 Simple packet rate limiter added to online-related tools
879 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
882 Ability to specify niceness with symbolic notation:
883 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
886 Changed default niceness levels:
887 for @command{nncp-exec} from 64 to 96,
888 for @command{nncp-freq} from 64 to 160,
889 for @command{nncp-file} from 196 to 224.
897 @strong{Incompatible} @emph{bundle} archive format changes and
898 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
899 valid tar archives, but Go 1.9 made them invalid because of long paths
900 inside. NNCP accidentally was dependant on that bug. Explicit adding of
901 @file{NNCP/} directory in archive restores workability with valid tar
909 Ability to disable relaying at all using @verb{|-via -|} command line option.
917 @strong{Incompatible} plain packet format changes. Older versions are
921 Ability to queue remote command execution, by configuring @option{exec}
922 option in configuration file and using @command{nncp-exec} command:
925 @command{nncp-mail} command is replaced with more flexible
926 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
927 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
929 @option{sendmail} configuration file option is replaced with
930 @option{exec}. @code{sendmail: [@dots{}]} must be replaced with
931 @code{exec: sendmail: [@dots{}]}.
935 Ability to override @option{via} configuration option for destination
936 node via @option{-via} command line option for following commands:
937 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
940 Chunked files, having size less than specified chunk size, will be sent
941 as an ordinary single file.
944 Exec commands are invoked with additional @env{$NNCP_NICE} and
945 @env{$NNCP_SELF} environment variables.
948 Files, that are sent as a reply to freq, have niceness level taken from
949 the freq packet. You can set desired niceness during @command{nncp-freq}
950 invocation using @option{-replynice} option.
953 @command{nncp-toss} command can ignore specified packet types during
954 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
958 @command{nncp-file} command uses
959 @option{FreqMinSize}/@option{FreqChunked} configuration file options
960 for @option{-minsize}/@option{-chunked} by default. You can turn this
961 off by specifying zero value.
970 @strong{Incompatible} encrypted/eblob packet format changes. Older
971 versions are not supported.
974 Twofish encryption algorithm is replaced with ChaCha20. It is much more
975 faster. One cryptographic primitive less.
978 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
979 another cryptographic primitive less (assuming that BLAKE2X is nearly
980 identical to BLAKE2).
989 @strong{Incompatible} encrypted packet format changes. Older versions
993 @command{nncp-bundle} command can either create stream of encrypted
994 packets, or digest it. It is useful when dealing with
995 @code{stdin}/@code{stdout} based transmission methods (like writing to
996 CD-ROM without intermediate prepared ISO image and working with tape
1000 @command{nncp-toss} is able to create @file{.seen} files preventing
1001 duplicate packets receiving.
1004 Single background checksum verifier worker is allowed in
1005 @command{nncp-call}. This is helpful when thousands of small inbound
1006 packets could create many goroutines.
1009 Ability to override path to spool directory and logfile through either
1010 command line argument, or environment variable.
1013 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
1014 @file{.part}, @file{.lock} and temporary files.
1019 @section Release 0.12
1021 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
1025 @section Release 0.11
1027 @item @command{nncp-stat}'s command output is sorted by node name.
1031 @section Release 0.10
1034 @command{nncp-freq}'s @file{DST} argument is optional now. Last
1035 @file{SRC} path's element will be used by default.
1039 @section Release 0.9
1042 Fix @option{-rx}/@option{-tx} arguments processing in
1043 @command{nncp-call} command. They were ignored.
1047 @section Release 0.8
1050 Little bugfix in @command{nncp-file} command, where @option{-minsize}
1051 option for unchunked transfer was not in KiBs, but in bytes.
1055 @section Release 0.7
1059 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
1060 encrypted temporary file for that.
1063 Chunked files transmission appeared with corresponding
1064 @command{nncp-reass} command and @option{freqchunked} configuration file
1065 entry. Useful for transferring big files over small storage devices.
1068 @option{freqminsize} configuration file option, analogue to
1069 @option{-minsize} one.
1072 @command{nncp-xfer}'s @option{-force} option is renamed to
1073 @option{-mkdir} for clarity.
1076 @option{-minsize} option is specified in KiBs, not bytes, for
1080 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
1081 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
1082 common prefix and are grouped together for convenience.
1085 @command{nncp-cfgenc} command appeared, allowing configuration file
1086 encryption/decryption, for keeping it safe without any either OpenPGP or
1087 similar tools usage.
1090 Cryptographic libraries (dependencies) are updated.
1095 @section Release 0.6
1097 @item Small @command{nncp-rm} command appeared.
1098 @item Cryptographic libraries (dependencies) are updated.
1102 @section Release 0.5
1105 Trivial small fix in default niceness level of @command{nncp-file}
1106 and @command{nncp-freq} commands.
1110 @section Release 0.4
1114 Small fix in @command{nncp-call}, @command{nncp-caller},
1115 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
1119 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
1120 and more convenient to use.
1123 @command{nncp-mincfg} command appeared: helper allowing to create
1124 minimalistic stripped down configuration file without private keys, that
1125 is useful during @command{nncp-xfer} usage.
1130 @section Release 0.3
1132 @item Fixed compatibility with Go 1.6.
1136 @section Release 0.2
1140 @strong{Incompatible} packet's format change (magic number is changed
1141 too): size field is encrypted and is not send in plaintext anymore.
1144 @option{-minsize} option gives ability to automatically pad outgoing
1145 packets to specified minimal size.
1148 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
1149 always check new @emph{tx} packets appearance in the background while
1150 connected. Remote side is immediately notified.
1153 @option{-onlinedeadline} option gives ability to configure timeout of
1154 inactivity of online connection, when it could be disconnected. It could
1155 be used to keep connection alive for a long time.
1158 @option{-maxonlinetime} option gives ability to set maximal allowable
1159 online connection aliveness time.
1162 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
1165 @command{nncp-pkt} command can decompress the data.