5 See also this page @ref{Новости, on russian}.
12 @command{nncp-xfer} checks if locally copied packet's checksum differs
13 from the source's one.
16 @command{nncp-ack} command appeared, that sends explicit packet receipt
17 acknowledgement (ACK packet). That acknowledgement deletes referenced
18 packet from the outbound spool.
21 Ability to turn @code{fsync} operation off using @env{$NNCPNOSYNC=1}
25 Added various indices in documentation, that should help searching in it.
30 @section Release 8.5.0
34 Fixed @command{nncp-bundle} workability.
37 Mistakenly @option{-mcd-wait} option was enabled by default in
41 Ability to override internal default timeout for online protocol through
42 @env{$NNCPDEADLINE} environment variable. Can be useful for very high
46 NNCP builds on OpenBSD.
51 @section Release 8.4.0
55 Multicast related interface names (@code{mcd-listen} and @code{mcd-send}
56 configuration options) are now regular expressions. By default
57 @command{nncp-cfgnew} uncomments them now with @code{.*} interface name.
60 @command{nncp-call} command has @option{-mcd-wait} option to wait for
61 multicast packet about node's address.
64 @command{nncp-file} command skips everything that is neither regular
65 file nor directory during pax-archive creation.
70 @section Release 8.3.0
74 Fixed building issues on 32-bit systems.
79 @section Release 8.2.0
83 Yggdrasil uses pure-Go IPv6+TCP network stack, instead of naked μTP
84 transport protocol, making it able to work as an ordinary TCP server
85 inside overlay network.
88 Yggdrasil's @code{prv;bind1,bind2;pub...}-like configuration strings are
89 replaced with URL-like ones (@code{yggdrasils://PRV?bind=BIND1&bind=BIND2&pub=PUB}).
92 Ability to pass multicast-related parameters to Yggdrasil configuration.
95 @command{nncp-daemon} is able to listen on both TCP and Yggdrasil-driven
96 sockets simultaneously.
99 @command{nncp-daemon}'s listening on peering endpoint socket is optional
100 -- you can be reached through the peers.
105 @section Release 8.1.0
109 @command{nncp-cfgdir} does not require @code{self} section existence in
113 Ability to act as Yggdrasil network client, using online protocol on top of it.
118 @section Release 8.0.2
122 Fixed sending ability to areas.
127 @section Release 8.0.1
131 Fixed incorrect @code{freq.chunked} value calculation. If it was missed,
132 then chunked transfer mode was forcefully turned on anyway.
135 Fixed incorrect full file's size calculation in @file{.nncp.meta}.
140 @section Release 8.0.0
144 @strong{Incompatible} encrypted packet format change: payload and pad
145 sizes are sent in-bound in the encrypted stream. That gives ability to
146 streamingly create encrypted packets, without knowing sizes in advance,
147 without creating temporary file or buffer data in memory.
150 Proper encrypted packet padding verification is done now. This is not
151 critical issue, but previously neither padding value, nor its size were
152 authenticated, giving ability to iteratively strip trailing bytes and
153 determine payload's size by observing the reaction of the encrypted
157 @command{nncp-exec} loses its @option{-use-tmp} option, because of
158 streaming-compatible encrypted packets format.
161 @command{nncp-file} and @command{nncp-exec} commands have
162 @option{-maxsize} option, limiting maximal resulting encrypted packet's
163 maximal size (returning error if it is exceeded). Could be useful,
164 because no payload size could be known in advance.
169 @section Release 7.7.0
173 Experimental @code{kqueue} and @code{inotify} based notifications
174 support about spool directory changes, for reducing their often reading
178 @file{.seen} and @file{.hdr} files moved to @file{seen/} and @file{hdr/}
179 subdirectories, for faster scanning of spool directories.
180 Current files migration required:
183 $ find $NNCPSPOOL -type f -name "*.hdr" -exec rm @{@} +
185 $ find $NNCPSPOOL -type d -name rx | while read rx ; do
188 find . -type f -name "*.seen" | while read fn ; do
189 mv $fn seen/$@{fn%.seen@}
193 $ find $NNCPSPOOL -type d -name area | while read area ; do
194 find $area -type f -name "*.seen" | while read fn ; do
203 @section Release 7.6.0
207 Logging may be done to specified opened file descriptor
208 (@env{$NNCPLOG=FD:5} for example).
209 That is friendly to use under @command{daemontools}.
212 Added additional checks of public keys existence in configuration file,
213 preventing some commands from failing.
218 @section Release 7.5.1
222 NNCP builds on NetBSD.
227 @section Release 7.5.0
231 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
232 will contain remote side's address (when running under appropriate
233 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
236 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
239 Do not exit if some of MCD network interfaces can not be listened --
240 only warn about that.
245 @section Release 7.4.0
249 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
254 @section Release 7.3.2
258 @command{hjson-cli} utility builds in vendor-mode now.
263 @section Release 7.3.1
267 Fixed possibly left opened file descriptor in online commands.
270 Severely decreased memory usage of MTH hashing.
275 @section Release 7.3.0
279 Fixed some workability problems on 32-bit systems with big files.
282 Ability to use directory with a bunch of files as a configuration.
283 @command{nncp-cfgdir} command appeared.
288 @section Release 7.2.1
292 Small optimizations in online commands.
297 @section Release 7.2.0
301 @command{nncp-trns} command appeared for manual transition packets creation.
304 If destination node of transitional packet has non empty @option{via}
305 route, then do not ignore, but use it.
308 Do not relay multicast packet to area message's originator, that
309 obviously has seen its own packet.
312 Much less memory usage during MTH hashing when offset is zero: when
313 packet is not resumed, but for example checked with @command{nncp-check}
319 @section Release 7.1.1
323 Fixed failing directories @code{fsync} after @file{.seen} file creation.
328 @section Release 7.1.0
332 Multicasting areas feature appeared. Implemented merely by an additional
333 plain packet type with @command{nncp-toss}, @command{nncp-file} and
334 @command{nncp-exec} commands modification.
337 Fixed workability of @command{nncp-file} and @command{nncp-exec}
338 commands, that use temporary file (stdin and @option{-use-tmp}).
341 Fixed disappearing bad return code in @command{nncp-exec} command.
344 Fixed invalid @file{.hdr} generation when transitional packets are used.
347 @option{-all} option appeared in @command{nncp-rm} command, applying to
348 all the nodes at once.
351 @option{-cycle} option appeared in @command{nncp-check} command, looping
352 the check in infinite cycle.
355 @command{nncp-rm} command can take node alias name.
358 @command{nncp-pkt} can parse @file{.hdr} files.
363 @section Release 7.0.0
367 Minimal required Go version 1.13.
370 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
371 Because of that, there are backward @strong{incompatible} changes of
372 encrypted files (everything laying in the spool directory) and
373 @file{.meta} files of chunked transfer.
375 Current implementation is far from being optimal: it lacks
376 parallelizable calculations and has higher memory consumption: nearly
377 512 KiB for each 1 GiB of file's data. Future performance and memory
378 size optimizations should not lead to packet's format change. But it is
379 still several times faster than BLAKE2b.
382 Resumed online downloads, because of MTH, require reading only of the
383 preceding part of file, not the whole one as was before.
386 @command{nncp-hash} utility appeared for calculating file's MTH hash.
389 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
390 packets. Lowering number of used primitives. Also, its encrypted
391 packet's header is used as an associated data during encryption.
394 MultiCast Discovery uses
395 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
398 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
401 @command{nncp-stat} reports about partly downloaded packets.
404 Updated dependencies.
409 @section Release 6.6.0
413 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
414 commands wait for all background checksummers completion after
415 connection is finished.
418 Added possibility of address determining through multicast announcement
419 in local area network, so called MCD (MultiCast Discovery).
424 @section Release 6.5.0
428 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
431 Fixed possible bad return code ignoring in automatic tosser.
434 Fixed race during file descriptors closing when online protocol call is
435 finished, that could lead to write error of received packet fragment.
438 Kill all packet transmission progress bars in @command{nncp-daemon},
439 @command{nncp-call} and @command{nncp-caller} when call is finished.
444 @section Release 6.4.0
448 Fixed possible race in online protocol, that lead to panic.
453 @section Release 6.3.0
457 Fixed possible panic while showing progress during online protocol.
462 @section Release 6.2.1
466 Three places in logs contained excess @code{%s}.
471 @section Release 6.2.0
475 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
478 Yet another logging refactoring and simplification.
479 Should be no visible differences to the end user.
484 @section Release 6.1.0
488 Optimization: most commands do not keep opened file descriptors now.
489 Previously you can exceed maximal number of opened files if you have got
490 many packets in the spool directory.
493 Optimization: do not close file descriptor of the file we download
494 online. Previously each chunk lead to expensive open/close calls.
497 Online downloaded files are saved with @file{.nock} (non-checksummed)
498 suffix, waiting either for @command{nncp-check}, or online daemons to
499 perform integrity check.
502 Optimization: files, that are not resumed, are checksummed immediately
503 during the online download, skipping @file{.nock}-intermediate step.
506 Ability to store encrypted packet's header in @file{.hdr} file, close to
507 the packet itself. That can greatly increase performance of packets
508 listing on filesystems with big block's size.
513 @section Release 6.0.0
517 Log uses human readable and easy machine parseable
518 @url{https://www.gnu.org/software/recutils/, recfile} format for the
519 records, instead of structured RFC 3339 lines. Old logs are not readable
520 by @command{nncp-log} anymore.
523 @option{-autotoss*} option workability with @command{nncp-daemon}'s
524 @option{-inetd} mode.
527 Call's @option{when-tx-exists} allows to make a call only when outbound
528 packets exists. Combined with seconds-aware cron expression that can be
529 used as some kind of auto dialler.
532 @command{nncp-cronexpr} command allows you to check validity and
533 expectations of specified cron expression.
538 @section Release 5.6.0
542 @option{-autotoss*} option runs tosser not after the call, but every
543 second while it is active.
546 @option{autotoss}, @option{autotoss-doseen},
547 @option{autotoss-nofile}, @option{autotoss-nofreq},
548 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
549 @option{calls} configuration section. You can configure per-call
550 automatic tosser options.
553 Use vendoring, instead of @env{$GOPATH} overriding during tarball
554 installation, because current minimal Go's version is 1.12 and it
560 @section Release 5.5.1
564 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
565 variables in @file{config} during installation.
570 @section Release 5.5.0
574 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
575 @command{nncp-bundle} and @command{nncp-stat}.
578 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
581 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
582 options now. Uncompressed packets are not compatible with previous NNCP
586 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
587 have @option{-autotoss*} options for running tosser after call is ended.
590 Updated dependencies. Minimal required Go version is 1.12.
595 @section Release 5.4.1
599 Fixed @code{SENDMAIL} variable usage during the build.
604 @section Release 5.4.0
608 Updated dependencies.
611 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
612 This should not influence package maintainers, because minimal @command{redo}
613 implementation is included in tarball.
618 @section Release 5.3.3
622 More various error checks.
625 Updated dependencies.
630 @section Release 5.3.2
634 Fixed incorrect logic of @option{onlinedeadline} timeout, where
635 connection won't take into account incoming packets events and will
636 forcefully disconnect.
641 @section Release 5.3.1
645 Fixed @option{onlinedeadline} workability with call addresses that use
646 external commands (@verb{#"|somecmd"#}).
649 @command{nncp-stat} has @option{-pkt} option displaying information
650 about each packet in the spool.
655 @section Release 5.3.0
659 Progress messages contain prefix, describing the running action.
662 Fixed not occurring handshake messages padding.
665 Finish all SP protocol related goroutines, less memory leak.
668 SP protocol generates less socket write calls, thus generating less TCP
672 Check @option{onlinedeadline} and @option{maxonlinetime} options every
673 second, independently from socket reads (up to 10 seconds).
676 Once per minute, if no other traffic exists, PING packets are sent in
677 SP-connection. That allows faster determining of connection unworkability.
680 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
685 @section Release 5.2.1
689 Fixed SP protocol error handling, sometimes causing program panic.
694 @section Release 5.2.0
698 Most commands by default show oneline operations progress.
699 @option{-progress}, @option{-noprogress} command line options,
700 @option{noprogress} configuration file option appeared.
703 Fixed incorrect @command{nncp-check} command return code, that returned
704 bad code when everything is good.
707 Free disk space check during @command{nncp-bundle -rx} call.
712 @section Release 5.1.2
716 @strong{Critical} vulnerability: remote peers authentication could lead
717 to incorrect identification of remote side, allowing foreign encrypted
721 Bugfix: private and public Noise keys were swapped in newly created
722 configuration files, that lead to inability to authenticate online peers.
725 Explicit directories @code{fsync}-ing for guaranteed files renaming.
730 @section Release 5.1.1
734 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
739 @section Release 5.1.0
743 @command{nncp-file} can send directories, automatically creating pax
747 Free disk space is checked during outbound packets creation.
750 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
751 file options replaced with the structure:
752 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
755 Added @option{freq.maxsize} configuration file option, forbidding of
756 freq sending larger than specified size.
759 Ability to notify about successfully executed commands (exec) with
760 @option{notify.exec} configuration file option.
765 @section Release 5.0.0
769 @strong{Incompatible} configuration file format change: YAML is
770 replaced with Hjson, due to its simplicity, without noticeable lack
771 of either functionality or convenience.
774 @strong{Incompatible} plain packet format changes. Older versions are
775 not supported. @code{zlib} compression is replaced with
776 @code{Zstandard}, due to its speed and efficiency, despite library
777 version is not mature enough.
780 Ability to call remote nodes via pipe call of external command, not only
784 @command{nncp-cfgnew} generates configuration file with many
785 comments. @option{-nocomments} option can be used for an old
789 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
790 avoid possible collisions with @file{.nncp.chunkCTR}.
793 Ability to override process umask through configuration file option.
796 Files and directories are created with 666/777 permissions by default,
797 allowing control with @command{umask}.
800 Updated dependencies.
803 Full usage of go modules for dependencies management
804 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
807 Forbid any later GNU GPL version autousage
808 (project's licence now is GNU GPLv3-only).
815 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
823 @strong{Incompatible} encrypted and eblob packet format change: AEAD
824 encryption mode with 128 KiB blocks is used now, because previously
825 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
826 decrypted data to external command. Older versions are not supported.
829 Available free space checking before copying in @command{nncp-xfer},
830 @command{nncp-daemon}, @command{nncp-call(er)}.
833 @command{nncp-call} has ability only to list packets on remote node,
834 without their transmission.
837 @command{nncp-call} has ability to transfer only specified packets.
840 Workability of @option{xxrate} preference in @option{calls}
841 configuration file section.
844 Dependant libraries are updated.
850 Begin using of @code{go.mod} subsystem.
857 @item @command{nncp-daemon} can be run as @command{inetd}-service.
865 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
866 if @file{.seen} exists and treat it like file was already downloaded.
867 Possibly it was transferred out-of-bound and remote side needs to be
871 If higher priority packet is spooled, then @command{nncp-daemon} will
872 queue its sending first, interrupting lower priority transmissions.
875 Simple packet rate limiter added to online-related tools
876 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
879 Ability to specify niceness with symbolic notation:
880 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
883 Changed default niceness levels:
884 for @command{nncp-exec} from 64 to 96,
885 for @command{nncp-freq} from 64 to 160,
886 for @command{nncp-file} from 196 to 224.
894 @strong{Incompatible} @emph{bundle} archive format changes and
895 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
896 valid tar archives, but Go 1.9 made them invalid because of long paths
897 inside. NNCP accidentally was dependant on that bug. Explicit adding of
898 @file{NNCP/} directory in archive restores workability with valid tar
906 Ability to disable relaying at all using @verb{|-via -|} command line option.
914 @strong{Incompatible} plain packet format changes. Older versions are
918 Ability to queue remote command execution, by configuring @option{exec}
919 option in configuration file and using @command{nncp-exec} command:
922 @command{nncp-mail} command is replaced with more flexible
923 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
924 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
926 @option{sendmail} configuration file option is replaced with
927 @option{exec}. @verb{|sendmail: [...]|} must be replaced with
928 @verb{|exec: sendmail: [...]|}.
932 Ability to override @option{via} configuration option for destination
933 node via @option{-via} command line option for following commands:
934 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
937 Chunked files, having size less than specified chunk size, will be sent
938 as an ordinary single file.
941 Exec commands are invoked with additional @env{$NNCP_NICE} and
942 @env{$NNCP_SELF} environment variables.
945 Files, that are sent as a reply to freq, have niceness level taken from
946 the freq packet. You can set desired niceness during @command{nncp-freq}
947 invocation using @option{-replynice} option.
950 @command{nncp-toss} command can ignore specified packet types during
951 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
955 @command{nncp-file} command uses
956 @option{FreqMinSize}/@option{FreqChunked} configuration file options
957 for @option{-minsize}/@option{-chunked} by default. You can turn this
958 off by specifying zero value.
967 @strong{Incompatible} encrypted/eblob packet format changes. Older
968 versions are not supported.
971 Twofish encryption algorithm is replaced with ChaCha20. It is much more
972 faster. One cryptographic primitive less.
975 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
976 another cryptographic primitive less (assuming that BLAKE2X is nearly
977 identical to BLAKE2).
986 @strong{Incompatible} encrypted packet format changes. Older versions
990 @command{nncp-bundle} command can either create stream of encrypted
991 packets, or digest it. It is useful when dealing with
992 @code{stdin}/@code{stdout} based transmission methods (like writing to
993 CD-ROM without intermediate prepared ISO image and working with tape
997 @command{nncp-toss} is able to create @file{.seen} files preventing
998 duplicate packets receiving.
1001 Single background checksum verifier worker is allowed in
1002 @command{nncp-call}. This is helpful when thousands of small inbound
1003 packets could create many goroutines.
1006 Ability to override path to spool directory and logfile through either
1007 command line argument, or environment variable.
1010 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
1011 @file{.part}, @file{.lock} and temporary files.
1016 @section Release 0.12
1018 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
1022 @section Release 0.11
1024 @item @command{nncp-stat}'s command output is sorted by node name.
1028 @section Release 0.10
1031 @command{nncp-freq}'s @file{DST} argument is optional now. Last
1032 @file{SRC} path's element will be used by default.
1036 @section Release 0.9
1039 Fix @option{-rx}/@option{-tx} arguments processing in
1040 @command{nncp-call} command. They were ignored.
1044 @section Release 0.8
1047 Little bugfix in @command{nncp-file} command, where @option{-minsize}
1048 option for unchunked transfer was not in KiBs, but in bytes.
1052 @section Release 0.7
1056 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
1057 encrypted temporary file for that.
1060 Chunked files transmission appeared with corresponding
1061 @command{nncp-reass} command and @option{freqchunked} configuration file
1062 entry. Useful for transferring big files over small storage devices.
1065 @option{freqminsize} configuration file option, analogue to
1066 @option{-minsize} one.
1069 @command{nncp-xfer}'s @option{-force} option is renamed to
1070 @option{-mkdir} for clarity.
1073 @option{-minsize} option is specified in KiBs, not bytes, for
1077 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
1078 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
1079 common prefix and are grouped together for convenience.
1082 @command{nncp-cfgenc} command appeared, allowing configuration file
1083 encryption/decryption, for keeping it safe without any either OpenPGP or
1084 similar tools usage.
1087 Cryptographic libraries (dependencies) are updated.
1092 @section Release 0.6
1094 @item Small @command{nncp-rm} command appeared.
1095 @item Cryptographic libraries (dependencies) are updated.
1099 @section Release 0.5
1102 Trivial small fix in default niceness level of @command{nncp-file}
1103 and @command{nncp-freq} commands.
1107 @section Release 0.4
1111 Small fix in @command{nncp-call}, @command{nncp-caller},
1112 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
1116 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
1117 and more convenient to use.
1120 @command{nncp-mincfg} command appeared: helper allowing to create
1121 minimalistic stripped down configuration file without private keys, that
1122 is useful during @command{nncp-xfer} usage.
1127 @section Release 0.3
1129 @item Fixed compatibility with Go 1.6.
1133 @section Release 0.2
1137 @strong{Incompatible} packet's format change (magic number is changed
1138 too): size field is encrypted and is not send in plaintext anymore.
1141 @option{-minsize} option gives ability to automatically pad outgoing
1142 packets to specified minimal size.
1145 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
1146 always check new @emph{tx} packets appearance in the background while
1147 connected. Remote side is immediately notified.
1150 @option{-onlinedeadline} option gives ability to configure timeout of
1151 inactivity of online connection, when it could be disconnected. It could
1152 be used to keep connection alive for a long time.
1155 @option{-maxonlinetime} option gives ability to set maximal allowable
1156 online connection aliveness time.
1159 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
1162 @command{nncp-pkt} command can decompress the data.