4 See also this page @ref{Новости, on russian}.
11 Logging may be done to specified opened file descriptor
12 (@env{$NNCPLOG=FD:5} for example).
13 That is friendly to use under @command{daemontools}.
16 Added additional checks of public keys existence in configuration file,
17 preventing some commands from failing.
22 @section Release 7.5.1
26 NNCP builds on NetBSD.
31 @section Release 7.5.0
35 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
36 will contain remote side's address (when running under appropriate
37 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
40 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
43 Do not exit if some of MCD network interfaces can not be listened --
49 @section Release 7.4.0
53 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
58 @section Release 7.3.2
62 @command{hjson-cli} utility builds in vendor-mode now.
67 @section Release 7.3.1
71 Fixed possibly left opened file descriptor in online commands.
74 Severely decreased memory usage of MTH hashing.
79 @section Release 7.3.0
83 Fixed some workability problems on 32-bit systems with big files.
86 Ability to use directory with a bunch of files as a configuration.
87 @command{nncp-cfgdir} command appeared.
92 @section Release 7.2.1
96 Small optimizations in online commands.
101 @section Release 7.2.0
105 @command{nncp-trns} command appeared for manual transition packets creation.
108 If destination node of transitional packet has non empty @option{via}
109 route, then do not ignore, but use it.
112 Do not relay multicast packet to area message's originator, that
113 obviously has seen its own packet.
116 Much less memory usage during MTH hashing when offset is zero: when
117 packet is not resumed, but for example checked with @command{nncp-check}
123 @section Release 7.1.1
127 Fixed failing directories fsync after @file{.seen} file creation.
132 @section Release 7.1.0
136 Multicasting areas feature appeared. Implemented merely by an additional
137 plain packet type with @command{nncp-toss}, @command{nncp-file} and
138 @command{nncp-exec} commands modification.
141 Fixed workability of @command{nncp-file} and @command{nncp-exec}
142 commands, that use temporary file (stdin and @option{-use-tmp}).
145 Fixed disappearing bad return code in @command{nncp-exec} command.
148 Fixed invalid @file{.hdr} generation when transitional packets are used.
151 @option{-all} option appeared in @command{nncp-rm} command, applying to
152 all the nodes at once.
155 @option{-cycle} option appeared in @command{nncp-check} command, looping
156 the check in infinite cycle.
159 @command{nncp-rm} command can take node alias name.
162 @command{nncp-pkt} can parse @file{.hdr} files.
167 @section Release 7.0.0
171 Minimal required Go version 1.13.
174 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
175 Because of that, there are backward @strong{incompatible} changes of
176 encrypted files (everything laying in the spool directory) and
177 @file{.meta} files of chunked transfer.
179 Current implementation is far from being optimal: it lacks
180 parallelizable calculations and has higher memory consumption: nearly
181 512 KiB for each 1 GiB of file's data. Future performance and memory
182 size optimizations should not lead to packet's format change. But it is
183 still several times faster than BLAKE2b.
186 Resumed online downloads, because of MTH, require reading only of the
187 preceding part of file, not the whole one as was before.
190 @command{nncp-hash} utility appeared for calculating file's MTH hash.
193 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
194 packets. Lowering number of used primitives. Also, its encrypted
195 packet's header is used as an associated data during encryption.
198 MultiCast Discovery uses
199 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
202 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
205 @command{nncp-stat} reports about partly downloaded packets.
208 Updated dependencies.
213 @section Release 6.6.0
217 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
218 commands wait for all background checksummers completion after
219 connection is finished.
222 Added possibility of address determining through multicast announcement
223 in local area network, so called MCD (MultiCast Discovery).
228 @section Release 6.5.0
232 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
235 Fixed possible bad return code ignoring in automatic tosser.
238 Fixed race during file descriptors closing when online protocol call is
239 finished, that could lead to write error of received packet fragment.
242 Kill all packet transmission progress bars in @command{nncp-daemon},
243 @command{nncp-call} and @command{nncp-caller} when call is finished.
248 @section Release 6.4.0
252 Fixed possible race in online protocol, that lead to panic.
257 @section Release 6.3.0
261 Fixed possible panic while showing progress during online protocol.
266 @section Release 6.2.1
270 Three places in logs contained excess @code{%s}.
275 @section Release 6.2.0
279 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
282 Yet another logging refactoring and simplification.
283 Should be no visible differences to the end user.
288 @section Release 6.1.0
292 Optimization: most commands do not keep opened file descriptors now.
293 Previously you can exceed maximal number of opened files if you have got
294 many packets in the spool directory.
297 Optimization: do not close file descriptor of the file we download
298 online. Previously each chunk lead to expensive open/close calls.
301 Online downloaded files are saved with @file{.nock} (non-checksummed)
302 suffix, waiting either for @command{nncp-check}, or online daemons to
303 perform integrity check.
306 Optimization: files, that are not resumed, are checksummed immediately
307 during the online download, skipping @file{.nock}-intermediate step.
310 Ability to store encrypted packet's header in @file{.hdr} file, close to
311 the packet itself. That can greatly increase performance of packets
312 listing on filesystems with big block's size.
317 @section Release 6.0.0
321 Log uses human readable and easy machine parseable
322 @url{https://www.gnu.org/software/recutils/, recfile} format for the
323 records, instead of structured RFC 3339 lines. Old logs are not readable
324 by @command{nncp-log} anymore.
327 @option{-autotoss*} option workability with @command{nncp-daemon}'s
328 @option{-inetd} mode.
331 Call's @option{when-tx-exists} allows to make a call only when outbound
332 packets exists. Combined with seconds-aware cron expression that can be
333 used as some kind of auto dialler.
336 @command{nncp-cronexpr} command allows you to check validity and
337 expectations of specified cron expression.
342 @section Release 5.6.0
346 @option{-autotoss*} option runs tosser not after the call, but every
347 second while it is active.
350 @option{autotoss}, @option{autotoss-doseen},
351 @option{autotoss-nofile}, @option{autotoss-nofreq},
352 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
353 @option{calls} configuration section. You can configure per-call
354 automatic tosser options.
357 Use vendoring, instead of @env{$GOPATH} overriding during tarball
358 installation, because current minimal Go's version is 1.12 and it
364 @section Release 5.5.1
368 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
369 variables in @file{config} during installation.
374 @section Release 5.5.0
378 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
379 @command{nncp-bundle} and @command{nncp-stat}.
382 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
385 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
386 options now. Uncompressed packets are not compatible with previous NNCP
390 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
391 have @option{-autotoss*} options for running tosser after call is ended.
394 Updated dependencies. Minimal required Go version is 1.12.
399 @section Release 5.4.1
403 Fixed @code{SENDMAIL} variable usage during the build.
408 @section Release 5.4.0
412 Updated dependencies.
415 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
416 This should not influence package maintainers, because minimal @command{redo}
417 implementation is included in tarball.
422 @section Release 5.3.3
426 More various error checks.
429 Updated dependencies.
434 @section Release 5.3.2
438 Fixed incorrect logic of @option{onlinedeadline} timeout, where
439 connection won't take into account incoming packets events and will
440 forcefully disconnect.
445 @section Release 5.3.1
449 Fixed @option{onlinedeadline} workability with call addresses that use
450 external commands (@verb{#"|somecmd"#}).
453 @command{nncp-stat} has @option{-pkt} option displaying information
454 about each packet in the spool.
459 @section Release 5.3.0
463 Progress messages contain prefix, describing the running action.
466 Fixed not occurring handshake messages padding.
469 Finish all SP protocol related goroutines, less memory leak.
472 SP protocol generates less socket write calls, thus generating less TCP
476 Check @option{onlinedeadline} and @option{maxonlinetime} options every
477 second, independently from socket reads (up to 10 seconds).
480 Once per minute, if no other traffic exists, PING packets are sent in
481 SP-connection. That allows faster determining of connection unworkability.
484 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
489 @section Release 5.2.1
493 Fixed SP protocol error handling, sometimes causing program panic.
498 @section Release 5.2.0
502 Most commands by default show oneline operations progress.
503 @option{-progress}, @option{-noprogress} command line options,
504 @option{noprogress} configuration file option appeared.
507 Fixed incorrect @command{nncp-check} command return code, that returned
508 bad code when everything is good.
511 Free disk space check during @command{nncp-bundle -rx} call.
516 @section Release 5.1.2
520 @strong{Critical} vulnerability: remote peers authentication could lead
521 to incorrect identification of remote side, allowing foreign encrypted
525 Bugfix: private and public Noise keys were swapped in newly created
526 configuration files, that lead to inability to authenticate online peers.
529 Explicit directories fsync-ing for guaranteed files renaming.
534 @section Release 5.1.1
538 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
543 @section Release 5.1.0
547 @command{nncp-file} can send directories, automatically creating pax
551 Free disk space is checked during outbound packets creation.
554 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
555 file options replaced with the structure:
556 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
559 Added @option{freq.maxsize} configuration file option, forbidding of
560 freq sending larger than specified size.
563 Ability to notify about successfully executed commands (exec) with
564 @option{notify.exec} configuration file option.
569 @section Release 5.0.0
573 @strong{Incompatible} configuration file format change: YAML is
574 replaced with Hjson, due to its simplicity, without noticeable lack
575 of either functionality or convenience.
578 @strong{Incompatible} plain packet format changes. Older versions are
579 not supported. @code{zlib} compression is replaced with
580 @code{Zstandard}, due to its speed and efficiency, despite library
581 version is not mature enough.
584 Ability to call remote nodes via pipe call of external command, not only
588 @command{nncp-cfgnew} generates configuration file with many
589 comments. @option{-nocomments} option can be used for an old
593 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
594 avoid possible collisions with @file{.nncp.chunkCTR}.
597 Ability to override process umask through configuration file option.
600 Files and directories are created with 666/777 permissions by default,
601 allowing control with @command{umask}.
604 Updated dependencies.
607 Full usage of go modules for dependencies management
608 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
611 Forbid any later GNU GPL version autousage
612 (project's licence now is GNU GPLv3-only).
619 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
627 @strong{Incompatible} encrypted and eblob packet format change: AEAD
628 encryption mode with 128 KiB blocks is used now, because previously
629 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
630 decrypted data to external command. Older versions are not supported.
633 Available free space checking before copying in @command{nncp-xfer},
634 @command{nncp-daemon}, @command{nncp-call(er)}.
637 @command{nncp-call} has ability only to list packets on remote node,
638 without their transmission.
641 @command{nncp-call} has ability to transfer only specified packets.
644 Workability of @option{xxrate} preference in @option{calls}
645 configuration file section.
648 Dependant libraries are updated.
654 Begin using of @code{go.mod} subsystem.
661 @item @command{nncp-daemon} can be run as @command{inetd}-service.
669 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
670 if @file{.seen} exists and treat it like file was already downloaded.
671 Possibly it was transferred out-of-bound and remote side needs to be
675 If higher priority packet is spooled, then @command{nncp-daemon} will
676 queue its sending first, interrupting lower priority transmissions.
679 Simple packet rate limiter added to online-related tools
680 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
683 Ability to specify niceness with symbolic notation:
684 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
687 Changed default niceness levels:
688 for @command{nncp-exec} from 64 to 96,
689 for @command{nncp-freq} from 64 to 160,
690 for @command{nncp-file} from 196 to 224.
698 @strong{Incompatible} @emph{bundle} archive format changes and
699 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
700 valid tar archives, but Go 1.9 made them invalid because of long paths
701 inside. NNCP accidentally was dependant on that bug. Explicit adding of
702 @file{NNCP/} directory in archive restores workability with valid tar
710 Ability to disable relaying at all using @verb{|-via -|} command line option.
718 @strong{Incompatible} plain packet format changes. Older versions are
722 Ability to queue remote command execution, by configuring @option{exec}
723 option in configuration file and using @command{nncp-exec} command:
726 @command{nncp-mail} command is replaced with more flexible
727 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
728 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
730 @option{sendmail} configuration file option is replaced with
731 @option{exec}. @verb{|sendmail: [...]|} must be replaced with
732 @verb{|exec: sendmail: [...]|}.
736 Ability to override @option{via} configuration option for destination
737 node via @option{-via} command line option for following commands:
738 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
741 Chunked files, having size less than specified chunk size, will be sent
742 as an ordinary single file.
745 Exec commands are invoked with additional @env{$NNCP_NICE} and
746 @env{$NNCP_SELF} environment variables.
749 Files, that are sent as a reply to freq, have niceness level taken from
750 the freq packet. You can set desired niceness during @command{nncp-freq}
751 invocation using @option{-replynice} option.
754 @command{nncp-toss} command can ignore specified packet types during
755 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
759 @command{nncp-file} command uses
760 @option{FreqMinSize}/@option{FreqChunked} configuration file options
761 for @option{-minsize}/@option{-chunked} by default. You can turn this
762 off by specifying zero value.
771 @strong{Incompatible} encrypted/eblob packet format changes. Older
772 versions are not supported.
775 Twofish encryption algorithm is replaced with ChaCha20. It is much more
776 faster. One cryptographic primitive less.
779 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
780 another cryptographic primitive less (assuming that BLAKE2X is nearly
781 identical to BLAKE2).
790 @strong{Incompatible} encrypted packet format changes. Older versions
794 @command{nncp-bundle} command can either create stream of encrypted
795 packets, or digest it. It is useful when dealing with
796 @code{stdin}/@code{stdout} based transmission methods (like writing to
797 CD-ROM without intermediate prepared ISO image and working with tape
801 @command{nncp-toss} is able to create @file{.seen} files preventing
802 duplicate packets receiving.
805 Single background checksum verifier worker is allowed in
806 @command{nncp-call}. This is helpful when thousands of small inbound
807 packets could create many goroutines.
810 Ability to override path to spool directory and logfile through either
811 command line argument, or environment variable.
814 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
815 @file{.part}, @file{.lock} and temporary files.
820 @section Release 0.12
822 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
826 @section Release 0.11
828 @item @command{nncp-stat}'s command output is sorted by node name.
832 @section Release 0.10
835 @command{nncp-freq}'s @file{DST} argument is optional now. Last
836 @file{SRC} path's element will be used by default.
843 Fix @option{-rx}/@option{-tx} arguments processing in
844 @command{nncp-call} command. They were ignored.
851 Little bugfix in @command{nncp-file} command, where @option{-minsize}
852 option for unchunked transfer was not in KiBs, but in bytes.
860 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
861 encrypted temporary file for that.
864 Chunked files transmission appeared with corresponding
865 @command{nncp-reass} command and @option{freqchunked} configuration file
866 entry. Useful for transferring big files over small storage devices.
869 @option{freqminsize} configuration file option, analogue to
870 @option{-minsize} one.
873 @command{nncp-xfer}'s @option{-force} option is renamed to
874 @option{-mkdir} for clarity.
877 @option{-minsize} option is specified in KiBs, not bytes, for
881 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
882 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
883 common prefix and are grouped together for convenience.
886 @command{nncp-cfgenc} command appeared, allowing configuration file
887 encryption/decryption, for keeping it safe without any either OpenPGP or
891 Cryptographic libraries (dependencies) are updated.
898 @item Small @command{nncp-rm} command appeared.
899 @item Cryptographic libraries (dependencies) are updated.
906 Trivial small fix in default niceness level of @command{nncp-file}
907 and @command{nncp-freq} commands.
915 Small fix in @command{nncp-call}, @command{nncp-caller},
916 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
920 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
921 and more convenient to use.
924 @command{nncp-mincfg} command appeared: helper allowing to create
925 minimalistic stripped down configuration file without private keys, that
926 is useful during @command{nncp-xfer} usage.
933 @item Fixed compatibility with Go 1.6.
941 @strong{Incompatible} packet's format change (magic number is changed
942 too): size field is encrypted and is not send in plaintext anymore.
945 @option{-minsize} option gives ability to automatically pad outgoing
946 packets to specified minimal size.
949 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
950 always check new @emph{tx} packets appearance in the background while
951 connected. Remote side is immediately notified.
954 @option{-onlinedeadline} option gives ability to configure timeout of
955 inactivity of online connection, when it could be disconnected. It could
956 be used to keep connection alive for a long time.
959 @option{-maxonlinetime} option gives ability to set maximal allowable
960 online connection aliveness time.
963 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
966 @command{nncp-pkt} command can decompress the data.