4 See also this page @ref{Новости, on russian}.
11 Experimental @code{kqueue} and @code{inotify} based notifications
12 support about spool directory changes, for reducing their often reading
16 @file{.seen} and @file{.hdr} files moved to @file{seen/} and @file{hdr/}
17 subdirectories, for faster scanning of spool directories.
18 Current files migration required:
21 $ find $NNCPSPOOL -type f -name "*.hdr" -exec rm @{@} +
23 $ find $NNCPSPOOL -type d -name rx | while read rx ; do
26 find . -type f -name "*.seen" | while read fn ; do
27 mv $fn seen/$@{fn%.seen@}
31 $ find $NNCPSPOOL -type d -name area | while read area ; do
32 find $area -type f -name "*.seen" | while read fn ; do
41 @section Release 7.6.0
45 Logging may be done to specified opened file descriptor
46 (@env{$NNCPLOG=FD:5} for example).
47 That is friendly to use under @command{daemontools}.
50 Added additional checks of public keys existence in configuration file,
51 preventing some commands from failing.
56 @section Release 7.5.1
60 NNCP builds on NetBSD.
65 @section Release 7.5.0
69 @command{nncp-daemon} is compatible with UCSPI-TCP interface, so log
70 will contain remote side's address (when running under appropriate
71 utility). @option{-ucspi} option should be used instead of @option{-inetd}.
74 @command{nncp-call} can be UCSPI-TCP client, using @option{-ucspi} option.
77 Do not exit if some of MCD network interfaces can not be listened --
83 @section Release 7.4.0
87 Fixed simultaneous @command{nncp-daemon} and @command{nncp-caller} MCD work.
92 @section Release 7.3.2
96 @command{hjson-cli} utility builds in vendor-mode now.
101 @section Release 7.3.1
105 Fixed possibly left opened file descriptor in online commands.
108 Severely decreased memory usage of MTH hashing.
113 @section Release 7.3.0
117 Fixed some workability problems on 32-bit systems with big files.
120 Ability to use directory with a bunch of files as a configuration.
121 @command{nncp-cfgdir} command appeared.
126 @section Release 7.2.1
130 Small optimizations in online commands.
135 @section Release 7.2.0
139 @command{nncp-trns} command appeared for manual transition packets creation.
142 If destination node of transitional packet has non empty @option{via}
143 route, then do not ignore, but use it.
146 Do not relay multicast packet to area message's originator, that
147 obviously has seen its own packet.
150 Much less memory usage during MTH hashing when offset is zero: when
151 packet is not resumed, but for example checked with @command{nncp-check}
157 @section Release 7.1.1
161 Fixed failing directories fsync after @file{.seen} file creation.
166 @section Release 7.1.0
170 Multicasting areas feature appeared. Implemented merely by an additional
171 plain packet type with @command{nncp-toss}, @command{nncp-file} and
172 @command{nncp-exec} commands modification.
175 Fixed workability of @command{nncp-file} and @command{nncp-exec}
176 commands, that use temporary file (stdin and @option{-use-tmp}).
179 Fixed disappearing bad return code in @command{nncp-exec} command.
182 Fixed invalid @file{.hdr} generation when transitional packets are used.
185 @option{-all} option appeared in @command{nncp-rm} command, applying to
186 all the nodes at once.
189 @option{-cycle} option appeared in @command{nncp-check} command, looping
190 the check in infinite cycle.
193 @command{nncp-rm} command can take node alias name.
196 @command{nncp-pkt} can parse @file{.hdr} files.
201 @section Release 7.0.0
205 Minimal required Go version 1.13.
208 Merkle Tree-based Hashing with BLAKE3 (MTH) is used instead of BLAKE2b.
209 Because of that, there are backward @strong{incompatible} changes of
210 encrypted files (everything laying in the spool directory) and
211 @file{.meta} files of chunked transfer.
213 Current implementation is far from being optimal: it lacks
214 parallelizable calculations and has higher memory consumption: nearly
215 512 KiB for each 1 GiB of file's data. Future performance and memory
216 size optimizations should not lead to packet's format change. But it is
217 still several times faster than BLAKE2b.
220 Resumed online downloads, because of MTH, require reading only of the
221 preceding part of file, not the whole one as was before.
224 @command{nncp-hash} utility appeared for calculating file's MTH hash.
227 BLAKE2 KDF and XOF functions are replaced with BLAKE3 in encrypted
228 packets. Lowering number of used primitives. Also, its encrypted
229 packet's header is used as an associated data during encryption.
232 MultiCast Discovery uses
233 @verb{|ff02::4e4e:4350|} address instead of @verb{|ff02::1|}.
236 @command{nncp-cfgenc} mistakenly asked passphrase three times during encryption.
239 @command{nncp-stat} reports about partly downloaded packets.
242 Updated dependencies.
247 @section Release 6.6.0
251 @command{nncp-daemon}, @command{nncp-call} and @command{nncp-caller}
252 commands wait for all background checksummers completion after
253 connection is finished.
256 Added possibility of address determining through multicast announcement
257 in local area network, so called MCD (MultiCast Discovery).
262 @section Release 6.5.0
266 Fixed segfault in @command{nncp-daemon} when SP handshake did not succeed.
269 Fixed possible bad return code ignoring in automatic tosser.
272 Fixed race during file descriptors closing when online protocol call is
273 finished, that could lead to write error of received packet fragment.
276 Kill all packet transmission progress bars in @command{nncp-daemon},
277 @command{nncp-call} and @command{nncp-caller} when call is finished.
282 @section Release 6.4.0
286 Fixed possible race in online protocol, that lead to panic.
291 @section Release 6.3.0
295 Fixed possible panic while showing progress during online protocol.
300 @section Release 6.2.1
304 Three places in logs contained excess @code{%s}.
309 @section Release 6.2.0
313 Returned @command{nncp-caller}'s @option{-autotoss*} options workability.
316 Yet another logging refactoring and simplification.
317 Should be no visible differences to the end user.
322 @section Release 6.1.0
326 Optimization: most commands do not keep opened file descriptors now.
327 Previously you can exceed maximal number of opened files if you have got
328 many packets in the spool directory.
331 Optimization: do not close file descriptor of the file we download
332 online. Previously each chunk lead to expensive open/close calls.
335 Online downloaded files are saved with @file{.nock} (non-checksummed)
336 suffix, waiting either for @command{nncp-check}, or online daemons to
337 perform integrity check.
340 Optimization: files, that are not resumed, are checksummed immediately
341 during the online download, skipping @file{.nock}-intermediate step.
344 Ability to store encrypted packet's header in @file{.hdr} file, close to
345 the packet itself. That can greatly increase performance of packets
346 listing on filesystems with big block's size.
351 @section Release 6.0.0
355 Log uses human readable and easy machine parseable
356 @url{https://www.gnu.org/software/recutils/, recfile} format for the
357 records, instead of structured RFC 3339 lines. Old logs are not readable
358 by @command{nncp-log} anymore.
361 @option{-autotoss*} option workability with @command{nncp-daemon}'s
362 @option{-inetd} mode.
365 Call's @option{when-tx-exists} allows to make a call only when outbound
366 packets exists. Combined with seconds-aware cron expression that can be
367 used as some kind of auto dialler.
370 @command{nncp-cronexpr} command allows you to check validity and
371 expectations of specified cron expression.
376 @section Release 5.6.0
380 @option{-autotoss*} option runs tosser not after the call, but every
381 second while it is active.
384 @option{autotoss}, @option{autotoss-doseen},
385 @option{autotoss-nofile}, @option{autotoss-nofreq},
386 @option{autotoss-noexec}, @option{autotoss-notrns} options available in
387 @option{calls} configuration section. You can configure per-call
388 automatic tosser options.
391 Use vendoring, instead of @env{$GOPATH} overriding during tarball
392 installation, because current minimal Go's version is 1.12 and it
398 @section Release 5.5.1
402 Respect for @env{$BINDIR}, @env{$INFODIR} and @env{$DOCDIR} environment
403 variables in @file{config} during installation.
408 @section Release 5.5.0
412 Bugfixes in @command{nncp-call(er)}/@command{nncp-daemon},
413 @command{nncp-bundle} and @command{nncp-stat}.
416 @command{nncp-rm} has @option{-dryrun} and @option{-older} options now.
419 @command{nncp-exec} has @option{-use-tmp} and @option{-nocompress}
420 options now. Uncompressed packets are not compatible with previous NNCP
424 @command{nncp-call}, @command{nncp-caller} and @command{nncp-daemon} commands
425 have @option{-autotoss*} options for running tosser after call is ended.
428 Updated dependencies. Minimal required Go version is 1.12.
433 @section Release 5.4.1
437 Fixed @code{SENDMAIL} variable usage during the build.
442 @section Release 5.4.0
446 Updated dependencies.
449 Build system is moved from Makefiles to @url{http://cr.yp.to/redo.html, redo}.
450 This should not influence package maintainers, because minimal @command{redo}
451 implementation is included in tarball.
456 @section Release 5.3.3
460 More various error checks.
463 Updated dependencies.
468 @section Release 5.3.2
472 Fixed incorrect logic of @option{onlinedeadline} timeout, where
473 connection won't take into account incoming packets events and will
474 forcefully disconnect.
479 @section Release 5.3.1
483 Fixed @option{onlinedeadline} workability with call addresses that use
484 external commands (@verb{#"|somecmd"#}).
487 @command{nncp-stat} has @option{-pkt} option displaying information
488 about each packet in the spool.
493 @section Release 5.3.0
497 Progress messages contain prefix, describing the running action.
500 Fixed not occurring handshake messages padding.
503 Finish all SP protocol related goroutines, less memory leak.
506 SP protocol generates less socket write calls, thus generating less TCP
510 Check @option{onlinedeadline} and @option{maxonlinetime} options every
511 second, independently from socket reads (up to 10 seconds).
514 Once per minute, if no other traffic exists, PING packets are sent in
515 SP-connection. That allows faster determining of connection unworkability.
518 @command{nncp-toss} uses lock-file to prevent simultaneous tossing.
523 @section Release 5.2.1
527 Fixed SP protocol error handling, sometimes causing program panic.
532 @section Release 5.2.0
536 Most commands by default show oneline operations progress.
537 @option{-progress}, @option{-noprogress} command line options,
538 @option{noprogress} configuration file option appeared.
541 Fixed incorrect @command{nncp-check} command return code, that returned
542 bad code when everything is good.
545 Free disk space check during @command{nncp-bundle -rx} call.
550 @section Release 5.1.2
554 @strong{Critical} vulnerability: remote peers authentication could lead
555 to incorrect identification of remote side, allowing foreign encrypted
559 Bugfix: private and public Noise keys were swapped in newly created
560 configuration files, that lead to inability to authenticate online peers.
563 Explicit directories fsync-ing for guaranteed files renaming.
568 @section Release 5.1.1
572 Fixed workability of @command{nncp-file} with @option{-chunked 0} option.
577 @section Release 5.1.0
581 @command{nncp-file} can send directories, automatically creating pax
585 Free disk space is checked during outbound packets creation.
588 @option{freq}, @option{freqminsize}, @option{freqchunked} configuration
589 file options replaced with the structure:
590 @option{freq: @{path: @dots{}, minsize: @dots{}, chunked: @dots{}@}}.
593 Added @option{freq.maxsize} configuration file option, forbidding of
594 freq sending larger than specified size.
597 Ability to notify about successfully executed commands (exec) with
598 @option{notify.exec} configuration file option.
603 @section Release 5.0.0
607 @strong{Incompatible} configuration file format change: YAML is
608 replaced with Hjson, due to its simplicity, without noticeable lack
609 of either functionality or convenience.
612 @strong{Incompatible} plain packet format changes. Older versions are
613 not supported. @code{zlib} compression is replaced with
614 @code{Zstandard}, due to its speed and efficiency, despite library
615 version is not mature enough.
618 Ability to call remote nodes via pipe call of external command, not only
622 @command{nncp-cfgnew} generates configuration file with many
623 comments. @option{-nocomments} option can be used for an old
627 Duplicate filenames have @file{.CTR} suffix, instead of @file{CTR}, to
628 avoid possible collisions with @file{.nncp.chunkCTR}.
631 Ability to override process umask through configuration file option.
634 Files and directories are created with 666/777 permissions by default,
635 allowing control with @command{umask}.
638 Updated dependencies.
641 Full usage of go modules for dependencies management
642 (@code{go.cypherpunks.ru/nncp/v5} namespace is used).
645 Forbid any later GNU GPL version autousage
646 (project's licence now is GNU GPLv3-only).
653 @item Workability on GNU/Linux systems and Go 1.10 is fixed.
661 @strong{Incompatible} encrypted and eblob packet format change: AEAD
662 encryption mode with 128 KiB blocks is used now, because previously
663 @command{nncp-toss} did not verify encrypted packet's MAC before feeding
664 decrypted data to external command. Older versions are not supported.
667 Available free space checking before copying in @command{nncp-xfer},
668 @command{nncp-daemon}, @command{nncp-call(er)}.
671 @command{nncp-call} has ability only to list packets on remote node,
672 without their transmission.
675 @command{nncp-call} has ability to transfer only specified packets.
678 Workability of @option{xxrate} preference in @option{calls}
679 configuration file section.
682 Dependant libraries are updated.
688 Begin using of @code{go.mod} subsystem.
695 @item @command{nncp-daemon} can be run as @command{inetd}-service.
703 @command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller} check
704 if @file{.seen} exists and treat it like file was already downloaded.
705 Possibly it was transferred out-of-bound and remote side needs to be
709 If higher priority packet is spooled, then @command{nncp-daemon} will
710 queue its sending first, interrupting lower priority transmissions.
713 Simple packet rate limiter added to online-related tools
714 (@command{nncp-daemon}, @command{nncp-call}, @command{nncp-caller}).
717 Ability to specify niceness with symbolic notation:
718 @verb{|NORMAL|}, @verb{|BULK+10|}, @verb{|PRIORITY-5|}, etc.
721 Changed default niceness levels:
722 for @command{nncp-exec} from 64 to 96,
723 for @command{nncp-freq} from 64 to 160,
724 for @command{nncp-file} from 196 to 224.
732 @strong{Incompatible} @emph{bundle} archive format changes and
733 @command{nncp-bundle} workability with Go 1.10+. Bundles must be
734 valid tar archives, but Go 1.9 made them invalid because of long paths
735 inside. NNCP accidentally was dependant on that bug. Explicit adding of
736 @file{NNCP/} directory in archive restores workability with valid tar
744 Ability to disable relaying at all using @verb{|-via -|} command line option.
752 @strong{Incompatible} plain packet format changes. Older versions are
756 Ability to queue remote command execution, by configuring @option{exec}
757 option in configuration file and using @command{nncp-exec} command:
760 @command{nncp-mail} command is replaced with more flexible
761 @command{nncp-exec}. Instead of @verb{|nncp-mail NODE RECIPIENT|}
762 you must use @verb{|nncp-exec NODE sendmail RECIPIENT|}.
764 @option{sendmail} configuration file option is replaced with
765 @option{exec}. @verb{|sendmail: [...]|} must be replaced with
766 @verb{|exec: sendmail: [...]|}.
770 Ability to override @option{via} configuration option for destination
771 node via @option{-via} command line option for following commands:
772 @command{nncp-file}, @command{nncp-freq}, @command{nncp-exec}.
775 Chunked files, having size less than specified chunk size, will be sent
776 as an ordinary single file.
779 Exec commands are invoked with additional @env{$NNCP_NICE} and
780 @env{$NNCP_SELF} environment variables.
783 Files, that are sent as a reply to freq, have niceness level taken from
784 the freq packet. You can set desired niceness during @command{nncp-freq}
785 invocation using @option{-replynice} option.
788 @command{nncp-toss} command can ignore specified packet types during
789 processing: @option{-nofile}, @option{-nofreq}, @option{-noexec},
793 @command{nncp-file} command uses
794 @option{FreqMinSize}/@option{FreqChunked} configuration file options
795 for @option{-minsize}/@option{-chunked} by default. You can turn this
796 off by specifying zero value.
805 @strong{Incompatible} encrypted/eblob packet format changes. Older
806 versions are not supported.
809 Twofish encryption algorithm is replaced with ChaCha20. It is much more
810 faster. One cryptographic primitive less.
813 HKDF-BLAKE2b-256 KDF algorithm is replaced with BLAKE2Xb XOF. Yet
814 another cryptographic primitive less (assuming that BLAKE2X is nearly
815 identical to BLAKE2).
824 @strong{Incompatible} encrypted packet format changes. Older versions
828 @command{nncp-bundle} command can either create stream of encrypted
829 packets, or digest it. It is useful when dealing with
830 @code{stdin}/@code{stdout} based transmission methods (like writing to
831 CD-ROM without intermediate prepared ISO image and working with tape
835 @command{nncp-toss} is able to create @file{.seen} files preventing
836 duplicate packets receiving.
839 Single background checksum verifier worker is allowed in
840 @command{nncp-call}. This is helpful when thousands of small inbound
841 packets could create many goroutines.
844 Ability to override path to spool directory and logfile through either
845 command line argument, or environment variable.
848 @command{nncp-rm} is able to delete outbound/inbound, @file{.seen},
849 @file{.part}, @file{.lock} and temporary files.
854 @section Release 0.12
856 @item Sendmail command is called with @env{$NNCP_SENDER} environment variable.
860 @section Release 0.11
862 @item @command{nncp-stat}'s command output is sorted by node name.
866 @section Release 0.10
869 @command{nncp-freq}'s @file{DST} argument is optional now. Last
870 @file{SRC} path's element will be used by default.
877 Fix @option{-rx}/@option{-tx} arguments processing in
878 @command{nncp-call} command. They were ignored.
885 Little bugfix in @command{nncp-file} command, where @option{-minsize}
886 option for unchunked transfer was not in KiBs, but in bytes.
894 Ability to feed @command{nncp-file} from @code{stdin}, that uses an
895 encrypted temporary file for that.
898 Chunked files transmission appeared with corresponding
899 @command{nncp-reass} command and @option{freqchunked} configuration file
900 entry. Useful for transferring big files over small storage devices.
903 @option{freqminsize} configuration file option, analogue to
904 @option{-minsize} one.
907 @command{nncp-xfer}'s @option{-force} option is renamed to
908 @option{-mkdir} for clarity.
911 @option{-minsize} option is specified in KiBs, not bytes, for
915 @command{nncp-newcfg} command is renamed to @command{nncp-cfgnew},
916 and @command{nncp-mincfg} to @command{nncp-cfgmin} -- now they have
917 common prefix and are grouped together for convenience.
920 @command{nncp-cfgenc} command appeared, allowing configuration file
921 encryption/decryption, for keeping it safe without any either OpenPGP or
925 Cryptographic libraries (dependencies) are updated.
932 @item Small @command{nncp-rm} command appeared.
933 @item Cryptographic libraries (dependencies) are updated.
940 Trivial small fix in default niceness level of @command{nncp-file}
941 and @command{nncp-freq} commands.
949 Small fix in @command{nncp-call}, @command{nncp-caller},
950 @command{nncp-daemon}: they can segmentation fail sometimes (no data is
954 @command{nncp-newnode} renamed to @command{nncp-newcfg} -- it is shorter
955 and more convenient to use.
958 @command{nncp-mincfg} command appeared: helper allowing to create
959 minimalistic stripped down configuration file without private keys, that
960 is useful during @command{nncp-xfer} usage.
967 @item Fixed compatibility with Go 1.6.
975 @strong{Incompatible} packet's format change (magic number is changed
976 too): size field is encrypted and is not send in plaintext anymore.
979 @option{-minsize} option gives ability to automatically pad outgoing
980 packets to specified minimal size.
983 @command{nncp-daemon} and @command{nncp-call}/@command{nncp-caller}
984 always check new @emph{tx} packets appearance in the background while
985 connected. Remote side is immediately notified.
988 @option{-onlinedeadline} option gives ability to configure timeout of
989 inactivity of online connection, when it could be disconnected. It could
990 be used to keep connection alive for a long time.
993 @option{-maxonlinetime} option gives ability to set maximal allowable
994 online connection aliveness time.
997 @command{nncp-caller} command appeared: cron-ed TCP daemon caller.
1000 @command{nncp-pkt} command can decompress the data.