]> Cypherpunks.ru repositories - nncp.git/commitdiff
Mention crawl website crawler
authorSergey Matveev <stargrave@stargrave.org>
Fri, 24 Jun 2022 13:08:07 +0000 (16:08 +0300)
committerSergey Matveev <stargrave@stargrave.org>
Fri, 24 Jun 2022 13:08:07 +0000 (16:08 +0300)
doc/integration/warc.texi

index 4c5872906e7df18cb93b1e12216f84829946170d..f449ed5556834fa534f11c30a2712bcd2e15453f 100644 (file)
@@ -64,6 +64,10 @@ $ wget [--page-requisites] [--recursive] \
     [@dots{}] http://www.example.com/
 @end example
 
+@pindex crawl
+Or even more simpler @url{https://git.jordan.im/crawl/tree/README.md, crawl}
+utility written on Go too.
+
 @pindex tofuproxy
 That command will create @file{www.example.com-XXX.warc} web archive.
 It could produce specialized segmented