]> Cypherpunks.ru repositories - nncp.git/blobdiff - doc/integration/warc.texi
Mention crawl website crawler
[nncp.git] / doc / integration / warc.texi
index 4c5872906e7df18cb93b1e12216f84829946170d..f449ed5556834fa534f11c30a2712bcd2e15453f 100644 (file)
@@ -64,6 +64,10 @@ $ wget [--page-requisites] [--recursive] \
     [@dots{}] http://www.example.com/
 @end example
 
+@pindex crawl
+Or even more simpler @url{https://git.jordan.im/crawl/tree/README.md, crawl}
+utility written on Go too.
+
 @pindex tofuproxy
 That command will create @file{www.example.com-XXX.warc} web archive.
 It could produce specialized segmented