X-Git-Url: http://www.git.cypherpunks.ru/?p=nncp.git;a=blobdiff_plain;f=doc%2Fintegration%2Fwarc.texi;h=f449ed5556834fa534f11c30a2712bcd2e15453f;hp=4c5872906e7df18cb93b1e12216f84829946170d;hb=d708b1fb5ba9fef9ba5c6add645a0c74a2c2b27b;hpb=7b7a769770d5e81348c376f5f63a878f9887eac3 diff --git a/doc/integration/warc.texi b/doc/integration/warc.texi index 4c58729..f449ed5 100644 --- a/doc/integration/warc.texi +++ b/doc/integration/warc.texi @@ -64,6 +64,10 @@ $ wget [--page-requisites] [--recursive] \ [@dots{}] http://www.example.com/ @end example +@pindex crawl +Or even more simpler @url{https://git.jordan.im/crawl/tree/README.md, crawl} +utility written on Go too. + @pindex tofuproxy That command will create @file{www.example.com-XXX.warc} web archive. It could produce specialized segmented