Change the -1 to a positive number like 5 or so.... (In the command) On Sep 9, 2016 8:20 PM, "KRIS MUSSHORN" <[email protected]> wrote:
> Executing this does NOT index everything in and under seed.txt. > > ./bin/crawl -i -D solr.server.url=http://localhost:8983/solr/TEST_CORE > urls/ crawl -1 > > I have to run it multiple times to get all content. > > Is it possible related to this setting in nutch-site.xml? > > <property> > <name>db.max.outlinks.per.page</name> > <value>-1</value> > <description> > allow unlimited outlinks with -1 > </description> > </property> > > Thx, > > Kris >
