Hello, I am trying to optimize my crawls as much as possible. The current bottleneck is the step after adding segments to the linkdb, where Nutch is trying to load the natiive-hadoop library:
2012-03-26 13:20:59,089 WARN util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable This step takes about 15 minutes, compared to all other steps which takes about 25 minutes in total. How can I make this step faster? Thanks, James Ford -- View this message in context: http://lucene.472066.n3.nabble.com/Bottleneck-of-my-crawls-NativeCodeLoader-tp3857929p3857929.html Sent from the Nutch - User mailing list archive at Nabble.com.
