Hello - these are waiting threads. You probably have too little queues to crawl, and high queue delay. This is not a problem. If you have a 'lot' of data for a single mapper you should see spinWaiting 0 or occasionally 1. Then you need to increase the number of threads, or preferably the number of mappers.
M -----Original message----- > From:Manish Verma <[email protected]> > Sent: Thursday 17th December 2015 0:11 > To: [email protected] > Subject: What Does spinWaiting fetchQueues.totalSize > fetchQueues.getQueueCount Represents > > Hi, > > I see below in Nutch logs . > > spinWaiting=49, fetchQueues.totalSize=498, fetchQueues.getQueueCount=1 > > I got some idea what does these value represent but could not conclude. > Please tell what does these values says and when does it changes ? > > Thanks MV > > >
