Hi Srini, in distributed mode the bulk of Nutch's log output is kept in the Hadoop task logs. The configuration whether, how long and where these logs are kept depends on the configuration of your Hadoop cluster. You can easily find tutorials and examples how to configure this if you google for "hadoop task logs".
Be careful the Nutch logs are usually huge. The easiest way to get them for a jobs is to run the following command on the master node: yarn logs -applicationId <app_id> Best, Sebastian On 07/21/2017 10:09 PM, Srinivasan Ramaswamy wrote: > Hi > > I am running nutch in distributed mode. I would like to see all nuch logs > written to files. I only see the console output. Can i see the same > information logged to some log files ? > > When i run nutch in local mode i do see the logs in runtime/local/logs > directory. But when i run nutch in distributed mode, i dont see it anywhere > except console. > > Can anyone help me with the settings that i need to change ? > > Thanks > Srini >
