Re: 0.8 Intranet Crawl Output/Logging?

2006-09-14 Thread Tomi NA
On 9/14/06, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: Everyone, thanks for the help with this. I hope to return the assistance, once I am more familiar with 0.8. I am using tail -f now to monitor my test crawls. It also look like you can use conf/hadoop-env.sh to redirect log file output to

Re: 0.8 Intranet Crawl Output/Logging?

2006-09-14 Thread Renaud Richardet
06 1:24 AM To: nutch-user@lucene.apache.org Subject: Re: 0.8 Intranet Crawl Output/Logging? On my system, I run the crawl command in one shell while running this command in another shell to monitor the crawl: tail -f log/hadoop.log Of course this does about the same thing as listed below, but &quo

RE: 0.8 Intranet Crawl Output/Logging?

2006-09-14 Thread jared.dunne
Repository - Nutch Content Parser (org.apache.nutch.parse.Parser) [snip] Jared- -Original Message- From: Jacob Brunson [mailto:[EMAIL PROTECTED] Sent: Thursday, September 14, 2006 1:24 AM To: nutch-user@lucene.apache.org Subject: Re: 0.8 Intranet Crawl Output/Logging? On my system, I run

Re: 0.8 Intranet Crawl Output/Logging?

2006-09-14 Thread Jacob Brunson
On my system, I run the crawl command in one shell while running this command in another shell to monitor the crawl: tail -f log/hadoop.log Of course this does about the same thing as listed below, but "tail -f" is a little easier to remember. On 9/13/06, Tomi NA <[EMAIL PROTECTED]> wrote: On 9/

Re: 0.8 Intranet Crawl Output/Logging?

2006-09-13 Thread Jim Wilson
If you don't know what's good for you, baretail can provide a suitable Windows alternative. http://www.baremetalsoft.com/baretail/ -- Jim On 9/13/06, Tomi NA <[EMAIL PROTECTED]> wrote: On 9/13/06, wmelo <[EMAIL PROTECTED]> wrote: > I have the same original doubt. I know that the log shows i

Re: 0.8 Intranet Crawl Output/Logging?

2006-09-13 Thread Tomi NA
On 9/13/06, wmelo <[EMAIL PROTECTED]> wrote: I have the same original doubt. I know that the log shows informations, but, how to see the things happening, real time, like in nutch 0.7.2, when you use the crawl command in the terminal? try something like this (assuming you know what's good for

Re: 0.8 Intranet Crawl Output/Logging?

2006-09-13 Thread wmelo
ay, September 13, 2006 5:59 PM Subject: Re: 0.8 Intranet Crawl Output/Logging? Look in the hadoop.log file under the nutch-0.8/logs dir. It should have that info. Ben jared.dunne wrote: I am using the nutch 0.8 'crawl' command to crawl some content. When I run the crawl comma

Re: 0.8 Intranet Crawl Output/Logging?

2006-09-13 Thread Ben Ogle
gt; but I cant tell if they are being loaded correctly with out some output > from nutch. > > Thanks! > Jared- > > -- View this message in context: http://www.nabble.com/0.8-Intranet-Crawl-Output-Logging--tf2267654.html#a6294542 Sent from the Nutch - User forum at Nabble.com.

0.8 Intranet Crawl Output/Logging?

2006-09-13 Thread jared.dunne
I am using the nutch 0.8 'crawl' command to crawl some content. When I run the crawl command, I don't see any output, but the crawl is running... Is there a way to see information about what the crawler is doing? I have tried setting 'fetcher.verbose' to 'true' in my nutch-site.xml causing no ch