[jira] [Created] (NUTCH-1075) Delegate language identification to Tika

2011-08-02 Thread Julien Nioche (JIRA)
Delegate language identification to Tika Key: NUTCH-1075 URL: https://issues.apache.org/jira/browse/NUTCH-1075 Project: Nutch Issue Type: Improvement Components: parser Affects

[jira] [Updated] (NUTCH-1075) Delegate language identification to Tika

2011-08-02 Thread Julien Nioche (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Nioche updated NUTCH-1075: - Attachment: NUTCH-1075.patch Passes the tests but requires some testing Delegate language

[jira] [Commented] (NUTCH-917) Website Navigation Links

2011-08-02 Thread Lewis John McGibbney (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13076174#comment-13076174 ] Lewis John McGibbney commented on NUTCH-917: Committed @ revision 1153108. I

[Nutch Wiki] Trivial Update of SetupProxyForNutch by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The SetupProxyForNutch page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/SetupProxyForNutch?action=diffrev1=3rev2=4 - = Install Tinyproxy (Ubuntu Dapper) = + =

[Nutch Wiki] Trivial Update of SetupProxyForNutch by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The SetupProxyForNutch page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/SetupProxyForNutch?action=diffrev1=4rev2=5 + = Install Tinyproxy = - = Install Tinyproxy

[Nutch Wiki] Trivial Update of SetupProxyForNutch by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The SetupProxyForNutch page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/SetupProxyForNutch?action=diffrev1=6rev2=7 == Configure == {{{ - sudo vi

[jira] [Commented] (NUTCH-1075) Delegate language identification to Tika

2011-08-02 Thread Markus Jelsma (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13076187#comment-13076187 ] Markus Jelsma commented on NUTCH-1075: -- Cool! This would solve a lot of issues with

[Nutch Wiki] Trivial Update of SetupProxyForNutch by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The SetupProxyForNutch page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/SetupProxyForNutch?action=diffrev1=7rev2=8 {{{ sudo vi /etc/tinyproxy.conf }}} -

[jira] [Updated] (NUTCH-1067) Configure minimum throughput for fetcher

2011-08-02 Thread Markus Jelsma (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma updated NUTCH-1067: - Attachment: NUTCH-1067-1.4-2.patch New patch to enable the check only when the feeder has

[Nutch Wiki] Trivial Update of SetupProxyForNutch by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The SetupProxyForNutch page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/SetupProxyForNutch?action=diffrev1=8rev2=9 }}} == Create filters == - If necessary

[Nutch Wiki] Trivial Update of SetupProxyForNutch by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The SetupProxyForNutch page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/SetupProxyForNutch?action=diffrev1=9rev2=10 }}} == Test the proxy with your browser

[Nutch Wiki] Trivial Update of SetupProxyForNutch by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The SetupProxyForNutch page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/SetupProxyForNutch?action=diffrev1=11rev2=12 }}} = More resources = - *

[jira] [Commented] (NUTCH-208) http: proxy exception list:

2011-08-02 Thread Lewis John McGibbney (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13076212#comment-13076212 ] Lewis John McGibbney commented on NUTCH-208: This is an interesting (if

[Nutch Wiki] Trivial Update of FrontPage by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The FrontPage page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/FrontPage?action=diffrev1=215rev2=216 * NonDefaultIntranetCrawlingOptions - Desirable options to

RE: Nutch 2 and Cassandra

2011-08-02 Thread Tom Davidson
I found the problem. I am using Cloudera CDH3 and it has a hue plugins jar with an older thrift library in it. I removed the jar from my classpath and all is good. Thanks for your help. -Original Message- From: Tom Davidson [mailto:tdavid...@covario.com] Sent: Monday, August 01, 2011

[jira] [Commented] (NUTCH-937) When nutch is run on hadoop 0.20.2 (or cdh) it will not find plugins because MapReduce will not unpack plugin/ directory from the job's pack (due to MAPREDUCE-967)

2011-08-02 Thread Tom Davidson (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13078341#comment-13078341 ] Tom Davidson commented on NUTCH-937: I had the same problem in my build of nutch 2 and

[Nutch Wiki] Trivial Update of ErrorMessagesInNutch2 by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The ErrorMessagesInNutch2 page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/ErrorMessagesInNutch2 New page: = Error Messages in Nutch 2.0 = This page acts as a

[Nutch Wiki] Trivial Update of FrontPage by LewisJohnMcgibbney

2011-08-02 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on Nutch Wiki for change notification. The FrontPage page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/FrontPage?action=diffrev1=216rev2=217 * NewScoringIndexingExample -- Two full fetch cycles of

Re: Nutch 2 and Cassandra

2011-08-02 Thread lewis john mcgibbney
Hi I've been watching progress on this thread with interest and think that this would be a great addition to the wiki under the following page [1] I am happy to write it up, however is there anything else we need to be aware of in addition to the material you have provided, for example some

RE: Nutch 2 and Cassandra

2011-08-02 Thread Tom Davidson
I did run into a couple more problems running Nutch 2 with CDH3. See https://issues.apache.org/jira/browse/NUTCH-937. I added a comment on the thread explaining my additional problem. I worked around the problem by unjarring the nutch-2-dev.job and seeting the HADOOP_CLASSPATH (see below)

Nutch 2 LinkAnalysisScoringFilter

2011-08-02 Thread Tom Davidson
Does the LinkAnalysisScoringFilter in Nutch 2 work?