Build failed in Jenkins: Nutch-trunk #1439

2011-03-27 Thread Apache Hudson Server
See -- [...truncated 1009 lines...] A src/plugin/subcollection/src/java/org/apache/nutch/collection A src/plugin/subcollection/src/java/org/apache/nutch/collection/Subcollection.java A

Re: http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling

2011-03-27 Thread Gabriele Kahlout
On Sun, Mar 27, 2011 at 7:03 PM, Julien Nioche < lists.digitalpeb...@gmail.com> wrote: > > I think it is a good idea to have a script like this however your proposal >>> could be improved. It currently works only on a single machine and uses >>> commands such as mv, ls etc... which won't work on

[jira] [Created] (NUTCH-973) Remove Segment Merger in 1.3

2011-03-27 Thread Julien Nioche (JIRA)
Remove Segment Merger in 1.3 Key: NUTCH-973 URL: https://issues.apache.org/jira/browse/NUTCH-973 Project: Nutch Issue Type: Task Reporter: Julien Nioche Priority: Minor Fix Fo

Re: http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling

2011-03-27 Thread Julien Nioche
> I think it is a good idea to have a script like this however your proposal >> could be improved. It currently works only on a single machine and uses >> commands such as mv, ls etc... which won't work on a pseudo or fully >> distributed cluster. You should use the 'hadoop fs' commands instead. >

Re: http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling

2011-03-27 Thread Gabriele Kahlout
P.S. I'm still modifying. On Sun, Mar 27, 2011 at 2:34 PM, Julien Nioche < lists.digitalpeb...@gmail.com> wrote: > Gabriele, > > I think it is a good idea to have a script like this however your proposal > could be improved. It currently works only on a single machine and uses > commands such as

[Nutch Wiki] Trivial Update of "FrontPage" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "FrontPage" page has been changed by Gabriele Kahlout. The comment on this change is: fixed broken link. http://wiki.apache.org/nutch/FrontPage?action=diff&rev1=147&rev2=148

Page Tutorial on incremental crawling renamed to Whole-Web Crawling incremental script on Nutch Wiki

2011-03-27 Thread Apache Wiki
Dear wiki user, You have subscribed to a wiki page "Nutch Wiki" for change notification. The page "Whole-Web Crawling incremental script" has been renamed from "Tutorial on incremental crawling" by Gabriele Kahlout. The comment on this change is: more of a documented script than a tutorial. http

[Nutch Wiki] Update of "FrontPage" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "FrontPage" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/FrontPage?action=diff&rev1=146&rev2=147 -- * [

[Nutch Wiki] Update of "Incremental Crawling Scripts Test" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Incremental Crawling Scripts Test" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Incremental%20Crawling%20Scripts%20Test?action=diff&rev1=2&rev2=3 ---

[Nutch Wiki] Trivial Update of "Incremental Crawling Scripts Test" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Incremental Crawling Scripts Test" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Incremental%20Crawling%20Scripts%20Test?action=diff&rev1=1&rev2=2 ---

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=13&rev2=14 ---

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=12&rev2=13 ---

[Nutch Wiki] Update of "Incremental Crawling Scripts Test" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Incremental Crawling Scripts Test" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Incremental%20Crawling%20Scripts%20Test -

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=11&rev2=12 ---

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=10&rev2=11 ---

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=9&rev2=10

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=8&rev2=9 -

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=7&rev2=8 -

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=6&rev2=7 -

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=5&rev2=6 -

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=4&rev2=5 -

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. The comment on this change is: . http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?a

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=2&rev2=3 -

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling?action=diff&rev1=1&rev2=2 -

http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling

2011-03-27 Thread Julien Nioche
Gabriele, I think it is a good idea to have a script like this however your proposal could be improved. It currently works only on a single machine and uses commands such as mv, ls etc... which won't work on a pseudo or fully distributed cluster. You should use the 'hadoop fs' commands instead. I

[Nutch Wiki] Update of "Tutorial on incremental crawling" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Tutorial on incremental crawling" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Tutorial%20on%20incremental%20crawling ---

[Nutch Wiki] Update of "FrontPage" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "FrontPage" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/FrontPage?action=diff&rev1=145&rev2=146 -- * [

[Nutch Wiki] Update of "Gabriele Kahlout" by Gabriele Kahlout

2011-03-27 Thread Apache Wiki
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The "Gabriele Kahlout" page has been changed by Gabriele Kahlout. http://wiki.apache.org/nutch/Gabriele%20Kahlout -- New page: ##language

[jira] [Updated] (NUTCH-972) Mergedb doesn't merge with empty directory, as is the case with merge (for indexes)

2011-03-27 Thread Gabriele Kahlout (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabriele Kahlout updated NUTCH-972: --- Attachment: check_empty.diff > Mergedb doesn't merge with empty directory, as is the case with

[jira] [Created] (NUTCH-972) Mergedb doesn't merge with empty directory, as is the case with merge (for indexes)

2011-03-27 Thread Gabriele Kahlout (JIRA)
Mergedb doesn't merge with empty directory, as is the case with merge (for indexes) --- Key: NUTCH-972 URL: https://issues.apache.org/jira/browse/NUTCH-972 Project: Nutch