Jenkins build is back to normal : nutch-trunk-maven #214

2012-03-26 Thread Apache Jenkins Server 
See

[jira] [Commented] (NUTCH-1305) Domain(blacklist)URLFilter to trim entries

2012-03-26 Thread Hudson (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239174#comment-13239174
 ] 

Hudson commented on NUTCH-1305:
---

Integrated in Nutch-trunk #1799 (See 
[https://builds.apache.org/job/Nutch-trunk/1799/])
NUTCH-1305 DomainFilter missing (Revision 1305381)

 Result = SUCCESS
markus : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1305381
Files : 
* 
/nutch/trunk/src/plugin/urlfilter-domain/src/java/org/apache/nutch/urlfilter/domain/DomainURLFilter.java


> Domain(blacklist)URLFilter to trim entries
> --
>
> Key: NUTCH-1305
> URL: https://issues.apache.org/jira/browse/NUTCH-1305
> Project: Nutch
>  Issue Type: Bug
>Affects Versions: 1.4
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Minor
> Fix For: 1.5
>
> Attachments: NUTCH-1305-1.5-1.patch
>
>
> Both filters should handle entries with trailing whitespace.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (NUTCH-1234) Upgrade to Tika 1.1

2012-03-26 Thread Hudson (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239173#comment-13239173
 ] 

Hudson commented on NUTCH-1234:
---

Integrated in Nutch-trunk #1799 (See 
[https://builds.apache.org/job/Nutch-trunk/1799/])
NUTCH-1234 Upgrade to Tika 1.1 (Revision 1305355)

 Result = SUCCESS
markus : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1305355
Files : 
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/ivy/ivy.xml


> Upgrade to Tika 1.1
> ---
>
> Key: NUTCH-1234
> URL: https://issues.apache.org/jira/browse/NUTCH-1234
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
> Fix For: 1.5
>
> Attachments: NUTCH-1234-1.5-1.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: nutch-trunk-maven #213

2012-03-26 Thread Apache Jenkins Server 
See 

Changes:

[markus] NUTCH-1305 DomainFilter missing

--
[...truncated 1000 lines...]
AU
src/plugin/language-identifier/src/java/org/apache/nutch/analysis/lang/HTMLLanguageParser.java
AU
src/plugin/language-identifier/src/java/org/apache/nutch/analysis/lang/langmappings.properties
AU
src/plugin/language-identifier/src/java/org/apache/nutch/analysis/lang/package.html
AUsrc/plugin/language-identifier/plugin.xml
AUsrc/plugin/language-identifier/build.xml
A src/plugin/subcollection
A src/plugin/subcollection/ivy.xml
A src/plugin/subcollection/src
A src/plugin/subcollection/src/test
A src/plugin/subcollection/src/test/org
A src/plugin/subcollection/src/test/org/apache
A src/plugin/subcollection/src/test/org/apache/nutch
A src/plugin/subcollection/src/test/org/apache/nutch/collection
AU
src/plugin/subcollection/src/test/org/apache/nutch/collection/TestSubcollection.java
A src/plugin/subcollection/src/java
A src/plugin/subcollection/src/java/org
A src/plugin/subcollection/src/java/org/apache
A src/plugin/subcollection/src/java/org/apache/nutch
A src/plugin/subcollection/src/java/org/apache/nutch/collection
AU
src/plugin/subcollection/src/java/org/apache/nutch/collection/Subcollection.java
AU
src/plugin/subcollection/src/java/org/apache/nutch/collection/CollectionManager.java
AU
src/plugin/subcollection/src/java/org/apache/nutch/collection/package.html
A src/plugin/subcollection/src/java/org/apache/nutch/indexer
A 
src/plugin/subcollection/src/java/org/apache/nutch/indexer/subcollection
AU
src/plugin/subcollection/src/java/org/apache/nutch/indexer/subcollection/SubcollectionIndexingFilter.java
AUsrc/plugin/subcollection/README.txt
AUsrc/plugin/subcollection/plugin.xml
AUsrc/plugin/subcollection/build.xml
A src/plugin/urlfilter-domainblacklist
A src/plugin/urlfilter-domainblacklist/ivy.xml
A src/plugin/urlfilter-domainblacklist/src
A src/plugin/urlfilter-domainblacklist/src/test
A src/plugin/urlfilter-domainblacklist/src/test/org
A src/plugin/urlfilter-domainblacklist/src/test/org/apache
A src/plugin/urlfilter-domainblacklist/src/test/org/apache/nutch
A 
src/plugin/urlfilter-domainblacklist/src/test/org/apache/nutch/urlfilter
A 
src/plugin/urlfilter-domainblacklist/src/test/org/apache/nutch/urlfilter/domainblacklist
A 
src/plugin/urlfilter-domainblacklist/src/test/org/apache/nutch/urlfilter/domainblacklist/TestDomainBlacklistURLFilter.java
A src/plugin/urlfilter-domainblacklist/src/java
A src/plugin/urlfilter-domainblacklist/src/java/org
A src/plugin/urlfilter-domainblacklist/src/java/org/apache
A src/plugin/urlfilter-domainblacklist/src/java/org/apache/nutch
A 
src/plugin/urlfilter-domainblacklist/src/java/org/apache/nutch/urlfilter
A 
src/plugin/urlfilter-domainblacklist/src/java/org/apache/nutch/urlfilter/domainblacklist
A 
src/plugin/urlfilter-domainblacklist/src/java/org/apache/nutch/urlfilter/domainblacklist/DomainBlacklistURLFilter.java
A src/plugin/urlfilter-domainblacklist/data
A src/plugin/urlfilter-domainblacklist/data/hosts.txt
A src/plugin/urlfilter-domainblacklist/plugin.xml
A src/plugin/urlfilter-domainblacklist/build.xml
A src/plugin/index-more
A src/plugin/index-more/ivy.xml
A src/plugin/index-more/src
A src/plugin/index-more/src/test
A src/plugin/index-more/src/test/org
A src/plugin/index-more/src/test/org/apache
A src/plugin/index-more/src/test/org/apache/nutch
A src/plugin/index-more/src/test/org/apache/nutch/indexer
A src/plugin/index-more/src/test/org/apache/nutch/indexer/more
AU
src/plugin/index-more/src/test/org/apache/nutch/indexer/more/TestMoreIndexingFilter.java
A src/plugin/index-more/src/java
A src/plugin/index-more/src/java/org
A src/plugin/index-more/src/java/org/apache
A src/plugin/index-more/src/java/org/apache/nutch
A src/plugin/index-more/src/java/org/apache/nutch/indexer
A src/plugin/index-more/src/java/org/apache/nutch/indexer/more
AU
src/plugin/index-more/src/java/org/apache/nutch/indexer/more/MoreIndexingFilter.java
AU
src/plugin/index-more/src/java/org/apache/nutch/indexer/more/package.html
AUsrc/plugin/index-more/plugin.xml
AUsrc/plugin/index-more/build.xml
AUsrc/plugin/plugin.dtd
A src/plugin/parse-ext
A src/plugin/parse-ext/ivy.xml
A src/plugin/parse-ext/src
A src/plugin/parse-ext/src/test
A src/plugin/parse-ext/src/test/org
A src/plugin/parse-ext/src/test/org/apache
A

[jira] [Commented] (NUTCH-1305) Domain(blacklist)URLFilter to trim entries

2012-03-26 Thread Hudson (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238510#comment-13238510
 ] 

Hudson commented on NUTCH-1305:
---

Integrated in nutch-trunk-maven #213 (See 
[https://builds.apache.org/job/nutch-trunk-maven/213/])
NUTCH-1305 DomainFilter missing (Revision 1305381)

 Result = FAILURE
markus : 
Files : 
* 
/nutch/trunk/src/plugin/urlfilter-domain/src/java/org/apache/nutch/urlfilter/domain/DomainURLFilter.java


> Domain(blacklist)URLFilter to trim entries
> --
>
> Key: NUTCH-1305
> URL: https://issues.apache.org/jira/browse/NUTCH-1305
> Project: Nutch
>  Issue Type: Bug
>Affects Versions: 1.4
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Minor
> Fix For: 1.5
>
> Attachments: NUTCH-1305-1.5-1.patch
>
>
> Both filters should handle entries with trailing whitespace.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: nutch-trunk-maven #212

2012-03-26 Thread Apache Jenkins Server 
See 

Changes:

[markus] NUTCH-1234 Upgrade to Tika 1.1

--
[...truncated 1000 lines...]
AU
src/plugin/language-identifier/src/java/org/apache/nutch/analysis/lang/LanguageIndexingFilter.java
AU
src/plugin/language-identifier/src/java/org/apache/nutch/analysis/lang/HTMLLanguageParser.java
AU
src/plugin/language-identifier/src/java/org/apache/nutch/analysis/lang/langmappings.properties
AU
src/plugin/language-identifier/src/java/org/apache/nutch/analysis/lang/package.html
AUsrc/plugin/language-identifier/plugin.xml
AUsrc/plugin/language-identifier/build.xml
A src/plugin/subcollection
A src/plugin/subcollection/ivy.xml
A src/plugin/subcollection/src
A src/plugin/subcollection/src/test
A src/plugin/subcollection/src/test/org
A src/plugin/subcollection/src/test/org/apache
A src/plugin/subcollection/src/test/org/apache/nutch
A src/plugin/subcollection/src/test/org/apache/nutch/collection
AU
src/plugin/subcollection/src/test/org/apache/nutch/collection/TestSubcollection.java
A src/plugin/subcollection/src/java
A src/plugin/subcollection/src/java/org
A src/plugin/subcollection/src/java/org/apache
A src/plugin/subcollection/src/java/org/apache/nutch
A src/plugin/subcollection/src/java/org/apache/nutch/collection
AU
src/plugin/subcollection/src/java/org/apache/nutch/collection/Subcollection.java
AU
src/plugin/subcollection/src/java/org/apache/nutch/collection/CollectionManager.java
AU
src/plugin/subcollection/src/java/org/apache/nutch/collection/package.html
A src/plugin/subcollection/src/java/org/apache/nutch/indexer
A 
src/plugin/subcollection/src/java/org/apache/nutch/indexer/subcollection
AU
src/plugin/subcollection/src/java/org/apache/nutch/indexer/subcollection/SubcollectionIndexingFilter.java
AUsrc/plugin/subcollection/README.txt
AUsrc/plugin/subcollection/plugin.xml
AUsrc/plugin/subcollection/build.xml
A src/plugin/urlfilter-domainblacklist
A src/plugin/urlfilter-domainblacklist/ivy.xml
A src/plugin/urlfilter-domainblacklist/src
A src/plugin/urlfilter-domainblacklist/src/test
A src/plugin/urlfilter-domainblacklist/src/test/org
A src/plugin/urlfilter-domainblacklist/src/test/org/apache
A src/plugin/urlfilter-domainblacklist/src/test/org/apache/nutch
A 
src/plugin/urlfilter-domainblacklist/src/test/org/apache/nutch/urlfilter
A 
src/plugin/urlfilter-domainblacklist/src/test/org/apache/nutch/urlfilter/domainblacklist
A 
src/plugin/urlfilter-domainblacklist/src/test/org/apache/nutch/urlfilter/domainblacklist/TestDomainBlacklistURLFilter.java
A src/plugin/urlfilter-domainblacklist/src/java
A src/plugin/urlfilter-domainblacklist/src/java/org
A src/plugin/urlfilter-domainblacklist/src/java/org/apache
A src/plugin/urlfilter-domainblacklist/src/java/org/apache/nutch
A 
src/plugin/urlfilter-domainblacklist/src/java/org/apache/nutch/urlfilter
A 
src/plugin/urlfilter-domainblacklist/src/java/org/apache/nutch/urlfilter/domainblacklist
A 
src/plugin/urlfilter-domainblacklist/src/java/org/apache/nutch/urlfilter/domainblacklist/DomainBlacklistURLFilter.java
A src/plugin/urlfilter-domainblacklist/data
A src/plugin/urlfilter-domainblacklist/data/hosts.txt
A src/plugin/urlfilter-domainblacklist/plugin.xml
A src/plugin/urlfilter-domainblacklist/build.xml
A src/plugin/index-more
A src/plugin/index-more/ivy.xml
A src/plugin/index-more/src
A src/plugin/index-more/src/test
A src/plugin/index-more/src/test/org
A src/plugin/index-more/src/test/org/apache
A src/plugin/index-more/src/test/org/apache/nutch
A src/plugin/index-more/src/test/org/apache/nutch/indexer
A src/plugin/index-more/src/test/org/apache/nutch/indexer/more
AU
src/plugin/index-more/src/test/org/apache/nutch/indexer/more/TestMoreIndexingFilter.java
A src/plugin/index-more/src/java
A src/plugin/index-more/src/java/org
A src/plugin/index-more/src/java/org/apache
A src/plugin/index-more/src/java/org/apache/nutch
A src/plugin/index-more/src/java/org/apache/nutch/indexer
A src/plugin/index-more/src/java/org/apache/nutch/indexer/more
AU
src/plugin/index-more/src/java/org/apache/nutch/indexer/more/MoreIndexingFilter.java
AU
src/plugin/index-more/src/java/org/apache/nutch/indexer/more/package.html
AUsrc/plugin/index-more/plugin.xml
AUsrc/plugin/index-more/build.xml
AUsrc/plugin/plugin.dtd
A src/plugin/parse-ext
A src/plugin/parse-ext/ivy.xml
A src/plugin/parse-ext/src
A src/plugin/parse-ext/s

[jira] [Commented] (NUTCH-1234) Upgrade to Tika 1.1

2012-03-26 Thread Hudson (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238456#comment-13238456
 ] 

Hudson commented on NUTCH-1234:
---

Integrated in nutch-trunk-maven #212 (See 
[https://builds.apache.org/job/nutch-trunk-maven/212/])
NUTCH-1234 Upgrade to Tika 1.1 (Revision 1305355)

 Result = FAILURE
markus : 
Files : 
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/ivy/ivy.xml


> Upgrade to Tika 1.1
> ---
>
> Key: NUTCH-1234
> URL: https://issues.apache.org/jira/browse/NUTCH-1234
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
> Fix For: 1.5
>
> Attachments: NUTCH-1234-1.5-1.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (NUTCH-1234) Upgrade to Tika 1.1

2012-03-26 Thread Markus Jelsma (Resolved) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/NUTCH-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma resolved NUTCH-1234.
--

Resolution: Fixed

Committed for 1.5 in rev. 1305355.

> Upgrade to Tika 1.1
> ---
>
> Key: NUTCH-1234
> URL: https://issues.apache.org/jira/browse/NUTCH-1234
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
> Fix For: 1.5
>
> Attachments: NUTCH-1234-1.5-1.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (NUTCH-1319) HostNormalizer

2012-03-26 Thread Markus Jelsma (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238315#comment-13238315
 ] 

Markus Jelsma commented on NUTCH-1319:
--

Objections? I'd like to resolve this issue.

> HostNormalizer
> --
>
> Key: NUTCH-1319
> URL: https://issues.apache.org/jira/browse/NUTCH-1319
> Project: Nutch
>  Issue Type: New Feature
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
> Fix For: 1.5
>
> Attachments: NUTCH-1319-1.5-1.patch
>
>
> Nutch would benefit from having a host normalizer. A host normalizer maps a 
> given host to the desired host. A basic example is to map www.apache.org to 
> apache.org. The Apache website is one of many on the internet that has a 
> duplicate website on the same domain just because it allows both www and 
> non-www to return HTTP 200 and proper content.
> It is also able to handle wildcards such as *.example.org to example.org if 
> there are multiple sub domains that actually point to the same website.
> Large internet crawls tend to get polluted very quickly due to these 
> problems. It also leads to skewed scores in the webgraph as different 
> websites link to different versions of the same duplicate website.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (NUTCH-1234) Upgrade to Tika 1.1

2012-03-26 Thread Markus Jelsma (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/NUTCH-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma updated NUTCH-1234:
-

Attachment: NUTCH-1234-1.5-1.patch

Patch for 1.5 upgrading to Tika-core 1.1 and upgrading Hadoop test to 1.0.0 and 
all tests pass. Will commit shortly unless there are objections.

> Upgrade to Tika 1.1
> ---
>
> Key: NUTCH-1234
> URL: https://issues.apache.org/jira/browse/NUTCH-1234
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
> Fix For: 1.5
>
> Attachments: NUTCH-1234-1.5-1.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira