[ 
https://issues.apache.org/jira/browse/NUTCH-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293334#comment-13293334
 ] 

Hudson commented on NUTCH-1262:
-------------------------------

Integrated in Nutch-trunk #1868 (See 
[https://builds.apache.org/job/Nutch-trunk/1868/])
    NUTCH-1262 Map `duplicating` content-types to a single type (Revision 
1348785)

     Result = SUCCESS
markus : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1348785
Files : 
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/conf/nutch-default.xml
* 
/nutch/trunk/src/plugin/index-more/src/java/org/apache/nutch/indexer/more/MoreIndexingFilter.java

                
> Map `duplicating` content-types to a single type
> ------------------------------------------------
>
>                 Key: NUTCH-1262
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1262
>             Project: Nutch
>          Issue Type: Improvement
>    Affects Versions: 1.4
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>            Priority: Minor
>             Fix For: 1.6
>
>         Attachments: NUTCH-1262-1.5-1.patch, NUTCH-1262-1.5-2.patch
>
>
> Similar or duplicating content-types can end-up differently in an index. 
> With, for example, both application/xhtml+xml and text/html it is impossible 
> to use a single filter to select `web pages`.
> See also: 
> http://lucene.472066.n3.nabble.com/application-xhtml-xml-gt-text-html-td3699942.html
> Content-Type mapping is disabled by default and is enabled via 
> moreIndexingFilter.mapMimeTypes. Example mapping file is provided in conf/.
> {code}
> # target MIME-type <TAB> type1 [<TAB> type2 ...]
> # Map XHTML to HTML
> text/html       application/xhtml+xml
> # Map XHTML and HTML to something else
> Web page        text/html       application/xhtml+xml
> # Map some office documents to each other
> Office document application/vnd.oasis.opendocument.text 
> application/x-tika-msoffice
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to