[ 
https://issues.apache.org/jira/browse/NUTCH-923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277748#comment-13277748
 ] 

Markus Agethle commented on NUTCH-923:
--------------------------------------

Ah, very cool, thanks for the hint.
So the best solution would be to use Nutch's language-identifier plugin and use 
that language in Solr to remap the fields? I suppose this is better than plain 
Solr language identification as Nutch has access to http-headers and 
html-metadata to identify the language?
                
> Multilingual support for Solr-index-mapping
> -------------------------------------------
>
>                 Key: NUTCH-923
>                 URL: https://issues.apache.org/jira/browse/NUTCH-923
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>    Affects Versions: 1.2
>            Reporter: Matthias Agethle
>            Assignee: Markus Jelsma
>            Priority: Minor
>         Attachments: patch-923-nutch-release-1.2.txt
>
>
> It would be useful to extend the mapping-possibilites when indexing to solr.
> One useful feature would be to use the detected language of the html page 
> (for example via the language-identifier plugin) and send the content to 
> corresponding language-aware solr-fields.
> The mapping file could be as follows:
> <field dest="lang" source="lang"/>
> <field dest="title_${lang}" source="title" />
> so that the title-field gets mapped to title_en for English-pages and 
> tilte_fr for French pages.
> What do you think? Could this be useful also to others?
> Or are there already other solutions out there?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to