Re: Language detection for multivalued field

[Jan Høydahl]

Hi,

First, the feature will only detect ONE language per field, even if it is a 
multi-valued field. In your case there is VERY little text for the detector, so 
do not expect great detection quality. But I believe the detector chose ES as 
language and mapped the whole field as tag_es. The reason you do not see tag_es 
in the first schema version is naturally because you have it defined as 
stored="false".

If you want individual detection of each value, please send the values in 
differently named fields, of file a JIRA to add a feature request for 
individual detection of language for values in a multiValued field.

--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com

22. okt. 2013 kl. 14:16 skrev vatuska <vatu...@yandex.ru>:

> *Can you elaborate on your comment "There isn't tag indexed". Are you saying
> that your multiValued "tag" field is not indexed at all, gone, missing? *
> There aren't any tag_... field despite of indexed=true stored=true for
> dynamicField 
> 
> I found the reason, but I don't understand why
> If I specify
> <str name="langid.whitelist">en,es</str> 
> 
> There aren't any tag_... field for document
> ...
> <field name="tag">español</field> 
> <field name="tag">first</field> 
> <field name="tag">My tag</field>
> ...
> 
> If there are these lines in schema.xml 
> <dynamicField name=&quot;*_undfnd&quot; type=&quot;text_general&quot;
> indexed=&lt;b>"true"* stored="true" multiValued="true"/><dynamicField
> name=&quot;*_en&quot; type=&quot;text_en_splitting&quot;
> indexed=&lt;b>"true"* stored="true" multiValued="true"/>
> <dynamicField name=&quot;*_es&quot; type=&quot;text_es&quot;
> indexed=&quot;true&quot; stored=&lt;b>"false"* multiValued="true"/> 
> 
> But if I specify
> <dynamicField name=&quot;*_es&quot; type=&quot;text_es&quot;
> indexed=&quot;true&quot; stored=&lt;b>"true"* multiValued="true"/> 
> 
> There is a *tag_es* : español , first,  My tag
> in the stored document
> 
> Could you explain, please, how does it work? 
> 
> 
> 
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/Language-detection-for-multivalued-field-tp4096996p4097013.html
> Sent from the Solr - User mailing list archive at Nabble.com.