Re: HTTP Status 500 - Severe errors in solr configuration change: false in null ------------------------------------------------------------- org

[jim]

I open it  buy Firefox,and find the mistake. when correct the mistake. There
still has the error as:
HTTP Status 500 - Severe errors in solr configuration. Check your log files
for more detailed information on what may be wrong. If you want solr to
continue after configuration errors, change: false in null
-
org.apache.solr.common.SolrException: invalid boolean value: at
org.apache.solr.common.util.StrUtils.parseBool(StrUtils.java:237) at
org.apache.solr.common.util.DOMUtil.addToNamedList(DOMUtil.java:140) at
org.apache.solr.common.util.DOMUtil.nodesToNamedList(DOMUtil.java:98) at
org.apache.solr.common.util.DOMUtil.childNodesToNamedList(DOMUtil.java:88)
at org.apache.solr.common.util.DOMUtil.addToNamedList(DOMUtil.java:142) at
org.apache.solr.common.util.DOMUtil.nodesToNamedList(DOMUtil.java:98) at
org.apache.solr.common.util.DOMUtil.childNodesToNamedList(DOMUtil.java:88)
at org.apache.solr.core.PluginInfo.(PluginInfo.java:54) at
org.apache.solr.core.SolrConfig.readPluginInfos(SolrConfig.java:220) at
org.apache.solr.core.SolrConfig.loadPluginInfo(SolrConfig.java:212) at
org.apache.solr.core.SolrConfig.(SolrConfig.java:184) at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:134)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:83)
at
org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:295)
at
org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:422)
at
org.apache.catalina.core.ApplicationFilterConfig.(ApplicationFilterConfig.java:115)
at
org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4001)
at org.apache.catalina.core.StandardContext.start(StandardContext.java:4651)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:546) at
org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:637)
at
org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:563)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:498) at
org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) at
org.apache.catalina.core.StandardHost.start(StandardHost.java:785) at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:445) at
org.apache.catalina.core.StandardService.start(StandardService.java:519) at
org.apache.catalina.core.StandardServer.start(StandardServer.java:710) at
org.apache.catalina.startup.Catalina.start(Catalina.java:581) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616) at
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) 


i need help

--
View this message in context: 
http://lucene.472066.n3.nabble.com/HTTP-Status-500-Severe-errors-in-solr-configuration-change-abortOnConfigurationError-false-abortOnCo6-tp2757494p2762082.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: HTTP Status 500 - Severe errors in solr configuration change: false in null ------------------------------------------------------------- org

[Marcelo Iturbe]

Hello,
The error message states:
The markup in the document following the root element must be well-formed

Which means that one of your XML files is broken (invalid). It might be the
solrconfig.xml file.

Check the structure of these files, open them in a browser which checks for
XML structure (such as Firefox or IE I think) and go from there.

Hope this helps


On Thu, Mar 31, 2011 at 10:33 PM, jim  wrote:

> i need help
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/HTTP-Status-500-Severe-errors-in-solr-configuration-change-abortOnConfigurationError-false-abortOnCo6-tp2757494p2761679.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: HTTP Status 500 - Severe errors in solr configuration change: false in null ------------------------------------------------------------- org

[jim]

Thanks . I'll check it. but i don't know how to get the right solr
configuration

--
View this message in context: 
http://lucene.472066.n3.nabble.com/HTTP-Status-500-Severe-errors-in-solr-configuration-change-abortOnConfigurationError-false-abortOnCo6-tp2757493p2761753.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solrj Performance check.

[Chris Hostetter]

: For eg, if I post a search url in browser, it shows the QTime in
: milliseconds only.
: 
: http://serverName/solr/mydata/select?q=computing&qt=myhandler&fq=category:1
: 
: But, if I query the same using Solrj from my project like below, it takes
: long time(8 - 12 sec) to produce the same results. Hence, I suspect whether
: Solrj takes such long time to produce results.

a) QTime is only the time spent processing the request, it doens't include 
the time spent writing the results back to hte client (which may be high 
if there are a lot of documents in the response, or very large documents 
i nthe response, or lots of network overhead, etc...)

b) how are you timing your SolrJ code? the snippet you presented doesn't 
give us any indication of what you are using to determine the 8-12 second 
timing number, so we have no way of knowing what exactly might be 
contributing to the total time.

: SolrServer server = new CommonsHttpSolrServer(url);
: SolrQuery query = new SolrQuery("computing");
: query.setParam("qt", "myhandler");
: query.setFilterQueries("category:1");
: query.setHighlight(false);
: QueryResponse rsp = server.query( query );

(for instance: if you put those lines in a small java program and time the 
entire program, that's going ot be a bad way to represent the timing, as 
it will also factor in all the time spent initializing hte JVM, loading 
classes etc...)


-Hoss

Re: query expansion à la dismax

[Chris Hostetter]

: So I wrote my own code that filters the top level queries and expands 
: them, using a similar instruction as dismax within a particular query 
: component.
: 
: Question 1: doesn't such a code already exist?
:  (I haven't found it)

the DisjunctionMaxQueryParser class has support for configuring field 
aliase -- in the DisMaxQParser it only uses it with setting up aliaes for a 
(fake) default field, but if you use it directly in code you can set up 
specific aliases for specific field names (there's plans to do this for 
the edismax handler but some other weird behavior bugs are holding it up)

: Question 2: should I rather make a QParserPlugin?
:   (the javadoc is not very helpful)

implementing QParserPlugin is how you register a plugin that solr knows 
to use to parse query strings when the user asks for a parser by name 
(either using the defType param, or with the local param syntax).  within 
your QParserPlugin you can implement the actaul parsing anyway you like.

The LuceneQParserPlugin serves as a really simple example of how to 
implement a QParserPlugin if you've already got a QueryParser subclass 
that you want to use -- it's really just about managing the request 
parameters.


-Hoss

Re: HTTP Status 500 - Severe errors in solr configuration change: false in null ------------------------------------------------------------- org

[jim]

i need help

--
View this message in context: 
http://lucene.472066.n3.nabble.com/HTTP-Status-500-Severe-errors-in-solr-configuration-change-abortOnConfigurationError-false-abortOnCo6-tp2757494p2761679.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr 1.4.1 and Tika 0.9 - some tests not passing

[Chris Hostetter]

: I'm still interested on what steps I could take to get to the bottom of the 
: failing tests.  Is there additional information that I should provide?

i'm not really up to speed on what might have changed in Tika 0.9 to cause 
this, but the best thing to do would probably be to look at what *does* 
work compared to what doesn't work.

if *none* of hte asserts for dealing with an html doc work, that suggests 
that fundementally something is just completley broken about the html 
parsing.

Consider this first assertion failure...

: assertQ(req("title:Welcome"), "//*[@numFound='1']");

...in the context of what you said tika 0.9 gives you for that doc on the 
command line...

: $ java -jar tika-app-0.9.jar 
: 
../../../apache-solr-1.4.1-with-tika-0.9/contrib/extraction/src/test/resources/simple.html
...
: Welcome to Solr

...if that basic little bit of info can't be extracted, then i'm guessing 
nothing is being extracted.

I would suggest you run the example (with the 0.9 tika jars) and manually 
attempt to index one document, and then use the schema browser to see 
exactly what gets indexed.

you may need to experiment with tweaking the config options for the 
extraction handler.

-Hoss

Re: How could I set multi-value for a field in DataImporter

[kun xiong]

I found the answer from source code.

Using a Collection as value.

Thanks any way

2011/4/1 kun xiong 

> Stefan,
>
> Thanks very much for your quick reply.
>
> Actually I have to write a CustomDataImporter class to full-import data and
> index them all.
>
> So it should be done in java code and schema.xml.
>
> When  I write a CustomDataImporter, I have to implement a nextRow() method,
> which return a map. And also schema,xml have a multiValued
> label for each field.
>
> I am wondering how could I utilize it.
>
> I believe there must be several ways to make it multi-valued, using
> analyzer or copyField. I am finding a efficient and easiest way that I don't
> have to change data format.
>
> Kun
>
> 2011/3/31 Stefan Matheis 
>
>> Kun,
>>
>> it should be enough to use the same field second time, like this:
>> 
>> value2
>>
>> Regards
>> Stefan
>>
>> On Thu, Mar 31, 2011 at 11:39 AM, kun xiong  wrote:
>> > Since the interface of DataImporter return a Map, I can't put multi
>> value
>> > for a same field, right?
>> >
>> > Example:
>> >
>> > I write a class extending DataImporter, and  want to index {"value1",
>> > "value2"} for field "name".
>> >
>> > How should I do?
>> >
>> > Many thanks.
>> >
>> > Kun
>> >
>>
>
>

Re: How could I set multi-value for a field in DataImporter

[kun xiong]

Stefan,

Thanks very much for your quick reply.

Actually I have to write a CustomDataImporter class to full-import data and
index them all.

So it should be done in java code and schema.xml.

When  I write a CustomDataImporter, I have to implement a nextRow() method,
which return a map. And also schema,xml have a multiValued
label for each field.

I am wondering how could I utilize it.

I believe there must be several ways to make it multi-valued, using analyzer
or copyField. I am finding a efficient and easiest way that I don't have to
change data format.

Kun

2011/3/31 Stefan Matheis 

> Kun,
>
> it should be enough to use the same field second time, like this:
> 
> value2
>
> Regards
> Stefan
>
> On Thu, Mar 31, 2011 at 11:39 AM, kun xiong  wrote:
> > Since the interface of DataImporter return a Map, I can't put multi value
> > for a same field, right?
> >
> > Example:
> >
> > I write a class extending DataImporter, and  want to index {"value1",
> > "value2"} for field "name".
> >
> > How should I do?
> >
> > Many thanks.
> >
> > Kun
> >
>

Re: solr upgrade question

[Johannes Goll]

Hi Alexander,

I have posted same question a few month ago. The only solution that came up
was to regenerate the index files using the new  version. How did you do
this exactly with
luke 1.0.1 ? Would you mind sharing some of that magic ?

Best,
Johannes


2011/3/31 Alexander Aristov 

> Didn't get any responses.
>
> But I tried luke 1.0.1 and it did the magic. I run optimization and after
> that solr got up.
>
> Best Regards
> Alexander Aristov
>
>
> On 30 March 2011 15:47, Alexander Aristov  >wrote:
>
> > People
> >
> > Is were way to upgrade existsing index from solr 1.4 to solr 4(trunk).
> When
> > I configured solr 4 and launched it complained about incorrect lucence
> file
> > version (3 instead of old 2)
> >
> > Are there any procedures to convert index?
> >
> >
> > Best Regards
> > Alexander Aristov
> >
>

Re: Concatenate multivalued DIH fields

[neha]

Hi, When there are multiple authors instead of concatenating, it append list
of last names after the first names.

Vincent
White
Bakken
Sjaastad
Maurice B.
Linda R.
Inger Johanne
Ottar

Thanks,
Neha

-
Thanks,
Neha
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Concatenate-multivalued-DIH-fields-tp2749988p2760520.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Matching the beginning of a word within a term

[lboutros]

So if i understand well, in these exemples :

http://localhost:8983/solr/search/?q=*:*&fq={!q.op=AND%20df=common_names}"companion
mank"~10 

http://localhost:8983/solr/search/?q=*:*&fq={!q.op=AND%20df=common_names}"companion
manki"~10 

http://localhost:8983/solr/search/?q=*:*&fq={!q.op=AND%20df=common_names}"companion
mankin"~10 

You want to retrieve the same record (1) ? So you would like something like
:

http://localhost:8983/solr/search/?q=*:*&fq={!q.op=AND%20df=common_names}"companion
man*"~10 

Did you took a look to the ComplexPhraseQueryParser ?

http://lucene.apache.org/java/3_1_0/api/all/org/apache/lucene/queryParser/complexPhrase/ComplexPhraseQueryParser.html

Ludovic


-
Jouve
France.
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Matching-the-beginning-of-a-word-within-a-term-tp2754668p2760486.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Concatenate multivalued DIH fields

[Marcelo Iturbe]

Hello,

In the schema.xml file you can contenate much easier.

  


 


Hope this helps

On Tue, Mar 29, 2011 at 3:01 PM, neha  wrote:

> I have two multivalued DIH fields "fname" and "lname". I want to
> concatenate
> each of the fname and lname pairs to get a third multivalued DIH field
> "name".
>
> I tried this :
>
>
>
>
> But the result is :  [Lars L., Helle K., Thomas A., Jes] [Thomsen, Iversen,
> Brinck, Olesen],  instead of   Lars L. Thomsen, Helle K. Iverson, Thomas A
> Brinck, Jes Oleson.
>
> Is there a way to iterate through the multivalued fields or is there
> something more simple to do this.
>
> Thanks,
> Neha
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Concatenate-multivalued-DIH-fields-tp2749988p2749988.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: Exact keyword search and redirect term

[Erick Erickson]

Oops, fat fingers.

In addition to Jonathan's comment, you can construct your own
field type from, say, keywordanalyzer and lowercasefilter to do
some normalization, and/or patternreplacefilterfactory if you want
to do even more normalization.

Best
Erick

On Thu, Mar 31, 2011 at 3:57 PM, Erick Erickson  wrote:
> In addition to Jo
>
> On Thu, Mar 31, 2011 at 2:43 PM, Jonathan Rochkind  wrote:
>> There is no configuration.
>>
>> If:
>> 1) you index your records as type String, with no analysis
>> 2) You always do phrase searches in your query, surround it with double
>> quotes. (Neccesary because otherwise queries with spaces in them won't be
>> passed intact to the field for matching). (Alternately use the 'field' or
>> 'raw' query parsers, or that other new one that will be in solr 3.1 that i
>> forget the name of).
>>
>> Then I believe it will work how you say you want, only matching on _exact_
>> matches.   I think, try it out. But beware that 'exact' here will REALLY
>> mean 'exact' -- same case, exact same punctuation and spacing, exact same
>> bytes. (Same serialization for unicode that can be serialized to several
>> different valid byte representations in UTF8, etc)
>>
>> On 3/31/2011 2:17 PM, Tejinder Rawat wrote:
>>>
>>> Hi All,
>>>
>>>
>>>
>>> I have many documents indexed based on a field having value “anniversary”.
>>>
>>>
>>>
>>> Also there is a redirect term which is having “anniversary” inside this.
>>> E.g. below:
>>>
>>>
>>>
>>> --
>>>
>>>     termRedirect
>>>
>>>    >> name="redirectUri_meta_s">/product/silver+25th+anniversary.do
>>>
>>>     25th anniversary
>>>
>>> --
>>>
>>>
>>>
>>> Now for any search based on “anniversary”, I am getting the redirection to
>>> above uri. I am expecting the redirection only for exact term “25th
>>> anniversary”.
>>>
>>>
>>>
>>> Is there any configuration to make sure that redirection should work on
>>> exact match?
>>>
>>>
>>>
>>>
>>>
>>> Thank You!
>>>
>>
>

Re: Exact keyword search and redirect term

[Erick Erickson]

In addition to Jo

On Thu, Mar 31, 2011 at 2:43 PM, Jonathan Rochkind  wrote:
> There is no configuration.
>
> If:
> 1) you index your records as type String, with no analysis
> 2) You always do phrase searches in your query, surround it with double
> quotes. (Neccesary because otherwise queries with spaces in them won't be
> passed intact to the field for matching). (Alternately use the 'field' or
> 'raw' query parsers, or that other new one that will be in solr 3.1 that i
> forget the name of).
>
> Then I believe it will work how you say you want, only matching on _exact_
> matches.   I think, try it out. But beware that 'exact' here will REALLY
> mean 'exact' -- same case, exact same punctuation and spacing, exact same
> bytes. (Same serialization for unicode that can be serialized to several
> different valid byte representations in UTF8, etc)
>
> On 3/31/2011 2:17 PM, Tejinder Rawat wrote:
>>
>> Hi All,
>>
>>
>>
>> I have many documents indexed based on a field having value “anniversary”.
>>
>>
>>
>> Also there is a redirect term which is having “anniversary” inside this.
>> E.g. below:
>>
>>
>>
>> --
>>
>>     termRedirect
>>
>>    > name="redirectUri_meta_s">/product/silver+25th+anniversary.do
>>
>>     25th anniversary
>>
>> --
>>
>>
>>
>> Now for any search based on “anniversary”, I am getting the redirection to
>> above uri. I am expecting the redirection only for exact term “25th
>> anniversary”.
>>
>>
>>
>> Is there any configuration to make sure that redirection should work on
>> exact match?
>>
>>
>>
>>
>>
>> Thank You!
>>
>

Re: HTTP Status 500 - Severe errors in solr configuration change: false in null ------------------------------------------------------------- org

[Erick Erickson]

At a guess, you've somehow changed one of the configuration
files and made it into invalid XML. Try opening the configuration
XMLs in an application that checks for well-formedness
and/or look at the line in the XML file indicated and see if there's
anything that jumps out at you...

Or just replace the whole directory if you haven't made any
changes to it. It's always possible this is a random error.

Best
Erick

On Thu, Mar 31, 2011 at 3:51 AM, jim  wrote:
> hi all,
> I used ubuntu 10.10 ,I'm trying to get solr 1.4up andrunning,with no
> success. i have fllowed this
> http://ubuntuforums.org/showthread.php?t=1532230 to run my solr,
> but there has  error as:
>
> HTTP Status 500 - Severe errors in solr configuration. Check your log files
> for more detailed information on what may be wrong. If you want solr to
> continue after configuration errors, change: false in null
> -
> org.xml.sax.SAXParseException; lineNumber: 1036; columnNumber: 2; The markup
> in the document following the root element must be well-formed. at
> com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:253)
> at
> com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:288)
> at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121) at
> org.apache.solr.core.Config.(Config.java:110) at
> org.apache.solr.core.SolrConfig.(SolrConfig.java:130) at
> org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:134)
> at
> org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:83)
> at
> org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:295)
> at
> org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:422)
> at
> org.apache.catalina.core.ApplicationFilterConfig.(ApplicationFilterConfig.java:115)
> at
> org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4001)
> at org.apache.catalina.core.StandardContext.start(StandardContext.java:4651)
> at
> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
> at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
> at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:546) at
> org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:637)
> at
> org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:563)
> at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:498) at
> org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) at
> org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
> at
> org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
> at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) at
> org.apache.catalina.core.StandardHost.start(StandardHost.java:785) at
> org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) at
> org.apache.catalina.core.StandardEngine.start(StandardEngine.java:445) at
> org.apache.catalina.core.StandardService.start(StandardService.java:519) at
> org.apache.catalina.core.StandardServer.start(StandardServer.java:710) at
> org.apache.catalina.startup.Catalina.start(Catalina.java:581) at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616) at
> org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at
> org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
>
>
> any body know how to do?thanks
>
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/HTTP-Status-500-Severe-errors-in-solr-configuration-change-abortOnConfigurationError-false-abortOnCo6-tp2757493p2757493.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Problems with DIH and missing fields.

[Marcelo Iturbe]

Hello,
I have an XML which contains personal contacts. Not all contacts have the
same fields (email, phone, postal).

The problem is that when certain fields are NOT present,  SOLR is injecting
the previous contacts data.

For example, assume the following from the XML feed:

Jane Doe

Santiago
Region Metropolitana
Chile


Jeff Smith



Ana Mercurio
+56912345678


The second contact, will have the first contacts postal address.
The third contact, will have Janes Postal Address and Jeffs email address:



Ana Mercurio


+5612345678


jeff.sm...@gmail.com


Santiago
Region Metropolitana
Chile



This is how I have the fields specified in the schema.xml file:




What did I miss?

Thanks for your help.

Re: ComplexPhraseQueryParser and wildcards

[Erick Erickson]

Ohhh, my. Well, in that case I'm afraid I'm out of ideas. Can you
raise a JIRA on the crash? Please include the field definition
and an example of the query you're sending. This should
be fixed...

Best
Erick

On Thu, Mar 31, 2011 at 11:28 AM, jmr  wrote:
>
> Erick Erickson wrote:
>>
>> No, WDF only works on tokens from the tokenizer. It would
>> not concatenate two separate tokens together, just tokens generated
>> because of, say, case changes, punctuation, etc in the single token
>> that made it through, say, WhitespaceTokenizerFactory.
>>
>> The analysis page should make that clear, have you looked at it?
>>
>
> Thanks Erik,
>
> So, I've changed the query analyser and set catenateWords to 1.
> Unfortunately, the query "crosslin* compiler"~50" returns nothing.
> I have looked at the Analysis page and it does not show something different
> excepting than catenateWords is 1.
> Furthermore, the query ("cross-linker compiler"~50) is now crashing
> ComplexPhraseQueryParser.
>
> If there is nothing out of the box, maybe we'll need to modify the
> ComplexPhraseQuery Parser.
> I think that it should accept phrases as token for the proximity search. we
> could enter escaped quotes to specify phrases like: "(\"cross link*\")
> (\"compiler\")"~10
>
> I just wanted to be sure I did not miss something obvious before investing
> time in developing/changing solr parser.
>
> Regards,
> Jean-Michel
>
>
>
>
>
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/ComplexPhraseQueryParser-and-wildcards-tp2742244p2759078.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Apache Solr 3.1.0

[Grant Ingersoll]

March 2011, Apache Solr 3.1 available

The Lucene PMC is pleased to announce the release of Apache Solr 3.1.

This release contains numerous bug fixes, optimizations, and
improvements, some of which are highlighted below.  The release is
available for immediate download at 
http://www.apache.org/dyn/closer.cgi/lucene/solr (see note below).
See the CHANGES.txt file included with the release for a full list of
details as well as instructions on upgrading.

What's in a Version? 

The version number for Solr 3.1 was chosen to reflect the merge of
development with Lucene, which is currently also on 3.1.  Going
forward, we expect the Solr version to be the same as the Lucene
version.  Solr 3.1 contains Lucene 3.1 and is the release after Solr 1.4.1.

Solr 3.1 Release Highlights

* Numeric range facets (similar to date faceting).

* New spatial search, including spatial filtering, boosting and sorting 
capabilities.

* Example Velocity driven search UI at http://localhost:8983/solr/browse

* A new termvector-based highlighter

* Extend dismax (edismax) query parser which addresses some
 missing features in the dismax query parser along with some
 extensions.

* Several more components now support distributed mode:
 TermsComponent, SpellCheckComponent.

* A new Auto Suggest component.

* Ability to sort by functions.

* JSON document indexing

* CSV response format

* Apache UIMA integration for metadata extraction

* Leverages Lucene 3.1 and it's inherent optimizations and bug fixes
 as well as new analysis capabilities.

* Numerous improvements, bug fixes, and optimizations.

Note: The Apache Software Foundation uses an extensive mirroring network for 
distributing releases.  It is possible that the mirror you are using may not 
have replicated the release yet.  If that is the case, please try another 
mirror.  This also goes for Maven access.

Re: Exact keyword search and redirect term

[Jonathan Rochkind]

There is no configuration.

If:
1) you index your records as type String, with no analysis
2) You always do phrase searches in your query, surround it with double 
quotes. (Neccesary because otherwise queries with spaces in them won't 
be passed intact to the field for matching). (Alternately use the 
'field' or 'raw' query parsers, or that other new one that will be in 
solr 3.1 that i forget the name of).


Then I believe it will work how you say you want, only matching on 
_exact_ matches.   I think, try it out. But beware that 'exact' here 
will REALLY mean 'exact' -- same case, exact same punctuation and 
spacing, exact same bytes. (Same serialization for unicode that can be 
serialized to several different valid byte representations in UTF8, etc)


On 3/31/2011 2:17 PM, Tejinder Rawat wrote:

Hi All,



I have many documents indexed based on a field having value “anniversary”.



Also there is a redirect term which is having “anniversary” inside this.
E.g. below:



--

 termRedirect

/product/silver+25th+anniversary.do

 25th anniversary

--



Now for any search based on “anniversary”, I am getting the redirection to
above uri. I am expecting the redirection only for exact term “25th
anniversary”.



Is there any configuration to make sure that redirection should work on
exact match?





Thank You!

Apache Solr 3.1.0 available

[Grant Ingersoll]

March 2011, Apache Solr 3.1 available

The Lucene PMC is pleased to announce the release of Apache Solr 3.1.

This release contains numerous bug fixes, optimizations, and
improvements, some of which are highlighted below.  The release is
available for immediate download at 
http://www.apache.org/dyn/closer.cgi/lucene/solr (see note below).
See the CHANGES.txt file included with the release for a full list of
details as well as instructions on upgrading.

What's in a Version? 

The version number for Solr 3.1 was chosen to reflect the merge of
development with Lucene, which is currently also on 3.1.  Going
forward, we expect the Solr version to be the same as the Lucene
version.  Solr 3.1 contains Lucene 3.1 and is the release after Solr 1.4.1.

Solr 3.1 Release Highlights

* Numeric range facets (similar to date faceting).

* New spatial search, including spatial filtering, boosting and sorting 
capabilities.

* Example Velocity driven search UI at http://localhost:8983/solr/browse

* A new termvector-based highlighter

* Extend dismax (edismax) query parser which addresses some
  missing features in the dismax query parser along with some
  extensions.

* Several more components now support distributed mode:
  TermsComponent, SpellCheckComponent.

* A new Auto Suggest component.

* Ability to sort by functions.

* JSON document indexing

* CSV response format

* Apache UIMA integration for metadata extraction

* Leverages Lucene 3.1 and it's inherent optimizations and bug fixes
  as well as new analysis capabilities.

* Numerous improvements, bug fixes, and optimizations.

Note: The Apache Software Foundation uses an extensive mirroring network for 
distributing releases.  It is possible that the mirror you are using may not 
have replicated the release yet.  If that is the case, please try another 
mirror.  This also goes for Maven access.

HTTP Status 500 - Severe errors in solr configuration change: false in null ------------------------------------------------------------- org.xml

[jim]

hi all,
I used ubuntu 10.10 ,I'm trying to get solr 1.4up andrunning,with no
success. i have fllowed this
http://ubuntuforums.org/showthread.php?t=1532230 to run my solr,
but there has  error as:

HTTP Status 500 - Severe errors in solr configuration. Check your log files
for more detailed information on what may be wrong. If you want solr to
continue after configuration errors, change: false in null
-
org.xml.sax.SAXParseException; lineNumber: 1036; columnNumber: 2; The markup
in the document following the root element must be well-formed. at
com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:253)
at
com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:288)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121) at
org.apache.solr.core.Config.(Config.java:110) at
org.apache.solr.core.SolrConfig.(SolrConfig.java:130) at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:134)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:83)
at
org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:295)
at
org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:422)
at
org.apache.catalina.core.ApplicationFilterConfig.(ApplicationFilterConfig.java:115)
at
org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4001)
at org.apache.catalina.core.StandardContext.start(StandardContext.java:4651)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:546) at
org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:637)
at
org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:563)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:498) at
org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) at
org.apache.catalina.core.StandardHost.start(StandardHost.java:785) at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:445) at
org.apache.catalina.core.StandardService.start(StandardService.java:519) at
org.apache.catalina.core.StandardServer.start(StandardServer.java:710) at
org.apache.catalina.startup.Catalina.start(Catalina.java:581) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616) at
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) 


any body know how to do?thanks

--
View this message in context: 
http://lucene.472066.n3.nabble.com/HTTP-Status-500-Severe-errors-in-solr-configuration-change-abortOnConfigurationError-false-abortOnCo6-tp2757494p2757494.html
Sent from the Solr - User mailing list archive at Nabble.com.

HTTP Status 500 - Severe errors in solr configuration change: false in null ------------------------------------------------------------- org.xml

[jim]

hi all,
I used ubuntu 10.10 ,I'm trying to get solr 1.4up andrunning,with no
success. i have fllowed this
http://ubuntuforums.org/showthread.php?t=1532230 to run my solr,
but there has  error as:

HTTP Status 500 - Severe errors in solr configuration. Check your log files
for more detailed information on what may be wrong. If you want solr to
continue after configuration errors, change: false in null
-
org.xml.sax.SAXParseException; lineNumber: 1036; columnNumber: 2; The markup
in the document following the root element must be well-formed. at
com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:253)
at
com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:288)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121) at
org.apache.solr.core.Config.(Config.java:110) at
org.apache.solr.core.SolrConfig.(SolrConfig.java:130) at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:134)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:83)
at
org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:295)
at
org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:422)
at
org.apache.catalina.core.ApplicationFilterConfig.(ApplicationFilterConfig.java:115)
at
org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4001)
at org.apache.catalina.core.StandardContext.start(StandardContext.java:4651)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:546) at
org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:637)
at
org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:563)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:498) at
org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) at
org.apache.catalina.core.StandardHost.start(StandardHost.java:785) at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:445) at
org.apache.catalina.core.StandardService.start(StandardService.java:519) at
org.apache.catalina.core.StandardServer.start(StandardServer.java:710) at
org.apache.catalina.startup.Catalina.start(Catalina.java:581) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616) at
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) 


any body know how to do?thanks

--
View this message in context: 
http://lucene.472066.n3.nabble.com/HTTP-Status-500-Severe-errors-in-solr-configuration-change-abortOnConfigurationError-false-abortOnCo6-tp2757493p2757493.html
Sent from the Solr - User mailing list archive at Nabble.com.

Exact keyword search and redirect term

[Tejinder Rawat]

Hi All,



I have many documents indexed based on a field having value “anniversary”.



Also there is a redirect term which is having “anniversary” inside this.
E.g. below:



--

termRedirect

   /product/silver+25th+anniversary.do

25th anniversary

--



Now for any search based on “anniversary”, I am getting the redirection to
above uri. I am expecting the redirection only for exact term “25th
anniversary”.



Is there any configuration to make sure that redirection should work on
exact match?





Thank You!

Re: 2 index within the same Solr server ?

[Amel Fraisse]

Hi every body,

This is my implementation SolrJ to instanciate 2 SolrCore.

File f = new File ("./solr/solr.xml");

System.setProperty("solr.solr.home", "solr");
CoreContainer.Initializer initializer = new
CoreContainer.Initializer();
CoreContainer coreContainer = initializer.initialize();

coreContainer.load(f.getParent(), f);

SolrCore mycore0 = coreContainer.getCore("core0");
SolrCore mycore1 = coreContainer.getCore("core1");

servercore0 = new EmbeddedSolrServer(coreContainer, "core0");
servercore1 = new EmbeddedSolrServer(coreContainer, "core1");


But I have the follow bug:  org.apache.solr.common.SolrException: No such
core: core1
at
org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:104)


The solr.xml file :


 
 
  

  
  
  
 



Amel.

2011/3/31 Amel Fraisse 

> Hello Deepack,
>
>
> Thank you for your response.
>
> Yes I would doing the same thing with SolrJ.
>
> Amel.
>
>
> 2011/3/31 Deepak Singh 
>
>>
>> i have implemented this works
>>
>> indexing document at first index (core0)
>>
>> http://localhost:8983/solr/core0/update/extract/?stream.file=path_of_filename&commit=true
>>
>> indexing document at first index (core)
>>
>> http://localhost:8983/solr/core1/update/extract/?stream.file=path_of_filename&commit=true
>>
>>
>>
>> On Thu, Mar 31, 2011 at 4:28 PM, Amel Fraisse  wrote:
>>
>>>
>>>
>>> 2011/3/31 Deepak Singh 
>>>

 I want 2 index in same solr server.
 How to create 2 index and its schema  for two different search result

 Hi,

>>>
>>> You have to use SolrCore to create a solr.xml file in wich you specify 2
>>> cores ( refer to the link :  http://wiki.apache.org/solr/CoreAdmin )
>>>
>>> But for indexing and searching I've the same question: I don't know how I
>>> could specify that document would be indexed a twice (in the first index and
>>> in the second index).
>>>
>>> Amel.
>>>

 On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse 
 wrote:

> Hello every body,
>
> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
>
> I've created a solr.xml file as follows:
>
> 
>  
>   adminHandler="fr.splayce.solr.handler.MyAdminHandler">
>  
>
>  
>  
>  
>  
> 
>
> So before using SolrCore I instanciated a SolrServer to index and
> search
> documents as follows:
>
>System.setProperty("solr.solr.home", "solr");
>CoreContainer.Initializer initializer = new
> CoreContainer.Initializer();
>CoreContainer coreContainer = initializer.initialize();
>server = new EmbeddedSolrServer(coreContainer, "");
>
> And then to  index a document  : server.add(doc) and to search :
> server.query(...).
>
> So with SolrCore I've create MyAdminHandler by overrinding
> handleCistomAction method like this (as mentionned in the link):
>
> protected boolean handleCustomAction(SolrQueryRequest req,
> SolrQueryResponse
> rsp) {
>CoreContainer container = super.getCoreContainer();
> SolrCore mycore1 = container.getCore("core1");
> SolrCore mycore2 = container.getCore("core2");
>
> So how I could index and search document within the 2 indexes?
>
> Thank you for your help.
>
>
> 2011/3/29 Rahul Warawdekar 
>
> > Please refer
> > http://wiki.apache.org/solr/MultipleIndexes
> >
> > On 3/29/11, Amel Fraisse  wrote:
> > > Hello every body,
> > >
> > > Is it possible to create 2 index within the same Solr server ?
> > >
> > > Thank you.
> > >
> > > Amel.
> > >
> >
> >
> > --
> > Thanks and Regards
> > Rahul A. Warawdekar
> >
>


>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>
>
>

Highlight snippets for a set of known documents

[Jay Luker]

Hi all,

I'm trying to get highlight snippets for a set of known documents and
I must being doing something wrong because it's only sort of working.

Say my query is "foobar" and I already know that docs 1, 5 and 11 are
matches. Now I want to retrieve the highlight snippets for the term
"foobar" for docs 1, 5 and 11. What I assumed would work was something
like: "...&q=foobar&fq={!q.op=OR}id:1 id:5 id:11...". This returns
numfound=3 in the response, but I only get the highlight snippets for
document id:1. What am I doing wrong?

Thanks,
--jay

Re: Best practice for rotating solr logs

[Bill Bell]

I would no recommend a restart. You can use log4j to do this without a restart.

Bill Bell
Sent from mobile


On Mar 31, 2011, at 11:54 AM, Paul  wrote:

> I'm about to set up log rotation using logrotate, but I have a
> question about how to do it.
> 
> The general examples imply that one should include the following in the 
> script:
> 
> postrotate
> /sbin/service solr restart
> endscript
> 
> but it seems to me that any requests that come in during that restart
> process are going to return errors. The other way to do it is to use
> 
> copytruncate
> 
> but that will cause any requests that come in during the time that the
> file is being truncated to not appear in the log.
> 
> How do you set up your logrotate file?
> 
> Thanks,
> Paul

Best practice for rotating solr logs

[Paul]

I'm about to set up log rotation using logrotate, but I have a
question about how to do it.

The general examples imply that one should include the following in the script:

postrotate
/sbin/service solr restart
endscript

but it seems to me that any requests that come in during that restart
process are going to return errors. The other way to do it is to use

copytruncate

but that will cause any requests that come in during the time that the
file is being truncated to not appear in the log.

How do you set up your logrotate file?

Thanks,
Paul

Re: DIH OutOfMemoryError?

[Markus Jelsma]

Try splitting the files into smaller chunks. It'll help.

> Hi,
> 
> I'm trying to index a big XML file (800Mo) using DIH, but i'm getting an
> OutOfMemoryError!
> 
> I've got 2048mo of RAM on this server, obviously it's not enough... How
> much RAM is recomended for indexing big files?
> 
> Thanks for your help
> 
> 
> Here is the error from DIH mode verbose:
> 
> java.lang.ClassCastException:
> java.lang.OutOfMemoryError cannot be cast to java.lang.Exception
>  at
> org.apache.solr.handler.dataimport.DebugLogger.log(DebugLogger.java:139)
>  at
> org.apache.solr.handler.dataimport.SolrWriter.log(SolrWriter.java:237)
>  at
> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java
> :422) at
> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java
> :383) at
> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:24
> 2) at
> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:180)
>  at
> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.j
> ava:331) at
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:38
> 9) at
> org.apache.solr.handler.dataimport.DataImportHandler.handleRequestBody(Data
> ImportHandler.java:203) at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase
> .java:131) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316)
>  at
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:
> 338) at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java
> :241) at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicatio
> nFilterChain.java:235) at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterC
> hain.java:206) at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.j
> ava:233) at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.j
> ava:191) at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:12
> 7) at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:10
> 2) at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.jav
> a:109) at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
>  at
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
>  at
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Htt
> p11Protocol.java:588) at
> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>  at java.lang.Thread.run(Thread.java:636)
> 

Re: 2 index within the same Solr server ?

[Amel Fraisse]

Hello Deepack,

Thank you for your response.

Yes I would doing the same thing with SolrJ.

Amel.

2011/3/31 Deepak Singh 

>
> i have implemented this works
>
> indexing document at first index (core0)
>
> http://localhost:8983/solr/core0/update/extract/?stream.file=path_of_filename&commit=true
>
> indexing document at first index (core)
>
> http://localhost:8983/solr/core1/update/extract/?stream.file=path_of_filename&commit=true
>
>
>
> On Thu, Mar 31, 2011 at 4:28 PM, Amel Fraisse  wrote:
>
>>
>>
>> 2011/3/31 Deepak Singh 
>>
>>>
>>> I want 2 index in same solr server.
>>> How to create 2 index and its schema  for two different search result
>>>
>>> Hi,
>>>
>>
>> You have to use SolrCore to create a solr.xml file in wich you specify 2
>> cores ( refer to the link :  http://wiki.apache.org/solr/CoreAdmin )
>>
>> But for indexing and searching I've the same question: I don't know how I
>> could specify that document would be indexed a twice (in the first index and
>> in the second index).
>>
>> Amel.
>>
>>>
>>> On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse wrote:
>>>
 Hello every body,

 referring to the link : http://wiki.apache.org/solr/CoreAdmin.

 I've created a solr.xml file as follows:

 
  
  >>> adminHandler="fr.splayce.solr.handler.MyAdminHandler">
  

  
  
  
  
 

 So before using SolrCore I instanciated a SolrServer to index and search
 documents as follows:

System.setProperty("solr.solr.home", "solr");
CoreContainer.Initializer initializer = new
 CoreContainer.Initializer();
CoreContainer coreContainer = initializer.initialize();
server = new EmbeddedSolrServer(coreContainer, "");

 And then to  index a document  : server.add(doc) and to search :
 server.query(...).

 So with SolrCore I've create MyAdminHandler by overrinding
 handleCistomAction method like this (as mentionned in the link):

 protected boolean handleCustomAction(SolrQueryRequest req,
 SolrQueryResponse
 rsp) {
CoreContainer container = super.getCoreContainer();
 SolrCore mycore1 = container.getCore("core1");
 SolrCore mycore2 = container.getCore("core2");

 So how I could index and search document within the 2 indexes?

 Thank you for your help.


 2011/3/29 Rahul Warawdekar 

 > Please refer
 > http://wiki.apache.org/solr/MultipleIndexes
 >
 > On 3/29/11, Amel Fraisse  wrote:
 > > Hello every body,
 > >
 > > Is it possible to create 2 index within the same Solr server ?
 > >
 > > Thank you.
 > >
 > > Amel.
 > >
 >
 >
 > --
 > Thanks and Regards
 > Rahul A. Warawdekar
 >

>>>
>>>
>>
>>
>>
>>
>>
>>
>>
>

Re: ComplexPhraseQueryParser and wildcards

[jmr]

Erick Erickson wrote:
> 
> No, WDF only works on tokens from the tokenizer. It would
> not concatenate two separate tokens together, just tokens generated
> because of, say, case changes, punctuation, etc in the single token
> that made it through, say, WhitespaceTokenizerFactory.
> 
> The analysis page should make that clear, have you looked at it?
> 

Thanks Erik,

So, I've changed the query analyser and set catenateWords to 1.
Unfortunately, the query "crosslin* compiler"~50" returns nothing.
I have looked at the Analysis page and it does not show something different
excepting than catenateWords is 1.
Furthermore, the query ("cross-linker compiler"~50) is now crashing
ComplexPhraseQueryParser.

If there is nothing out of the box, maybe we'll need to modify the
ComplexPhraseQuery Parser.
I think that it should accept phrases as token for the proximity search. we
could enter escaped quotes to specify phrases like: "(\"cross link*\")
(\"compiler\")"~10

I just wanted to be sure I did not miss something obvious before investing
time in developing/changing solr parser.

Regards,
Jean-Michel





--
View this message in context: 
http://lucene.472066.n3.nabble.com/ComplexPhraseQueryParser-and-wildcards-tp2742244p2759078.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: assit with the Clustering component in Solr/Lucene

[Stanislaw Osinski]

Thanks for the confirmation, I'll take a look at the issue.

S.

On Thu, Mar 31, 2011 at 17:24,  wrote:

> That did make a difference, I now see the exact number of cluster i see
> from the workbench.
> I am of course interested in why the config changes did not have much
> effect. However, I am happy that by adding the threshold to my request URL
> produces the desired results
>
> let me know if I can do any more tests and I will do so. Thanks much
>
> Ramdev
>
>
>
> On Mar 31, 2011, at 10:18 AM, Stanislaw Osinski wrote:
>
>
>  I added the parameter as you suggested.
>> (LingoClusteringAlgorithm.clusterMergingThreshold) into the searchComponent
>> section that describes the Clustering module
>> Changing the value of the parameter  did not have any effect on my search
>> results.
>>
>> However, when I used the Carrot2 workbench, I could see the effect of
>> changing the value. (from 6 clusters it went down to 2 clusters)
>>
>
> Interesting... Can you, for the sake of debugging, append
> &LingoClusteringAlgorithm.clusterMergingThreshold=0.0 to your request URL?
>
> S.
>
>
>

Re: assit with the Clustering component in Solr/Lucene

[ramdev.wudali]

That did make a difference, I now see the exact number of cluster i see from 
the workbench.
I am of course interested in why the config changes did not have much effect. 
However, I am happy that by adding the threshold to my request URL produces the 
desired results

let me know if I can do any more tests and I will do so. Thanks much

Ramdev



On Mar 31, 2011, at 10:18 AM, Stanislaw Osinski wrote:



 I added the parameter as you suggested. 
(LingoClusteringAlgorithm.clusterMergingThreshold) into the searchComponent 
section that describes the Clustering module
Changing the value of the parameter  did not have any effect on 
my search results.

However, when I used the Carrot2 workbench, I could see the 
effect of changing the value. (from 6 clusters it went down to 2 clusters)


Interesting... Can you, for the sake of debugging, append 
&LingoClusteringAlgorithm.clusterMergingThreshold=0.0 to your request URL?

S.

Re: assit with the Clustering component in Solr/Lucene

[Stanislaw Osinski]

>  I added the parameter as you suggested.
> (LingoClusteringAlgorithm.clusterMergingThreshold) into the searchComponent
> section that describes the Clustering module
> Changing the value of the parameter  did not have any effect on my search
> results.
>
> However, when I used the Carrot2 workbench, I could see the effect of
> changing the value. (from 6 clusters it went down to 2 clusters)
>

Interesting... Can you, for the sake of debugging, append
&LingoClusteringAlgorithm.clusterMergingThreshold=0.0 to your request URL?

S.

DIH OutOfMemoryError?

[Rosa (Anuncios)]

Hi,

I'm trying to index a big XML file (800Mo) using DIH, but i'm getting an 
OutOfMemoryError!


I've got 2048mo of RAM on this server, obviously it's not enough... How 
much RAM is recomended for indexing big files?


Thanks for your help


Here is the error from DIH mode verbose:

java.lang.ClassCastException: 
java.lang.OutOfMemoryError cannot be cast to java.lang.Exception
at 
org.apache.solr.handler.dataimport.DebugLogger.log(DebugLogger.java:139)
at 
org.apache.solr.handler.dataimport.SolrWriter.log(SolrWriter.java:237)
at 
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:422)
at 
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:383)
at 
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:242)
at 
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:180)
at 
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:331)
at 
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:389)
at 
org.apache.solr.handler.dataimport.DataImportHandler.handleRequestBody(DataImportHandler.java:203)
at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)

at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316)
at 
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
at 
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at 
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)

at java.lang.Thread.run(Thread.java:636)

Re: assit with the Clustering component in Solr/Lucene

[ramdev.wudali]

Hi Staszek:
 I added the parameter as you suggested. 
(LingoClusteringAlgorithm.clusterMergingThreshold) into the searchComponent 
section that describes the Clustering module
Changing the value of the parameter  did not have any effect on my search 
results.

However, when I used the Carrot2 workbench, I could see the effect of changing 
the value. (from 6 clusters it went down to 2 clusters)

here is the XML snippet for the searchComponent:

  


  
  default
  
  org.carrot2.clustering.lingo.LingoClusteringAlgorithm
  
  20
  0.0

  


I would appreciate any insights into this behavior. 

Thanks

Ramdev


On Mar 30, 2011, at 11:51 AM, Stanislaw Osinski wrote:


Hi Ramdev,

Both of the clustering algorithms that ship with Solr (Lingo and STC) 
are designed to allow one document to appear in more than one cluster, which 
actually does make sense in many scenarios. There's no easy way to force them 
to produce hard clusterings because this would require a complete change in the 
way the algorithms work. If you need each document to belong to exactly one 
cluster, you'd have to post-process the clusters to remove the redundant 
document assignments. Alternatively, in case of the Lingo algorithm, you can 
try lowering the "LingoClusteringAlgorithm.clusterMergingThreshold" to some 
value in the range of 0.2--0.5. If you do that, clusters containing overlapping 
documents will get merged. For more information about this attribute, see here: 
http://download.carrot2.org/stable/manual/#section.attribute.LingoClusteringAlgorithm.clusterMergingThreshold.

Cheers,

Staszek


On Wed, Mar 30, 2011 at 18:21, Markus Jelsma 
 wrote:


Yes, you can set engine specific parameters. Check the comments 
in your
snippety.


> Hi:
>   I recently included the CLustering component into Solr and 
updated the
> requestHandler accordingly (in solrconfig.xml). Snippet of 
the Config for
> the CLuserting:
>
>name="clusteringComponent"
> enable="${solr.clustering.enabled:false}"
> 
class="org.apache.solr.handler.clustering.ClusteringComponent" >
> 
> 
>   
>   default
>   
>
name="carrot.algorithm">org.carrot2.clustering.lingo.LingoClusteringAlgori
> thm 
>   20
> 
> 
>   stc
>
name="carrot.algorithm">org.carrot2.clustering.stc.STCClusteringAlgorithm<
> /str> 
>   
>
> snippet of the Config for requestHandler
>default="true"> 
>  
>explicit
>
>true
>default
>true
>
>headline
>pi
>
>headline
>
>true
>
>
>
>false
>  
> 
>   clusteringComponent
> 
>   
>
>
> When I perform a search, I see that the Cluster section 
within the Solr
> results shows me results that are not quite consistent. There 
are two
> documents that are reported in two different documents
>
> Are there parameters that can be set that will prevent this 
from happening
> ?
>
>
> Thanks much
>
> Ramdev

Re: 2 index within the same Solr server ?

[Deepak Singh]

i have implemented this works

indexing document at first index (core0)
http://localhost:8983/solr/core0/update/extract/?stream.file=path_of_filename&commit=true

indexing document at first index (core)
http://localhost:8983/solr/core1/update/extract/?stream.file=path_of_filename&commit=true


On Thu, Mar 31, 2011 at 4:28 PM, Amel Fraisse  wrote:

>
>
> 2011/3/31 Deepak Singh 
>
>>
>> I want 2 index in same solr server.
>> How to create 2 index and its schema  for two different search result
>>
>> Hi,
>>
>
> You have to use SolrCore to create a solr.xml file in wich you specify 2
> cores ( refer to the link :  http://wiki.apache.org/solr/CoreAdmin )
>
> But for indexing and searching I've the same question: I don't know how I
> could specify that document would be indexed a twice (in the first index and
> in the second index).
>
> Amel.
>
>>
>> On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse wrote:
>>
>>> Hello every body,
>>>
>>> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
>>>
>>> I've created a solr.xml file as follows:
>>>
>>> 
>>>  
>>>  >> adminHandler="fr.splayce.solr.handler.MyAdminHandler">
>>>  
>>>
>>>  
>>>  
>>>  
>>>  
>>> 
>>>
>>> So before using SolrCore I instanciated a SolrServer to index and search
>>> documents as follows:
>>>
>>>System.setProperty("solr.solr.home", "solr");
>>>CoreContainer.Initializer initializer = new
>>> CoreContainer.Initializer();
>>>CoreContainer coreContainer = initializer.initialize();
>>>server = new EmbeddedSolrServer(coreContainer, "");
>>>
>>> And then to  index a document  : server.add(doc) and to search :
>>> server.query(...).
>>>
>>> So with SolrCore I've create MyAdminHandler by overrinding
>>> handleCistomAction method like this (as mentionned in the link):
>>>
>>> protected boolean handleCustomAction(SolrQueryRequest req,
>>> SolrQueryResponse
>>> rsp) {
>>>CoreContainer container = super.getCoreContainer();
>>> SolrCore mycore1 = container.getCore("core1");
>>> SolrCore mycore2 = container.getCore("core2");
>>>
>>> So how I could index and search document within the 2 indexes?
>>>
>>> Thank you for your help.
>>>
>>>
>>> 2011/3/29 Rahul Warawdekar 
>>>
>>> > Please refer
>>> > http://wiki.apache.org/solr/MultipleIndexes
>>> >
>>> > On 3/29/11, Amel Fraisse  wrote:
>>> > > Hello every body,
>>> > >
>>> > > Is it possible to create 2 index within the same Solr server ?
>>> > >
>>> > > Thank you.
>>> > >
>>> > > Amel.
>>> > >
>>> >
>>> >
>>> > --
>>> > Thanks and Regards
>>> > Rahul A. Warawdekar
>>> >
>>>
>>
>>
>
>
> --
> *Amel Fraisse*
>
> *Imaginatio SAS*
> *128 rue la Boétie
> 75008 PARIS
> Bureaux : 12 rue Martel - 75010 PARIS*
> http://compta.splayce.com
>
>
>

Re: Matching the beginning of a word within a term

[Brian Lamb]

No, I don't really want to break down the words into subwords. In the
example I provided, I would not want "kind" to match either record because
it is not at the beginning of the word even though "kind" appears in both
records as part of a word.

On Wed, Mar 30, 2011 at 4:42 PM, lboutros  wrote:

> Do you want to tokenize subwords based on dictionaries ? A bit like
> disagglutination of german words ?
>
> If so, something like this could help : DictionaryCompoundWordTokenFilter
>
> http://search.lucidimagination.com/search/document/CDRG_ch05_5.8.8
>
> Ludovic
>
>
> http://lucene.apache.org/java/2_4_0/api/org/apache/lucene/analysis/compound/DictionaryCompoundWordTokenFilter.html
>
> 2011/3/30 Brian Lamb [via Lucene] <
> ml-node+2754668-300063934-383...@n3.nabble.com>
>
> > Hi all,
> >
> > I have a field set up like this:
> >
> >  > stored="true" required="false" />
> >
> > And I have some records:
> >
> > RECORD1
> > 
> > companion to mankind
> > pooch
> > 
> >
> > RECORD2
> > 
> > companion to womankind
> > man's worst enemy
> > 
> >
> > I would like to write a query that will match the beginning of a word
> > within
> > the term. Here is the query I would use as it exists now:
> >
> >
> http://localhost:8983/solr/search/?q=*:*&fq={!q.op=AND%20df=common_names}
> "companion
> >
> > man"~10
> >
> > In the above example. I would want to return only RECORD1.
> >
> > The query as it exists right now is designed to only match records where
> > both words are present in the same term. So if I changed man to mankind
> in
> > the query, RECORD1 will be returned.
> >
> > Even though the phrases companion and man exist in the same term in
> > RECORD2,
> > I do not want RECORD2 to be returned because 'man' is not at the
> beginning
> > of the word.
> >
> > How can I achieve this?
> >
> > Thanks,
> >
> > Brian Lamb
> >
> >
> > --
> >  If you reply to this email, your message will be added to the discussion
> > below:
> >
> >
> http://lucene.472066.n3.nabble.com/Matching-the-beginning-of-a-word-within-a-term-tp2754668p2754668.html
> >  To start a new topic under Solr - User, email
> > ml-node+472068-1765922688-383...@n3.nabble.com
> > To unsubscribe from Solr - User, click here<
> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=472068&code=Ym91dHJvc2xAZ21haWwuY29tfDQ3MjA2OHw0Mzk2MDUxNjE=
> >.
> >
> >
>
>
> -
> Jouve
> France.
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Matching-the-beginning-of-a-word-within-a-term-tp2754668p2755561.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Re: ComplexPhraseQueryParser and wildcards

[Erick Erickson]

> I'm afraid this could have some side effects.
> I suppose that thematic* would then return:
> thematically
> but also "the matico"

No, WDF only works on tokens from the tokenizer. It would
not concatenate two separate tokens together, just tokens generated
because of, say, case changes, punctuation, etc in the single token
that made it through, say, WhitespaceTokenizerFactory.

The analysis page should make that clear, have you looked at it?

But if WDF doesn't do what you want then I don't know what in Solr
will do it OOTB.

Best
Erick

On Thu, Mar 31, 2011 at 8:45 AM, jmr  wrote:
>
> Erick Erickson wrote:
>>
>> If you change your WordDelimiterFilterFactory (WDF) setting
>> in the  section of your field definition and set
>> catenatewords="1", do you get the specific behavior you're
>> asking for when you search for "crosslin* compiler"~50? And
>> is this acceptable?
>>
>
> I'm afraid this could have some side effects.
> I suppose that thematic* would then return:
> thematically
> but also "the matico"
>
> So, you confirm that there is nothing right now to do such kind of search in
> solr ?
>
> Regards,
> Jean-Michel
>
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/ComplexPhraseQueryParser-and-wildcards-tp2742244p2758422.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: 2 index within the same Solr server ?

[Shawn Heisey]

On 3/31/2011 5:09 AM, Amel Fraisse wrote:

Hi Markus,

Thank you for your response.
In fact, I never used SolrCore before that.
So could you give me an example to ilustrate how I could send a document to
be indexed by both cores?


There is no magic within Solr that would let you issue a single command 
and import/post documents to more than one core.  The cores are not 
linked in any way, even if you have them share config files.  You could 
have one core replicate to the other, but I don't see much point to 
doing that, unless you're testing what will eventually become a 
multi-server setup.


Logically speaking, cores are as separate as running Solr on two 
different machines, they just happen to live in the same servlet 
container on one machine.  You must already have some kind of 
infrastructure in place to do your indexing, you have to either adjust 
that process to do the indexing twice or run two copies of it.


Without cores, the base URL is http://HOST:PORT/solr/ ... with cores, it 
becomes http://HOST:PORT/solr/corename/ with corename being the variable 
part.


Shawn

Re: DIH Issue(newbie to solr)

[neha]

Hello Gora,
I have a new Issue:

http://lucene.472066.n3.nabble.com/Concatenate-multivalued-DIH-fields-td2749988.html

I haven't got enough help on this issue, Please could you advice me on
solving this.

Thanks,
Neha

-
Thanks,
Neha
--
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2758500.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Concatenate multivalued DIH fields

[neha]

I would appreciate any help on this issue, I am unable to proceed without
getting  this solved.

Thanks,
Neha

-
Thanks,
Neha
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Concatenate-multivalued-DIH-fields-tp2749988p2758485.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: ComplexPhraseQueryParser and wildcards

[jmr]

Erick Erickson wrote:
> 
> If you change your WordDelimiterFilterFactory (WDF) setting
> in the  section of your field definition and set
> catenatewords="1", do you get the specific behavior you're
> asking for when you search for "crosslin* compiler"~50? And
> is this acceptable?
> 

I'm afraid this could have some side effects.
I suppose that thematic* would then return:
thematically
but also "the matico"

So, you confirm that there is nothing right now to do such kind of search in
solr ?

Regards,
Jean-Michel

--
View this message in context: 
http://lucene.472066.n3.nabble.com/ComplexPhraseQueryParser-and-wildcards-tp2742244p2758422.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: how to set cookie for url requesting in stream_url

[Markus Jelsma]

That depends on what you're using. So, what are you using?

On Thursday 31 March 2011 14:29:36 satya swaroop wrote:
> Hi All,
> for indexing the documents in the other server i need to include a
> cookie value in the url requesting through the stream_url.
> can anybody tell me how to include the cookie in the url???
> have anybody done this type??? or if there are any suggestions please tell
> me???
> 
> ex:
> http://localhost:8456/solr/update/extract?stream_url=remote_server_url&lite
> ral.id=13748 ;
> 
> here i need to include a cookie value while requesting for the
> remote_server_url.
> 
> 
> Regards,
> satya

-- 
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350

how to set cookie for url requesting in stream_url

[satya swaroop]

Hi All,
for indexing the documents in the other server i need to include a
cookie value in the url requesting through the stream_url.
can anybody tell me how to include the cookie in the url???
have anybody done this type??? or if there are any suggestions please tell
me???

ex:
http://localhost:8456/solr/update/extract?stream_url=remote_server_url&literal.id=13748
;

here i need to include a cookie value while requesting for the
remote_server_url.


Regards,
satya

Re: 2 index within the same Solr server ?

[Erick Erickson]

I would guess just the way you always use cores. You'd open
your connection in SolrJ with the core name tacked on, something
like:

CommonsHttpSolrServer server1 = new
CommonsHttpSolrServer(http://localhost:8983/solr/core1);
CommonsHttpSolrServer server2 = new
CommonsHttpSolrServer(http://localhost:8983/solr/core2);

then add the document to both servers.

But I confess I haven't tried it from SolrJ so it's a guess. There may be
more efficient ways to do this.

But I have to ask what the purpose of putting the *same* document in two cores
is. Seems like a waste. That said, I don't know your problem space.

Best
Erick

On Thu, Mar 31, 2011 at 7:09 AM, Amel Fraisse  wrote:
> Hi Markus,
>
> Thank you for your response.
> In fact, I never used SolrCore before that.
> So could you give me an example to ilustrate how I could send a document to
> be indexed by both cores?
>
> Thank you.
> Amel.
>
> 2011/3/31 Markus Jelsma 
>
>>
>>
>> On Thursday 31 March 2011 12:58:54 Amel Fraisse wrote:
>>
>> > But for indexing and searching I've the same question: I don't know how I
>> > could specify that document would be indexed a twice (in the first index
>> > and in the second index).
>> >
>>
>> Amel, if you use multi core and wish to have a document indexed in both
>> cores
>> then you must post the document to both cores.
>>
>> > Amel.
>> >
>> > > On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse
>> wrote:
>> > >> Hello every body,
>> > >>
>> > >> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
>> > >>
>> > >> I've created a solr.xml file as follows:
>> > >>
>> > >> 
>> > >>
>> > >>  
>> > >>
>> > >>  > > >>
>> > >> adminHandler="fr.splayce.solr.handler.MyAdminHandler">
>> > >>
>> > >>  
>> > >>
>> > >>    
>> > >>
>> > >>  
>> > >>  
>> > >>
>> > >>      
>> > >>
>> > >>  
>> > >>
>> > >> 
>> > >>
>> > >> So before using SolrCore I instanciated a SolrServer to index and
>> search
>> > >>
>> > >> documents as follows:
>> > >>            System.setProperty("solr.solr.home", "solr");
>> > >>            CoreContainer.Initializer initializer = new
>> > >>
>> > >> CoreContainer.Initializer();
>> > >>
>> > >>            CoreContainer coreContainer = initializer.initialize();
>> > >>            server = new EmbeddedSolrServer(coreContainer, "");
>> > >>
>> > >> And then to  index a document  : server.add(doc) and to search :
>> > >> server.query(...).
>> > >>
>> > >> So with SolrCore I've create MyAdminHandler by overrinding
>> > >> handleCistomAction method like this (as mentionned in the link):
>> > >>
>> > >> protected boolean handleCustomAction(SolrQueryRequest req,
>> > >> SolrQueryResponse
>> > >> rsp) {
>> > >>
>> > >>        CoreContainer container = super.getCoreContainer();
>> > >>
>> > >>         SolrCore mycore1 = container.getCore("core1");
>> > >>         SolrCore mycore2 = container.getCore("core2");
>> > >>
>> > >> So how I could index and search document within the 2 indexes?
>> > >>
>> > >> Thank you for your help.
>> > >>
>> > >>
>> > >> 2011/3/29 Rahul Warawdekar 
>> > >>
>> > >> > Please refer
>> > >> > http://wiki.apache.org/solr/MultipleIndexes
>> > >> >
>> > >> > On 3/29/11, Amel Fraisse  wrote:
>> > >> > > Hello every body,
>> > >> > >
>> > >> > > Is it possible to create 2 index within the same Solr server ?
>> > >> > >
>> > >> > > Thank you.
>> > >> > >
>> > >> > > Amel.
>> > >> >
>> > >> > --
>> > >> > Thanks and Regards
>> > >> > Rahul A. Warawdekar
>>
>> --
>> Markus Jelsma - CTO - Openindex
>> http://www.linkedin.com/in/markus17
>> 050-8536620 / 06-50258350
>>
>

Re: ComplexPhraseQueryParser and wildcards

[Erick Erickson]

If you change your WordDelimiterFilterFactory (WDF) setting
in the  section of your field definition and set
catenatewords="1", do you get the specific behavior you're
asking for when you search for "crosslin* compiler"~50? And
is this acceptable?

However, WDF settings take some time to really understand. I
strongly recommend you spend some time on the admin/analysis
page to get your mind around all the ramifications, or you'll
be surprised 

Also, the surround or span queries in lucene might give
you another avenue, but you'd have to do some custom work
to use them.

Best
Erick
On Thu, Mar 31, 2011 at 2:51 AM, jmr  wrote:
>
> iorixxx wrote:
>>
>> Hi Jean,
>> Since you use WDF, your best bet can be to modify your query :
>>
>> "cross link* compiler"~50
>>
>> "crosslink* compiler"~50
>>
>
> Thanks but
>
> "crosslink* compiler"~50 returns nothing (seems correct to me however)
>
> "cross link* compiler"~50 does not return exactly what I want e.g it
> returns:
>        A cross and a linker and a compiler
>
> I want the exact expression "cross link* e.g cross linkage, cross linking,
> cross linked ...
>
> Jean-Michel
>
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/ComplexPhraseQueryParser-and-wildcards-tp2742244p2757396.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

MorelikeThis search Component

[Isha Garg]

Hello!

   Can Morelikethis works for string type of field. like if I 
have field name person of string type and i use mlt.fl=person . Does it 
shows any result or not?



Thanks!
Isha

Re: 2 index within the same Solr server ?

[Markus Jelsma]

I don't use SolrJ. Try to find the documentation for that.

On Thursday 31 March 2011 13:09:49 Amel Fraisse wrote:
> Hi Markus,
> 
> Thank you for your response.
> In fact, I never used SolrCore before that.
> So could you give me an example to ilustrate how I could send a document to
> be indexed by both cores?
> 
> Thank you.
> Amel.
> 
> 2011/3/31 Markus Jelsma 
> 
> > On Thursday 31 March 2011 12:58:54 Amel Fraisse wrote:
> > > But for indexing and searching I've the same question: I don't know how
> > > I could specify that document would be indexed a twice (in the first
> > > index and in the second index).
> > 
> > Amel, if you use multi core and wish to have a document indexed in both
> > cores
> > then you must post the document to both cores.
> > 
> > > Amel.
> > > 
> > > > On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse
> > 
> > wrote:
> > > >> Hello every body,
> > > >> 
> > > >> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
> > > >> 
> > > >> I've created a solr.xml file as follows:
> > > >> 
> > > >> 
> > > >> 
> > > >>  
> > > >> 
> > > >>   > > >> 
> > > >> adminHandler="fr.splayce.solr.handler.MyAdminHandler">
> > > >> 
> > > >>  
> > > >>  
> > > >>
> > > >>  
> > > >>  
> > > >>  
> > > >>  
> > > >>  
> > > >>  
> > > >>  
> > > >> 
> > > >> 
> > > >> 
> > > >> So before using SolrCore I instanciated a SolrServer to index and
> > 
> > search
> > 
> > > >> documents as follows:
> > > >>System.setProperty("solr.solr.home", "solr");
> > > >>CoreContainer.Initializer initializer = new
> > > >> 
> > > >> CoreContainer.Initializer();
> > > >> 
> > > >>CoreContainer coreContainer = initializer.initialize();
> > > >>server = new EmbeddedSolrServer(coreContainer, "");
> > > >> 
> > > >> And then to  index a document  : server.add(doc) and to search :
> > > >> server.query(...).
> > > >> 
> > > >> So with SolrCore I've create MyAdminHandler by overrinding
> > > >> handleCistomAction method like this (as mentionned in the link):
> > > >> 
> > > >> protected boolean handleCustomAction(SolrQueryRequest req,
> > > >> SolrQueryResponse
> > > >> rsp) {
> > > >> 
> > > >>CoreContainer container = super.getCoreContainer();
> > > >>
> > > >> SolrCore mycore1 = container.getCore("core1");
> > > >> SolrCore mycore2 = container.getCore("core2");
> > > >> 
> > > >> So how I could index and search document within the 2 indexes?
> > > >> 
> > > >> Thank you for your help.
> > > >> 
> > > >> 
> > > >> 2011/3/29 Rahul Warawdekar 
> > > >> 
> > > >> > Please refer
> > > >> > http://wiki.apache.org/solr/MultipleIndexes
> > > >> > 
> > > >> > On 3/29/11, Amel Fraisse  wrote:
> > > >> > > Hello every body,
> > > >> > > 
> > > >> > > Is it possible to create 2 index within the same Solr server ?
> > > >> > > 
> > > >> > > Thank you.
> > > >> > > 
> > > >> > > Amel.
> > > >> > 
> > > >> > --
> > > >> > Thanks and Regards
> > > >> > Rahul A. Warawdekar
> > 
> > --
> > Markus Jelsma - CTO - Openindex
> > http://www.linkedin.com/in/markus17
> > 050-8536620 / 06-50258350

-- 
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350

Re: 2 index within the same Solr server ?

[Amel Fraisse]

Hi Markus,

Thank you for your response.
In fact, I never used SolrCore before that.
So could you give me an example to ilustrate how I could send a document to
be indexed by both cores?

Thank you.
Amel.

2011/3/31 Markus Jelsma 

>
>
> On Thursday 31 March 2011 12:58:54 Amel Fraisse wrote:
>
> > But for indexing and searching I've the same question: I don't know how I
> > could specify that document would be indexed a twice (in the first index
> > and in the second index).
> >
>
> Amel, if you use multi core and wish to have a document indexed in both
> cores
> then you must post the document to both cores.
>
> > Amel.
> >
> > > On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse
> wrote:
> > >> Hello every body,
> > >>
> > >> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
> > >>
> > >> I've created a solr.xml file as follows:
> > >>
> > >> 
> > >>
> > >>  
> > >>
> > >>   > >>
> > >> adminHandler="fr.splayce.solr.handler.MyAdminHandler">
> > >>
> > >>  
> > >>
> > >>
> > >>
> > >>  
> > >>  
> > >>
> > >>  
> > >>
> > >>  
> > >>
> > >> 
> > >>
> > >> So before using SolrCore I instanciated a SolrServer to index and
> search
> > >>
> > >> documents as follows:
> > >>System.setProperty("solr.solr.home", "solr");
> > >>CoreContainer.Initializer initializer = new
> > >>
> > >> CoreContainer.Initializer();
> > >>
> > >>CoreContainer coreContainer = initializer.initialize();
> > >>server = new EmbeddedSolrServer(coreContainer, "");
> > >>
> > >> And then to  index a document  : server.add(doc) and to search :
> > >> server.query(...).
> > >>
> > >> So with SolrCore I've create MyAdminHandler by overrinding
> > >> handleCistomAction method like this (as mentionned in the link):
> > >>
> > >> protected boolean handleCustomAction(SolrQueryRequest req,
> > >> SolrQueryResponse
> > >> rsp) {
> > >>
> > >>CoreContainer container = super.getCoreContainer();
> > >>
> > >> SolrCore mycore1 = container.getCore("core1");
> > >> SolrCore mycore2 = container.getCore("core2");
> > >>
> > >> So how I could index and search document within the 2 indexes?
> > >>
> > >> Thank you for your help.
> > >>
> > >>
> > >> 2011/3/29 Rahul Warawdekar 
> > >>
> > >> > Please refer
> > >> > http://wiki.apache.org/solr/MultipleIndexes
> > >> >
> > >> > On 3/29/11, Amel Fraisse  wrote:
> > >> > > Hello every body,
> > >> > >
> > >> > > Is it possible to create 2 index within the same Solr server ?
> > >> > >
> > >> > > Thank you.
> > >> > >
> > >> > > Amel.
> > >> >
> > >> > --
> > >> > Thanks and Regards
> > >> > Rahul A. Warawdekar
>
> --
> Markus Jelsma - CTO - Openindex
> http://www.linkedin.com/in/markus17
> 050-8536620 / 06-50258350
>

Re: 2 index within the same Solr server ?

[Markus Jelsma]

On Thursday 31 March 2011 12:58:54 Amel Fraisse wrote:

> But for indexing and searching I've the same question: I don't know how I
> could specify that document would be indexed a twice (in the first index
> and in the second index).
> 

Amel, if you use multi core and wish to have a document indexed in both cores 
then you must post the document to both cores.

> Amel.
> 
> > On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse 
wrote:
> >> Hello every body,
> >> 
> >> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
> >> 
> >> I've created a solr.xml file as follows:
> >> 
> >> 
> >> 
> >>  
> >> 
> >>   >> 
> >> adminHandler="fr.splayce.solr.handler.MyAdminHandler">
> >> 
> >>  
> >>  
> >>
> >>  
> >>  
> >>  
> >>  
> >>  
> >>  
> >>  
> >> 
> >> 
> >> 
> >> So before using SolrCore I instanciated a SolrServer to index and search
> >> 
> >> documents as follows:
> >>System.setProperty("solr.solr.home", "solr");
> >>CoreContainer.Initializer initializer = new
> >> 
> >> CoreContainer.Initializer();
> >> 
> >>CoreContainer coreContainer = initializer.initialize();
> >>server = new EmbeddedSolrServer(coreContainer, "");
> >> 
> >> And then to  index a document  : server.add(doc) and to search :
> >> server.query(...).
> >> 
> >> So with SolrCore I've create MyAdminHandler by overrinding
> >> handleCistomAction method like this (as mentionned in the link):
> >> 
> >> protected boolean handleCustomAction(SolrQueryRequest req,
> >> SolrQueryResponse
> >> rsp) {
> >> 
> >>CoreContainer container = super.getCoreContainer();
> >>
> >> SolrCore mycore1 = container.getCore("core1");
> >> SolrCore mycore2 = container.getCore("core2");
> >> 
> >> So how I could index and search document within the 2 indexes?
> >> 
> >> Thank you for your help.
> >> 
> >> 
> >> 2011/3/29 Rahul Warawdekar 
> >> 
> >> > Please refer
> >> > http://wiki.apache.org/solr/MultipleIndexes
> >> > 
> >> > On 3/29/11, Amel Fraisse  wrote:
> >> > > Hello every body,
> >> > > 
> >> > > Is it possible to create 2 index within the same Solr server ?
> >> > > 
> >> > > Thank you.
> >> > > 
> >> > > Amel.
> >> > 
> >> > --
> >> > Thanks and Regards
> >> > Rahul A. Warawdekar

-- 
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350

Re: 2 index within the same Solr server ?

[Amel Fraisse]

Hi,

You have to use SolrCore to create a solr.xml file in wich you specify 2
cores ( refer to the link :  http://wiki.apache.org/solr/CoreAdmin )

But for indexing and searching I've the same question: I don't know how I
could specify that document would be indexed a twice (in the first index and
in the second index).

Amel.

2011/3/31 Deepak Singh 

>
> I want 2 index in same solr server.
> How to create 2 index and its schema  for two different search result
>
>
>
> On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse wrote:
>
>> Hello every body,
>>
>> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
>>
>> I've created a solr.xml file as follows:
>>
>> 
>>  
>>  > adminHandler="fr.splayce.solr.handler.MyAdminHandler">
>>  
>>
>>  
>>  
>>  
>>  
>> 
>>
>> So before using SolrCore I instanciated a SolrServer to index and search
>> documents as follows:
>>
>>System.setProperty("solr.solr.home", "solr");
>>CoreContainer.Initializer initializer = new
>> CoreContainer.Initializer();
>>CoreContainer coreContainer = initializer.initialize();
>>server = new EmbeddedSolrServer(coreContainer, "");
>>
>> And then to  index a document  : server.add(doc) and to search :
>> server.query(...).
>>
>> So with SolrCore I've create MyAdminHandler by overrinding
>> handleCistomAction method like this (as mentionned in the link):
>>
>> protected boolean handleCustomAction(SolrQueryRequest req,
>> SolrQueryResponse
>> rsp) {
>>CoreContainer container = super.getCoreContainer();
>> SolrCore mycore1 = container.getCore("core1");
>> SolrCore mycore2 = container.getCore("core2");
>>
>> So how I could index and search document within the 2 indexes?
>>
>> Thank you for your help.
>>
>>
>> 2011/3/29 Rahul Warawdekar 
>>
>> > Please refer
>> > http://wiki.apache.org/solr/MultipleIndexes
>> >
>> > On 3/29/11, Amel Fraisse  wrote:
>> > > Hello every body,
>> > >
>> > > Is it possible to create 2 index within the same Solr server ?
>> > >
>> > > Thank you.
>> > >
>> > > Amel.
>> > >
>> >
>> >
>> > --
>> > Thanks and Regards
>> > Rahul A. Warawdekar
>> >
>>
>
>

Re: 2 index within the same Solr server ?

[Amel Fraisse]

2011/3/31 Deepak Singh 

>
> I want 2 index in same solr server.
> How to create 2 index and its schema  for two different search result
>
> Hi,
>

You have to use SolrCore to create a solr.xml file in wich you specify 2
cores ( refer to the link :  http://wiki.apache.org/solr/CoreAdmin )

But for indexing and searching I've the same question: I don't know how I
could specify that document would be indexed a twice (in the first index and
in the second index).

Amel.

>
> On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse wrote:
>
>> Hello every body,
>>
>> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
>>
>> I've created a solr.xml file as follows:
>>
>> 
>>  
>>  > adminHandler="fr.splayce.solr.handler.MyAdminHandler">
>>  
>>
>>  
>>  
>>  
>>  
>> 
>>
>> So before using SolrCore I instanciated a SolrServer to index and search
>> documents as follows:
>>
>>System.setProperty("solr.solr.home", "solr");
>>CoreContainer.Initializer initializer = new
>> CoreContainer.Initializer();
>>CoreContainer coreContainer = initializer.initialize();
>>server = new EmbeddedSolrServer(coreContainer, "");
>>
>> And then to  index a document  : server.add(doc) and to search :
>> server.query(...).
>>
>> So with SolrCore I've create MyAdminHandler by overrinding
>> handleCistomAction method like this (as mentionned in the link):
>>
>> protected boolean handleCustomAction(SolrQueryRequest req,
>> SolrQueryResponse
>> rsp) {
>>CoreContainer container = super.getCoreContainer();
>> SolrCore mycore1 = container.getCore("core1");
>> SolrCore mycore2 = container.getCore("core2");
>>
>> So how I could index and search document within the 2 indexes?
>>
>> Thank you for your help.
>>
>>
>> 2011/3/29 Rahul Warawdekar 
>>
>> > Please refer
>> > http://wiki.apache.org/solr/MultipleIndexes
>> >
>> > On 3/29/11, Amel Fraisse  wrote:
>> > > Hello every body,
>> > >
>> > > Is it possible to create 2 index within the same Solr server ?
>> > >
>> > > Thank you.
>> > >
>> > > Amel.
>> > >
>> >
>> >
>> > --
>> > Thanks and Regards
>> > Rahul A. Warawdekar
>> >
>>
>
>


-- 
*Amel Fraisse*

*Imaginatio SAS*
*128 rue la Boétie
75008 PARIS
Bureaux : 12 rue Martel - 75010 PARIS*
http://compta.splayce.com

Re: 2 index within the same Solr server ?

[Deepak Singh]

I want 2 index in same solr server.
How to create 2 index and its schema  for two different search result


On Wed, Mar 30, 2011 at 7:07 PM, Amel Fraisse wrote:

> Hello every body,
>
> referring to the link : http://wiki.apache.org/solr/CoreAdmin.
>
> I've created a solr.xml file as follows:
>
> 
>  
>   adminHandler="fr.splayce.solr.handler.MyAdminHandler">
>  
>
>  
>  
>  
>  
> 
>
> So before using SolrCore I instanciated a SolrServer to index and search
> documents as follows:
>
>System.setProperty("solr.solr.home", "solr");
>CoreContainer.Initializer initializer = new
> CoreContainer.Initializer();
>CoreContainer coreContainer = initializer.initialize();
>server = new EmbeddedSolrServer(coreContainer, "");
>
> And then to  index a document  : server.add(doc) and to search :
> server.query(...).
>
> So with SolrCore I've create MyAdminHandler by overrinding
> handleCistomAction method like this (as mentionned in the link):
>
> protected boolean handleCustomAction(SolrQueryRequest req,
> SolrQueryResponse
> rsp) {
>CoreContainer container = super.getCoreContainer();
> SolrCore mycore1 = container.getCore("core1");
> SolrCore mycore2 = container.getCore("core2");
>
> So how I could index and search document within the 2 indexes?
>
> Thank you for your help.
>
>
> 2011/3/29 Rahul Warawdekar 
>
> > Please refer
> > http://wiki.apache.org/solr/MultipleIndexes
> >
> > On 3/29/11, Amel Fraisse  wrote:
> > > Hello every body,
> > >
> > > Is it possible to create 2 index within the same Solr server ?
> > >
> > > Thank you.
> > >
> > > Amel.
> > >
> >
> >
> > --
> > Thanks and Regards
> > Rahul A. Warawdekar
> >
>

Re: How could I set multi-value for a field in DataImporter

[Stefan Matheis]

Kun,

it should be enough to use the same field second time, like this:

value2

Regards
Stefan

On Thu, Mar 31, 2011 at 11:39 AM, kun xiong  wrote:
> Since the interface of DataImporter return a Map, I can't put multi value
> for a same field, right?
>
> Example:
>
> I write a class extending DataImporter, and  want to index {"value1",
> "value2"} for field "name".
>
> How should I do?
>
> Many thanks.
>
> Kun
>

Re: Unexpected character '0' (code 48) in prolog;

[Markus Jelsma]

There is a spurious 0 at [1,1]. Check the XML you're posting.

On Thursday 31 March 2011 03:23:40 Charles Wardell wrote:
> Can someone translate this error for me. My data looks pretty clean, so I
> am not sure what is going on here.
> 
> Mar 30, 2011 5:21:52 AM org.apache.solr.common.SolrException log
> SEVERE: Error processing "legacy" update
> command:com.ctc.wstx.exc.WstxUnexpectedCharException: Unexpected character
> '0' (code 48) in prolog; expected '<' at [row,col {unknown-source}]: [1,1]

-- 
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350

How could I set multi-value for a field in DataImporter

[kun xiong]

Since the interface of DataImporter return a Map, I can't put multi value
for a same field, right?

Example:

I write a class extending DataImporter, and  want to index {"value1",
"value2"} for field "name".

How should I do?

Many thanks.

Kun

Re: How to use SolrSimilarity with Luke?

[Gabriele Kahlout]

http://localhost:8080/nutch/scoringtest1.html";>

2.188457 = (MATCH) fieldWeight(content:artifici in 58), product of:
  1.4142135 = tf(termFreq(content:artifici)=2)
  3.0949457 = idf(docFreq=7, maxDocs=65)
  0.5 = *fieldNorm*(field=content, doc=58)


So Solr interface provides with all I want. Luke is still prettier.

On Wed, Mar 30, 2011 at 11:05 PM, Gabriele Kahlout  wrote:

> Hello,
>
> I'm not sure what's the Default Similarity Luke uses but I doubt it's
> SolrSimilarity (which I modified).
> I see the field to change the similarity used but typing
> org.apache.solr.search.SolrSimilarity doesn't work (Default similarity
> remains selected).
>
> Adding &debugQuery=true to the query on Solr Web Interface gives most of
> what I want, except for the FieldNorm I see in Luke[1] . How can I see that
> with Solr too?
>
>
> $ cd $SOLR_HOME
> $ ant luke
>
> [1] http://screencast.com/t/I1YqGFZ2n
>
> --
> Regards,
> K. Gabriele
>
> --- unchanged since 20/9/10 ---
> P.S. If the subject contains "[LON]" or the addressee acknowledges the
> receipt within 48 hours then I don't resend the email.
> subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧
> time(x) < Now + 48h) ⇒ ¬resend(I, this).
>
> If an email is sent by a sender that is not a trusted contact or the email
> does not contain a valid code then the email is not received. A valid code
> starts with a hyphen and ends with "X".
> ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈
> L(-[a-z]+[0-9]X)).
>



-- 
Regards,
K. Gabriele

--- unchanged since 20/9/10 ---
P.S. If the subject contains "[LON]" or the addressee acknowledges the
receipt within 48 hours then I don't resend the email.
subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧ time(x)
< Now + 48h) ⇒ ¬resend(I, this).

If an email is sent by a sender that is not a trusted contact or the email
does not contain a valid code then the email is not received. A valid code
starts with a hyphen and ends with "X".
∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈
L(-[a-z]+[0-9]X)).

TermsComponent and Morelikethis

[Isha Garg]

Hi!
  plz tell me how  can we filter the termcomponent handler result  
on the basis of user query .Also explain me how interesting terms are 
shown in morelikethis for ml on the basis of user query.



Thanks!
Isha

Re: solr upgrade question

[Alexander Aristov]

Didn't get any responses.

But I tried luke 1.0.1 and it did the magic. I run optimization and after
that solr got up.

Best Regards
Alexander Aristov


On 30 March 2011 15:47, Alexander Aristov wrote:

> People
>
> Is were way to upgrade existsing index from solr 1.4 to solr 4(trunk). When
> I configured solr 4 and launched it complained about incorrect lucence file
> version (3 instead of old 2)
>
> Are there any procedures to convert index?
>
>
> Best Regards
> Alexander Aristov
>