Re: Solr regex documenation

[Anil]

HI ,

i am using [a-z]+works. i could not see networks in the solr results.

is it regex working properly in solr ? Please clarify.

Regards,
Anil



On 27 February 2016 at 20:52, Anil  wrote:

> Thanks Jack.
>
> On 27 February 2016 at 20:41, Jack Krupansky 
> wrote:
>
>> See:
>>
>> https://lucene.apache.org/core/5_5_0/core/org/apache/lucene/search/RegexpQuery.html
>>
>> https://lucene.apache.org/core/5_5_0/core/org/apache/lucene/util/automaton/RegExp.html
>>
>> I vaguely recall a Jira about regex not working at all in Solr. I don't
>> recall reading about a resolution.
>>
>>
>> -- Jack Krupansky
>>
>> On Sat, Feb 27, 2016 at 7:05 AM, Anil  wrote:
>>
>> > Hi,
>> >
>> > Can some one point me to the solr regex documentation ?
>> >
>> > i read it supports all java regex features.  i tried ^ and $ , seems it
>> is
>> > not working.
>> >
>> > Thanks,
>> > Anil
>> >
>>
>
>

Re: docValues error

[shamik]

David, this is tad weird. I've seen this error if you turn on docvalues for
an existing field. You can running an "optimize" on your index and see if it
helps.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/docValues-error-tp4260408p4260455.html
Sent from the Solr - User mailing list archive at Nabble.com.

Too many close [count:-1]

[Vipul G]

[08:04:49] ERROR 0-thread-7 o.a.s.c.SolrCore <> Too many close [count:-1]
on org.apache.solr.core.SolrCore@2720dd. Please report this exception to
solr-user@lucene.apache.org

Re: Query time de-boost

[shamik]

I tried the function query route, but getting a weird exception.

*bf=if(termfreq(ContentGroup,'Developer Doc'),-20,0)* throws an exception
*org.apache.solr.search.SyntaxError: Missing end quote for string at pos 29
str='if(termfreq(ContentGroup,'Developer'* . Does it only accept single word
or there's something wrong with the syntax? It seems to work if only use
'Developer' as a single term.

I was trying to explore the negative boost route. From the documentation, 

"Negative query boosts have been supported at the "Query" object level for a
long time (resulting in negative scores for matching documents). Now the
QueryParsers have been updated to handle this too." 

I'm struggling to figure the usage for this. To me, it seems like having the
same effect in boost query if I use either 

*(*:* -ContetGroup:"Developer")^99*  or *ContenGroup-local:Developer^-99*

But, both cannot be used in conjunction with other bq parameters. 

*bq=Source:simplecontent^10 Source:Help^20 ContenGroup-local:Developer^-99*
doesn't work, which I thought would be.





--
View this message in context: 
http://lucene.472066.n3.nabble.com/Query-time-de-boost-tp4259309p4260451.html
Sent from the Solr - User mailing list archive at Nabble.com.

Indicator of collapsed results in CollapsingQParserPlugin

[Wil -]

Hi,

One use case I have is to return a collapse results, but provide a link for 
users to get the non-collapsed results.  I don't want to display a link the 
result set returned has no collapsed result. Is there a way to tell whether the 
results returned are collapsed on a per-page basis and all-results basis with 
the CollapsingQParserPlugin?

On a per-page basis, I can figure out whether results are collapsed via the 
expand plugin. However that adds significant response time. Is there a way to 
improve the response time? All I need is the counts rather than the documents.

I'm not exactly sure how to get if the total result sets is collapsed.

Any pointers is greatly appreciated. Thanks.

--wil

Re: ExtendedDisMax configuration nowhere to be found

[Walter Underwood]

> On Feb 28, 2016, at 2:40 PM,  
>  wrote:
> 
> But Disney Land and Disney World are actually really good examples of places 
> where the magic stuff is suitable, ...


As a former Disney employee, those are properly “Disneyland” and “Walt Disney 
World”, which makes a good example of the need for shingle-type synonyms.

wunder
Walter Underwood
Former GO.com/Infoseek search engineer
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

Re: ExtendedDisMax configuration nowhere to be found

[Jack Krupansky]

So, all this hard work that people have put into Solr to make it more like
a Disney theme park is just... wasted... on you? Sigh. Okay, I guess we
can't please everyone.

-- Jack Krupansky

On Sun, Feb 28, 2016 at 5:40 PM, 
wrote:

> I have no problem with automatic. It is "automagicall" stuff that I find a
> bit hard to like. Ie things that are automatic, but doesn't explain how and
> why they are automatic. But Disney Land and Disney World are actually
> really good examples of places where the magic stuff is suitable, ie in
> themeparks, designed mostly for kids. In the grown up world of IT, most
> people prefer logical and documented stuff, not things that "just works"
> without explaining why. No offence :)
>
> /Jimi
>
> -Original Message-
> From: Jack Krupansky [mailto:jack.krupan...@gmail.com]
> Sent: Sunday, February 28, 2016 11:31 PM
> To: solr-user@lucene.apache.org
> Subject: Re: ExtendedDisMax configuration nowhere to be found
>
> Yes, it absolutely is automagic - just look at those examples in the
> Confluence ref guide. No special request handler is needed - just the
> normal default handler. Just the defType and qf parameters are needed - as
> shown in the wiki examples.
>
> It really is that simple! All you have to supply is the list of fields to
> query (qf) and your actual query text (q).
>
> I know, I know... some people just can't handle automatic. (Some people
> hate DisneyLand/World!)
>
> -- Jack Krupansky
>
> On Sun, Feb 28, 2016 at 5:16 PM, 
> wrote:
>
> > I'm sorry, but I am still confused. I'm expecting to see some
> >  tag somewhere. Why doesn't the documentation nor the
> > example solrconfig.xml contain such a tag?
> >
> > If the edismax requestHandler is defined automatically, the
> > documentation should explain that. Also, there should still exist some
> > xml code that corresponds exactly to that default setup, right? That
> > is what I'm looking for.
> >
> > For now, this edismax thing seems to work "automagically", and I
> > prefer to understand why and how something works.
> >
> > /Jimi
> >
> > -Original Message-
> > From: Jack Krupansky [mailto:jack.krupan...@gmail.com]
> > Sent: Sunday, February 28, 2016 10:58 PM
> > To: solr-user@lucene.apache.org
> > Subject: Re: ExtendedDisMax configuration nowhere to be found
> >
> > Consult the Confluence wiki for more recent doc:
> >
> > https://cwiki.apache.org/confluence/display/solr/The+Extended+DisMax+Q
> > uery+Parser
> >
> > You can specify all the parameters on your query request as in the
> > examples, or by placing the parameters in the "defaults" section for
> > your request handler in solrconfig.xml.
> >
> >
> > -- Jack Krupansky
> >
> > On Sun, Feb 28, 2016 at 2:42 PM, 
> > wrote:
> >
> > > Hi,
> > >
> > > I want to setup ExtendedDisMax in our solr 4.6 server, but I can't
> > > seem to find any example configuration for this. Ie the
> > > configuration needed in solrconfig.xml. In the wiki page
> > > http://wiki.apache.org/solr/ExtendedDisMax it simply says:
> > >
> > > "Extended DisMax is already configured in the example configuration,
> > > with the name edismax."
> > >
> > > But this is not true for the solrconfig.xml in our setup (it only
> > > contains an example for dismax, not edismax), and I downloaded the
> > > latest solr zip file (solr 5.5.0), and it didn't have either dismax
> > > or edismax in any of its solrconfig.xml files.
> > >
> > > Why is it so hard to find this configuration? Am I missing something
> > > obvious?
> > >
> > > Regards
> > > /Jimi
> > >
> >
>

RE: ExtendedDisMax configuration nowhere to be found

[jimi.hullegard]

I have no problem with automatic. It is "automagicall" stuff that I find a bit 
hard to like. Ie things that are automatic, but doesn't explain how and why 
they are automatic. But Disney Land and Disney World are actually really good 
examples of places where the magic stuff is suitable, ie in themeparks, 
designed mostly for kids. In the grown up world of IT, most people prefer 
logical and documented stuff, not things that "just works" without explaining 
why. No offence :)

/Jimi

-Original Message-
From: Jack Krupansky [mailto:jack.krupan...@gmail.com] 
Sent: Sunday, February 28, 2016 11:31 PM
To: solr-user@lucene.apache.org
Subject: Re: ExtendedDisMax configuration nowhere to be found

Yes, it absolutely is automagic - just look at those examples in the Confluence 
ref guide. No special request handler is needed - just the normal default 
handler. Just the defType and qf parameters are needed - as shown in the wiki 
examples.

It really is that simple! All you have to supply is the list of fields to query 
(qf) and your actual query text (q).

I know, I know... some people just can't handle automatic. (Some people hate 
DisneyLand/World!)

-- Jack Krupansky

On Sun, Feb 28, 2016 at 5:16 PM, 
wrote:

> I'm sorry, but I am still confused. I'm expecting to see some 
>  tag somewhere. Why doesn't the documentation nor the 
> example solrconfig.xml contain such a tag?
>
> If the edismax requestHandler is defined automatically, the 
> documentation should explain that. Also, there should still exist some 
> xml code that corresponds exactly to that default setup, right? That 
> is what I'm looking for.
>
> For now, this edismax thing seems to work "automagically", and I 
> prefer to understand why and how something works.
>
> /Jimi
>
> -Original Message-
> From: Jack Krupansky [mailto:jack.krupan...@gmail.com]
> Sent: Sunday, February 28, 2016 10:58 PM
> To: solr-user@lucene.apache.org
> Subject: Re: ExtendedDisMax configuration nowhere to be found
>
> Consult the Confluence wiki for more recent doc:
>
> https://cwiki.apache.org/confluence/display/solr/The+Extended+DisMax+Q
> uery+Parser
>
> You can specify all the parameters on your query request as in the 
> examples, or by placing the parameters in the "defaults" section for 
> your request handler in solrconfig.xml.
>
>
> -- Jack Krupansky
>
> On Sun, Feb 28, 2016 at 2:42 PM, 
> wrote:
>
> > Hi,
> >
> > I want to setup ExtendedDisMax in our solr 4.6 server, but I can't 
> > seem to find any example configuration for this. Ie the 
> > configuration needed in solrconfig.xml. In the wiki page 
> > http://wiki.apache.org/solr/ExtendedDisMax it simply says:
> >
> > "Extended DisMax is already configured in the example configuration, 
> > with the name edismax."
> >
> > But this is not true for the solrconfig.xml in our setup (it only 
> > contains an example for dismax, not edismax), and I downloaded the 
> > latest solr zip file (solr 5.5.0), and it didn't have either dismax 
> > or edismax in any of its solrconfig.xml files.
> >
> > Why is it so hard to find this configuration? Am I missing something 
> > obvious?
> >
> > Regards
> > /Jimi
> >
>

docValues error

[David Santamauro]

I'm porting a 4.8 schema to 5.3 and I came across this new error when I 
tried to group.field=f1:


unexpected docvalues type SORTED_SET for field 'f1' (expected=SORTED). 
Use UninvertingReader or index with docvalues.


f1 is defined as

positionIncrementGap="100">

  



  


  required="true" />


Notice that I don't have docValues defined. I realize the field type 
doesn't allow docValues so why does this group request fail with a 
docValues error? It did work with 4.8


Any clue would be appreciated, thanks

David

Re: ExtendedDisMax configuration nowhere to be found

[Jack Krupansky]

Yes, it absolutely is automagic - just look at those examples in the
Confluence ref guide. No special request handler is needed - just the
normal default handler. Just the defType and qf parameters are needed - as
shown in the wiki examples.

It really is that simple! All you have to supply is the list of fields to
query (qf) and your actual query text (q).

I know, I know... some people just can't handle automatic. (Some people
hate DisneyLand/World!)

-- Jack Krupansky

On Sun, Feb 28, 2016 at 5:16 PM, 
wrote:

> I'm sorry, but I am still confused. I'm expecting to see some
>  tag somewhere. Why doesn't the documentation nor the
> example solrconfig.xml contain such a tag?
>
> If the edismax requestHandler is defined automatically, the documentation
> should explain that. Also, there should still exist some xml code that
> corresponds exactly to that default setup, right? That is what I'm looking
> for.
>
> For now, this edismax thing seems to work "automagically", and I prefer to
> understand why and how something works.
>
> /Jimi
>
> -Original Message-
> From: Jack Krupansky [mailto:jack.krupan...@gmail.com]
> Sent: Sunday, February 28, 2016 10:58 PM
> To: solr-user@lucene.apache.org
> Subject: Re: ExtendedDisMax configuration nowhere to be found
>
> Consult the Confluence wiki for more recent doc:
>
> https://cwiki.apache.org/confluence/display/solr/The+Extended+DisMax+Query+Parser
>
> You can specify all the parameters on your query request as in the
> examples, or by placing the parameters in the "defaults" section for your
> request handler in solrconfig.xml.
>
>
> -- Jack Krupansky
>
> On Sun, Feb 28, 2016 at 2:42 PM, 
> wrote:
>
> > Hi,
> >
> > I want to setup ExtendedDisMax in our solr 4.6 server, but I can't
> > seem to find any example configuration for this. Ie the configuration
> > needed in solrconfig.xml. In the wiki page
> > http://wiki.apache.org/solr/ExtendedDisMax it simply says:
> >
> > "Extended DisMax is already configured in the example configuration,
> > with the name edismax."
> >
> > But this is not true for the solrconfig.xml in our setup (it only
> > contains an example for dismax, not edismax), and I downloaded the
> > latest solr zip file (solr 5.5.0), and it didn't have either dismax or
> > edismax in any of its solrconfig.xml files.
> >
> > Why is it so hard to find this configuration? Am I missing something
> > obvious?
> >
> > Regards
> > /Jimi
> >
>

RE: ExtendedDisMax configuration nowhere to be found

[jimi.hullegard]

I'm sorry, but I am still confused. I'm expecting to see some  
tag somewhere. Why doesn't the documentation nor the example solrconfig.xml 
contain such a tag?

If the edismax requestHandler is defined automatically, the documentation 
should explain that. Also, there should still exist some xml code that 
corresponds exactly to that default setup, right? That is what I'm looking for.

For now, this edismax thing seems to work "automagically", and I prefer to 
understand why and how something works.

/Jimi

-Original Message-
From: Jack Krupansky [mailto:jack.krupan...@gmail.com] 
Sent: Sunday, February 28, 2016 10:58 PM
To: solr-user@lucene.apache.org
Subject: Re: ExtendedDisMax configuration nowhere to be found

Consult the Confluence wiki for more recent doc:
https://cwiki.apache.org/confluence/display/solr/The+Extended+DisMax+Query+Parser

You can specify all the parameters on your query request as in the examples, or 
by placing the parameters in the "defaults" section for your request handler in 
solrconfig.xml.


-- Jack Krupansky

On Sun, Feb 28, 2016 at 2:42 PM, 
wrote:

> Hi,
>
> I want to setup ExtendedDisMax in our solr 4.6 server, but I can't 
> seem to find any example configuration for this. Ie the configuration 
> needed in solrconfig.xml. In the wiki page 
> http://wiki.apache.org/solr/ExtendedDisMax it simply says:
>
> "Extended DisMax is already configured in the example configuration, 
> with the name edismax."
>
> But this is not true for the solrconfig.xml in our setup (it only 
> contains an example for dismax, not edismax), and I downloaded the 
> latest solr zip file (solr 5.5.0), and it didn't have either dismax or 
> edismax in any of its solrconfig.xml files.
>
> Why is it so hard to find this configuration? Am I missing something 
> obvious?
>
> Regards
> /Jimi
>

Re: ExtendedDisMax configuration nowhere to be found

[Jack Krupansky]

Consult the Confluence wiki for more recent doc:
https://cwiki.apache.org/confluence/display/solr/The+Extended+DisMax+Query+Parser

You can specify all the parameters on your query request as in the
examples, or by placing the parameters in the "defaults" section for your
request handler in solrconfig.xml.


-- Jack Krupansky

On Sun, Feb 28, 2016 at 2:42 PM, 
wrote:

> Hi,
>
> I want to setup ExtendedDisMax in our solr 4.6 server, but I can't seem to
> find any example configuration for this. Ie the configuration needed in
> solrconfig.xml. In the wiki page
> http://wiki.apache.org/solr/ExtendedDisMax it simply says:
>
> "Extended DisMax is already configured in the example configuration, with
> the name edismax."
>
> But this is not true for the solrconfig.xml in our setup (it only contains
> an example for dismax, not edismax), and I downloaded the latest solr zip
> file (solr 5.5.0), and it didn't have either dismax or edismax in any of
> its solrconfig.xml files.
>
> Why is it so hard to find this configuration? Am I missing something
> obvious?
>
> Regards
> /Jimi
>

Re: Query time de-boost

[Jack Krupansky]

Thanks for clarifying - that you are referring to the bq parameter which is
in fact additive to the underlying score within the original query, while
in the main query, or using the bf and boost and qf and pf parameters the
boosting is multiplicative rather than "additive".

IOW, only in the bq parameter do you need to use negative boost values - in
all the other contexts a fractional boost is sufficient.

It's unfortunate that the ref guide isn't more clear about this key
distinction.

Now hopefully we (and others!) are on the same page.


-- Jack Krupansky

On Sun, Feb 28, 2016 at 3:26 PM, Emir Arnautovic <
emir.arnauto...@sematext.com> wrote:

> Hi Jack,
> I think we are talking about different things: I agree that boost is
> multiplicative, and boost values less than zero will reduce score, but if
> you use such boost value in bq, it will still bust documents that are
> matching it. Simplest example is with ids. If you query:
>   q=id:a OR id:b
> both doc a and b will have same score. If you boost a^2 it will be first,
> if you boost a^0.1 it will be second. But if you use dismax's bq=id:a^0.1
> it will be first. In such case you have to use negative boost to make sure
> it is last.
>
> Are we on the same page now?
>
> Regards,
> Emir
>
>
> On 26.02.2016 16:00, Jack Krupansky wrote:
>
>> Could you share your actual numbers and test case? IOW, the document score
>> without ^0.01 and with ^0.01.
>>
>> Again, to repeat, the specific boost factor may be positive, but the
>> effect
>> of a fractional boost is to reduce, not add, to the score, so that a score
>> of 0.5 boosted by 0.1 would become 0.05. IOW, it de-boosts occurrences of
>> the term.
>>
>> The point remains that you do not need a "negative boost" to de-boost a
>> term.
>>
>>
>> -- Jack Krupansky
>>
>> On Fri, Feb 26, 2016 at 4:01 AM, Emir Arnautovic <
>> emir.arnauto...@sematext.com> wrote:
>>
>> Hi Jack,
>>> I just checked on 5.5 and 0.1 is positive boost.
>>>
>>> Regards,
>>> Emir
>>>
>>>
>>> On 26.02.2016 01:11, Jack Krupansky wrote:
>>>
>>> 0.1 is a fractional boost - all intra-query boosts are multiplicative,
 not
 additive, so term^0.1 reduces the term by 90%.

 -- Jack Krupansky

 On Wed, Feb 24, 2016 at 11:29 AM, shamik  wrote:

 Binoy, 0.1 is still a positive boost. With title getting the highest

> weight,
> this won't make any difference. I've tried this as well.
>
>
>
> --
> View this message in context:
>
>
> http://lucene.472066.n3.nabble.com/Query-time-de-boost-tp4259309p4259552.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
> --
>>> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
>>> Solr & Elasticsearch Support * http://sematext.com/
>>>
>>>
>>>
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>

Re: Query time de-boost

[Emir Arnautovic]

Hi Jack,
I think we are talking about different things: I agree that boost is 
multiplicative, and boost values less than zero will reduce score, but 
if you use such boost value in bq, it will still bust documents that are 
matching it. Simplest example is with ids. If you query:

  q=id:a OR id:b
both doc a and b will have same score. If you boost a^2 it will be 
first, if you boost a^0.1 it will be second. But if you use dismax's 
bq=id:a^0.1 it will be first. In such case you have to use negative 
boost to make sure it is last.


Are we on the same page now?

Regards,
Emir

On 26.02.2016 16:00, Jack Krupansky wrote:

Could you share your actual numbers and test case? IOW, the document score
without ^0.01 and with ^0.01.

Again, to repeat, the specific boost factor may be positive, but the effect
of a fractional boost is to reduce, not add, to the score, so that a score
of 0.5 boosted by 0.1 would become 0.05. IOW, it de-boosts occurrences of
the term.

The point remains that you do not need a "negative boost" to de-boost a
term.


-- Jack Krupansky

On Fri, Feb 26, 2016 at 4:01 AM, Emir Arnautovic <
emir.arnauto...@sematext.com> wrote:


Hi Jack,
I just checked on 5.5 and 0.1 is positive boost.

Regards,
Emir


On 26.02.2016 01:11, Jack Krupansky wrote:


0.1 is a fractional boost - all intra-query boosts are multiplicative, not
additive, so term^0.1 reduces the term by 90%.

-- Jack Krupansky

On Wed, Feb 24, 2016 at 11:29 AM, shamik  wrote:

Binoy, 0.1 is still a positive boost. With title getting the highest

weight,
this won't make any difference. I've tried this as well.



--
View this message in context:

http://lucene.472066.n3.nabble.com/Query-time-de-boost-tp4259309p4259552.html
Sent from the Solr - User mailing list archive at Nabble.com.



--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/




--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/

ExtendedDisMax configuration nowhere to be found

[jimi.hullegard]

Hi,

I want to setup ExtendedDisMax in our solr 4.6 server, but I can't seem to find 
any example configuration for this. Ie the configuration needed in 
solrconfig.xml. In the wiki page http://wiki.apache.org/solr/ExtendedDisMax it 
simply says:

"Extended DisMax is already configured in the example configuration, with the 
name edismax."

But this is not true for the solrconfig.xml in our setup (it only contains an 
example for dismax, not edismax), and I downloaded the latest solr zip file 
(solr 5.5.0), and it didn't have either dismax or edismax in any of its 
solrconfig.xml files.

Why is it so hard to find this configuration? Am I missing something obvious?

Regards
/Jimi

Re: Exception SolrServerException: No live SolrServers available to handle this request:

[Elaine Cario]

You may be bumping into this bug:
https://issues.apache.org/jira/browse/SOLR-7951.  Can you try a simple
query (no grouping) and see if Solr responds?

On Tue, Feb 23, 2016 at 11:57 AM, Mugeesh Husain  wrote:

> Yes, all of the shards in a live state. I guess may be there will be
> docvalues type NUMERIC for field 'year' (expected=SORTED) exception. Still
> i
> am suffering what is the issue
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Exception-SolrServerException-No-live-SolrServers-available-to-handle-this-request-tp4258898p4259205.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>