Re: Best practices on monitoring Solr

2015-12-23 Thread Emir Arnautovic
Hi Shail, As William mentioned, our SPM allows you to monitor all main Solr/Jvm/Host metrics and also set up alerts for some values or use anomaly detection to notify you when something is about to be wrong. You can test all features for free for 30 days

Solr Timeouts during query aggregation

2015-12-23 Thread Peter Lee
Greetings, I'm having a hard time locating information about how solr handles timeouts (if it DOES handle them) during a search across multiple shards in a solr cloud configuration. I have found information and have confirmed through empirical testing as to how solr handles timeouts on each

Re: Best practices on monitoring Solr

2015-12-23 Thread Florian Gleixner
On 12/22/2015 08:15 PM, Tiwari, Shailendra wrote: > Hi, > > Last week our Solr Search was un-responsive and we need to re-boot the > server, but we were able to find out after customer complained about it. > What's best way to monitor that search is working? > We can always add Gomez alerts

Re: API accessible without authentication even though Basic Auth Plugin is enabled

2015-12-23 Thread Shawn Heisey
On 12/22/2015 11:45 PM, William Bell wrote: > Why would someone stay on 5.3.x instead of upgrading to 5.4? Why backport > when you can just upgrade? We just had this same discussion on the dev list. Anshum wants to cut a 5.3.2 release, somebody asked the same thing you did, and this is what I

Re: Best practices on monitoring Solr

2015-12-23 Thread Jack Krupansky
Solr does have a monitoring wiki page, but it is fairly weak and could use more serious contribution, including suggestions from this email thread. This is also a good example of where the wiki still has value relative to the formal Solr Reference Guide. E.g., third parties can add tool and

Re: Increasing Solr5 time out from 30 seconds while starting solr

2015-12-23 Thread Debraj Manna
Please see the logs below I am seeing :- jabong@jabong1143:~/Downloads/software/dev/solr5$ sudo bin/solr start -p Waiting to see Solr listening on port [-] Still not seeing Solr listening on after 30 seconds! INFO - 2015-12-23 16:23:46.006; [ ]

Re: Streaming Expressions (/stream) NPE

2015-12-23 Thread Jason Gerlowski
Thanks for the heads up Joel. Glad this was just user error, and not an actual problem. Though it is interesting that Solr's response didn't contain any information about what was wrong. I probably would've expected a message to the effect of: "the required parameter 'expr' was not found".

Re: Best practices on monitoring Solr

2015-12-23 Thread Ahmet Arslan
Hi, http://newrelic.com is another option. Ahmet On Wednesday, December 23, 2015 4:26 PM, Florian Gleixner wrote: On 12/22/2015 08:15 PM, Tiwari, Shailendra wrote: > Hi, > > Last week our Solr Search was un-responsive and we need to re-boot the > server, but we were

ToParentBlockJoinQuery.java

2015-12-23 Thread Rick Leir
Hi all, This is working fine for me, searching for 'charlie': $ curl http://localhost:8983/solr/dorsetdata/query -d ' q={!parent which="content_type:parentDocument" score=total} type:page AND charlie =json =2 =true =score,[child parentFilter=content_type:parentDocument

Re: How to check when a search exceeds the threshold of timeAllowed parameter

2015-12-23 Thread Jeff Wartes
Looks like it’ll set partialResults=true on your results if you hit the timeout. https://issues.apache.org/jira/browse/SOLR-502 https://issues.apache.org/jira/browse/SOLR-5986 On 12/22/15, 5:43 PM, "Vincenzo D'Amore" wrote: >Well... I can write everything, but

Re: ToParentBlockJoinQuery.java

2015-12-23 Thread Yonik Seeley
On Wed, Dec 23, 2015 at 11:50 AM, Rick Leir wrote: > I would like to put conditions on the parent document, so I tried this, > adding ' AND lang:eng': > > $ curl http://localhost:8983/solr/dorsetdata/query -d ' > q={!parent which="content_type:parentDocument AND

Re: Streaming Expressions (/stream) NPE

2015-12-23 Thread Joel Bernstein
Thanks for the feedback. Yes, please create the ticket. I believe all that needs to be done is to check for null and then throw a better exception. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Dec 23, 2015 at 9:15 AM, Jason Gerlowski wrote: > Thanks for the heads

Re: Best practices on monitoring Solr

2015-12-23 Thread Debraj Manna
We use datadog . On Thu, Dec 24, 2015 at 12:44 AM, Ahmet Arslan wrote: > > > Hi, > > http://newrelic.com is another option. > > Ahmet > > On Wednesday, December 23, 2015 4:26 PM, Florian Gleixner > wrote: > > > > On

Re: Providing own _version field in solr doc

2015-12-23 Thread Debraj Manna
For my use case I tried document centric versioning as mentioned here . But In my case this is not working I am seeing the document having version older is

Re: Providing own _version field in solr doc

2015-12-23 Thread Shawn Heisey
On 12/23/2015 10:30 AM, Debraj Manna wrote: > For my use case I tried document centric versioning as mentioned here > . > But In my case this is not working I

Re: Providing own _version field in solr doc

2015-12-23 Thread Debraj Manna
Thanks Shawn. But after making the below changes (making versionable_chain as default) all my update,inserts & deleteByQuery are failing with the error "*Error from server at http://localhost:/solr/discovery : DistributedUpdateProcessor must follow

Re: ToParentBlockJoinQuery.java

2015-12-23 Thread Rick Leir
> If you want conditions/filters on the parent document, that's easy... > your query is already mapping to parents, so simply add another "fq" > param. That is perfect. Thanks!! Cheers -- Rick

Re: Providing own _version field in solr doc

2015-12-23 Thread Debraj Manna
Thanks Shawn :) . On Dec 24, 2015 1:12 AM, "Shawn Heisey" wrote: > On 12/23/2015 12:25 PM, Debraj Manna wrote: > > Thanks Shawn. But after making the below changes (making > versionable_chain > > as default) all my update,inserts & deleteByQuery are failing with the > >

Solr 6 - Relational Index querying

2015-12-23 Thread Troy Edwards
In Solr 5.1.0 we had to flatten out two collections into one Item - about 1.5 million items with primary key - ItemId (this mainly contains item description) FacilityItem - about 10,000 facilities - primary key - FacilityItemId (pricing information for each facility) - ItemId points to Item We

Re: mlt and document boost

2015-12-23 Thread CrazyDiamond
So no way to apply boost to mlt or any other way to change order of document in mlt result? also may be there is a way to make to mlt query at once and merge. -- View this message in context: http://lucene.472066.n3.nabble.com/mlt-and-document-boost-tp4246522p4247154.html Sent from the Solr -

Re: Providing own _version field in solr doc

2015-12-23 Thread Shawn Heisey
On 12/23/2015 12:25 PM, Debraj Manna wrote: > Thanks Shawn. But after making the below changes (making versionable_chain > as default) all my update,inserts & deleteByQuery are failing with the > error "*Error from server at http://localhost:/solr/discovery >

Re: 5.4 facet performance thumbs-up

2015-12-23 Thread Yonik Seeley
Awesome, thanks for the feedback! -Yonik On Tue, Dec 22, 2015 at 5:36 PM, Aigner, Max wrote: > I'm happy to report that we are seeing significant speed-ups in our queries > with Json facets on 5.4 vs regular facets on 5.1. Our queries contain mostly > terms facets,

Re: mlt and document boost

2015-12-23 Thread Binoy Dalal
Have you tried applying the boosts to individual fields with mlt.qf? Optionally, you could get the patch that is on jira and integrate it into your code if you're so inclined. On Thu, 24 Dec 2015, 03:17 CrazyDiamond wrote: > So no way to apply boost to mlt or any other

Data import issue

2015-12-23 Thread Midas A
Hi , Please provide the steps to resolve the issue. com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Communications link failure during rollback(). Transaction resolution unknown.

DIH errors

2015-12-23 Thread Midas A
Please help us a) java.sql.SQLException: Streaming result set com.mysql.jdbc.RowDataDynamic@755ea675 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets

Re: How to check when a search exceeds the threshold of timeAllowed parameter

2015-12-23 Thread David Santamauro
On 12/23/2015 01:42 AM, William Bell wrote: I agree that when using timeAllowed in the header info there should be an entry that indicates timeAllowed triggered. If I'm not mistaken, there is => partialResults:true "responseHeader":{ "partialResults":true } // This is the only reason

how to use distribute facet.pivot

2015-12-23 Thread soledede_w...@ehsy.com
I have two shards facet.pivot=categoryId1,categoryId2,categoryId3,categoryId4 when I excute facet.pivot, cpu and mem both full How can I solve this problem Who can help me Thanks soledede_w...@ehsy.com

Re: Unable to extract images content (OCR) from PDF files using Solr

2015-12-23 Thread Upayavira
If your needs of Tika fall outside of those provided by the embedded Tika, I would suggest you include Tika in your own ingestion pipeline, and just post raw content to Solr. This will probably perform better anyway, as you are otherwise using up valuable Solr resources to do your extraction work,

Multiple Unique Keys

2015-12-23 Thread Salman Ansari
Hi, I am wondering if I can specify multiple unique keys in the same document in Solr. My scenario is that I want to integrate with another system that has an ID and our system has a reference number (auto-generated for each document on the fly) as well that is unique. What I am trying to

Re: Multiple Unique Keys

2015-12-23 Thread Alexandre Rafalovitch
No. Whichever one triggers the document override should be your primary key. The rest is application logic. You can make the field required, but that's about it. Regards, Alex On 23 Dec 2015 3:32 pm, "Salman Ansari" wrote: > Hi, > > I am wondering if I can specify