Re: Default Index config

2018-03-28 Thread Shawn Heisey
On 3/28/2018 9:44 PM, mganeshs wrote: Regarding auto commit, we discussed lot with our product owners and atlast we are forced to keep it to 1sec and we couldn't increase further. As this itself, sometimes our customers says that they have to refresh their pages for couple of times to get the

Re: Default Index config

2018-03-28 Thread mganeshs
Hi Shawn, Thanks again for detailed reply. Regarding auto commit, we discussed lot with our product owners and atlast we are forced to keep it to 1sec and we couldn't increase further. As this itself, sometimes our customers says that they have to refresh their pages for couple of times to get

Solr Metrics mismatch the query logs

2018-03-28 Thread Nawab Zada Asad Iqbal
Hi, I gather solr metrics from the following URL for my request handler. [solr-host]/solr/core1/admin/mbeans?stats=true=json Specifically, there is a requests value in the stats map for each handler. I use this value to calculate the requests which arrived between two successive intervals

New 7.2.1 install on linux; "permission denied" on exec?

2018-03-28 Thread hal469
I'm attempting to install Solr 7.2.1 on linux. Following instructions at https://lucene.apache.org/solr/guide/7_2/taking-solr-to-production.html#taking-solr-to-production I install cd /home/test/ wget http://apache.osuosl.org/lucene/solr/7.2.1/solr-7.2.1.tgz

Re: Copying a SolrCloud collection to other hosts

2018-03-28 Thread Jeff Wartes
I really like the fetchindex approach. Once I figured out the undocumented API, it worked really well, and I haven't had to change my usage for any Solr I've tried between 4.7-7.2. I recall having some issues if I tried to apply a fetchindex to a shard that already had data, where it'd get

Re: Copying a SolrCloud collection to other hosts

2018-03-28 Thread Jeff Wartes
It'd work fine, I played around with this a bit once upon a time. The trick is that you need to either: 1. Make sure all shards for the index are synchronized onto every node for the duration of the restore (as you mention) 2. Know exactly which nodes will ask to restore which shards for the

Re: Copying a SolrCloud collection to other hosts

2018-03-28 Thread Shawn Heisey
On 3/28/2018 10:34 AM, Jeff Wartes wrote: > The backup/restore still requires setting up a shared filesystem on all your > nodes though right? Technically speaking, I don't think a shared filesystem is actually REQUIRED to make a backup. But in order to do a restore, all machines involved with

UIMA-SOLR integration

2018-03-28 Thread Mark Robinson
Hi, I was trying to integrate UIMA into SOLR following the solr docs and many other hints on the net. While trying to get a VALID_ALCHEMYAPI_KEY I contacted IBM support and got the following advice:- "As announced a year a go the Alchemy Service was scheduled and shutdown on March 7th, 2018, and

Re: Copying a SolrCloud collection to other hosts

2018-03-28 Thread Erick Erickson
Hmmm, wouldn't even be all that hard would it? A collections API call. Assuming both collection's state.json nodes were available from ZooKeeper a command would have all the necessary information, only an HTTP connection required. I don't think it would be too much of a stretch to be able to

Re: Copying a SolrCloud collection to other hosts

2018-03-28 Thread David Smiley
Right, there is a shared filesystem requirement. It would be nice if this Solr feature could be enhanced to have more options like backing up directly to another SolrCloud using replication/fetchIndex like your cool solrcloud_manager thing. On Wed, Mar 28, 2018 at 12:34 PM Jeff Wartes

Re: Copying a SolrCloud collection to other hosts

2018-03-28 Thread Jeff Wartes
The backup/restore still requires setting up a shared filesystem on all your nodes though right? I've been using the fetchindex trick in my solrcloud_manager tool for ages now: https://github.com/whitepages/solrcloud_manager#cluster-commands Some of the original features in that tool have been

Using Solr to build a product matcher, with learning to rank

2018-03-28 Thread Xavier Schepler
Hello, I'm considering using Solr with learning to rank to build a product matcher. For example, it should match the titles: - Apple iPhone 6 16 Gb, - iPhone 6 16 Gb, - Smartphone IPhone 6 16 Gb, - iPhone 6 black 16 Gb, to the same internal reference, an unique identifier. With Solr, each

Re: Add remote ip address in solr log

2018-03-28 Thread Vincenzo D'Amore
Thanks Shawn, actually I have my log flooded by an old http client which generate a "bad HTTP parsed: 400 HTTP/0.9 not supported", very likely is a nagios monitor or a old load balancer firmware. Anyway, I've found the ip address of the caller using the old (but still very useful) command

Re: Solr on HDInsight to write to Active Data Lake

2018-03-28 Thread Abhi Basu
Yes, for the life of me, cannot find info on azure data lake jars and MS has not been much help either. Maybe they dont want us to use Solr on ADLS, Thanks, Abhi On Wed, Mar 28, 2018 at 10:59 AM, Rick Leir wrote: > Hi, > The class that is not found is likely in the Azure

Re: Add remote ip address in solr log

2018-03-28 Thread Shawn Heisey
On 3/28/2018 9:47 AM, Vincenzo D'Amore wrote: I'm struggling to add http remote ip address in solr (jetty) log file. I've tried to modify the server/resources/log4j.properties file, which seems to control the output log format, but I'm unable to understand how to add in ConversionPattern the

Re: Solr on HDInsight to write to Active Data Lake

2018-03-28 Thread Rick Leir
Hi, The class that is not found is likely in the Azure related libraries. As Erick said, are you sure that you have a library containing it? Cheers Rick -- Sorry for being brief. Alternate email is rickleir at yahoo dot com

Add remote ip address in solr log

2018-03-28 Thread Vincenzo D'Amore
Hi, I'm struggling to add http remote ip address in solr (jetty) log file. I've tried to modify the server/resources/log4j.properties file, which seems to control the output log format, but I'm unable to understand how to add in ConversionPattern the proper ip address field.

RE: query regarding Solr partial search

2018-03-28 Thread Paul, Lulu
Hi Erik Below is the configuration in our solrconfig.xml. So, yes the query parser used is edismax explicit json true text explicit velocity browse layout edismax

Re: edit gc parameters in solr.in.sh or solr?

2018-03-28 Thread Shawn Heisey
On 3/28/2018 1:06 AM, Bernd Fehling wrote: Humongous Allocations are not genrally bad. Sure, the G1 part for humongous allocations is not that performant and takes time. But just try to limit humongous allocations and not to avoid it under all circumstances. I was told by Oracle engineers

Re: Trying to Restore older indexes in Solr7.2.1

2018-03-28 Thread Shawn Heisey
On 3/28/2018 1:16 AM, Mugdha Varadkar wrote: I am trying to restore Solr 5.5.5 indexes into Solr 7.2.1 Performed below steps: 1. Upgraded the indexes to Solr 6.6.2 indexes using IndexUpgraded Tool

Trying to Restore older indexes in Solr7.2.1

2018-03-28 Thread Mugdha Varadkar
Hi, I am trying to restore Solr 5.5.5 indexes into Solr 7.2.1 Performed below steps: 1. Upgraded the indexes to Solr 6.6.2 indexes using IndexUpgraded Tool Command used : java -cp

Re: edit gc parameters in solr.in.sh or solr?

2018-03-28 Thread Bernd Fehling
Hi Shawn, the problem with heap regions is, you can't get one advantage without any disadvantage. According to your G1 example: 4GB heap with default 2MB region size = 2048 heap regions 4GB heap with G1HeapRegionSize set to 8MB = 512 heap regions You see, you only have 1/4th of heap regions

Re: Error when running ant package in solr 7.2.1 from source

2018-03-28 Thread Shawn Heisey
On 3/27/2018 7:36 PM, C F wrote: I'm unable to run the ant package target in solr-7.2.1-src.tgz. Any ideas? Is git required now? This is not a new requirement.  When the official repository was in subversion, that target required svn -- it couldn't be built if the checkout was done from