Re: solr error

2016-08-02 Thread GW
best to get a build document together to ensure your server is correct. testing with a simple curl get/post I use PHP and Perl all the time and have to say the overall docs suck because the technology changes fast. The coolest thing about Solrcloud is it changes fast. For instance apt-get

custom field types in solr 6.1.0

2016-08-02 Thread Naveen Pajjuri
Hi, Im trying to move from 4.10.4 to 6.1.0. I want to define and use custom field types. but i read that its not advisable to modify managed-schema file. how do i create custom field types ?? Thanks in advance, Naveen Reddy

Re: custom field types in solr 6.1.0

2016-08-02 Thread Kais Hassan
Hello Naveen, There is not against using custom types, actually to provide a good search experience you will need to create your own custom types. You can use the Classic schema.xml in Solr 6 read the following

RE: Installing Solr with Ivy

2016-08-02 Thread Demian Katz
Thanks, Shawn, for confirming my suspicions. Regarding your question about how Solr differs from a database server, I agree with you in theory, but the problem is in the practice: there are very easy, familiar, well-established techniques for installing and maintaining database platforms, and

Re: problems with bulk indexing with concurrent DIH

2016-08-02 Thread Susheel Kumar
My experience with DIH was we couldn't scale to the level we wanted. SorlJ with multi-threading & batch updates (parallel threads pushing data into solr) worked and were able to ingest 5K-10K docs per second. Thanks, Susheel On Tue, Aug 2, 2016 at 9:15 AM, Mikhail Khludnev

Re: solr error

2016-08-02 Thread GW
K, After installing the latest PECL for Solr in PHP I found that it fails with Solr 6.1.0. This is Debian 8. Anyway, I just ended up writing a function using curl to post JSON to Solr. This is working with PHP5.6 & The latest Solrcloud No more Solr client in PHP for me lol. Parallel SQL is a

Re: problems with bulk indexing with concurrent DIH

2016-08-02 Thread Bernd Fehling
Hi Mikhail, there are no deletes at all from my point of view. All records have unique id's. No sharding at all, it is a single index and it is certified that all DIH's get different data to load and no record is sent twice to any DIH participating at concurrent loading. Only assumption so far,

Re: Solr: Block Join Faceting

2016-08-02 Thread Mikhail Khludnev
On Wed, Jul 27, 2016 at 5:27 PM, Morse, Matthew K. < matthew.k.mo...@fmr.com.invalid> wrote: > > 1.With this query I receive no facet results. The main response > is correct, but I was expecting to see a fundCode facet of 245 with 1. > Below is the query with the output. > > the empty

Re: problems with bulk indexing with concurrent DIH

2016-08-02 Thread Mikhail Khludnev
These deletes seem really puzzling to me. Can you experiment with commenting uniqeKey in schema.xml. My expectation that deletes should go away after that. On Tue, Aug 2, 2016 at 4:50 PM, Bernd Fehling < bernd.fehl...@uni-bielefeld.de> wrote: > Hi Mikhail, > > there are no deletes at all from my

Re: how to sort search results by count matches

2016-08-02 Thread Mikhail Khludnev
tfidf especially unreliable for such microindexes. =true can explain why exactly. On Tue, Aug 2, 2016 at 4:57 PM, syegorius wrote: > I have 4 records index by Solr: > > 1 hello planet dear friends > 2 hello world dear friends > 3 nothing > 4 just friends > > I'm

Re: custom field types in solr 6.1.0

2016-08-02 Thread Shawn Heisey
On 8/2/2016 5:16 AM, Naveen Pajjuri wrote: > Hi, Im trying to move from 4.10.4 to 6.1.0. I want to define and use > custom field types. but i read that its not advisable to modify > managed-schema file. how do i create custom field types ?? You have three choices. * Ignore the warning and edit

Re: problems with bulk indexing with concurrent DIH

2016-08-02 Thread Bernd Fehling
Well, concurrent DIH is very simple, just one little shell script :-) 5K-10K docs per second say nothing. Is it just data pushed plain into the index or has it complex schema with many analyzers? Bernd Am 02.08.2016 um 15:44 schrieb Susheel Kumar: > My experience with DIH was we couldn't scale

how to sort search results by count matches

2016-08-02 Thread syegorius
I have 4 records index by Solr: 1 hello planet dear friends 2 hello world dear friends 3 nothing 4 just friends I'm searching with this query: select?q=world+dear+friends=json=true The result is: 1 hello planet dear friends 2 hello world dear friends 4 just friends But as you can see

Re: how to sort search results by count matches

2016-08-02 Thread Michael Kuhlmann
Hi syegorius, are you sure that there's no synonym "planet,world" defined? -Michael Am 02.08.2016 um 15:57 schrieb syegorius: > I have 4 records index by Solr: > > 1 hello planet dear friends > 2 hello world dear friends > 3 nothing > 4 just friends > > I'm searching with this query: > >

Re: problems with bulk indexing with concurrent DIH

2016-08-02 Thread Mikhail Khludnev
Bernd, But why do you have so many deletes? Is it expected? When you run DIHs concurrently, do you shard intput data by uniqueKey? On Wed, Jul 27, 2016 at 6:20 PM, Bernd Fehling < bernd.fehl...@uni-bielefeld.de> wrote: > If there is a problem in single index then it might also be in CloudSolr. >

Re: how to sort search results by count matches

2016-08-02 Thread syegorius
2016-08-02 17:12 GMT+03:00, syegorius [via Lucene] : > > > no. this is just just an example. i need some formula or some statement to > sort results by count matches. everything i wrote was for you to best > understand my problem > > > >

Re: problems with bulk indexing with concurrent DIH

2016-08-02 Thread Shalin Shekhar Mangar
Hi Bernd, I think you are running into https://issues.apache.org/jira/browse/LUCENE-6161. Can you upgrade to 5.1 or newer? On Wed, Jul 27, 2016 at 7:29 PM, Bernd Fehling < bernd.fehl...@uni-bielefeld.de> wrote: > After enhancing the server with SSDs I'm trying to speed up indexing. > > The

Re: how to sort search results by count matches

2016-08-02 Thread syegorius
no. this is just just an example. i need some formula or some statement to sort results by count matches. everything i wrote was for you to best understand my problem -- View this message in context:

RE: Solr: Block Join Faceting

2016-08-02 Thread Morse, Matthew K.
Thanks for the response! 1. So based on my document structure, how can I query on one child document but obtain facet counts based on another? In my example, if my query matches only child id=”12”, how can I retrieve facet counts on the other children, like fundCode or employeeId for

Re: Indexing a bean class with custom datatype

2016-08-02 Thread Alexandre Rafalovitch
Why? How would you then search it and what would you find? Solr is not a storage database, but a search one. Faithful relationship and depth preservation is often the wrong direction to start your modelling from. Regards, Alex On 3 Aug 2016 2:52 AM, "Godwin Joel"

EmbeddedSolrServer problem when using one-jar-with-dependency including solr

2016-08-02 Thread Ziqi Zhang
Hi, I am using Solr, Solrj 6.1, and Maven to manage my project. I use maven to build a jar-with-dependency and run a java program pointing its classpath to this jar. However I keep getting errors even when I just try to create an instance of EmbeddedSolrServer: */code/ *String

RE: Solr: Block Join Faceting

2016-08-02 Thread Mikhail Khludnev
I.m not quite sure about the last question. Why do you slice these nested docs? I hope you have the reason for this, it.s just not obvious to me. Regarding the first question, you need to expand docset to all children and then wrap it back to parents, thus you need to prepend the query with

Sum of all values in Function Query

2016-08-02 Thread Zheng Lin Edwin Yeo
Hi, Would like to find out, is it possible for Solr to find a sum of all the values that are returned in a query? For example, when I does a search in which that is a field called "Amount" with fieldType=float. Is it possible for Solr to do return the sum of all the "Amount" that are returned?

Re: Regarding HTMLStripCharFilter.

2016-08-02 Thread Modassar Ather
Hi, Please provide your inputs. Thanks, Modassar On Tue, Aug 2, 2016 at 9:30 AM, Modassar Ather wrote: > Hi, > > Kindly help me understand the way HTMLStripCharFilter works. > > I have following analysis chain. > > int flags = WordDelimiterFilter.GENERATE_WORD_PARTS >

Indexing a bean class with custom datatype

2016-08-02 Thread Godwin Joel
Hi all, I have a Java Bean like this: public class Component { @Field private double totalCoverage; @Field private List applicationComponents; //setters and getter } where the applicationComponents is of custom datatype, while indexing this through SolrJ, it is being inserted as: {

Collection going to recovery mode - Leader election issue?

2016-08-02 Thread Aswath Srinivasan (TMS)
Hi All, Solr verion 5.3.2 Zookeeper 3.6.2 SolrCloud - 2 shards, 4 replicas, 4 nodes Above is the set up. 3 of the shards (replicas) went to a recovery mode which the following ERROR in the logs. Anyone experienced this before? I had to restart the Solr server nodes to bring them all up. Looks

Re: EmbeddedSolrServer problem when using one-jar-with-dependency including solr

2016-08-02 Thread Steve Rowe
solr-core[1] and solr-solrj[2] POMs have parent POM solr-parent[3], which in turn has parent POM lucene-solr-grandparent[4], which has a section that specifies dependency versions & exclusions *for all direct dependencies*. The intent is for all Lucene/Solr’s internal dependencies to be

RE: Installing Solr with Ivy

2016-08-02 Thread Demian Katz
Dan, Thanks for taking the time to share this! I'll give it a test run in the near future and will happily share improvements if I come up with any (though I'll most likely be focusing on the download steps rather than the subsequent configuration). - Demian -Original Message- From:

Re: EmbeddedSolrServer problem when using one-jar-with-dependency including solr

2016-08-02 Thread Rohit Kanchan
We also faced same issue when we were running embedded solr 6.1 server. Actually I faced the same in our integration environment after deploying project. Solr 6.1 is using http client 4.4.1 which I think embedded solr server is looking for. I think when solr core is getting loaded then old http

RE: Installing Solr with Ivy

2016-08-02 Thread Davis, Daniel (NIH/NLM) [C]
Demian, I've long meant to upload my own "automated installation" - it is ant without ivy, but with checksums. I suppose gpg signatures could also be worked in. It is only semi-automated, because our DevOps group does not have root, but here is a clean version -