Re: setup solrcloud from scratch vie web-ui

2017-05-16 Thread Thomas Porschberg
Hi, I did not manipulating the data dir. What I did was: 1. Downloaded solr-6.5.1.zip 2. ensured no solr process is running 3. unzipped solr-6.5.1.zip to ~/solr_new2/solr-6.5.1 3. started an external zookeeper 4. copied a conf directory from a working non-cloudsolr (6.5.1) to

Re: SolrJ - How to add a blocked document without child documents

2017-05-16 Thread Jeffery Yuan
Yes, the id is the unique key. I think maybe this is because the first one (a parent doc(Parent1) without any children) is not a block (I don't really know what's the term), so later when we add same parent (Parent2) with some children, the first one is somehow left alone. - If we update the

Re: SolrJ - How to add a blocked document without child documents

2017-05-16 Thread Zheng Lin Edwin Yeo
Is the id your unique key in the collections? By right if your id is the unique key, it will be overwritten automatically if the id is the same, when you add the same parent documents with child documents. Regards, Edwin On 16 May 2017 at 08:25, Jeffery Yuan wrote: > Hi,

Re: Possible regression in Parallel SQL in 6.5.1?

2017-05-16 Thread Kevin Risden
Well didn't take as long as I thought: https://issues.apache.org/jira/browse/CALCITE-1306 Once Calcite 1.13 is released we should upgrade and get support for this again. Kevin Risden On Tue, May 16, 2017 at 7:23 PM, Kevin Risden wrote: > Yea this came up on the

Re: Possible regression in Parallel SQL in 6.5.1?

2017-05-16 Thread Kevin Risden
Yea this came up on the calcite mailing list. Not sure if aliases in the having clause were going to be added. I'll have to see if I can find that discussion or JIRA. Kevin Risden On May 16, 2017 18:54, "Joel Bernstein" wrote: > Yeah, Calcite doesn't support field aliases

Re: solr /export handler - behavior during close()

2017-05-16 Thread Joel Bernstein
Yep, saw it. I'll comment on the ticket for what I believe needs to be done. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 16, 2017 at 8:00 PM, Varun Thacker wrote: > Hi Joel,Susmit > > I created https://issues.apache.org/jira/browse/SOLR-10698 to track the >

Re: solr /export handler - behavior during close()

2017-05-16 Thread Varun Thacker
Hi Joel,Susmit I created https://issues.apache.org/jira/browse/SOLR-10698 to track the issue @Susmit looking at the stack trace I see the expression is using JSONTupleStream . I wonder if you tried using JavabinTupleStreamParser could it help improve performance ? On Tue, May 16, 2017 at 9:39

Re: Possible regression in Parallel SQL in 6.5.1?

2017-05-16 Thread Joel Bernstein
Yeah, Calcite doesn't support field aliases in the having clause. The query should work if you use count(*). We could consider this a regression, but I think this will be a won't fix. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 16, 2017 at 12:51 PM, Timothy Potter

Re: Best practices for backup & restore

2017-05-16 Thread Dave
I think it's depends what you are backing up and restoring from. Hardware failure? Accidental delete? For my use case my master indexer stores the index on a San with daily snap shots for reliability, then my live searching master is on a San as well, my live slave searchers are all on SSD

Best practices for backup & restore

2017-05-16 Thread Jay Potharaju
Hi, I was wondering if there are any best practices for doing solr backup & restore. In the past when running backup, I stopped indexing during the backup process. I am looking at this documentation and it says that indexing can continue when backup is in progress.

Re: Solr Admin Documents tab

2017-05-16 Thread Chris Ulicny
If you pass the array of documents without the opening and closing square brackets it should work with the page defaults (at least in v6.3.0) { "id":"1",...},{"id":"2",...},... instead of [{ "id":"1",...},{"id":"2",...},...] Best, Chris On Tue, May 16, 2017 at 2:42 PM Rick Leir

Re: Shard marked as down while its operational & SOLR-9120

2017-05-16 Thread Susheel Kumar
Do not see any similar issue fixed part of later releases. Anyone experienced similar issue / suggestions to look into? Thanks, Susheel On Tue, May 16, 2017 at 2:43 PM, Walter Underwood wrote: > Look at all the bugs fixed or reported after 6.0.0. This might have been >

Re: Shard marked as down while its operational & SOLR-9120

2017-05-16 Thread Walter Underwood
Look at all the bugs fixed or reported after 6.0.0. This might have been reported and their might be a workaround. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On May 16, 2017, at 11:41 AM, Susheel Kumar wrote: > > Hi

Solr Admin Documents tab

2017-05-16 Thread Rick Leir
Hi all, In the Solr Admin Documents tab, with the document type set to JSON, I cannot get it to accept more than one document. The legend says "Document(s)". What syntax is expected? It rejects an array of documents. Thanks -- Rick -- Sorry for being brief. Alternate email is rickleir at yahoo

Re: Shard marked as down while its operational & SOLR-9120

2017-05-16 Thread Susheel Kumar
Hi Walter - will upgrade to 6.5.1 but this will take time to go from all the environments to Prod. Looking for something short term while we upgrade. Though we can connect to Solr Admin panel on the shard which is down but if I query shards.info, then that shard is not being shown/queried. So

Re: knowing which fields were successfully hit

2017-05-16 Thread Erik Hatcher
Is this the equivalent of facet.query’s? or maybe rather, group.query? Erik > On May 16, 2017, at 1:16 PM, Dorian Hoxha wrote: > > Something like elasticsearch named-queries, right >

Re: Shard marked as down while its operational & SOLR-9120

2017-05-16 Thread Walter Underwood
I would upgrade to 6.5.1 before doing anything else. 6.0.0 is more than a year old. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On May 16, 2017, at 10:27 AM, Susheel Kumar wrote: > > Also this is for Solr-6.0.0. > > On

Re: knowing which fields were successfully hit

2017-05-16 Thread John Blythe
dorian - yup! mikhail - interesting, will definitely check it out. thanks- -- *John Blythe* Product Manager & Lead Developer 251.605.3071 | j...@curvolabs.com www.curvolabs.com 58 Adams Ave Evansville, IN 47713 On Tue, May 16, 2017 at 1:16 PM, Dorian Hoxha wrote: >

Re: knowing which fields were successfully hit

2017-05-16 Thread Mikhail Khludnev
John, You can probably go with something like https://issues.apache.org/jira/browse/LUCENE-7628. I even gave a talk about this approach. But turns out it's really hard to support. On Tue, May 16, 2017 at 8:10 PM, John Blythe wrote: > sorry for the confusion. as in i received

Re: Are there roadblocks to creating custom DocRouter implementations?

2017-05-16 Thread Dorian Hoxha
Also interested in custom/pluggable routing. On Tue, May 16, 2017 at 4:47 PM, Erick Erickson wrote: > Hmmm, would the functionality be served by just using implicit routing > putting the logic in creating the doc and populating the route field? > Not, perhaps, as

Re: Shard marked as down while its operational & SOLR-9120

2017-05-16 Thread Susheel Kumar
Also this is for Solr-6.0.0. On Tue, May 16, 2017 at 12:41 PM, Susheel Kumar wrote: > Hello, > > One of the shard (out of 6 six shards and 6 replica's) we have, is being > shown as down in Solr Admin Cloud Panel (orange color) while the Solr > process is running and even

Re: knowing which fields were successfully hit

2017-05-16 Thread Dorian Hoxha
Something like elasticsearch named-queries, right https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-named-queries-and-filters.html ? On Tue, May 16, 2017 at 7:10 PM, John Blythe wrote: > sorry for the confusion. as in i received results due to

Re: knowing which fields were successfully hit

2017-05-16 Thread John Blythe
sorry for the confusion. as in i received results due to matches on field x vs. field y. i've gone w a highlighting solution for now. the fact that it requires field storage isn't yet prohibitive for me, so can serve well for now. open to any alternative approaches all the same thanks- --

Solr Carrot Clustering query with specific label in it

2017-05-16 Thread Pratik Patel
Hi, When we do a Carrot Clustering query on a set of solr documents we get back following type of response. DDR 3.9599865057283354 TWINX2048-3200PRO VS1GB400C3 VDBDB1A16 iPod

Possible regression in Parallel SQL in 6.5.1?

2017-05-16 Thread Timothy Potter
This SQL used to work pre-calcite: SELECT movie_id, COUNT(*) as num_ratings, avg(rating) as aggAvg FROM ratings GROUP BY movie_id HAVING num_ratings > 100 ORDER BY aggAvg ASC LIMIT 10 Now I get: Caused by: java.io.IOException: --> http://192.168.1.4:8983/solr/ratings_shard2_replica1/:Failed to

Re: TrieIntField vs IntPointField performance only for equality comparison (no range filtering)

2017-05-16 Thread Dorian Hoxha
Hi Shawn, I forgot that legacy-int-fields were deprecated. Point fields it is then. Thanks, Dorian On Tue, May 16, 2017 at 3:01 PM, Shawn Heisey wrote: > On 5/16/2017 3:33 AM, Dorian Hoxha wrote: > > Has anyone measured which is more efficient/performant between the 2 > >

Shard marked as down while its operational & SOLR-9120

2017-05-16 Thread Susheel Kumar
Hello, One of the shard (out of 6 six shards and 6 replica's) we have, is being shown as down in Solr Admin Cloud Panel (orange color) while the Solr process is running and even can connect to it Solr Admin Cloud panel. Each shard size is around 18GB and have around 40+ million docs. Also I do

Re: solr /export handler - behavior during close()

2017-05-16 Thread Susmit Shukla
Hi Joel, queries can be arbitrarily nested with AND/OR/NOT joins e.g. (intersect(intersect(search, search), union(search, search))). If I cut off the innermost stream with a limit, the complete intersection would not happen at upper levels. Also would the limit stream have same effect as using

RE: Solr Index issue on string type while querying

2017-05-16 Thread Matt Kuiper
Your problem statement is not quite clear, however I will make a guess. Assuming your problem is that when you remove the '>' sign from your query term you receive zero results, then this is actually expected behavior for field types that are of type string. When searching against string

Re: resource governance

2017-05-16 Thread Joel Bernstein
Streaming Expressions has this capability through it's parallel executor and priority streams. But this would mean switching to a queue based mechanism for both indexing a querying. Here is a blog describing how this works:

Re: Configure query parser to handle field name case-insensitive

2017-05-16 Thread Erick Erickson
Rick: Easiest to _code_. There isn't any. And if you just toss the problem over the fence to support then it's not a problem ;) Best, Erick On Tue, May 16, 2017 at 9:04 AM, Rick Leir wrote: > Björn > You are not serious about (1) are you? Yikes!! Easiest for you if you do

Solr Index issue on string type while querying

2017-05-16 Thread Padmanabhan V
Hello Solr Geeks, Am looking for some helping hands to proceed on an issue am facing now. Here given below one record from the prepared index. i could query the fields without greater than symbol. but when i did query for widthSquareTube_string_mv & heightSquareTube_string_mv. It is not returning

Re: Configure query parser to handle field name case-insensitive

2017-05-16 Thread Rick Leir
Björn You are not serious about (1) are you? Yikes!! Easiest for you if you do not need to sit at the helpdesk. Easiest if the users stop using the system. My guess is that (2) is easiest if you have text entry boxes for each field, and the user need not type in the field name. Cheers -- Rick

Re: does suggester's contextField support TrieDate data type?

2017-05-16 Thread arik
Yes your assumptions are correct. I have built the suggester and it works fine without the cfq. These queries work: /autocomplete?suggest.q=mexican=json /select?indent=on=+isoDateTime:[2016-05-16T0:0:0.0Z%20TO%20*]=json This one does not:

Re: knowing which fields were successfully hit

2017-05-16 Thread David Hastings
what do you mean "hit?" As in the user clicked it? On Tue, May 16, 2017 at 11:35 AM, John Blythe wrote: > hey all. i'm sending data out that could represent a purchased item or a > competitive alternative. when the results are returned i'm needing to know > which of the two

knowing which fields were successfully hit

2017-05-16 Thread John Blythe
hey all. i'm sending data out that could represent a purchased item or a competitive alternative. when the results are returned i'm needing to know which of the two were hit so i can serve up the *other*. i can make a blunt instrument in the application layer to simply look for a match between

Help reviewing json facet api query

2017-05-16 Thread Mandar Deshpande
Hi, Could anyone please help reviewing the below json facet api query. After updating to json facet api we are getting strange results in which the count (uniqueCount) for the first facet bucket is correct and the remaining are either 0 or incorrect. Below are the both the solr query urls:

resource governance

2017-05-16 Thread Avi Steiner
Hello I have a question about resource governance / quality of service. Is there any way to configure priorities of queries? Can I set some select queries, for example, higher priority than index (add/update) ? Thanks Avi This email and any attachments

Re: Configure query parser to handle field name case-insensitive

2017-05-16 Thread Erick Erickson
Yeah, your options (5) and (6) are well... definitely at the bottom of _my_ list, I understand you included them for completeness... as for (4) Oh, my aching head. Parsers give me a headache ;) Yes, (1) is the easiest.(2) and (3) mostly depend on where you're most comfortable coding. If you

Re: Are there roadblocks to creating custom DocRouter implementations?

2017-05-16 Thread Erick Erickson
Hmmm, would the functionality be served by just using implicit routing putting the logic in creating the doc and populating the route field? Not, perhaps, as elegant as having some kind of pluggable routing I grant. Best, Erick On Tue, May 16, 2017 at 7:31 AM, Shawn Heisey

Re: Terms not being indexed; not sure why

2017-05-16 Thread Erick Erickson
What David said. There are a very few cases where changing your schema does _not_ require that you blow away your index and re-index from scratch. I always blow the index away when I make any changes if at all possible. Also note that when you quote, you are asking for _phrases_, so searching for

Re: Stop solr instance

2017-05-16 Thread Shawn Heisey
On 5/15/2017 7:26 AM, Mithu Tokder wrote: > Now my question is that as the solr instances are running in three > machines so is it required to configure same value for STOP.PORT and > STOP.KEY in start and stop script of three machines or i can use > separate value for them. The port and key can

Re: setup solrcloud from scratch vie web-ui

2017-05-16 Thread Shawn Heisey
On 5/12/2017 8:49 AM, Thomas Porschberg wrote: > ERROR: Failed to create collection 'cat' due to: > {127.0.1.1:8983_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error > from server at http://127.0.1.1:8983/solr: Error CREATEing SolrCore > 'cat_shard1_replica1':

Are there roadblocks to creating custom DocRouter implementations?

2017-05-16 Thread Shawn Heisey
There was a question in the #solr IRC channel about creating a custom document router to assign documents to shards based on geolocation data. Looking into this, I think I see a roadblock or two standing in the way of users creating custom router implementations. The "routerMap" field in the

Re: Terms not being indexed; not sure why

2017-05-16 Thread David Hastings
something in text_general isnt actually doing what its supposed to be doing, is it possible you indexed it as a string then changed the type for the field after the fact? on my title i have something like such: "rawquerystring": "title:University", "querystring": "title:University",

Re: Query Regarding SOLR

2017-05-16 Thread Shawn Heisey
On 5/11/2017 12:26 PM, Deepak Mali wrote: > if there is any way to set threshold memory to the solr indexing process. > My computer is hung and the indexing process is killed by the OS. > > So , I was wondering if there is any way to set threshold memory usage to > solr indexing process in linux

Re: How to Speed Up Solr ResposeWriter

2017-05-16 Thread Shawn Heisey
On 5/10/2017 6:34 AM, Prashobh Chandran wrote: >Currently we are using solr 5.3.1 engine, Im getting json format results > from engine. But it's taking time to getting results, So i need to speed up > solr response writer. Is there anyway? It seems very unlikely that the response writer is

RE: Terms not being indexed; not sure why

2017-05-16 Thread Chip Calhoun
Now that I know what to look for in the debugQuery it's becoming more clear. Yes, it's just searching "text" unless I specify otherwise. More importantly, title searches don't work at all unless I search on the complete title; words used in the title have no effect. Clearly I'm doing something

Re: Too many logs recorded in zookeeper.out

2017-05-16 Thread Shawn Heisey
On 5/16/2017 3:07 AM, Noriyuki TAKEI wrote: > I use Solr Cloud with 3 Zoo Keepers and 2 Solr Servers, > having 3 shards and 2 replicas. > > These servers are running as virtual machine on VMWare and > virtual machines are stored in the iSCSI storage attached to VMWare. > > One day,iSCSI storage

Re: TrieIntField vs IntPointField performance only for equality comparison (no range filtering)

2017-05-16 Thread Shawn Heisey
On 5/16/2017 3:33 AM, Dorian Hoxha wrote: > Has anyone measured which is more efficient/performant between the 2 > intfields if we don't need to do range-checking ? (precisionStep=0) Point field support in Solr is *BRAND NEW*. Very little information is available yet on the Solr implementation.

Re: solr /export handler - behavior during close()

2017-05-16 Thread Joel Bernstein
Your approach looks OK. The single sharded worker collection is only needed if you were using CloudSolrStream to send the initial Streaming Expression to the /stream handler. You are not doing this, so you're approach is fine. Here are some thoughts on what you described: 1) If you are closing

Re: Date field by Atomic Update

2017-05-16 Thread Shawn Heisey
On 5/15/2017 11:31 PM, Noriyuki TAKEI wrote: > I update some fields by Solj Atomic Update.But in > particular case, an error occurred. > > When I try to set the value "2017-01-01" to date filed > by Solrj Atomic Update,the following error message appears. If the field is using the TrieDateField

Re: Seeing odd behavior with implicit routing

2017-05-16 Thread Chris Troullis
Shalin, Thanks for the response and explanation! I logged a JIRA per your request here: https://issues.apache.org/jira/browse/SOLR-10695 Chris On Mon, May 15, 2017 at 3:40 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Sun, May 14, 2017 at 7:40 PM, Chris Troullis

TrieIntField vs IntPointField performance only for equality comparison (no range filtering)

2017-05-16 Thread Dorian Hoxha
Hi, Has anyone measured which is more efficient/performant between the 2 intfields if we don't need to do range-checking ? (precisionStep=0) Regards, Dorian

Too many logs recorded in zookeeper.out

2017-05-16 Thread Noriyuki TAKEI
Hi.All. I use Solr Cloud with 3 Zoo Keepers and 2 Solr Servers, having 3 shards and 2 replicas. These servers are running as virtual machine on VMWare and virtual machines are stored in the iSCSI storage attached to VMWare. One day,iSCSI storage failure suddenly occurred and then 1 Solr Server

AW: Configure query parser to handle field name case-insensitive

2017-05-16 Thread Peemöller , Björn
Hi all, thank you for your replies! We do not directly expose the Solr API, but provide an endpoint in our backend which acts as a proxy for a specific search handler. One requirement in our application is to search for people using various properties, e.g., first name, last name,