Re: Empty facets on TextField

2016-10-18 Thread Yonik Seeley
Actually, a delete-by-query of *:* may also be hit-or-miss on replicas in a solr cloud setup because of reorders. If it does work, you should see something in the logs at the INFO level like "REMOVING ALL DOCUMENTS FROM INDEX" -Yonik On Tue, Oct 18, 2016 at 11:02 PM, Yonik Seeley

Re: Empty facets on TextField

2016-10-18 Thread Yonik Seeley
A delete-by-query of *:* may do it (because it special cases to removing the index). The underlying issue is when lucene merges a segment without docvalues with a segment that has them. -Yonik On Tue, Oct 18, 2016 at 10:09 PM, John Davis wrote: > Thanks. Is there a

Re: Empty facets on TextField

2016-10-18 Thread John Davis
Thanks. Is there a way around to not starting fresh and forcing the reindex to remove docValues? On Tue, Oct 18, 2016 at 6:56 PM, Yonik Seeley wrote: > This sounds like you didn't actually start fresh, but just reindexed your > data. > This would mean that docValues would

Re: Empty facets on TextField

2016-10-18 Thread Yonik Seeley
This sounds like you didn't actually start fresh, but just reindexed your data. This would mean that docValues would still exist in the index for this field (just with no values), and that normal faceting would use those. Forcing facet.method=enum forces the use of the index instead of docvalues

Empty facets on TextField

2016-10-18 Thread John Davis
Hi, I have converted one of my fields from StrField to TextField and am not getting back any facets for that field. Here's the exact configuration of the TextField. I have tested it with 6.2.0 on a fresh instance and it repros consistently. From reading through past archives and documentation, it

Re: Migration from Solr 4

2016-10-18 Thread sputul
Thanks, Eric. I will use IndexUpgraderTool to upgrade index per your suggestion. -- Putul -- View this message in context: http://lucene.472066.n3.nabble.com/Migration-from-Solr-4-tp4301788p4301859.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Migration from Solr 4

2016-10-18 Thread sputul
Thanks, Shawn. Sad but good to know upfront hat reindex is not magic. -- View this message in context: http://lucene.472066.n3.nabble.com/Migration-from-Solr-4-tp4301788p4301858.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread Markus Jelsma
ManifoldCF can do this really flexible, with Filenet or Sharepoint, or both, i don't remember that well. This means a variety of users can have changing privileges at any time. The backend determines visibility, ManifoldCF just asks how visible it should be. This also means you need those

Summary for term facet

2016-10-18 Thread prosens
How to find the stats for all the term facets where count>2, so looking for a 'termssummary' type like this: Json.facet={ Total:{ type:termssummary, field:filename, *mincount:2*, Facet:{ Sum:sum(size) }}} Is there a way to achieve this? -- View this message in context:

RE: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread Markus Jelsma
The key is static indeed, just a subscription key. Under the hood it translates to a function query, which can vary. In our simple case it is really a key that translates to fq=host:(host1 host2 ... hostX). A simple backend sends this data to nginx every few minutes. Again, just simple

Re: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread John Bickerstaff
Thanks Jan -- I did a quick scan on the wiki and here: http://www.slideshare.net/lucenerevolution/wright-nokia-manifoldcfeurocon-2011 and couldn't find the answer to the following question in the 5 or 10 minutes I spent looking. Admittedly I'm being lazy and hoping you have enough experience

Re: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread John Bickerstaff
Thanks Markus, In your case that client's key is fairly static, yes? It doesn't change at any time, but tends to live on the data more or less permanently? On Tue, Oct 18, 2016 at 4:07 PM, Markus Jelsma wrote: > In case you're not up for Doug or Jan's anwers; we

RE: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread Markus Jelsma
In case you're not up for Doug or Jan's anwers; we have relied on HTTP proxies (nginx) to solve the problem of restriction for over 6 years. Very easy if visibility is your only problem. Of course, the update handlers are hidden (we perform indexing for clients with crawlers) so we don't expose

Re: Advice on implementing SOLR Cloud

2016-10-18 Thread Sadheera Vithanage
Thank you ,Susheel Kumar. On Tue, Oct 18, 2016 at 11:13 PM, Susheel Kumar wrote: > In case if you need exact commands etc. you can follow this > > http://blog.thedigitalgroup.com/susheelk/2015/08/03/ > solrcloud-2-nodes-solr-1-node-zk-setup/ > > > Thanks, > Susheel > > On

Re: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread Jan Høydahl
https://wiki.apache.org/solr/SolrSecurity#Document_Level_Security -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 18. okt. 2016 kl. 23.00 skrev John Bickerstaff : > > I

Re: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread Doug Turnbull
You might want to talk to Kevin Waters or look at some of the work being done with the graph plugin. It's being used to model permissions with Solr. It's a bit of normalization within Solr whereby you could localize updates to a users shared-with document. Kevin can probably talk more

Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread John Bickerstaff
I have a question that I suspect I'll need to answer very soon in my current position. How (or is it even wise) to "segregate data" in Solr so that some data can be seen by some users and some data not be seen? Taking the case of "public / private" as a (hopefully) simple, binary example...

Re: HttpSolrClient.Builder

2016-10-18 Thread Shawn Heisey
On 10/18/2016 2:39 PM, wmcgin...@cox.net wrote: > What causes this? > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/http/impl/client/CloseableHttpClient > at > org.apache.solr.client.solrj.impl.HttpSolrClient.(HttpSolrClient.java:209) > at >

HttpSolrClient.Builder

2016-10-18 Thread wmcginnis
What causes this? Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/http/impl/client/CloseableHttpClient at org.apache.solr.client.solrj.impl.HttpSolrClient.(HttpSolrClient.java:209) at

Re: Migration from Solr 4

2016-10-18 Thread John Bickerstaff
Good point on the chroot - I used one and at one point I had 3 different versions of Solr running on 9 VMs - nary a problem... Sputul, the chroot "instructions" are in my notes... look for something like "./solr6.1" in the notes and you'll see what I mean... On Tue, Oct 18, 2016 at 2:05 PM,

Re: Migration from Solr 4

2016-10-18 Thread John Bickerstaff
Gratzi Eric for the correction on Zookeeper... On Tue, Oct 18, 2016 at 1:48 PM, Erick Erickson wrote: > bq: ...whether it's OK to just copy the data files between 4.3 and 6.x > > NOT ok. Solr (well, Lucene really) guarantees to read _one_ major version > behind. So a

Re: Migration from Solr 4

2016-10-18 Thread Shawn Heisey
On 10/18/2016 12:28 PM, John Bickerstaff wrote: > For what it's worth, (and it may not work for your situation) I > decided not to upgrade, but to "upgrade by replacing". In other words, > I just installed 6.x and because I had set up my configs for "include" > I didn't have to worry about what

Re: Migration from Solr 4

2016-10-18 Thread sputul
Thanks for quick reply and all documents, John. I plan on placing our index to Solr install to see if that works. And hope that Solr 4 index will magically work with SolrConfig changes. Excuse my ignorance, but is there a curl command or so to reindex documents in a collection? We do this in code

Re: Migration from Solr 4

2016-10-18 Thread Erick Erickson
bq: ...whether it's OK to just copy the data files between 4.3 and 6.x NOT ok. Solr (well, Lucene really) guarantees to read _one_ major version behind. So a Solr 5x will read a solr 4x. But a Solr 6x is not guaranteed at all to read a 4x. And in fact removing back-compat complexification is one

Re: Migration from Solr 4

2016-10-18 Thread John Bickerstaff
For what it's worth, (and it may not work for your situation) I decided not to upgrade, but to "upgrade by replacing". In other words, I just installed 6.x and because I had set up my configs for "include" I didn't have to worry about what would be different about the "new" solrconfig.xml and the

Migration from Solr 4

2016-10-18 Thread sputul
We are using Solr 4.3, sing Zoopeeker on development manage Solr Cloud having one or two nodes. Will it be easier to migrate to Solr 5 first or should I migrate to Solr 6 directly? I see Core definition has changed. Anything else worth noting? The goal is to also use HTTPS perhaps after

CachedSqlEntityProcessor with delta-import

2016-10-18 Thread Mohan, Sowmya
Good morning, Can CachedSqlEntityProcessor be used with delta-import? In my setup when running a delta-import with CachedSqlEntityProcessor, the child entity values are not correctly updated for the parent record. I am on Solr 4.3. Has anyone experienced this and if so how to resolve it?

Re: Query by distance

2016-10-18 Thread John Bickerstaff
Just in case it helps, I had good success on multi-word synonyms using this plugin... https://github.com/healthonnet/hon-lucene-synonyms IIRC, the instructions are clear and fairly easy to follow - especially for Solr 6.x Ping back if you run into any problems setting it up... On Tue, Oct

Re: Access solr in web browser

2016-10-18 Thread Shawn Heisey
On 10/18/2016 5:11 AM, Mugeesh Husain wrote: > It is not about the information of collection while it about the > accessibility, I want to access via putty session. The fact that you mentioned putty leads me to believe that you probably ARE using a UNIX or UNIX-like OS. Ideally the OS will

Re: Query by distance

2016-10-18 Thread marotosg
This is my field type. I was reading about this and it looks like the issue I have been reading and it looks like the issue is about multi term synonym.

Re: Advice on implementing SOLR Cloud

2016-10-18 Thread Susheel Kumar
In case if you need exact commands etc. you can follow this http://blog.thedigitalgroup.com/susheelk/2015/08/03/solrcloud-2-nodes-solr-1-node-zk-setup/ Thanks, Susheel On Mon, Oct 17, 2016 at 7:17 PM, John Bickerstaff wrote: > I had quite a lot of "fun" figuring out

Re: Access solr in web browser

2016-10-18 Thread Mugeesh Husain
It is not about the information of collection while it about the accessibility, I want to access via putty session. -- View this message in context: http://lucene.472066.n3.nabble.com/Access-solr-in-web-browser-tp4301201p4301659.html Sent from the Solr - User mailing list archive at

solr 5.5.2 using omitNorms=False on multivalued fields

2016-10-18 Thread elisabeth benoit
Hello, I would like to score higher, or even better to sort documents with same text scores based on norm for instance, with query "a b d" document with a b d should score higher than (or appear before) document with a b c d The problem is my field is multivalued so omitNorms= False is

Re: SolrJ & Ridiculously Large Queries

2016-10-18 Thread Bram Van Dam
On 14/10/16 16:13, Shawn Heisey wrote: > name="solr.jetty.request.header.size" default="8192" /> A belated thanks, Shawn! 32k should be sufficient, I hope. - Bram

Re: Advice on implementing SOLR Cloud

2016-10-18 Thread John Bickerstaff
Excellent! Glad to know the efforts were useful to someone else. On Oct 17, 2016 11:20 PM, "Sadheera Vithanage" wrote: Thank you very much John, I fixed it. Your steps helped big time.. Thanks again.. On Tue, Oct 18, 2016 at 10:17 AM, John Bickerstaff