Re: Getting dynamic fields using LukeRequest.

2016-08-09 Thread Pranaya Behera
Hi Steve, I did look at the schema api but it only gives the defined dynamic fields not the indexed dynamic fields. For indexed fields with the rule of the defined dynamic field I guess LukeRequest is the only option. (Please correct me if I am wrong.) Hence I am unable to

Re: How to re-index SOLR data

2016-08-09 Thread Erick Erickson
Assuming you can re-index Consider "collection aliasing". Say your current collection is C1. Create C2 (using the same cluster, Zookeeper and the like). Go ahead and index to C2 (however you do that). NOTE: the physical machines may be _different_ than C1, or not. That's up to you. The

Re: commit it taking 1300 ms

2016-08-09 Thread Midas A
Thanks for replying index size:9GB 2000 docs/sec. Actually earlier it was taking less but suddenly it has increased . Currently we do not have any monitoring tool. On Tue, Aug 9, 2016 at 7:00 PM, Emir Arnautovic < emir.arnauto...@sematext.com> wrote: > Hi Midas, > > Can you give us more

Re: The Query Elevation Component

2016-08-09 Thread Ryan Yacyshyn
Hi Alessandro, My mistake, I thought for a second there that the elevation component needed to actually searches through documents, which isn't the case. Thanks, Ryan On Wed, 27 Jul 2016 at 19:15 Alessandro Benedetti wrote: > Hi Ryan, > can you explain this ? > "

RE: Solr Cloud with 5 servers cluster failed due to Leader out of memory

2016-08-09 Thread Tim Chen
Guys, (@Erick & @Shawn), Thanks for the great suggestions! I have increased Tomcat MaxThreads from 200 to 1 on our staging environment. So far so good. I will perform some more indexing test and see how it goes. Many thanks, Tim -Original Message- From: Shawn Heisey

Re: Solr and Drupal

2016-08-09 Thread Alexandre Rafalovitch
I have this links from my - random - collection: http://www.jeffgeerling.com/blog/2016/hosted-apache-solr-drupal-8-support (has several pre-history articles cross-linked as well) https://www.youtube.com/watch?v=2yDwbqPwW9M - Markus Kalkbrenner, Nick Veenhof | The State of Search API Solr and

Re: How to re-index SOLR data

2016-08-09 Thread John Bickerstaff
In my case, I've done two things neither of them involved taking the data from SOLR to SOLR... although in my reading, I've seen that this is theoretically possible (I.E. sending data from one SOLR server to another SOLR server and having the second SOLR instance re-index...) I haven't

Re: How to re-index SOLR data

2016-08-09 Thread Bharath Kumar
Hi John, Thanks so much for your inputs. We have time to build another system. So how did you index the same data on the main SOLR node to the new SOLR node? Did you use the re-index python script? The new data will be indexed correctly with the new rules, but what about the old data? Our SOLR

Re: Unique key field type in solr 6.1 schema

2016-08-09 Thread Bharath Kumar
Hi Daniel, Thanks so much for your inputs. I tried this with SOLR 6.1.0 fresh data and if i use id field as long, the target site is not able to replay the transaction when we use delete by id. I opened a ticket in JIRA - https://issues.apache.org/jira/browse/SOLR-9394. Below is the exception on

Re: How to re-index SOLR data

2016-08-09 Thread John Bickerstaff
In case this helps... Assuming you have the resources to build a copy of your production environment and assuming you have the time, you don't need to take your production down - or even affect it's processing... What I've done (with admittedly smaller data sets) is build a separate environment

Re: Solr DeleteByQuery vs DeleteById

2016-08-09 Thread Bharath Kumar
Hi Danny and Daniel, Thank you so much for your inputs. Actually we use deleteByIds, but because we need the CDCR solution to work for us, we are having issues when we use deleteById. The deleteById logs a transaction in the transaction logs and that when passed over to the target site, the CDCR

Re: How to re-index SOLR data

2016-08-09 Thread Bharath Kumar
Hi Nick and Shawn, Thanks so much for the pointers. I will try that out. Thank you again! On Tue, Aug 9, 2016 at 9:40 AM, Nick Vasilyev wrote: > Hi, I work on a python Solr Client > library and there is a > reindexing

Re: Need Permission to commit feature branch for Pull Request SOLR-8146

2016-08-09 Thread Jan Høydahl
Hi, You need to create the feature branch in your own fork of the project, not in a clone of apache/lucene-solr. Please see http://wiki.apache.org/solr/HowToContribute#Working_with_GitHub -- Jan Høydahl, search solution

RE: Solr and Drupal

2016-08-09 Thread Davis, Daniel (NIH/NLM) [C]
John/Rose, With Drupal 7, the module John pointed to was the module to use. With Drupal 8, I have no idea. -Original Message- From: John Bickerstaff [mailto:j...@johnbickerstaff.com] Sent: Tuesday, August 09, 2016 2:38 PM To: solr-user@lucene.apache.org Subject: Re: Solr and Drupal

Re: Solr and Drupal

2016-08-09 Thread Rose, John B
Ok thanks. On 8/9/16, 2:38 PM, "John Bickerstaff" wrote: >Rose -- > >Further reading on the drupal site suggests to me that the latest Drupal >(8?) comes with a generic "connector" that can be tied to any search engine >and that the instructions on the page I sent may

Re: Solr and Drupal

2016-08-09 Thread John Bickerstaff
Rose -- Further reading on the drupal site suggests to me that the latest Drupal (8?) comes with a generic "connector" that can be tied to any search engine and that the instructions on the page I sent may be superseded by the new connector... I'm not familiar with Drupal beyond simple

Fwd: Getting dynamic fields using LukeRequest.

2016-08-09 Thread Pranaya Behera
Forwarded Message Subject:Getting dynamic fields using LukeRequest. Date: Tue, 9 Aug 2016 18:22:15 +0530 From: Pranaya Behera To: solr-user@lucene.apache.org Hi, I have the following script to retrieve all the fields in the

Re: Solr and Drupal

2016-08-09 Thread Rose, John B
Sameer, John Thanks From: Sameer Maggon Reply-To: "solr-user@lucene.apache.org" Date: Tuesday, August 9, 2016 at 1:46 PM To: "solr-user@lucene.apache.org" Subject: Re: Solr and Drupal Hi John, As John B.

Re: Solr Cloud with 5 servers cluster failed due to Leader out of memory

2016-08-09 Thread Shawn Heisey
On 8/8/2016 11:09 AM, Ritesh Kumar (Avanade) wrote: > This is great but where can I do this change in SOLR 6 as I have > implemented CDCR. In Solr 6, the chance of using Tomcat will be near zero, and the maxThreads setting in Solr's Jetty config should already be set to 1. If you're seeing

Re: Solr and Drupal

2016-08-09 Thread Sameer Maggon
Hi John, As John B. mentioned, you can utilize the plugin here - https://www.drupal.org/project/apachesolr. If you are looking to not have to worry

Re: Solr and Drupal

2016-08-09 Thread John Bickerstaff
This might be a good place to start... https://www.drupal.org/project/apachesolr On Tue, Aug 9, 2016 at 11:11 AM, Rose, John B wrote: > We are looking at Solr for a Drupal web site. We have never installed Solr. > > > From my readings it is not clear exactly what we need to

Modifying fl in QParser

2016-08-09 Thread Beale, Jim (US-KOP)
Hi, Is it possible to modify the SolrParam, fl, to append selected dynamic fields, while rewriting a query in QParser.parse()? Thanks in advance! Jim Beale Senior Lead Developer 2201 Renaissance Boulevard, King of Prussia, PA, 19406 Mobile: 610-220-3067 [cid:image001.png@01CD6E5F.BE5E6C20]

Solr and Drupal

2016-08-09 Thread Rose, John B
We are looking at Solr for a Drupal web site. We have never installed Solr. >From my readings it is not clear exactly what we need to implement a search in >Drupal with Solr. Some sites have implied Lucene and/or Tomcat are needed. Can someone point me to the site that explains minimally what

Help for -- Filter in the text field + highlight + no affect on boosting(if done with q instead of fq)

2016-08-09 Thread Raleraskar, Mayur
Hi All, I am using Solr for search functionality here @ eBay reviews team. I need to implement search functionality with q parameter but do not want it, to affect boosting or relevancy. How can I achieve that? Effectively I want it perform just like a filter. My query is like

Re: Can a MergeStrategy filter returned docs?

2016-08-09 Thread tedsolr
After some more digging I've learned that the Query gets called more than once on the same shard, but with a different shard purpose. I don't understand the flow, but I assume that one call is triggering the transform() via a path that does not pass through the document collector. I also don't

Re: How to re-index SOLR data

2016-08-09 Thread Nick Vasilyev
Hi, I work on a python Solr Client library and there is a reindexing helper module that you can use if you are on Solr 4.9+. I use it all the time and I think it works pretty well. You can re-index all documents from a collection into another

Re: Solr DeleteByQuery vs DeleteById

2016-08-09 Thread Daniel Collins
Seconding that point, we currently do DBQ to "tidy" some of our collections and time-bound them (so running "delete anything older than X"). They have similar issues with reordering and blocking from time to time. On 9 August 2016 at 14:20, danny teichthal wrote: > Hi

Re: Unique key field type in solr 6.1 schema

2016-08-09 Thread Daniel Collins
This vaguely rings a bell, though from a long time ago. We had our id field using the "lowercase" type in Solr, and that broke/changed somewhere in the 4.x series (we are on 4.8.1 now and it doesn't work there), so we have to revert to a simple "string" type instead. I know you have a very

Re: Returning parent's field which searching for child

2016-08-09 Thread Zheng Lin Edwin Yeo
If I drop childNo_s:123456 part, the result will return both parent and child, which is what I want. But this will match all the children, since the only filter now is contentType:child. It didn't work if I put only childNo_s:123456 and remove the contentType:child part. Regards, Edwin On 9

Re: Does solr support two phase commit or any other distributed transaction protocol?

2016-08-09 Thread Pablo Anzorena
Thanks Shawn, I understood perfectly well. One important thing in my use case is that I only have one entry point for indexing solr, so I won't have any problems of multiple threads trying to update the index. So what can I do if I have to index in solr and also in postgres and I need to do it

Re: Does solr support two phase commit or any other distributed transaction protocol?

2016-08-09 Thread Walter Underwood
Solr does not have transactions. A batch is submitted, then processed. The command to process the batch is named “commit”, but it isn’t very much like a database commit. Batch submissions are not isolated between clients. If three batches are being submitted at the same time, a commit command

Need Permission to commit feature branch for Pull Request SOLR-8146

2016-08-09 Thread Susheel Kumar
Hello, I created a feature branch for SOLR-8146 that i can submit a pull request (PR) for review. While pushing the feature branch i am getting below error. My github id is susheel2...@gmail.com Thanks, Susheel lucene-solr git:(SOLR-8146) git push origin SOLR-8146 Username for

Re: Does solr support two phase commit or any other distributed transaction protocol?

2016-08-09 Thread Shawn Heisey
On 8/9/2016 7:55 AM, Pablo Anzorena wrote: > That's it. Thanks. Solr doesn't support transactions in the way that most people with a database background imagine them. With a typical database server, all changes to the database that happen on a single DB connection can be committed or rolled back

Re: Custom SearchHandler with custom QueryResponseWriter

2016-08-09 Thread Alexandre Rafalovitch
Where did you put the jar that contains those custom classes? Perhaps they are not being loaded. Is there an error message in the logs? Are you doing this in standalone Solr or in a cloud-mode? Regards, Alex. Newsletter and resources for Solr beginners and intermediates:

Re: Returning parent's field which searching for child

2016-08-09 Thread Mikhail Khludnev
I wonder why {!parent} doesn't have subordinate clause. I suggest to drop childNo_s:123456 part of child filter just to get something to start from. On Tue, Aug 9, 2016 at 4:09 PM, Zheng Lin Edwin Yeo wrote: > Hi Mikhail, > > Thanks for your reply. > I tried this, but it

Re: Getting dynamic fields using LukeRequest.

2016-08-09 Thread Steve Rowe
Not sure what the issue is with LukeRequest, but Solrj has Schema API support: You can see which options are supported here:

Re: How to re-index SOLR data

2016-08-09 Thread Shawn Heisey
On 8/9/2016 1:48 AM, bharath.mvkumar wrote: > What would be the best way to re-index the data in the SOLR cloud? We > have around 65 million data and we are planning to change the schema > by changing the unique key type from long to string. How long does it > take to re-index 65 million documents

Does solr support two phase commit or any other distributed transaction protocol?

2016-08-09 Thread Pablo Anzorena
That's it. Thanks.

Re: commit it taking 1300 ms

2016-08-09 Thread Emir Arnautovic
Hi Midas, Can you give us more details on your index: size, number of new docs between commits. Why do you think 1.3s for commit is to much and why do you need it to take less? Did you do any system/Solr monitoring? Emir On 09.08.2016 14:10, Midas A wrote: please reply it is urgent. On

Re: Solr DeleteByQuery vs DeleteById

2016-08-09 Thread danny teichthal
Hi Bharath, I'm no expert, but we had some major problems because of deleteByQuery ( in short DBQ). We ended up replacing all of our DBQ to delete by ids. My suggestion is that if you don't realy need it - don't use it. Especially in your case, since you already know the population of ids, it is

Re: Returning parent's field which searching for child

2016-08-09 Thread Zheng Lin Edwin Yeo
Hi Mikhail, Thanks for your reply. I tried this, but it only returns the parent's record and not the child record.

Getting dynamic fields using LukeRequest.

2016-08-09 Thread Pranaya Behera
Hi, I have the following script to retrieve all the fields in the collection. I am using SolrCloud 6.1.0. LukeRequest lukeRequest = new LukeRequest(); lukeRequest.setNumTerms(0); lukeRequest.setShowSchema(false); LukeResponse lukeResponse = lukeRequest.process(cloudSolrClient); Map

Re: commit it taking 1300 ms

2016-08-09 Thread Midas A
please reply it is urgent. On Tue, Aug 9, 2016 at 11:17 AM, Midas A wrote: > Hi , > > commit is taking more than 1300 ms . what should i check on server. > > below is my configuration . > > ${solr.autoCommit.maxTime:15000} < > openSearcher>false >

Re: Returning parent's field which searching for child

2016-08-09 Thread Mikhail Khludnev
Hello Edwin, Have you tried to combine q={!parent ..}... =*,[child ...] ? On Tue, Aug 9, 2016 at 12:59 PM, Zheng Lin Edwin Yeo wrote: > Hi, > > Would like to check, is it possible to return certain fields from parent's > record, when we are searching for fields that are

Custom SearchHandler with custom QueryResponseWriter

2016-08-09 Thread Markus Boese
Hello everyone, I'm trying use my QueryResponseWriter with my SearchHandler, but the write(...)-Method of my QueryResponseWriter is not called. Excerpt of my sorlconfig.xml: wwWriter ww_search_key 10

Returning parent's field which searching for child

2016-08-09 Thread Zheng Lin Edwin Yeo
Hi, Would like to check, is it possible to return certain fields from parent's record, when we are searching for fields that are only contained in child records. For example, for this query: http://localhost:8983/solr/collection1/select?q=childField:123 The child field can only be found in

Antw: Backup And Restore

2016-08-09 Thread Rainer Gnan
Hi Hardika, the ASG says that a "shared drive" is necessary. Probably you have to install a NFS server. Best regards, Rainer Rainer Gnan Bayerische Staatsbibliothek BibliotheksVerbund Bayern Verbundnahe Dienste 80539 München Tel.:

Unique key field type in solr 6.1 schema

2016-08-09 Thread bharath.mvkumar
Hi All, I have an issue with cross data center replication, when we delete the document by id from the main site. The target site document is not deleted. I have the id field which is a unique field for my schema which is configured as "long". If i change the type to "string" it works fine. Is

Solr CDCR delete document issue on target site

2016-08-09 Thread bharath.mvkumar
Hi All, I am using the cdcr solution available in SOLR 6.1 and i have setup the cross data center replication on both the sites. When i add and update documents on the main site, the data is replicated to the target site with no issues. But when i delete a document on the main site, i see the

How to re-index SOLR data

2016-08-09 Thread bharath.mvkumar
Hi All, What would be the best way to re-index the data in the SOLR cloud? We have around 65 million data and we are planning to change the schema by changing the unique key type from long to string. How long does it take to re-index 65 million documents in SOLR and can you please suggest how to

Backup And Restore

2016-08-09 Thread Hardika Catur S
Hi, I will create a snapshot on solr backup and restore, but the process error and finding errors like this : org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Unable to create snapshot directory: /root/backup/snapshot.20160809065729143 Please help me to find a