Re: Indexing with customized parameters

Emir Thanks, Perfect On Thu, 12 Dec 2019 at 13:40, Emir Arnautović wrote: > Hi Anuj, > Maybe I am missing something but this is more question for some SQL group > than for Solr group. I am surprised that you get any records. You can > consult your DB documentation for some more elegant

Sometimes searching slow in Solr 6.1.0

We have 2 shards and 2 replicas in our live environment. Total of 26 collections. we give 64GB RAM for a single Solr instance. I have faced a slow searching issue in our live environment. In our scenario, there are many update requests come within minutes like 50,000. At that time searching

Re: Atomic solrj update

On 12/12/2019 10:00 PM, Prem wrote: I am trying to partially update of 50M data in a collection from CSV using Atomic script(solrj).But it is taking 2 hrs for 1M records.is there anyway i can speed up my update. How many documents are you sending in one request? Using HTTPClient to establish

Re: Atomic solrj update

One needs to see the code or get more insights on your design. Do you reuse the HTTPClient or do you create for every request a new one? How often do you commit? Do you do parallel updates from the client (multiple threads?). > Am 13.12.2019 um 06:56 schrieb Prem : > > I am trying to partially

Atomic solrj update

I am trying to partially update of 50M data in a collection from CSV using Atomic script(solrj).But it is taking 2 hrs for 1M records.is there anyway i can speed up my update. Using HTTPClient to establish connection and also i am validating whether the particular document is available in

Re: A question of solr recovery

Thank you @Erick Erickson for your explanation! (although I don't fully understand all details  ). I am using Solr 6.6, so I think there is only NRT replica in this version, and I understand the whole recovery process now. Maybe I will upgrade to Solr 7+ in future, and try the new TLOG/PULL

Re: Solr8 changes how security.json restricts access to GUI

Attachments are stripped from list, can you post a link to the screenshot of the UI when you first visit? Jan > 12. des. 2019 kl. 17:27 skrev Oakley, Craig (NIH/NLM/NCBI) [C] > : > > Below is the security.json (with password hashes redacted): in Solr7.4 it > prompts for a password and (if

Re: Facing jwt authentication problem using solr 8.1.1

Try something like this https://gist.github.com/b330e1bea7842bcdc1e5fa3940b4a4f7 The trick is to «whitelist» certain paths that will not require auth, but then further down add rules to block all other paths either as admin role or

RE: Solr8 changes how security.json restricts access to GUI

Below is the security.json (with password hashes redacted): in Solr7.4 it prompts for a password and (if you get it right) lets you into the whole GUI; But in Solr8.1.1 and in Solr 8.3, it does not prompt for a password before letting you into a crippled version of the GUI (as depicted in the

Re: backing up and restoring

I was able to successfully restore a backup by specifying name and location in the restore command. But now when i try to run: sudo -u solr curl http://localhost:8983/solr/debt/update -H "Content-type: text/xml" --data-binary '*:*' I get the following error: no segments* file found in

Re: A question of solr recovery

On 12/12/2019 8:53 AM, Shawn Heisey wrote: I do not think the replication handler deals with tlog files at all. The transaction log capability did not exist when the replication handler was built. I may have mixed up your message with a different one. Looking back over this, I don't see any

Re: A question of solr recovery

On 12/12/2019 3:37 AM, Hongxu Ma wrote: And I found my "full sync" log: "IndexFetcher Total time taken for download (fullCopy=true,bytesDownloaded=178161685180) : 4377 secs (40704063 bytes/sec) to NIOFSDirectory@..." A more question: Form the log, looks it downloaded all segment files

Re: backing up and restoring

This page seems to indicate that I should copy the files from the backup directory back into the index? Is this accurate? https://codice.atlassian.net/wiki/spaces/DDF22/pages/2785407/Solr+Standalone+Server+Backup Thanks, Rhys

Re: backing up and restoring

On Thu, Dec 12, 2019 at 3:49 AM sudhir kumar wrote: > once you backup index with some location, you have to specify the same > location to restore. > > ie in your case /tmp/solr is the location indexed was backed up , use same > location for restore. > > you did not provide name so latest

Re: JSON Facet doesn't allow date range facets

Searching on a single point in time would be extremely limiting because it has millisecond precision. So range queries would be the only real way to search the DatePointField. I've used this construct many times on the DatePointField: [2000-05-01T00:00:01Z TO 2019-06-02T00:00:01Z] Joel

Re: JSON Facet doesn't allow date range facets

I need to store date ranges in the index. While DatePointField can be queried using date ranges, the actual value can only be a single date - it can't represent a range of dates as far as I know. On 12/12/2019 12:11, Joel Bernstein wrote: So something like this should work:

Re: JSON Facet doesn't allow date range facets

So something like this should work: [2000-05-01T00:00:01Z TO 2019-06-02T00:00:01Z] Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Dec 12, 2019 at 7:08 AM Joel Bernstein wrote: > With the DatePointField you can still do the range query, but I believe > you'll need to specify the full

Re: JSON Facet doesn't allow date range facets

With the DatePointField you can still do the range query, but I believe you'll need to specify the full ISO date string: 2000-05-01T01:01:01Z Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Dec 12, 2019 at 6:46 AM Mel Mason wrote: > Unfortunately I need a date range field, e.g

Re: JSON Facet doesn't allow date range facets

Unfortunately I need a date range field, e.g [2000-05-01 TO 2019-06-02]. DatePointFields can't represent that as far as I know. On 12/12/2019 11:40, Joel Bernstein wrote: There is a field type in the schema called pdate: This should work for you. The timeseries Streaming Expression uses

Re: JSON Facet doesn't allow date range facets

There is a field type in the schema called pdate: This should work for you. The timeseries Streaming Expression uses the JSON facet API for range faceting and works really well. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Dec 12, 2019 at 6:28 AM Mel Mason wrote: > Hi, > > I'm

Re: JSON Facet doesn't allow date range facets

Currently, it is not supported yet. Related JIRA - https://issues.apache.org/jira/browse/SOLR-10567 Regards, Munendra S N On Thu, Dec 12, 2019 at 4:58 PM Mel Mason wrote: > Hi, > > I'm trying to have a range facet on a field of type solr.DateRangeField. > As far as I can tell, this isn't

JSON Facet doesn't allow date range facets

Hi, I'm trying to have a range facet on a field of type solr.DateRangeField. As far as I can tell, this isn't possible with JSONFacet, only with the old facet system - a quick google turns up several other people with the same problem. When using JSONFacet I get problems with this line of

Re: A question of solr recovery

Thank you very much @Erick Erickson It's very clear. And I found my "full sync" log: "IndexFetcher Total time taken for download (fullCopy=true,bytesDownloaded=178161685180) : 4377 secs (40704063 bytes/sec) to NIOFSDirectory@..." A more question: Form the log,

Re: backing up and restoring

Hi Rhyhs, once you backup index with some location, you have to specify the same location to restore. ie in your case /tmp/solr is the location indexed was backed up , use same location for restore. you did not provide name so latest snapshot will be restored. curl '

Re: Indexing with customized parameters

Hi Anuj, Maybe I am missing something but this is more question for some SQL group than for Solr group. I am surprised that you get any records. You can consult your DB documentation for some more elegant solution, but a brute-force solution, if your column is string, could be: WHERE sector =

Facing jwt authentication problem using solr 8.1.1

Hi, Using solr 8.1.1 version and facing problem while enabling jwt authentication in solr. Jwt authentication is working fine after configuring security.json file. Below is the configuration I am using for enabling jwt authentication. Security.json { "authentication":{