Re: [OT] 20180917-Need Apache SOLR support

2018-09-18 Thread Jan Høydahl
I guess you could do a version-independent backup with /export handler and store docs in XML or JSON format. Or you could use streaming and store the entire index as JSON tuples, which could then be ingested into another version. But it is correct that the backup/restore feature of Solr is not

Re: [OT] 20180917-Need Apache SOLR support

2018-09-18 Thread Erick Erickson
The only hard-and-fast rule is that you must re-index from source when you upgrade to Solr X+2. Solr (well, Lucene) tries very hard to maintain one-major-version back-compatibility, so Solr 8 will function with Solr 7 indexes but _not_ any index _ever touched_ by 6x. That said, it's usually a

Re: [OT] 20180917-Need Apache SOLR support

2018-09-18 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Walter, On 9/18/18 11:24, Walter Underwood wrote: > It isn’t very clear from that page, but the two backup methods make > a copy of the indexes in a commit-aware way. That is all. One > method copies them to a new server, the other to files in the

Re: [OT] 20180917-Need Apache SOLR support

2018-09-18 Thread Walter Underwood
It isn’t very clear from that page, but the two backup methods make a copy of the indexes in a commit-aware way. That is all. One method copies them to a new server, the other to files in the data directory. Database backups generally have a separate backup format which is independent of the

Re: [OT] 20180917-Need Apache SOLR support

2018-09-18 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Walter, On 9/17/18 11:39, Walter Underwood wrote: > Do not use Solr as a database. It was never designed to be a > database. It is missing a lot of features that are normal in > databases. > > [...] * no real backups (Solr backup is a cold server,

RE: 20180917-Need Apache SOLR support

2018-09-18 Thread Liu, Daphne
Sent: Tuesday, September 18, 2018 3:12 AM To: solr-user@lucene.apache.org Subject: Re: 20180917-Need Apache SOLR support I have 6 machines,and each machine run a solr server, each solr server use RAM 18GB. Total document number is 3.2billion,1.4TB , my collection‘s replica factor is 1。collection

Re: 20180917-Need Apache SOLR support

2018-09-18 Thread Shawn Heisey
On 9/18/2018 1:11 AM, zhenyuan wei wrote: I have 6 machines,and each machine run a solr server, each solr server use RAM 18GB. Total document number is 3.2billion,1.4TB , my collection‘s replica factor is 1。collection shard number is 60,currently each shard is 20~30GB。 15 fields per document。

Re: 20180917-Need Apache SOLR support

2018-09-18 Thread zhenyuan wei
I have 6 machines,and each machine run a solr server, each solr server use RAM 18GB. Total document number is 3.2billion,1.4TB , my collection‘s replica factor is 1。collection shard number is 60,currently each shard is 20~30GB。 15 fields per document。 Query rate is slow now,maybe 100-500

Re: 20180917-Need Apache SOLR support

2018-09-17 Thread Shawn Heisey
On 9/17/2018 9:05 PM, zhenyuan wei wrote: Is that means: Small amount of shards gains better performance? I also have a usecase which contains 3 billion documents,the collection contains 60 shard now. Is that 10 shard is better than 60 shard? There is no definite answer to this question.  It

Re: 20180917-Need Apache SOLR support

2018-09-17 Thread zhenyuan wei
Is that means: Small amount of shards gains better performance? I also have a usecase which contains 3 billion documents,the collection contains 60 shard now. Is that 10 shard is better than 60 shard? Shawn Heisey 于2018年9月18日周二 上午12:04写道: > On 9/17/2018 7:04 AM, KARTHICKRM wrote: > > Dear

Re: 20180917-Need Apache SOLR support

2018-09-17 Thread Ere Maijala
Shawn Heisey kirjoitti 17.9.2018 klo 19.03: 7.   If I have Billions of indexes, If the "start" parameter is 10th Million index and "end" parameter is  start+100th index, for this case any performance issue will be raised ? Let's say that you send a request with these parameters, and

Re: 20180917-Need Apache SOLR support

2018-09-17 Thread Shawn Heisey
On 9/17/2018 7:04 AM, KARTHICKRM wrote: Dear SOLR Team, We are beginners to Apache SOLR, We need following clarifications from you. Much of what I'm going to say is a mirror of what you were already told by Jan.  All of Jan's responses are good. 1. In SOLRCloud, How can we install

Re: 20180917-Need Apache SOLR support

2018-09-17 Thread Walter Underwood
Do not use Solr as a database. It was never designed to be a database. It is missing a lot of features that are normal in databases. * no transactions * no rollback (in Solr Cloud) * no session isolation (one client’s commit will commit all data in progress) * no schema migration * no version

Re: 20180917-Need Apache SOLR support

2018-09-17 Thread Susheel Kumar
I'll highly advice if you can use Java library/SolrJ to connect to Solr than .Net. There are many things taken care by CloudSolrClient and other classes when communicated with Solr Cloud having shards/replica's etc and if your .Net port for SolrJ are not up to date/having all the functionality

Re: 20180917-Need Apache SOLR support

2018-09-17 Thread Jan Høydahl
> We are beginners to Apache SOLR, We need following clarifications from you. > > > > 1. In SOLRCloud, How can we install more than one Shared on Single PC? You typically have one installation of Solr on each server. Then you can add a collection with multiple shards, specifying how

20180917-Need Apache SOLR support

2018-09-17 Thread KARTHICKRM
Dear SOLR Team, We are beginners to Apache SOLR, We need following clarifications from you. 1. In SOLRCloud, How can we install more than one Shared on Single PC? 2. How many maximum number of shared can be added under on SOLRCloud? 3. In my application there is no