Re: how to update billions of docs

2016-03-24 Thread Mohsin Beg Beg
the field, you might be able to create another > > > core/container with that one field (plus the key field), and use join > > > support. > > > > > > Note that https://issues.apache.org/jira/browse/LUCENE-6352 is an > > > improvement, which looks like i

Re: how to update billions of docs

2016-03-20 Thread Ishan Chattopadhyaya
gt; see > > a fix version. > > > > -- Ken > > > > > From: Mohsin Beg Beg > > > Sent: March 16, 2016 3:52:47pm PDT > > > To: solr-user@lucene.apache.org > > > Subject: how to update billions of docs > > > > > > Hi, > > &g

Re: how to update billions of docs

2016-03-19 Thread Toke Eskildsen
Mohsin Beg Beg wrote: > I have a requirement to replace a value of a field in 100B's of docs > in 100's of cores. The field is multiValued=false docValues=true > type=StrField stored=true indexed=true. If this is just a simple one-time search-replace, then don't update the value in the index. In

Re: how to update billions of docs

2016-03-19 Thread sudsport s
I think there are no inplace updates in solr , that means updates behaves like inserts and marking old version deleted. so behaviors should be same as indexing billions of docs. On Wed, Mar 16, 2016 at 3:52 PM, Mohsin Beg Beg wrote: > Hi, > > I have a requirement to replace a value of a field in

Re: how to update billions of docs

2016-03-19 Thread Jack Krupansky
ohsin Beg Beg > > Sent: March 16, 2016 3:52:47pm PDT > > To: solr-user@lucene.apache.org > > Subject: how to update billions of docs > > > > Hi, > > > > I have a requirement to replace a value of a field in 100B's of docs in > 100's of c

Re: how to update billions of docs

2016-03-19 Thread Jack Krupansky
), and use join > > > support. > > > > > > Note that https://issues.apache.org/jira/browse/LUCENE-6352 is an > > > improvement, which looks like it's in the 5.x code line, though I don't > > see > > > a fix version. > > > > >

how to update billions of docs

2016-03-19 Thread Mohsin Beg Beg
Hi, I have a requirement to replace a value of a field in 100B's of docs in 100's of cores. The field is multiValued=false docValues=true type=StrField stored=true indexed=true. Atomic Updates performance is on the order of 5K docs per sec per core in solr 5.3 (other fields are quite big). An

RE: how to update billions of docs

2016-03-19 Thread Ken Krugler
/LUCENE-6352 is an improvement, which looks like it's in the 5.x code line, though I don't see a fix version. -- Ken > From: Mohsin Beg Beg > Sent: March 16, 2016 3:52:47pm PDT > To: solr-user@lucene.apache.org > Subject: how to update billions of docs > > Hi, > &g