Re: Updating fields in an existing document

2011-07-25 Thread Chris Hostetter
: A followup. The wiki has a whole discussion of the 'update' XML
: message. But solrj has nothing like it. Does that really exist? Is
: there a reason to use it? If I just 'add' the document a second time,
: it will replace?

You should only see update in Solr docs used in the context of 
updating the index by adding (which might be replacing) or deleting 
documents.  (you'll note there is no update tag or anything like that 
in the XML syntax) 


-Hoss


Re: Updating fields in an existing document

2011-07-25 Thread Benson Margulies
As in http://wiki.apache.org/solr/UpdateXmlMessages?

On Mon, Jul 25, 2011 at 4:10 PM, Chris Hostetter
hossman_luc...@fucit.org wrote:
 : A followup. The wiki has a whole discussion of the 'update' XML
 : message. But solrj has nothing like it. Does that really exist? Is
 : there a reason to use it? If I just 'add' the document a second time,
 : it will replace?

 You should only see update in Solr docs used in the context of
 updating the index by adding (which might be replacing) or deleting
 documents.  (you'll note there is no update tag or anything like that
 in the XML syntax)


 -Hoss



Re: Updating fields in an existing document

2011-07-25 Thread Grant Ingersoll
This is a pretty low level issue with inverted indexes (i.e. the underlying 
data structure used) and not so much the architecture.  It is possible, I 
suppose, to solve it at the architectural level, but in many cases this causes 
performance problems that are not usually acceptable.

On Jul 20, 2011, at 7:08 PM, Jonathan Rochkind wrote:

 Nope, you're not missing anything, there's no way to alter a document in an 
 index but reindexing the whole document. Solr's architecture would make it 
 difficult (although never say impossible) to do otherwise. But you're right 
 it would be convenient for people other than you. 
 
 Reindexing a single document ought not to be slow, although if you have many 
 of them at once it could be, or if you end up needing to very frequently 
 commit to an index it can indeed cause problems. 
 
 From: Benson Margulies [bimargul...@gmail.com]
 Sent: Wednesday, July 20, 2011 6:05 PM
 To: solr-user
 Subject: Updating fields in an existing document
 
 We find ourselves in the following quandry:
 
 At initial index time, we store a value in a field, and we use it for
 facetting. So it, seemingly, has to be there as a field.
 
 However, from time to time, something happens that causes us to want
 to change this value. As far as we know, this requires us to
 completely re-index the document, which is slow.
 
 It struck me that we can't be the only people to go down this road, so
 I write to inquire if we are missing something.

--
Grant Ingersoll





Re: Updating fields in an existing document

2011-07-25 Thread Chris Hostetter
: As in http://wiki.apache.org/solr/UpdateXmlMessages?

Exactly ... the title is XML Messages for Updating a Solr Index

But i do see some confusing usages of add/update in the context of 
documents that definitely don't belong there -- so i've changed them to 
add/replace. 

Thanks for bringing this up.

-Hoss


Re: Updating fields in an existing document

2011-07-22 Thread Marc SCHNEIDER
Yes that's it if you add twice the same document (ie with the same id) it
will replace it.

On Thu, Jul 21, 2011 at 7:46 PM, Benson Margulies bimargul...@gmail.comwrote:

 A followup. The wiki has a whole discussion of the 'update' XML
 message. But solrj has nothing like it. Does that really exist? Is
 there a reason to use it? If I just 'add' the document a second time,
 it will replace?

 On Wed, Jul 20, 2011 at 7:08 PM, Jonathan Rochkind rochk...@jhu.edu
 wrote:
  Nope, you're not missing anything, there's no way to alter a document in
 an index but reindexing the whole document. Solr's architecture would make
 it difficult (although never say impossible) to do otherwise. But you're
 right it would be convenient for people other than you.
 
  Reindexing a single document ought not to be slow, although if you have
 many of them at once it could be, or if you end up needing to very
 frequently commit to an index it can indeed cause problems.
  
  From: Benson Margulies [bimargul...@gmail.com]
  Sent: Wednesday, July 20, 2011 6:05 PM
  To: solr-user
  Subject: Updating fields in an existing document
 
  We find ourselves in the following quandry:
 
  At initial index time, we store a value in a field, and we use it for
  facetting. So it, seemingly, has to be there as a field.
 
  However, from time to time, something happens that causes us to want
  to change this value. As far as we know, this requires us to
  completely re-index the document, which is slow.
 
  It struck me that we can't be the only people to go down this road, so
  I write to inquire if we are missing something.
 



Re: Updating fields in an existing document

2011-07-21 Thread Benson Margulies
A followup. The wiki has a whole discussion of the 'update' XML
message. But solrj has nothing like it. Does that really exist? Is
there a reason to use it? If I just 'add' the document a second time,
it will replace?

On Wed, Jul 20, 2011 at 7:08 PM, Jonathan Rochkind rochk...@jhu.edu wrote:
 Nope, you're not missing anything, there's no way to alter a document in an 
 index but reindexing the whole document. Solr's architecture would make it 
 difficult (although never say impossible) to do otherwise. But you're right 
 it would be convenient for people other than you.

 Reindexing a single document ought not to be slow, although if you have many 
 of them at once it could be, or if you end up needing to very frequently 
 commit to an index it can indeed cause problems.
 
 From: Benson Margulies [bimargul...@gmail.com]
 Sent: Wednesday, July 20, 2011 6:05 PM
 To: solr-user
 Subject: Updating fields in an existing document

 We find ourselves in the following quandry:

 At initial index time, we store a value in a field, and we use it for
 facetting. So it, seemingly, has to be there as a field.

 However, from time to time, something happens that causes us to want
 to change this value. As far as we know, this requires us to
 completely re-index the document, which is slow.

 It struck me that we can't be the only people to go down this road, so
 I write to inquire if we are missing something.



Updating fields in an existing document

2011-07-20 Thread Benson Margulies
We find ourselves in the following quandry:

At initial index time, we store a value in a field, and we use it for
facetting. So it, seemingly, has to be there as a field.

However, from time to time, something happens that causes us to want
to change this value. As far as we know, this requires us to
completely re-index the document, which is slow.

It struck me that we can't be the only people to go down this road, so
I write to inquire if we are missing something.


RE: Updating fields in an existing document

2011-07-20 Thread Jonathan Rochkind
Nope, you're not missing anything, there's no way to alter a document in an 
index but reindexing the whole document. Solr's architecture would make it 
difficult (although never say impossible) to do otherwise. But you're right it 
would be convenient for people other than you. 

Reindexing a single document ought not to be slow, although if you have many of 
them at once it could be, or if you end up needing to very frequently commit to 
an index it can indeed cause problems. 

From: Benson Margulies [bimargul...@gmail.com]
Sent: Wednesday, July 20, 2011 6:05 PM
To: solr-user
Subject: Updating fields in an existing document

We find ourselves in the following quandry:

At initial index time, we store a value in a field, and we use it for
facetting. So it, seemingly, has to be there as a field.

However, from time to time, something happens that causes us to want
to change this value. As far as we know, this requires us to
completely re-index the document, which is slow.

It struck me that we can't be the only people to go down this road, so
I write to inquire if we are missing something.