Re: DIH and duplicate content

2011-01-27 Thread Markus Jelsma
http://wiki.apache.org/solr/Deduplication On Thursday 27 January 2011 12:32:29 Rosa (Anuncios) wrote: > Is there a way to avoid duplicate content in a index at the moment i'm > uploading my xml feed via DIH? > > I would like to have only one entry for a given description.

DIH and duplicate content

2011-01-27 Thread Rosa (Anuncios)
Hi, Is there a way to avoid duplicate content in a index at the moment i'm uploading my xml feed via DIH? I would like to have only one entry for a given description. I mean if the desciption of one product already exist in index not import this new product. Is there a built in fun

Re: Duplicate content

2008-07-18 Thread Chris Hostetter
: > Is really unique if we allow duplicates? I had similar : > problem... : > : : if you allowDups, then uniqueKey may not be unique... allowDups is one of those features where Solr not only gives you enough rope to hang yourself, but Solr also ties the rope into a knot, cust some lumber, an

Re: Duplicate content

2008-07-15 Thread Ryan McKinley
TED]>: On Jul 15, 2008, at 2:45 AM, Sunil wrote: Hi All, I want to change the duplicate content behavior in solr. What I want to do is: 1) I don't want duplicate content. 2) I don't want to overwrite old content with new one. Means, if I add duplicate content in solr and the conten

Re: Duplicate content

2008-07-15 Thread Fuad Efendi
Thanks Ryan, Is really unique if we allow duplicates? I had similar problem... Quoting Ryan McKinley <[EMAIL PROTECTED]>: On Jul 15, 2008, at 2:45 AM, Sunil wrote: Hi All, I want to change the duplicate content behavior in solr. What I want to do is: 1) I don't want duplic

Re: Duplicate content

2008-07-15 Thread Ryan McKinley
On Jul 15, 2008, at 2:45 AM, Sunil wrote: Hi All, I want to change the duplicate content behavior in solr. What I want to do is: 1) I don't want duplicate content. 2) I don't want to overwrite old content with new one. Means, if I add duplicate content in solr and the conte

RE: Duplicate content

2008-07-15 Thread Sunil
Thanks guys. -Original Message- From: Norberto Meijome [mailto:[EMAIL PROTECTED] Sent: Tuesday, July 15, 2008 2:35 PM To: solr-user@lucene.apache.org Subject: Re: Duplicate content On Tue, 15 Jul 2008 10:48:14 +0200 Jarek Zgoda <[EMAIL PROTECTED]> wrote: > >> 2)

Re: Duplicate content

2008-07-15 Thread Norberto Meijome
On Tue, 15 Jul 2008 10:48:14 +0200 Jarek Zgoda <[EMAIL PROTECTED]> wrote: > >> 2) I don't want to overwrite old content with new one. > >> > >> Means, if I add duplicate content in solr and the content already > >> exists, the old content should no

Re: Duplicate content

2008-07-15 Thread Jarek Zgoda
Norberto Meijome pisze: >> 2) I don't want to overwrite old content with new one. >> >> Means, if I add duplicate content in solr and the content already >> exists, the old content should not be overwritten. > > before inserting a new document, query the index

Re: Duplicate content

2008-07-15 Thread Norberto Meijome
On Tue, 15 Jul 2008 13:15:41 +0530 "Sunil" <[EMAIL PROTECTED]> wrote: > 1) I don't want duplicate content. SOLR uses the field you define as the unique field to determine whether a document should be replaced or added. The rest of the fields are in your hands. You coul

Re: Duplicate content

2008-07-15 Thread Noble Paul നോബിള്‍ नोब्ळ्
You must do a check before adding documents On Tue, Jul 15, 2008 at 1:15 PM, Sunil <[EMAIL PROTECTED]> wrote: > Hi All, > > I want to change the duplicate content behavior in solr. What I want to > do is: > > 1) I don't want duplicate content. > 2) I don't w

Duplicate content

2008-07-15 Thread Sunil
Hi All, I want to change the duplicate content behavior in solr. What I want to do is: 1) I don't want duplicate content. 2) I don't want to overwrite old content with new one. Means, if I add duplicate content in solr and the content already exists, the old content should not be o