Re: Would changing the schema version from 1.5 to 1.6 require a reindex

[Paras Lehana]

Hi Karl,

Maybe someone else could help if reindexing is needed if we upgrade Schema
version. However, I guess, useDocValuesAsStored only impacts the query side
assuming docValues had already been stored during indexing. It's actually
easier to try querying the fields after enabling this parameter and see if
that works without reindexing!


On Thu, 13 Feb 2020 at 14:21, Karl Stoney
 wrote:

> Hey,
> I’m going to bump our schema version from 1.5 to 1.6 to get the implicit
> useDocValuesAsStored=true, would this require a reindex?
>
> Thanks
> Karl
> This e-mail is sent on behalf of Auto Trader Group Plc, Registered Office:
> 1 Tony Wilson Place, Manchester, Lancashire, M15 4FN (Registered in England
> No. 9439967). This email and any files transmitted with it are confidential
> and may be legally privileged, and intended solely for the use of the
> individual or entity to whom they are addressed. If you have received this
> email in error please notify the sender. This email message has been swept
> for the presence of computer viruses.
>


-- 
-- 
Regards,

*Paras Lehana* [65871]
Development Engineer, *Auto-Suggest*,
IndiaMART InterMESH Ltd,

11th Floor, Tower 2, Assotech Business Cresterra,
Plot No. 22, Sector 135, Noida, Uttar Pradesh, India 201305

Mob.: +91-9560911996
Work: 0120-4056700 | Extn:
*11096*

-- 
*
*

 

Would changing the schema version from 1.5 to 1.6 require a reindex

[Karl Stoney]

Hey,
I’m going to bump our schema version from 1.5 to 1.6 to get the implicit 
useDocValuesAsStored=true, would this require a reindex?

Thanks
Karl
This e-mail is sent on behalf of Auto Trader Group Plc, Registered Office: 1 
Tony Wilson Place, Manchester, Lancashire, M15 4FN (Registered in England No. 
9439967). This email and any files transmitted with it are confidential and may 
be legally privileged, and intended solely for the use of the individual or 
entity to whom they are addressed. If you have received this email in error 
please notify the sender. This email message has been swept for the presence of 
computer viruses.

Re: Changing Solr Schema with Data

[Salman Ansari]

Thanks.

Salman

On Tue, Dec 29, 2015 at 9:33 PM, Binoy Dalal  wrote:

> What shalin says is solid and will work with solr 5.x as well as 3.x
> You could do a little poc if you want to be absolutely certain. Shouldn't
> take you very long.
> Your only concern will be that your old docs won't be matched against
> queries matched against the newly added fields.
>
> On Tue, 29 Dec 2015, 23:38 Salman Ansari  wrote:
>
> > Thanks guys for your responses.
> >
> > @Shalin: Do you have a documentation that explains this? Moreover, is it
> > only for Solr 5+ or is it still applicable to Solr 3+? I am asking this
> as
> > I am working in a team and in some of our projects we are using old Solr
> > versions and I need to convince the guys that this is possible in the old
> > Solr as well.
> >
> > Thanks for your help.
> >
> > Regards,
> > Salman
> >
> >
> > On Tue, Dec 29, 2015 at 9:44 AM, Shalin Shekhar Mangar <
> > shalinman...@gmail.com> wrote:
> >
> > > Adding new fields is not a problem. You can continue to use your
> > > existing index with the new schema.
> > >
> > > On Tue, Dec 29, 2015 at 1:58 AM, Salman Ansari <
> salman.rah...@gmail.com>
> > > wrote:
> > > > You can say that we are not removing any fields (so the old data
> should
> > > not
> > > > get affected), however, we need to add new fields (which new data
> will
> > > > have). Does that answer your question?
> > > >
> > > >
> > > > Regards,
> > > > Salman
> > > >
> > > > On Mon, Dec 28, 2015 at 9:58 PM, Alexandre Rafalovitch <
> > > arafa...@gmail.com>
> > > > wrote:
> > > >
> > > >> Is the schema change affects the data you want to keep?
> > > >> 
> > > >> Newsletter and resources for Solr beginners and intermediates:
> > > >> http://www.solr-start.com/
> > > >>
> > > >>
> > > >> On 29 December 2015 at 01:48, Salman Ansari <
> salman.rah...@gmail.com>
> > > >> wrote:
> > > >> > Hi,
> > > >> >
> > > >> > I am facing an issue where I need to change Solr schema but I have
> > > >> crucial
> > > >> > data that I don't want to delete. Is there a way where I can
> change
> > > the
> > > >> > schema of the index while keeping the data intact?
> > > >> >
> > > >> > Regards,
> > > >> > Salman
> > > >>
> > >
> > >
> > >
> > > --
> > > Regards,
> > > Shalin Shekhar Mangar.
> > >
> >
> --
> Regards,
> Binoy Dalal
>

Re: Changing Solr Schema with Data

[Salman Ansari]

Thanks guys for your responses.

@Shalin: Do you have a documentation that explains this? Moreover, is it
only for Solr 5+ or is it still applicable to Solr 3+? I am asking this as
I am working in a team and in some of our projects we are using old Solr
versions and I need to convince the guys that this is possible in the old
Solr as well.

Thanks for your help.

Regards,
Salman


On Tue, Dec 29, 2015 at 9:44 AM, Shalin Shekhar Mangar <
shalinman...@gmail.com> wrote:

> Adding new fields is not a problem. You can continue to use your
> existing index with the new schema.
>
> On Tue, Dec 29, 2015 at 1:58 AM, Salman Ansari 
> wrote:
> > You can say that we are not removing any fields (so the old data should
> not
> > get affected), however, we need to add new fields (which new data will
> > have). Does that answer your question?
> >
> >
> > Regards,
> > Salman
> >
> > On Mon, Dec 28, 2015 at 9:58 PM, Alexandre Rafalovitch <
> arafa...@gmail.com>
> > wrote:
> >
> >> Is the schema change affects the data you want to keep?
> >> 
> >> Newsletter and resources for Solr beginners and intermediates:
> >> http://www.solr-start.com/
> >>
> >>
> >> On 29 December 2015 at 01:48, Salman Ansari 
> >> wrote:
> >> > Hi,
> >> >
> >> > I am facing an issue where I need to change Solr schema but I have
> >> crucial
> >> > data that I don't want to delete. Is there a way where I can change
> the
> >> > schema of the index while keeping the data intact?
> >> >
> >> > Regards,
> >> > Salman
> >>
>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>

Re: Changing Solr Schema with Data

[Binoy Dalal]

What shalin says is solid and will work with solr 5.x as well as 3.x
You could do a little poc if you want to be absolutely certain. Shouldn't
take you very long.
Your only concern will be that your old docs won't be matched against
queries matched against the newly added fields.

On Tue, 29 Dec 2015, 23:38 Salman Ansari  wrote:

> Thanks guys for your responses.
>
> @Shalin: Do you have a documentation that explains this? Moreover, is it
> only for Solr 5+ or is it still applicable to Solr 3+? I am asking this as
> I am working in a team and in some of our projects we are using old Solr
> versions and I need to convince the guys that this is possible in the old
> Solr as well.
>
> Thanks for your help.
>
> Regards,
> Salman
>
>
> On Tue, Dec 29, 2015 at 9:44 AM, Shalin Shekhar Mangar <
> shalinman...@gmail.com> wrote:
>
> > Adding new fields is not a problem. You can continue to use your
> > existing index with the new schema.
> >
> > On Tue, Dec 29, 2015 at 1:58 AM, Salman Ansari 
> > wrote:
> > > You can say that we are not removing any fields (so the old data should
> > not
> > > get affected), however, we need to add new fields (which new data will
> > > have). Does that answer your question?
> > >
> > >
> > > Regards,
> > > Salman
> > >
> > > On Mon, Dec 28, 2015 at 9:58 PM, Alexandre Rafalovitch <
> > arafa...@gmail.com>
> > > wrote:
> > >
> > >> Is the schema change affects the data you want to keep?
> > >> 
> > >> Newsletter and resources for Solr beginners and intermediates:
> > >> http://www.solr-start.com/
> > >>
> > >>
> > >> On 29 December 2015 at 01:48, Salman Ansari 
> > >> wrote:
> > >> > Hi,
> > >> >
> > >> > I am facing an issue where I need to change Solr schema but I have
> > >> crucial
> > >> > data that I don't want to delete. Is there a way where I can change
> > the
> > >> > schema of the index while keeping the data intact?
> > >> >
> > >> > Regards,
> > >> > Salman
> > >>
> >
> >
> >
> > --
> > Regards,
> > Shalin Shekhar Mangar.
> >
>
-- 
Regards,
Binoy Dalal

Changing Solr Schema with Data

[Salman Ansari]

Hi,

I am facing an issue where I need to change Solr schema but I have crucial
data that I don't want to delete. Is there a way where I can change the
schema of the index while keeping the data intact?

Regards,
Salman

Re: Changing Solr Schema with Data

[Alexandre Rafalovitch]

Is the schema change affects the data you want to keep?

Newsletter and resources for Solr beginners and intermediates:
http://www.solr-start.com/


On 29 December 2015 at 01:48, Salman Ansari  wrote:
> Hi,
>
> I am facing an issue where I need to change Solr schema but I have crucial
> data that I don't want to delete. Is there a way where I can change the
> schema of the index while keeping the data intact?
>
> Regards,
> Salman

Re: Changing Solr Schema with Data

[Jack Krupansky]

All crucial data that you don't want to delete should be stored in a
non-Solr backing store, either flat files (e.g., CSV or Solr XML), an
RDBMS, or a NoSQL database. You should always be in a position to either
fully reindex or fully discard your Solr data. Solr is not a system of
record database. Was someone telling you something different?

-- Jack Krupansky

On Mon, Dec 28, 2015 at 1:48 PM, Salman Ansari 
wrote:

> Hi,
>
> I am facing an issue where I need to change Solr schema but I have crucial
> data that I don't want to delete. Is there a way where I can change the
> schema of the index while keeping the data intact?
>
> Regards,
> Salman
>

Re: Changing Solr Schema with Data

[Salman Ansari]

You can say that we are not removing any fields (so the old data should not
get affected), however, we need to add new fields (which new data will
have). Does that answer your question?


Regards,
Salman

On Mon, Dec 28, 2015 at 9:58 PM, Alexandre Rafalovitch 
wrote:

> Is the schema change affects the data you want to keep?
> 
> Newsletter and resources for Solr beginners and intermediates:
> http://www.solr-start.com/
>
>
> On 29 December 2015 at 01:48, Salman Ansari 
> wrote:
> > Hi,
> >
> > I am facing an issue where I need to change Solr schema but I have
> crucial
> > data that I don't want to delete. Is there a way where I can change the
> > schema of the index while keeping the data intact?
> >
> > Regards,
> > Salman
>

Re: Changing Solr Schema with Data

[Shalin Shekhar Mangar]

Adding new fields is not a problem. You can continue to use your
existing index with the new schema.

On Tue, Dec 29, 2015 at 1:58 AM, Salman Ansari  wrote:
> You can say that we are not removing any fields (so the old data should not
> get affected), however, we need to add new fields (which new data will
> have). Does that answer your question?
>
>
> Regards,
> Salman
>
> On Mon, Dec 28, 2015 at 9:58 PM, Alexandre Rafalovitch 
> wrote:
>
>> Is the schema change affects the data you want to keep?
>> 
>> Newsletter and resources for Solr beginners and intermediates:
>> http://www.solr-start.com/
>>
>>
>> On 29 December 2015 at 01:48, Salman Ansari 
>> wrote:
>> > Hi,
>> >
>> > I am facing an issue where I need to change Solr schema but I have
>> crucial
>> > data that I don't want to delete. Is there a way where I can change the
>> > schema of the index while keeping the data intact?
>> >
>> > Regards,
>> > Salman
>>



-- 
Regards,
Shalin Shekhar Mangar.

Re: Changing the schema

[Chris Hostetter]

: If I change the field type in my schema, do I need to rebuild the entire
: index? I'm at a point now where it takes over a day to do a full import due
: to the sheer size of my application and I would prefer not having to reindex
: just because I want to make a change somewhere.

it really depends on the change.

gneral rule of thumb is yes but there are lots of exceptions depending 
on what you're doing and how concerned you are about consistency -- 
adding fields/fieldTypes really doesn't require reindexing unless you have 
a default value.  removing required or going from single valued to 
multivalued (ie: relaxing rules) doesn't require reindexing. changing 
analyzers ... oy.  that's a big ball of wax.

if you really know what you are doing, and fully understand what's 
changing under the covers, there are lots of cases where you don't need to 
reindex ... but it's not recommended in general.






-Hoss

Re: Changing the schema

[Otis Gospodnetic]

Brian,

Yes, you do need to reindex.  We've used Hadoop with Solr to speed up indexing 
by orders of magnitude for some of our customers.  Something to consider.

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Brian Lamb brian.l...@journalexperts.com
 To: solr-user@lucene.apache.org
 Sent: Thu, May 12, 2011 11:53:27 AM
 Subject: Changing the schema
 
 If I change the field type in my schema, do I need to rebuild the  entire
 index? I'm at a point now where it takes over a day to do a full  import due
 to the sheer size of my application and I would prefer not having  to reindex
 just because I want to make a change  somewhere.
 
 Thanks,
 
 Brian Lamb
 

Re: Changing the schema

[Chamnap Chhorn]

I wonder what if I add new field in the schema, do i have to reindex?

If no need to reindex, can i just update the schema.xml directly? After
that, Should I restart the tomcat service?

If no need to reindex, how about the existing documents? If I do a query
with new field, does it cause errors?

On Fri, May 13, 2011 at 1:38 PM, Otis Gospodnetic 
otis_gospodne...@yahoo.com wrote:

 Brian,

 Yes, you do need to reindex.  We've used Hadoop with Solr to speed up
 indexing
 by orders of magnitude for some of our customers.  Something to consider.

 Otis
 
 Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
 Lucene ecosystem search :: http://search-lucene.com/



 - Original Message 
  From: Brian Lamb brian.l...@journalexperts.com
  To: solr-user@lucene.apache.org
  Sent: Thu, May 12, 2011 11:53:27 AM
  Subject: Changing the schema
 
  If I change the field type in my schema, do I need to rebuild the  entire
  index? I'm at a point now where it takes over a day to do a full  import
 due
  to the sheer size of my application and I would prefer not having  to
 reindex
  just because I want to make a change  somewhere.
 
  Thanks,
 
  Brian Lamb
 




-- 
Chhorn Chamnap
http://chamnapchhorn.blogspot.com/

Re: Changing the schema

[Stefan Matheis]

Chamnap,

On Fri, May 13, 2011 at 2:59 PM, Chamnap Chhorn chamnapchh...@gmail.com wrote:
 I wonder what if I add new field in the schema, do i have to reindex?

If you're using that field within the DIH .. then of course yes, but
normally/otherwise: No :)

On Fri, May 13, 2011 at 2:59 PM, Chamnap Chhorn chamnapchh...@gmail.com wrote:
 If no need to reindex, can i just update the schema.xml directly? After
 that, Should I restart the tomcat service?

At least, you have to reload the Core-Config .. don't know exactly how
that works while using Tomcat -- with the packaged Jetty, it's just
hitting /admin/cores (while in Multicore-Mode) or restarting the
Java-Process (in Singlecore-Mode)

On Fri, May 13, 2011 at 2:59 PM, Chamnap Chhorn chamnapchh...@gmail.com wrote:
 If no need to reindex, how about the existing documents? If I do a query
 with new field, does it cause errors?

Afaik, the document are just not affected from searching and therefore
missing in/excluded from the result.

Regards
Stefan

Changing the schema

[Brian Lamb]

If I change the field type in my schema, do I need to rebuild the entire
index? I'm at a point now where it takes over a day to do a full import due
to the sheer size of my application and I would prefer not having to reindex
just because I want to make a change somewhere.

Thanks,

Brian Lamb

changing the schema

[Lutz Steinborn]

Hi,

I'm using Solr now for a while and I'm feeling fine. Its much easier to use
as native Lucene.
Many thanks for the good job.

But one question cames up as the index goes bigger and bigger: is it
possible to add fields to the schema without a complete   reindex ?

We are using Solr for a b2b catalog application with millions of records. A
complete reindex takes hours.

Kindly regards
Lutz Steinborn
http://www.4c-ag.de