Fwd: Re: squat broken after upgrade from 2.4 to 2.5?

[Vladislav Kurz via Info-cyrus]

I sent the previous mail off-list by mistake, so I'm forwarding it along
with the aswer for others to read.

Vladislav Kurz

 Forwarded Message 
Subject: Re: squat broken after upgrade from 2.4 to 2.5?
Date: Wed, 22 Jun 2016 11:59:12 +0200
From: Wolfgang Breyha <wbre...@gmx.net>
To: Vladislav Kurz <vladislav.k...@webstep.net>

Vladislav Kurz wrote on 22/06/16 11:19:
> Somewhere I read a recommendation to just delete all squat files on
> upgrade, and let the squatter reindex everything. But I can recall where
> it was. Perhaps it should be done automatically on upgrades.

Somewhere... yes, that's exactly the state of cyrus documentation.

On XFER the cyrus.squat file is ignored/dropped and rebuilt at the next run.
That's ok so far.

But the point is that 2.5 promised an upgrade path without IO havoc like
2.3->2.4 which needed an "on first access" reconstruct. But dropping all
squat
DBs and rebuilding them is exact the same nightmare again.

cyrus.squat has a version number inside. Making it incompatible while
keeping
the same version is simply stupid and a bug.

Greetings, Wolfgang
-- 
Wolfgang Breyha <wbre...@gmx.net> | http://www.blafasel.at/
Vienna University Computer Center | Austria



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: squat broken after upgrade from 2.4 to 2.5?

[Wolfgang Breyha via Info-cyrus]

Bron Gondwana via Info-cyrus wrote on 21/06/16 01:52:
> This could very well be a bug in the upgrade :(  It would be great to have
> a test case to check this.  I can't do that today, but maybe ellie can do
> something.
> 
> Sadly our bug tracking situtation for Cyrus is a mess at the moment, but
> I'm hoping to have that cleaned up soon.

I filed
https://bugzilla.cyrusimap.org/show_bug.cgi?id=3938

Greetings, Wolfgang
-- 
Wolfgang Breyha  | http://www.blafasel.at/
Vienna University Computer Center | Austria


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: squat broken after upgrade from 2.4 to 2.5?

[Bron Gondwana via Info-cyrus]

This could very well be a bug in the upgrade :(  It would be great to have a 
test case to check this.  I can't do that today, but maybe ellie can do 
something.

Sadly our bug tracking situtation for Cyrus is a mess at the moment, but I'm 
hoping to have that cleaned up soon.

Bron.

On Mon, Jun 20, 2016, at 19:33, Wolfgang Breyha via Info-cyrus wrote:
> Hi!
> 
> I upgraded some backend hosts from 2.4.18 to 2.5.8. Currently they are all
> still running with index version 12.
> 
> Some of these mailboxes have squatter activated as annotation and my
> cyrus.conf has
> squatter  cmd="squatter -asir *" at=0500
> 
> I see that it runs at night and logs entries like:
> Jun 20 05:00:15 lauren squatter[27593]: indexing mailbox user.
> 
> There are no errors in the log from squatter.
> 
> But today I recognized on my own mailbox that squatter returns nothing while
> searching with thunderbird. The resulting imap request looked like:
> <1466414132<18 UID Search UNDELETED (OR (OR OR TO "search" HEADER CC "search"
> SUBJECT "search") BODY "search")
> <1466414132>* SEARCH
> 18 OK Completed (0 msgs in 0.010 secs)
> 
> I then moved the current squat db and the same search returned 214 messages.
> 
> Rebuiling the squat db and searching again resulted in the exact same 214
> messages.
> 
> It seems that something changed within the squat DB and 2.5 can't search in
> the old 2.4 DBs. That's bad in two ways.
> 
> *) search doesn't fail with an error and simply returns no result. no fallback
> to searching without squat db.
> *) the squat db is not refreshed/rebuilt after upgrade.
> 
> Is this a bug or is something broken on my side?
> 
> Greetings, Wolfgang
> -- 
> Wolfgang Breyha  | http://www.blafasel.at/
> Vienna University Computer Center | Austria
> 
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


-- 
  Bron Gondwana
  br...@fastmail.fm

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

squat broken after upgrade from 2.4 to 2.5?

[Wolfgang Breyha via Info-cyrus]

Hi!

I upgraded some backend hosts from 2.4.18 to 2.5.8. Currently they are all
still running with index version 12.

Some of these mailboxes have squatter activated as annotation and my
cyrus.conf has
squatter  cmd="squatter -asir *" at=0500

I see that it runs at night and logs entries like:
Jun 20 05:00:15 lauren squatter[27593]: indexing mailbox user.

There are no errors in the log from squatter.

But today I recognized on my own mailbox that squatter returns nothing while
searching with thunderbird. The resulting imap request looked like:
<1466414132<18 UID Search UNDELETED (OR (OR OR TO "search" HEADER CC "search"
SUBJECT "search") BODY "search")
<1466414132>* SEARCH
18 OK Completed (0 msgs in 0.010 secs)

I then moved the current squat db and the same search returned 214 messages.

Rebuiling the squat db and searching again resulted in the exact same 214
messages.

It seems that something changed within the squat DB and 2.5 can't search in
the old 2.4 DBs. That's bad in two ways.

*) search doesn't fail with an error and simply returns no result. no fallback
to searching without squat db.
*) the squat db is not refreshed/rebuilt after upgrade.

Is this a bug or is something broken on my side?

Greetings, Wolfgang
-- 
Wolfgang Breyha  | http://www.blafasel.at/
Vienna University Computer Center | Austria


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus