Never-ending bug with recontruct - MISSING FOLDERS

2011-09-14 Thread Denis BUCHER
Dear all,

I think I've posted already here about this some years ago about this 
problem and I'm disappointed that cyrus reconstruct seems to still have 
the same bug. Although last time I was able to circumvent it, this time 
I am left out without any solution, and my users are very angry now !!!

Let me explain :
I have to switch to a new server and moved the cyrus mailboxes on it.
Most of the migration is working, but some folders are missing !!!

In fact all data is on the disk, but cyrus reconstruct decided (still 
this absolutely STUPID bug) do ignore folders containing only subfolders !!!

Example :
Archives/ (contains messages) will be included
Archives/2009/ (contains messages) will be included
Archives/2010/ (contains folders) WILL NOT BE INCLUDED !!! AND :
Archives/2010/janjun/ (contains messages) IS NOT INCLUDED
Archives/2010/juldec/ (contains messages) IS NOT INCLUDED

In my example, all 2010 email archives are missing !!!

I tried everything I think :

1. cyradm
  reconstruct user.psmith.archives.2...@domain.com

2. delete cyrus.header and restart cyrus

3. ???

Any help would be greatly appreciated !

Denis

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Never-ending bug with recontruct - MISSING FOLDERS

2011-09-14 Thread Jeroen van Meeuwen (Kolab Systems)
On 14.09.2011 09:42, Denis BUCHER wrote:
 Dear all,


Hi Denis,

 I think I've posted already here about this some years ago about this
 problem and I'm disappointed that cyrus reconstruct seems to still 
 have
 the same bug.

You wouldn't happen to have a ticket in bugzilla.cyrusimap.org about 
this problem you are experiencing, do you?

 Let me explain :
 I have to switch to a new server and moved the cyrus mailboxes on it.
 Most of the migration is working, but some folders are missing !!!


Could you please state the version of Cyrus IMAP on both the old as 
well as the new server?

 In fact all data is on the disk, but cyrus reconstruct decided (still
 this absolutely STUPID bug) do ignore folders containing only 
 subfolders !!!


 I tried everything I think :

 1. cyradm
   reconstruct user.psmith.archives.2...@domain.com


Have you tried appending '-r' to this command, to indicate the 
reconstruct should be performed recursively?

 2. delete cyrus.header and restart cyrus


Have you executed reconstruct from the command-line as opposed to 
through the 'cyradm' utility? Please see the output of 'man -k 
reconstruct' for the appropriate man page on your platform.

-- 
Kind regards,

Jeroen van Meeuwen

-- 
Senior Engineer, Kolab Systems AG

e: vanmeeuwen at kolabsys.com
t: +44 144 340 9500
m: +44 74 2516 3817
w: http://www.kolabsys.com

pgp: 9342 BF08

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Never-ending bug with recontruct - MISSING FOLDERS

2011-09-14 Thread Denis BUCHER
Dear Jeroen,

Le 14.09.2011 10:54, Jeroen van Meeuwen (Kolab Systems) a écrit :
 I think I've posted already here about this some years ago about this
 problem and I'm disappointed that cyrus reconstruct seems to still
 have
 the same bug.

 You wouldn't happen to have a ticket in bugzilla.cyrusimap.org about
 this problem you are experiencing, do you?

No sorry, at that time I only posted here.

 Let me explain :
 I have to switch to a new server and moved the cyrus mailboxes on it.
 Most of the migration is working, but some folders are missing !!!

 Could you please state the version of Cyrus IMAP on both the old as
 well as the new server?

New server : v2.3.7-Invoca-RPM-2.3.7-7.el5_6.4 2006/07/10 13:46:20
Old server : don't know (but I don't think it plays any role because 
most of the data was recovered by reconstruct)

 In fact all data is on the disk, but cyrus reconstruct decided (still
 this absolutely STUPID bug) do ignore folders containing only
 subfolders !!!


 I tried everything I think :

 1. cyradm
 reconstruct user.psmith.archives.2...@domain.com


 Have you tried appending '-r' to this command, to indicate the
 reconstruct should be performed recursively?

Yes, same problem.

 2. delete cyrus.header and restart cyrus


 Have you executed reconstruct from the command-line as opposed to
 through the 'cyradm' utility? Please see the output of 'man -k
 reconstruct' for the appropriate man page on your platform.

Yes absolutely I launched reconstruct -rf but reconstruct is ignoring 
folders that only contains subfolders but no messages !

So what I did is now to add one file (message copied from elsewhere) in 
these folders but now I don't find a solution to make cyrus rescan 
these folders ?

Denis

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Never-ending bug with recontruct - MISSING FOLDERS

2011-09-14 Thread Simon Matter
 Dear Jeroen,

 Le 14.09.2011 10:54, Jeroen van Meeuwen (Kolab Systems) a écrit :
 I think I've posted already here about this some years ago about this
 problem and I'm disappointed that cyrus reconstruct seems to still
 have
 the same bug.

 You wouldn't happen to have a ticket in bugzilla.cyrusimap.org about
 this problem you are experiencing, do you?

 No sorry, at that time I only posted here.

 Let me explain :
 I have to switch to a new server and moved the cyrus mailboxes on it.
 Most of the migration is working, but some folders are missing !!!

 Could you please state the version of Cyrus IMAP on both the old as
 well as the new server?

 New server : v2.3.7-Invoca-RPM-2.3.7-7.el5_6.4 2006/07/10 13:46:20
 Old server : don't know (but I don't think it plays any role because
 most of the data was recovered by reconstruct)

You missed the point, your new server is using a 5 year old version of
cyrus-imapd, which isn't exactly new. So, either try a current version,
which is 2.4.11, or ask your distributor to backport fixes if they exist.

Regards,
Simon


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Never-ending bug with recontruct - MISSING FOLDERS

2011-09-14 Thread Bron Gondwana
On 09/14/2011 11:51 AM, Simon Matter wrote:
 Dear Jeroen,

 Le 14.09.2011 10:54, Jeroen van Meeuwen (Kolab Systems) a écrit :
 I think I've posted already here about this some years ago about this
 problem and I'm disappointed that cyrus reconstruct seems to still
 have
 the same bug.
 You wouldn't happen to have a ticket in bugzilla.cyrusimap.org about
 this problem you are experiencing, do you?
 No sorry, at that time I only posted here.

 Let me explain :
 I have to switch to a new server and moved the cyrus mailboxes on it.
 Most of the migration is working, but some folders are missing !!!
 Could you please state the version of Cyrus IMAP on both the old as
 well as the new server?
 New server : v2.3.7-Invoca-RPM-2.3.7-7.el5_6.4 2006/07/10 13:46:20
 Old server : don't know (but I don't think it plays any role because
 most of the data was recovered by reconstruct)
 You missed the point, your new server is using a 5 year old version of
 cyrus-imapd, which isn't exactly new. So, either try a current version,
 which is 2.4.11, or ask your distributor to backport fixes if they exist.

 Regards,
 Simon
The fix itself won't be _too_ complex to backport, I suspect, but it will be
fresh coding, because reconstruct changed pretty massively between 2.3
and 2.4.  So it's not going to be a fun job for someone.

Also, 2.3.7 is ancient even by 2.3 standards. It still has a pretty buggy
skiplist implementation (maybe they backported fixes for that, I don't
know)

Bron.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/