Event notifications question

[Marco]

Hello,

 I'm trying event notifications. I would like to see if there are some 
methods to track all messages moved on a folder named "Spam", for instance.


First, I see that event filters in imapd.conf don't allow to specify a 
folder name... so the notifications produced are very large.
A way to emit only a kind of event, such as "vnd.cmu.MessageMove" could 
be appreciated.


My question is about "event_extra_params". It seems that I can add extra 
parameters. For instance, as you can see in 
https://www.cyrusimap.org/imap/concepts/features/event-notifications.html#imap-features-event-notifications-messagemove 
messageMove doesn't report the "messageContent" field.


So in imapd.conf I added:

event_extra_params: timestamp messages messageContent

I restarted the server, but messageMove events still exclude messageContent.

Do I have misunderstood something?

This is my config:

# Notify
event_notifier: log
event_exclude_specialuse: \Drafts
event_extra_params: timestamp messages messageContent
event_groups: message


Thank you very much

Cheers
Marco

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Question about replication, split-brains and unclean failover

[ego...@sarenet.es]

Hi!,


I was writing some code for automating the server fail-over and was trying to 
see, how should or could I handle not run log files from sync_client. Well when 
in a clean shutdown, it’s pretty easy to know how to manage because the 
replication is up-to-date… so almost no problem there, it’s pretty fast... The 
problem comes in an unclean shutdown where some delay exists.

I sometimes suffer about unclean shutdowns, the way are described here 
https://www.fastmail.com/help/technical/architecture.html "Unclean failover”. 
There sais too, some improvements where going to be done (or that were 
committed perhaps) to the replication in order to avoid them. But, by the way 
replication is handled (as I have seen in the source code about locks, modseq 
checks and so) and the way Cyrus writes replication logs for rolling 
replication later, the possibility of replying the logs from an actual slave 
(just failed over), for covering a split-brain I assume is not carried out at 
least nowadays?. Perhaps am I wrong?. I ask this just, for confirming and avoid 
having wrong ideas… 

If it’s undone or at least partially undone, I would love really doing 
something… although unfortunately due to our high work load... I can’t say when 
I could have some time for it… but I’ll try my bests...



Cheers!

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about squatter for Xapian

[Egoitz Aurrekoetxea via Info-cyrus]

Hi!!

Thank you so much Rob!!

I will launch it this weekend :) :)

Cheers!

> El 23 ene 2020, a las 23:04, Rob N ★  escribió:
> 
> On Fri, 24 Jan 2020, at 4:38 AM, ego...@sarenet.es  
> wrote:
>> - Does it regenerate all mailboxes indexes?. Just the non-indexed emails?. I 
>> assume it should be extremely slow… so could this be launched?. Could you 
>> advise me please, if another way is preferred? 
> 
> Normally, just the non-indexed emails.
> 
> squatter -i (incremental) should be all you need to fill the gaps in your 
> index.
> 
> Obviously how long it takes depends on how much mail has arrived and how good 
> your disks are, but for 12 hours worth I wouldn't expect more than a couple 
> of hours to fill the gaps.
> 
>> - I assume not, but as we move records between Xapian tiers nightly… if the 
>> Squatter launched by me, by hand (for those non indexed emails), runs at the 
>> same time as this between tiers movement of records or at the same time too 
>> as the rolling mode squatter (-R) could one squatter process interfere in 
>> the job of the other instance of squatter?.
> 
> It's ok to run them all at the same time. Cyrus has appropriate locks to make 
> sure that Xapian updates and repacks don't get in each others' way.
> 
> Rob N.
> 
> Cyrus Home Page: http://www.cyrusimap.org/ 
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ 
> 
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus 
> 

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about squatter for Xapian

[Rob N ★]

On Fri, 24 Jan 2020, at 4:38 AM, ego...@sarenet.es wrote:
> - Does it regenerate all mailboxes indexes?. Just the non-indexed emails?. I 
> assume it should be extremely slow… so could this be launched?. Could you 
> advise me please, if another way is preferred? 

Normally, just the non-indexed emails.

squatter -i (incremental) should be all you need to fill the gaps in your index.

Obviously how long it takes depends on how much mail has arrived and how good 
your disks are, but for 12 hours worth I wouldn't expect more than a couple of 
hours to fill the gaps.

> - I assume not, but as we move records between Xapian tiers nightly… if the 
> Squatter launched by me, by hand (for those non indexed emails), runs at the 
> same time as this between tiers movement of records or at the same time too 
> as the rolling mode squatter (-R) could one squatter process interfere in the 
> job of the other instance of squatter?.

It's ok to run them all at the same time. Cyrus has appropriate locks to make 
sure that Xapian updates and repacks don't get in each others' way.

Rob N.
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Question about squatter for Xapian

[ego...@sarenet.es]

Good morning,

We have mailboxes indexed with Xapian. We run for that Squatter in rolling mode 
(-R) so that a log can create new index records while new mail enters.. is 
removed and so… Nightly too move records between tiers and so… 

In an emergency on one mailbox server, we moved traffic to what was the slave 
server, and from that moment obviously the master… but we did a mistake, we 
forgot setting in the new slave "sync_log: true" so no squatter rolling log was 
generated. We noted about it 12 hours later. As we have "search_fuzzy_always: 
1” set all searches go through Xapian, so no indexed mail won’t never appear in 
the searchs run by the users. I think we could run squatter for indexing non 
indexed emails, but I was wondering : 

- Does it regenerate all mailboxes indexes?. Just the non-indexed emails?. I 
assume it should be extremely slow… so could this be launched?. Could you 
advise me please, if another way is preferred? 
- I assume not, but as we move records between Xapian tiers nightly… if the 
Squatter launched by me, by hand (for those non indexed emails), runs at the 
same time as this between tiers movement of records or at the same time too as 
the rolling mode squatter (-R) could one squatter process interfere in the job 
of the other instance of squatter?.

Thank you so much,
Best regards,

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Question about what is replicated with Cyrus replication and what isn't

[egoitz]

Hi! 

Previously (in 2.3 and older versions), cyr_expire and ipurge actions
for instance where not replicated to the slave. So, you needed to launch
them in both, the master and the slave. My question is, are now
replicated as mailbox replication commands?. What about commands like
Squatter -F for removing in Cyrus 3 from the database non existing
mails?. Or when you move data from search tiers in Xapian?. Are those
actions replicated or should be launched in the master and the replica?.


Cheers!
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about conversationsdb

[Egoitz Aurrekoetxea]

In the replica I assume sync_log should be off. But If I enable there
sync_log_unsuppressable_channels: squatter then I assume all Xapian
searches needing elements would be generated when the slave received
data from the master?. Even when the slave starts empty?. 

Thanks mates :)

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 08-02-2019 14:46, Egoitz Aurrekoetxea escribió:

> Hi!, 
> 
> One little question. If I wanted to upgrade a Cyrus server older then 3.0 but 
> greater than 2.3 (so replication is compatible) the conversations database 
> would be created automatically in the slave if I used an empty slave 3.0 and 
> I replicated the whole content there from the master running 2.4 for instance 
> (and then no Xapian searches or conversations for instance)?. 
> 
> Thanks a lot for your time :) 
> 
> Cheers!
> 
> -- 
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es 
> www.sarenet.es [1] 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo. 
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about manual replication (-u )

[Egoitz Aurrekoetxea]

Thanks a lot Bron!!! :) :)

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 08-01-2019 12:02, Bron Gondwana escribió:

> Yep, that's totally safe. Even doing the same user twice at the same time 
> should be safe, though it may do extra work. 
> 
> Bron. 
> 
> On Tue, Jan 8, 2019, at 05:05, Egoitz Aurrekoetxea wrote: 
> 
> Good afternoon, 
> 
> I know it seems a pretty stupid question, but some time ago, you cannot have 
> a Cyrus server acting for instance as a master and as slave... it was not 
> supported... worked... but not supported... so having multiple sync_client 
> instances... perhaps could damage something (although I suppose not) I'll 
> probably have the same dount for ctl_conversations -z and -b multiple 
> parallel commands... 
> 
> I know it seems ridiculous... but I ask it because I prefer to try get some 
> knowledge from Cyrus gurus... :) :) 
> 
> Cheers!
> 
> --- 
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 
> 944 209 470 
> Parque Tecnológico. Edificio 103 
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es
> 
> www.sarenet.es [1] 
> 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo. 
> 
> El 03-01-2019 16:32, Egoitz Aurrekoetxea escribió: 
> 
> Good afternoon, 
> 
> Is it possible to launch several instances of 
> "/usr/local/cyrus/bin/sync_client -S DEST-HOST -v -u EMAIL" in parallel?. 
> Doing it just one mailbox at a time takes ages It would help me a lot, 
> the fact of parallelizing and have no disk bottleneck issues 
> 
> I think it should be possible... isn't it?. Perhaps it just allowed between 
> same version in source and dest?. Or can be done for instance too, with a 2.4 
> as master to 3.0 slave?. 
> 
> Cheers!!
> 
> -- 
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 
> 944 209 470 
> Parque Tecnológico. Edificio 103 
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es
> 
> www.sarenet.es [1] 
> 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo. 
>  
> Cyrus Home Page: http://www.cyrusimap.org/ 
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ 
> To Unsubscribe: 
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

-- 
  Bron Gondwana, CEO, FastMail Pty Ltd 
  br...@fastmailteam.com 


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about manual replication (-u )

[Bron Gondwana]

Yep, that's totally safe. Even doing the same user twice at the same time 
should be safe, though it may do extra work.

Bron.

On Tue, Jan 8, 2019, at 05:05, Egoitz Aurrekoetxea wrote:
> Good afternoon,


> 


> I know it seems a pretty stupid question, but some time ago, you cannot have 
> a Cyrus server acting for instance as a master and as slave... it was not 
> supported... worked... but not supported... so having multiple sync_client 
> instances... perhaps could damage something (although I suppose not) I'll 
> probably have the same dount for ctl_conversations -z and -b multiple 
> parallel commands...


> 


> I know it seems ridiculous... but I ask it because I prefer to try get some 
> knowledge from Cyrus gurus... :) :)


> 


> Cheers!


> ---
>  
> sarenet
> *Egoitz Aurrekoetxea*
> Departamento de sistemas
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia)
> ego...@sarenet.es
> www.sarenet.es
> 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo.
> 


> El 03-01-2019 16:32, Egoitz Aurrekoetxea escribió:


>> Good afternoon,


>> 


>> Is it possible to launch several instances of 
>> "/usr/local/cyrus/bin/sync_client -S DEST-HOST -v -u EMAIL" in parallel?. 
>> Doing it just one mailbox at a time takes ages It would help me a lot, 
>> the fact of parallelizing and have no disk bottleneck issues


>> 


>> I think it should be possible... isn't it?. Perhaps it just allowed between 
>> same version in source and dest?. Or can be done for instance too, with a 
>> 2.4 as master to 3.0 slave?.


>> 


>> Cheers!!


>> -- 
>>  
>> sarenet
>> *Egoitz Aurrekoetxea*
>> Departamento de sistemas
>> 944 209 470
>> Parque Tecnológico. Edificio 103
>> 48170 Zamudio (Bizkaia)
>> ego...@sarenet.es
>> www.sarenet.es
>> 
>> Antes de imprimir este correo electrónico piense si es necesario hacerlo.
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

--
 Bron Gondwana, CEO, FastMail Pty Ltd
 br...@fastmailteam.com

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about manual replication (-u )

[Egoitz Aurrekoetxea]

Good afternoon, 

I know it seems a pretty stupid question, but some time ago, you cannot
have a Cyrus server acting for instance as a master and as slave... it
was not supported... worked... but not supported... so having multiple
sync_client instances... perhaps could damage something (although I
suppose not) I'll probably have the same dount for ctl_conversations
-z and -b multiple parallel commands... 

I know it seems ridiculous... but I ask it because I prefer to try get
some knowledge from Cyrus gurus... :) :) 

Cheers!

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 03-01-2019 16:32, Egoitz Aurrekoetxea escribió:

> Good afternoon, 
> 
> Is it possible to launch several instances of 
> "/usr/local/cyrus/bin/sync_client -S DEST-HOST -v -u EMAIL" in parallel?. 
> Doing it just one mailbox at a time takes ages It would help me a lot, 
> the fact of parallelizing and have no disk bottleneck issues 
> 
> I think it should be possible... isn't it?. Perhaps it just allowed between 
> same version in source and dest?. Or can be done for instance too, with a 2.4 
> as master to 3.0 slave?. 
> 
> Cheers!!
> 
> -- 
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es 
> www.sarenet.es [1] 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo.
 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Egoitz Aurrekoetxea]

Hi Javier!, 

Sorry for the delay and many many thanks for your ideas :) 

Cheers!

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 18-12-2018 13:50, Javier Angulo escribió:

> On 12/18/18 12:15 PM, Binarus wrote: On 15.12.2018 17:05, Nic Bernstein 
> wrote: On 12/13/18 9:52 AM, Egoitz Aurrekoetxea wrote: I was trying to 
> upgrade part of our Cyrus imap installation,
> concretely that one consisting in still 2.3. I was planning to set up
> Cyrus 3.0. I have seen all works properly except for the unexpunge
> command because as someone stated here, a reconstruct -V max was
> needed.The problem is that this reconstruct command, takes ages and
> I'm not able to keep the service offline so many time. So I have been
> thinking in the following scenario :
> Egoitz,
> As long as you've followed all of the various steps needed to account
> for version changes, as outlined in the Release Notes for /all/
> intermediary releases, then the last step should be the updating of the
> indexes.  Rather than running "reconstruct -V max" on all mailboxes at
> once, simply run it on subsets.  We've done this on large installations
> without ill effect.  You can have the service on line during the
> reconstruct, and, as you note, have most all functionality present.
 In my case, before the reconstruct had finished, I had several problems
which might be not acceptable for large organizations.

For example, users could not move messages between folders in their
mailbox. I would consider this quite basic functionality, because
deleting a message (with most clients) also means moving it (to trash).
Functionality was back not before the reconstruct had finished
completely. 
Apart from those we also had some weird problems with the message sort
order (using roundcube) before reconstruct was run.

We split the mailboxes reconstruction into 8 parallel jobs (IO on the
mailbox spool is the limit if you go from 2.3 -> 2.4/3.0). If you ran
the reconstruction online, once finished I would suggest to check again
all indexes version (some reconstruction jobs fail).

Cheers

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Egoitz Aurrekoetxea]

Thank you so much Binarus!!! And as said before, sorry for the big
delay!!

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 18-12-2018 12:15, Binarus escribió:

> On 15.12.2018 17:05, Nic Bernstein wrote: On 12/13/18 9:52 AM, Egoitz 
> Aurrekoetxea wrote: 
> I was trying to upgrade part of our Cyrus imap installation,
> concretely that one consisting in still 2.3. I was planning to set up
> Cyrus 3.0. I have seen all works properly except for the unexpunge
> command because as someone stated here, a reconstruct -V max was
> needed.The problem is that this reconstruct command, takes ages and
> I'm not able to keep the service offline so many time. So I have been
> thinking in the following scenario :
> 
> Egoitz,
> As long as you've followed all of the various steps needed to account
> for version changes, as outlined in the Release Notes for /all/
> intermediary releases, then the last step should be the updating of the
> indexes.  Rather than running "reconstruct -V max" on all mailboxes at
> once, simply run it on subsets.  We've done this on large installations
> without ill effect.  You can have the service on line during the
> reconstruct, and, as you note, have most all functionality present.

In my case, before the reconstruct had finished, I had several problems
which might be not acceptable for large organizations.

For example, users could not move messages between folders in their
mailbox. I would consider this quite basic functionality, because
deleting a message (with most clients) also means moving it (to trash).
Functionality was back not before the reconstruct had finished
completely.

If interested, please see the respective thread from yesterday / today
for details (I don't want to clutter the list by repeating all that
stuff here).

Regards,

Binarus


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Egoitz Aurrekoetxea]

Hi Nic, 

Sorry for the delay answering... I have been ill and later on holiday,
with very very very few time to answer to nothing when coming from
illness. Sorry then... 

My idea really, was to upgrade to 3.0... So I'm planning: 

- Upgrade in place from 2.3 to 2.4. 

- Continue giving the service... 

- Later setup a 3.0 slave all of this WITHOUT doing a reconstruct -V
max. as it seems in 2.4 all works (unexpunge command and so) without
it... should say too, it seems the own sync client performs database
upgrade 

Jan  3 14:46:02 mx8c sync_client[17186]: Index upgrade:
mydomain.com!user.mytestuser.Sarenet-staff.Alberto (10 -> 12)
Jan  3 14:46:06 mx8c sync_client[17186]: Index upgrade:
mydomain.com!user.mytestuser.Sarenet-staff.Comerciales (10 -> 12)
Jan  3 14:46:15 mx8c sync_client[17186]: Index upgrade:
mydomain.com!user.mytestuser.Sarenet-staff.Instalaciones-staff (10 ->
12)
Jan  3 14:46:25 mx8c sync_client[17186]: Index upgrade:
mydomain.com!user.mytestuser.Sarenet-staff.RRHH (10 -> 12) 

It seems to anyway be happening 

- When the 3.0 slave is totally replicated from the 2.4 mater... turn
the 3.0 as mater, and take a copy of it becoming it slave. 

This way I should have all the platform upgraded without downtimes 

How do you see Nic?. I think it should work... I'm still doing checks
anyway. 

Cheers!! Thanks a lot for your time!! 

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [2] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 15-12-2018 17:05, Nic Bernstein escribió:

> On 12/13/18 9:52 AM, Egoitz Aurrekoetxea wrote:
> 
>> I was trying to upgrade part of our Cyrus imap installation, concretely that 
>> one consisting in still 2.3. I was planning to set up Cyrus 3.0. I have seen 
>> all works properly except for the unexpunge command because as someone 
>> stated here, a reconstruct -V max was needed.The problem is that this 
>> reconstruct command, takes ages and I'm not able to keep the service offline 
>> so many time. So I have been thinking in the following scenario :
> 
> Egoitz,
> As long as you've followed all of the various steps needed to account for 
> version changes, as outlined in the Release Notes for _all_ intermediary 
> releases, then the last step should be the updating of the indexes.  Rather 
> than running "reconstruct -V max" on all mailboxes at once, simply run it on 
> subsets.  We've done this on large installations without ill effect.  You can 
> have the service on line during the reconstruct, and, as you note, have most 
> all functionality present.
> 
> We build a list of users (mboxlist.txt), and then run a cron job, during 
> off-peak hours, using the 'parallel' command like so (from 'crontab -e -u 
> cyrus'):
> 
>> ###
>> ## Start a batch of recursive reconstruct jobs at 7PM and discontinue
>> ## at 6:53AM.
>> 0 19 * * * parallel -j 5 --resume --joblog /var/lib/imap/reconstruct.log 
>> cyrus reconstruct -G -V max -r -u {} < /var/lib/imap/mboxlist.txt
>> 53 06 * * * kill -TERM `ps ax | grep [p]arallel | awk '{print $1}'`
> Cheers,
> -nic
> 
> -- 
> Nic Bernstein n...@onlight.com
> Onlight Inc.  www.onlight.com [1]
> 6525 W Bluemound Rd., Ste 24  v. 414.272.4477
> Milwaukee, Wisconsin  53213-4073  f. 414.290.0335
 

Links:
--
[1] http://www.onlight.com
[2] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Javier Angulo]

On 12/18/18 12:15 PM, Binarus wrote:
> On 15.12.2018 17:05, Nic Bernstein wrote:
>> On 12/13/18 9:52 AM, Egoitz Aurrekoetxea wrote:
>>> I was trying to upgrade part of our Cyrus imap installation,
>>> concretely that one consisting in still 2.3. I was planning to set up
>>> Cyrus 3.0. I have seen all works properly except for the unexpunge
>>> command because as someone stated here, a reconstruct -V max was
>>> needed.The problem is that this reconstruct command, takes ages and
>>> I'm not able to keep the service offline so many time. So I have been
>>> thinking in the following scenario :
>>>
>> Egoitz,
>> As long as you've followed all of the various steps needed to account
>> for version changes, as outlined in the Release Notes for /all/
>> intermediary releases, then the last step should be the updating of the
>> indexes.  Rather than running "reconstruct -V max" on all mailboxes at
>> once, simply run it on subsets.  We've done this on large installations
>> without ill effect.  You can have the service on line during the
>> reconstruct, and, as you note, have most all functionality present.
> In my case, before the reconstruct had finished, I had several problems
> which might be not acceptable for large organizations.
> 
> For example, users could not move messages between folders in their
> mailbox. I would consider this quite basic functionality, because
> deleting a message (with most clients) also means moving it (to trash).
> Functionality was back not before the reconstruct had finished completely.

Apart from those we also had some weird problems with the message sort
order (using roundcube) before reconstruct was run.

We split the mailboxes reconstruction into 8 parallel jobs (IO on the
mailbox spool is the limit if you go from 2.3 -> 2.4/3.0). If you ran
the reconstruction online, once finished I would suggest to check again
all indexes version (some reconstruction jobs fail).

Cheers

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Binarus]

On 15.12.2018 17:05, Nic Bernstein wrote:
> On 12/13/18 9:52 AM, Egoitz Aurrekoetxea wrote:
>>
>> I was trying to upgrade part of our Cyrus imap installation,
>> concretely that one consisting in still 2.3. I was planning to set up
>> Cyrus 3.0. I have seen all works properly except for the unexpunge
>> command because as someone stated here, a reconstruct -V max was
>> needed.The problem is that this reconstruct command, takes ages and
>> I'm not able to keep the service offline so many time. So I have been
>> thinking in the following scenario :
>>
> 
> Egoitz,
> As long as you've followed all of the various steps needed to account
> for version changes, as outlined in the Release Notes for /all/
> intermediary releases, then the last step should be the updating of the
> indexes.  Rather than running "reconstruct -V max" on all mailboxes at
> once, simply run it on subsets.  We've done this on large installations
> without ill effect.  You can have the service on line during the
> reconstruct, and, as you note, have most all functionality present.

In my case, before the reconstruct had finished, I had several problems
which might be not acceptable for large organizations.

For example, users could not move messages between folders in their
mailbox. I would consider this quite basic functionality, because
deleting a message (with most clients) also means moving it (to trash).
Functionality was back not before the reconstruct had finished completely.

If interested, please see the respective thread from yesterday / today
for details (I don't want to clutter the list by repeating all that
stuff here).

Regards,

Binarus


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Binarus]

On 13.12.2018 16:52, Egoitz Aurrekoetxea wrote:

> I was trying to upgrade part of our Cyrus imap installation, concretely
> that one consisting in still 2.3. I was planning to set up Cyrus 3.0. I
> have seen all works properly except for the unexpunge command because as
> someone stated here, a reconstruct -V max was needed.The problem is that
> this reconstruct command, takes ages and I'm not able to keep the
> service offline so many time.

Eventually you are meaning me by "someone", so I kick in here:

The reconstruct (for me) was only needed because I had transferred the
mailboxes using cyradm and the xfer command. As ellie has explained me
in detail, xfer is an IMAP extension which transfers the data on a lower
level than the standard IMAP commands.

Therefore, there is a trade-off: If you transfer the data at "low-level"
(e.g. xfer, file system), the transfer will be fast, and (at least in
case of xfer) everything (flags, permissions etc.) will be transferred
precisely, but you probably will have to reconstruct afterwards.

If you transfer the data at "higher" level, i.e. using standard imap
commands, for example using imapsync, the transfer will be slower, and
you eventually lose flags or permissions (note that I personally never
had any problem with imapsync, but can't say anything about other
software). But you don't need to reconstruct afterwards.

Could you eventually give us some figures?

In my case, I transferred between 10 and 20 GB of data from 2.4.16 to
2.5.10 (this is not that much data, but it contained a complicated
shared folder (public) namespace with thousands of deeply nested
folders). However, reconstruct -V max took less than 10 minutes afterwards.

Given that the source and the destination server were both running in
VMs on the *same* physical hardware which is over 7 years old and even
runs from normal HDD storage (it's a dual Xeon 5620 system, no SSDs),
this is very fast.

So I am curious what the size of your data is. You could do the transfer
and let the reconstruct run over the weekend when your users are not at
work. Based on my figures, you should be able to transfer and
reconstruct several TB of messages during one weekend ...

Regards,

Binarus


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Egoitz Aurrekoetxea]

Thank you so much Ellie!! 

I would test, read code when needed and finally attempt the upgrade... I
think this coud work should say I'm in testing phase still, 

I'll keep you informed :) 

Cheers!

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 17-12-2018 22:46, ellie timoney escribió:

>> Would be fine if Bron, Ellie or someone at Fastmail could tell something 
>> about it to us :) :) 
> 
> Cheeky!  Thing is, at FM our production servers more or less track the master 
> branch, so we were running "3.0" from the moment 2.5 forked off, and so our 
> upgrade process only ever really needs to deal with iterative changes.  Our 
> accumulated experience is what informs the "upgrade notes" included with the 
> 2.5.0 and 3.0.0 releases (not sure about older versions, I wasn't around 
> then). 
> 
> This mailing list is the right place to find people with real experience 
> doing big-bang upgrades. :) 
> 
> Cheers, 
> 
> ellie 
> 
> On Mon, Dec 17, 2018, at 8:40 PM, Egoitz Aurrekoetxea wrote: 
> 
> Hi mate, 
> 
> I think (and say think :) )I finally found a method. Although I'm testing it 
> deeply... it seems (say seems too :) ) 2.4 is compatible with a mail spool in 
> 2.3 (at least with my config). So I'll try to upgrade first to 2.4 and later 
> to 3.0 setting up a replication from 2.4 to 3.0. Would be fine if Bron, Ellie 
> or someone at Fastmail could tell something about it to us :) :) 
> 
> Cheers!
> 
> --- 
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 
> 944 209 470 
> Parque Tecnológico. Edificio 103 
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es
> 
> www.sarenet.es [1] 
> 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo. 
> 
> El 16-12-2018 22:24, John Capo escribió: 
> 
> On Thu, December 13, 2018 13:25, Egoitz Aurrekoetxea wrote: 
> Hi again! 
> 
> Else as a simplication way can you replicate any manner a 2.3 with some 
> newer version?. At least in manual mode (not rolling)?. 
> 
> The replication protocol in 2.4 is not compatible wit 2.3. 
> 
> There is no easy way.  I'm rsync'ing one account at a time between 2.3 and 
> 2.4 with IMAP/POP and LMTP access disabled, followed by a reconstruct, and 
> then enabling IMAP/POP and LMTP access. 
> 
> Many terrabytes to go. 
> 
> You could also look at imapsync but its slow. 
> 
> Cheers. 
> 
> --- 
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 944 209 470 
> Parque Tecnológico. Edificio 103 
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es www.sarenet.es [1] [1 [1]] Antes de imprimir este correo 
> electrónico piense si es 
> necesario hacerlo. 
> 
> El 13-12-2018 16:52, Egoitz Aurrekoetxea escribió: 
> 
> Good afternoon, 
> 
> I was trying to upgrade part of our Cyrus imap installation, concretely that 
> one consisting in 
> still 2.3. I was planning to set up Cyrus 3.0. I have seen all works properly 
> except for the 
> unexpunge command because as someone stated here, a reconstruct -V max was 
> needed.The problem 
> is that this reconstruct command, takes ages and I'm not able to keep the 
> service offline so 
> many time. So I have been thinking in the following scenario : 
> 
> - Cyrus 2.3 master -> Cyrus 2.4 slave 
> 
> Get this 2.4 slave ready and set it as master. But here comes my first doubt. 
> Does the 2.4 
> replication work with the 2.3 replication?. Can in this pair, both (the 2.3 
> and the 2.4) be 
> both master and slave?. I mean to switch roles in the pair. Make one become 
> master and the 
> other slave and  vice versa?. 
> 
> Let's think now Cyrus 2.4 is ready and working. 
> 
> - Now, I would set up a new 3.0 slave. I know 2.4 could replicate with 3.0. 
> So I would get the 
> 3.0 ready and then set 3.0 as master. Can in this pair both the 2.4 and 3.0 
> be master and 
> slave?. Meaning again to the same role switching commented before... to make 
> one to be master 
> and the other slave or vice versa 
> 
> I'l will end up with 2 3.0 master and slave... but I need to trace the 
> path... 
> 
> Does anyone see any other way?. 
> 
> Best regards, 
> 
> - 
> 
> -- 
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 944 209 470 
> Parque Tecnológico. Edificio 103 
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es www.sarenet.es [1] [1 [1]] Antes de imprimir este correo 
> electrónico piense si es 
> necesario hacerlo.  
> Cyrus Home Page: http://www.cyrusimap.org/ 
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ 
> To Unsubscribe: 
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus 
> 
> Links: 
> -- 
> [1] http://www.sarenet.es

  

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:

Re: Question for upgrading

[ellie timoney]

> Would be fine if Bron, Ellie or someone at Fastmail could tell
> something about it to us :) :)
Cheeky!  Thing is, at FM our production servers more or less track the
master branch, so we were running "3.0" from the moment 2.5 forked off,
and so our upgrade process only ever really needs to deal with iterative
changes.  Our accumulated experience is what informs the "upgrade notes"
included with the 2.5.0 and 3.0.0 releases (not sure about older
versions, I wasn't around then).
This mailing list is the right place to find people with real experience
doing big-bang upgrades. :)
Cheers,

ellie

On Mon, Dec 17, 2018, at 8:40 PM, Egoitz Aurrekoetxea wrote:
> Hi mate,


> 


> I think (and say think :) )I finally found a method. Although I'm
> testing it deeply... it seems (say seems too :) ) 2.4 is compatible
> with a mail spool in 2.3 (at least with my config). So I'll try to
> upgrade first to 2.4 and later to 3.0 setting up a replication from
> 2.4 to 3.0. Would be fine if Bron, Ellie or someone at Fastmail could
> tell something about it to us :) :)> 


> Cheers!


> ---
> 
> sarenet
> *Egoitz Aurrekoetxea*
> Departamento de sistemas
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia)
> ego...@sarenet.es
> www.sarenet.es
> 
> Antes de imprimir este correo electrónico piense si es necesario
> hacerlo.> 


> El 16-12-2018 22:24, John Capo escribió:


>> On Thu, December 13, 2018 13:25, Egoitz Aurrekoetxea wrote: 
>>> Hi again!
>>> 
>>> 
>>>  Else as a simplication way can you replicate any manner a 2.3
>>>  with some>>>  newer version?. At least in manual mode (not rolling)?.
>> 
>> The replication protocol in 2.4 is not compatible wit 2.3.
>> 
>>  There is no easy way.  I'm rsync'ing one account at a time between
>>  2.3 and 2.4 with IMAP/POP and LMTP access disabled, followed by a
>>  reconstruct, and then enabling IMAP/POP and LMTP access.>> 
>>  Many terrabytes to go.
>> 
>>  You could also look at imapsync but its slow.
>> 
>> 
>>> 
>>> Cheers.
>>> 
>>> 
>>>  ---
>>> 
>>> 
>>>  EGOITZ AURREKOETXEA
>>>  Departamento de sistemas
>>>  944 209 470
>>>  Parque Tecnológico. Edificio 103
>>>  48170 Zamudio (Bizkaia)
>>> ego...@sarenet.es www.sarenet.es [1[1]] Antes de imprimir este
>>> correo electrónico piense si es>>>  necesario hacerlo.
>>> 
>>>  El 13-12-2018 16:52, Egoitz Aurrekoetxea escribió:
>>> 
>>> 
>>> 
 Good afternoon,
 
 
  I was trying to upgrade part of our Cyrus imap installation,
  concretely that one consisting in  still 2.3. I was planning to set 
 up Cyrus 3.0. I have seen all
  works properly except for the  unexpunge command because as someone 
 stated here, a reconstruct -V
  max was needed.The problem  is that this reconstruct command, takes 
 ages and I'm not able to
  keep the service offline so  many time. So I have been thinking in 
 the following scenario :
 
  - Cyrus 2.3 master -> Cyrus 2.4 slave
 
 
  Get this 2.4 slave ready and set it as master. But here comes my
  first doubt. Does the 2.4  replication work with the 2.3 
 replication?. Can in this pair, both
  (the 2.3 and the 2.4) be  both master and slave?. I mean to switch 
 roles in the pair. Make
  one become master and the  other slave and  vice versa?.
 
  Let's think now Cyrus 2.4 is ready and working.
 
 
  - Now, I would set up a new 3.0 slave. I know 2.4 could replicate
with 3.0. So I would get the  3. ready and then set 3.0 as master. 
 Can in this pair both the 2.4
 and 3.0 be master and  slave?. Meaning again to the same role 
 switching commented
  before... to make one to be master  and the other slave or vice 
 versa
 
  I'l will end up with 2 3.0 master and slave... but I need to trace
  the path... 
 
  Does anyone see any other way?.
 
 
  Best regards,
 
 
  -
 
 
  --
 
 
  EGOITZ AURREKOETXEA
  Departamento de sistemas
  944 209 470
  Parque Tecnológico. Edificio 103
  48170 Zamudio (Bizkaia)
 ego...@sarenet.es www.sarenet.es [1[2]] Antes de imprimir este
 correo electrónico piense si es  necesario hacerlo. 
  Cyrus Home Page: http://www.cyrusimap.org/
  List Archives/Info:
  http://lists.andrew.cmu.edu/pipermail/info-cyrus/  To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
>>> 
>>> 
>>> Links:
>>>  --
>>>  [1] http://www.sarenet.es


Links:

  1. http://www.sarenet.es
  2. http://www.sarenet.es

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Egoitz Aurrekoetxea]

Hi! 

Yes, I assume there shouldn't be problems... in fact reconstruct in 2.4
does not have the option for upgrading the mailbox databases version
with a reconstruct -V max command... So... I assume it's compatible 

There I could then setup a slave replication... I hope... I'll tell you
:) 

Cheers!

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 17-12-2018 12:38, Adam Tauno Williams escribió:

> On Mon, 2018-12-17 at 10:40 +0100, Egoitz Aurrekoetxea wrote: 
> 
>> I think (and say think :) )I finally found a method. Although I'm
>> testing it deeply... it seems (say seems too :) ) 2.4 is compatible
>> with a mail spool in 2.3 (at least with my config). So I'll try to
>> upgrade first to 2.4 and later to 3.0 setting up a replication from
>> 2.4 to 3.0. Would be fine if Bron, Ellie or someone at Fastmail could
>> tell something about it to us :) :)
> 
> Yes, I have performed an in-place upgrade of 2.3 to 2.4.  Other than
> some delay due to index reconstruction it went very smoothly.
> 
> The only issues I recall is that some users got some deleted messages
> back after the reconstruct, and there were some mailboxes which lost
> Seen status;  I never figured out why [they were related to that
> handful of users which somehow always have problems with everything].
 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Adam Tauno Williams]

On Mon, 2018-12-17 at 10:40 +0100, Egoitz Aurrekoetxea wrote:
> I think (and say think :) )I finally found a method. Although I'm
> testing it deeply... it seems (say seems too :) ) 2.4 is compatible
> with a mail spool in 2.3 (at least with my config). So I'll try to
> upgrade first to 2.4 and later to 3.0 setting up a replication from
> 2.4 to 3.0. Would be fine if Bron, Ellie or someone at Fastmail could
> tell something about it to us :) :)

Yes, I have performed an in-place upgrade of 2.3 to 2.4.  Other than
some delay due to index reconstruction it went very smoothly.

The only issues I recall is that some users got some deleted messages
back after the reconstruct, and there were some mailboxes which lost
Seen status;  I never figured out why [they were related to that
handful of users which somehow always have problems with everything].

-- 
Executive Committee Vice-Chair
Michigan Association of Railroad Passengers
537 Shirley St NE Grand Rapids, MI 49503-1754 Phone: 616.581.8010
E-mail: awill...@whitemice.org GPG#D95ED383 


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Egoitz Aurrekoetxea]

Hi mate, 

I think (and say think :) )I finally found a method. Although I'm
testing it deeply... it seems (say seems too :) ) 2.4 is compatible with
a mail spool in 2.3 (at least with my config). So I'll try to upgrade
first to 2.4 and later to 3.0 setting up a replication from 2.4 to 3.0.
Would be fine if Bron, Ellie or someone at Fastmail could tell something
about it to us :) :) 

Cheers!

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 16-12-2018 22:24, John Capo escribió:

> On Thu, December 13, 2018 13:25, Egoitz Aurrekoetxea wrote: 
> 
>> Hi again!
>> 
>> Else as a simplication way can you replicate any manner a 2.3 with some
>> newer version?. At least in manual mode (not rolling)?.
> 
> The replication protocol in 2.4 is not compatible wit 2.3.
> 
> There is no easy way.  I'm rsync'ing one account at a time between 2.3 and 
> 2.4 with IMAP/POP and LMTP access disabled, followed by a reconstruct, and 
> then enabling IMAP/POP and LMTP access.
> 
> Many terrabytes to go.
> 
> You could also look at imapsync but its slow.
> 
> Cheers.
> 
> ---
> 
> EGOITZ AURREKOETXEA
> Departamento de sistemas
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia)
> ego...@sarenet.es www.sarenet.es [1] [1 [1]] Antes de imprimir este correo 
> electrónico piense si es
> necesario hacerlo.
> 
> El 13-12-2018 16:52, Egoitz Aurrekoetxea escribió:
> 
> Good afternoon,
> 
> I was trying to upgrade part of our Cyrus imap installation, concretely that 
> one consisting in
> still 2.3. I was planning to set up Cyrus 3.0. I have seen all works properly 
> except for the
> unexpunge command because as someone stated here, a reconstruct -V max was 
> needed.The problem
> is that this reconstruct command, takes ages and I'm not able to keep the 
> service offline so
> many time. So I have been thinking in the following scenario :
> 
> - Cyrus 2.3 master -> Cyrus 2.4 slave
> 
> Get this 2.4 slave ready and set it as master. But here comes my first doubt. 
> Does the 2.4
> replication work with the 2.3 replication?. Can in this pair, both (the 2.3 
> and the 2.4) be
> both master and slave?. I mean to switch roles in the pair. Make one become 
> master and the
> other slave and  vice versa?.
> 
> Let's think now Cyrus 2.4 is ready and working.
> 
> - Now, I would set up a new 3.0 slave. I know 2.4 could replicate with 3.0. 
> So I would get the
> 3.0 ready and then set 3.0 as master. Can in this pair both the 2.4 and 3.0 
> be master and
> slave?. Meaning again to the same role switching commented before... to make 
> one to be master
> and the other slave or vice versa
> 
> I'l will end up with 2 3.0 master and slave... but I need to trace the path...
> 
> Does anyone see any other way?.
> 
> Best regards,
> 
> -
> 
> --
> 
> EGOITZ AURREKOETXEA
> Departamento de sistemas
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia)
> ego...@sarenet.es www.sarenet.es [1] [1 [1]] Antes de imprimir este correo 
> electrónico piense si es
> necesario hacerlo. 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
> 
> Links:
> --
> [1] http://www.sarenet.es

 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[John Capo via Info-cyrus]

On Thu, December 13, 2018 13:25, Egoitz Aurrekoetxea wrote:
> Hi again!
>
>
> Else as a simplication way can you replicate any manner a 2.3 with some
> newer version?. At least in manual mode (not rolling)?.

The replication protocol in 2.4 is not compatible wit 2.3.

There is no easy way.  I'm rsync'ing one account at a time between 2.3 and 2.4 
with IMAP/POP and LMTP access disabled, followed by a reconstruct, and then 
enabling IMAP/POP and LMTP access.

Many terrabytes to go.

You could also look at imapsync but its slow.

>
> Cheers.
>
>
> ---
>
>
> EGOITZ AURREKOETXEA
> Departamento de sistemas
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia)
> ego...@sarenet.es www.sarenet.es [1] Antes de imprimir este correo 
> electrónico piense si es
> necesario hacerlo.
>
> El 13-12-2018 16:52, Egoitz Aurrekoetxea escribió:
>
>
>> Good afternoon,
>>
>>
>> I was trying to upgrade part of our Cyrus imap installation, concretely that 
>> one consisting in
>> still 2.3. I was planning to set up Cyrus 3.0. I have seen all works 
>> properly except for the
>> unexpunge command because as someone stated here, a reconstruct -V max was 
>> needed.The problem
>> is that this reconstruct command, takes ages and I'm not able to keep the 
>> service offline so
>> many time. So I have been thinking in the following scenario :
>>
>> - Cyrus 2.3 master -> Cyrus 2.4 slave
>>
>>
>> Get this 2.4 slave ready and set it as master. But here comes my first 
>> doubt. Does the 2.4
>> replication work with the 2.3 replication?. Can in this pair, both (the 2.3 
>> and the 2.4) be
>> both master and slave?. I mean to switch roles in the pair. Make one become 
>> master and the
>> other slave and  vice versa?.
>>
>> Let's think now Cyrus 2.4 is ready and working.
>>
>>
>> - Now, I would set up a new 3.0 slave. I know 2.4 could replicate with 3.0. 
>> So I would get the
>> 3.0 ready and then set 3.0 as master. Can in this pair both the 2.4 and 3.0 
>> be master and
>> slave?. Meaning again to the same role switching commented before... to make 
>> one to be master
>> and the other slave or vice versa
>>
>> I'l will end up with 2 3.0 master and slave... but I need to trace the 
>> path...
>>
>>
>> Does anyone see any other way?.
>>
>>
>> Best regards,
>>
>>
>> -
>>
>>
>> --
>>
>>
>> EGOITZ AURREKOETXEA
>> Departamento de sistemas
>> 944 209 470
>> Parque Tecnológico. Edificio 103
>> 48170 Zamudio (Bizkaia)
>> ego...@sarenet.es www.sarenet.es [1] Antes de imprimir este correo 
>> electrónico piense si es
>> necesario hacerlo. 
>> Cyrus Home Page: http://www.cyrusimap.org/
>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
>> To Unsubscribe:
>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
>>
>
>
> Links:
> --
> [1] http://www.sarenet.es



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Nic Bernstein]

On 12/13/18 9:52 AM, Egoitz Aurrekoetxea wrote:


I was trying to upgrade part of our Cyrus imap installation, 
concretely that one consisting in still 2.3. I was planning to set up 
Cyrus 3.0. I have seen all works properly except for the unexpunge 
command because as someone stated here, a reconstruct -V max was 
needed.The problem is that this reconstruct command, takes ages and 
I'm not able to keep the service offline so many time. So I have been 
thinking in the following scenario :




Egoitz,
As long as you've followed all of the various steps needed to account 
for version changes, as outlined in the Release Notes for /all/ 
intermediary releases, then the last step should be the updating of the 
indexes.  Rather than running "reconstruct -V max" on all mailboxes at 
once, simply run it on subsets.  We've done this on large installations 
without ill effect.  You can have the service on line during the 
reconstruct, and, as you note, have most all functionality present.


We build a list of users (mboxlist.txt), and then run a cron job, during 
off-peak hours, using the 'parallel' command like so (from 'crontab -e 
-u cyrus'):


   ### ## Start a batch of recursive reconstruct jobs at 7PM and
   discontinue ## at 6:53AM. 0 19 * * * parallel -j 5 --resume --joblog
   /var/lib/imap/reconstruct.log cyrus reconstruct -G -V max -r -u {} <
   /var/lib/imap/mboxlist.txt 53 06 * * * kill -TERM `ps ax | grep
   [p]arallel | awk '{print $1}'`

Cheers,
    -nic

--
Nic Bernstein n...@onlight.com
Onlight Inc.  www.onlight.com
6525 W Bluemound Rd., Ste 24  v. 414.272.4477
Milwaukee, Wisconsin  53213-4073  f. 414.290.0335


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Egoitz Aurrekoetxea]

Common Bron, Ellie, mates :) any advise? 

Cheers :) :)

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 13-12-2018 19:25, Egoitz Aurrekoetxea escribió:

> Hi again! 
> 
> Else as a simplication way can you replicate any manner a 2.3 with some newer 
> version?. At least in manual mode (not rolling)?. 
> 
> Cheers.
> 
> ---
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es 
> www.sarenet.es [1] 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo. 
> 
> El 13-12-2018 16:52, Egoitz Aurrekoetxea escribió:
> 
>> Good afternoon, 
>> 
>> I was trying to upgrade part of our Cyrus imap installation, concretely that 
>> one consisting in still 2.3. I was planning to set up Cyrus 3.0. I have seen 
>> all works properly except for the unexpunge command because as someone 
>> stated here, a reconstruct -V max was needed.The problem is that this 
>> reconstruct command, takes ages and I'm not able to keep the service offline 
>> so many time. So I have been thinking in the following scenario : 
>> 
>> - Cyrus 2.3 master -> Cyrus 2.4 slave 
>> 
>> Get this 2.4 slave ready and set it as master. But here comes my first 
>> doubt. Does the 2.4 replication work with the 2.3 replication?. Can in this 
>> pair, both (the 2.3 and the 2.4) be both master and slave?. I mean to switch 
>> roles in the pair. Make one become master and the other slave and  vice 
>> versa?. 
>> 
>> Let's think now Cyrus 2.4 is ready and working. 
>> 
>> - Now, I would set up a new 3.0 slave. I know 2.4 could replicate with 3.0. 
>> So I would get the 3.0 ready and then set 3.0 as master. Can in this pair 
>> both the 2.4 and 3.0 be master and slave?. Meaning again to the same role 
>> switching commented before... to make one to be master and the other slave 
>> or vice versa 
>> 
>> I'l will end up with 2 3.0 master and slave... but I need to trace the 
>> path... 
>> 
>> Does anyone see any other way?. 
>> 
>> Best regards, 
>> 
>> -
>> 
>> -- 
>> 
>> EGOITZ AURREKOETXEA 
>> Departamento de sistemas 
>> 944 209 470
>> Parque Tecnológico. Edificio 103
>> 48170 Zamudio (Bizkaia) 
>> ego...@sarenet.es 
>> www.sarenet.es [1] 
>> Antes de imprimir este correo electrónico piense si es necesario hacerlo. 
>> 
>> Cyrus Home Page: http://www.cyrusimap.org/
>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
>> To Unsubscribe:
>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
> 
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question for upgrading

[Egoitz Aurrekoetxea]

Hi again! 

Else as a simplication way can you replicate any manner a 2.3 with some
newer version?. At least in manual mode (not rolling)?. 

Cheers.

---

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

El 13-12-2018 16:52, Egoitz Aurrekoetxea escribió:

> Good afternoon, 
> 
> I was trying to upgrade part of our Cyrus imap installation, concretely that 
> one consisting in still 2.3. I was planning to set up Cyrus 3.0. I have seen 
> all works properly except for the unexpunge command because as someone stated 
> here, a reconstruct -V max was needed.The problem is that this reconstruct 
> command, takes ages and I'm not able to keep the service offline so many 
> time. So I have been thinking in the following scenario : 
> 
> - Cyrus 2.3 master -> Cyrus 2.4 slave 
> 
> Get this 2.4 slave ready and set it as master. But here comes my first doubt. 
> Does the 2.4 replication work with the 2.3 replication?. Can in this pair, 
> both (the 2.3 and the 2.4) be both master and slave?. I mean to switch roles 
> in the pair. Make one become master and the other slave and  vice versa?. 
> 
> Let's think now Cyrus 2.4 is ready and working. 
> 
> - Now, I would set up a new 3.0 slave. I know 2.4 could replicate with 3.0. 
> So I would get the 3.0 ready and then set 3.0 as master. Can in this pair 
> both the 2.4 and 3.0 be master and slave?. Meaning again to the same role 
> switching commented before... to make one to be master and the other slave or 
> vice versa 
> 
> I'l will end up with 2 3.0 master and slave... but I need to trace the 
> path... 
> 
> Does anyone see any other way?. 
> 
> Best regards, 
> 
> -
> 
> -- 
> 
> EGOITZ AURREKOETXEA 
> Departamento de sistemas 
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia) 
> ego...@sarenet.es 
> www.sarenet.es [1] 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo. 
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Question for upgrading

[Egoitz Aurrekoetxea]

Good afternoon, 

I was trying to upgrade part of our Cyrus imap installation, concretely
that one consisting in still 2.3. I was planning to set up Cyrus 3.0. I
have seen all works properly except for the unexpunge command because as
someone stated here, a reconstruct -V max was needed.The problem is that
this reconstruct command, takes ages and I'm not able to keep the
service offline so many time. So I have been thinking in the following
scenario : 

- Cyrus 2.3 master -> Cyrus 2.4 slave 

Get this 2.4 slave ready and set it as master. But here comes my first
doubt. Does the 2.4 replication work with the 2.3 replication?. Can in
this pair, both (the 2.3 and the 2.4) be both master and slave?. I mean
to switch roles in the pair. Make one become master and the other slave
and  vice versa?. 

Let's think now Cyrus 2.4 is ready and working. 

- Now, I would set up a new 3.0 slave. I know 2.4 could replicate with
3.0. So I would get the 3.0 ready and then set 3.0 as master. Can in
this pair both the 2.4 and 3.0 be master and slave?. Meaning again to
the same role switching commented before... to make one to be master and
the other slave or vice versa 

I'l will end up with 2 3.0 master and slave... but I need to trace the
path... 

Does anyone see any other way?. 

Best regards, 

-

-- 

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Operating system performance for Cyrus and one more question

[Egoitz Aurrekoetxea]

Good afternoon, 

Is there any noticiable operating systems whose syscalls, filesystems...
etc... could make Cyrus run faster?. We usually run it on FreeBSD and
are pretty happy. Perhaps newer versions run better in any Linux like
os?. 

About Xapian, XCONV, Jmap... I have tried doing a search with my mailbox
in a new testing env, where I have connected a tesing mailbox imap
partition with messages and mailboxes, coming from an older version of
Cyrus. Even having Xapian, Conversations and so enabled, it does not
find messages newer than 3 month located in the Sent folder. Perhaps
Xapian, only works for new incoming messages?. Or should the mailboxes
be reconstructed in order to a search to find and show all messages from
a conversation existing in all mailboxes?. Or perhaps it's my mua's
fault and is not searching properly in the IMAP server, because is not
issuing some new commands to be used in order to make this kind of
search to be done by Cyrus?. 

Best regards,

-- 

EGOITZ AURREKOETXEA 
Departamento de sistemas 
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia) 
ego...@sarenet.es 
www.sarenet.es [1] 
Antes de imprimir este correo electrónico piense si es necesario
hacerlo. 

Links:
--
[1] http://www.sarenet.es
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Simple replication question

[Nic Bernstein]

On 11/15/18 2:16 AM, Zorg wrote:

I ve one cyrus imap server I want to create a replicated one

I have read the documentation but nothing  explain how two start the 
first replication


If my slave master is empty how can i synchronise them the first time


Once you've got replication configured, simply follow the instructions 
in the Standard Operating Procedures for "Manual Replication" here:

https://cyrusimap.org/imap/reference/admin/sop/replication.html?highlight=replication#manual-replication

To be clear, the "sync_client" command is run on the replica master,  
The "sync_server" on the replica will be automatically started up by the 
'cyr_master' process (may be called 'cyrmaster' or simply 'master', 
depending on version and distro).  The arguments and options in the 
sample command will sync a given user, but you may use any of the 
various options to sync the entire mail store, or parts of it.


Cheers,
    -nic

--
Nic Bernstein n...@onlight.com
Onlight Inc.  www.onlight.com
6525 W Bluemound Rd., Ste 24  v. 414.272.4477
Milwaukee, Wisconsin  53213-4073  f. 414.290.0335


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Simple replication question

[Zorg]

Hello

I ve one cyrus imap server I want to create a replicated one

I have read the documentation but nothing  explain how two start the 
first replication


If my slave master is empty how can i synchronise them the first time

Thanks


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: archive and normal partition mixing question

[Bron Gondwana]

No, don't do that.  You can put them on the same filesystem, but don't
put different-named partitions on the same disk path.  That will confuse
Cyrus no end.
Bron.


On Tue, Jul 24, 2018, at 00:10, Marco wrote:
> Hello,
> 
>   I would like to create a quota root mailbox with a normal partition> which 
> is the same of the archive partition. Does Cyrus allow this?
> 
> For instance, I would know if this configuration is valid:
> 
> partition-maildata1: /maildata/maildata1
> partition-maildata2: /maildata/maildata2
> partition-arcmaildata1:  /archivio/maildata1
> partition-arcmaildata2: /archivio/maildata2
> archivepartition-maildata1: /archivio/maildata1
> archivepartition-maildata2: /archivio/maildata2
> 
> metapartition-maildata1: /metamaildata/maildata1
> metapartition-maildata2: /metamaildata/maildata2
> metapartition-arcmaildata1:  /metarchivio/maildata1
> metapartition-arcmaildata2: /metarchivio/maildata2
> 
> archive_enabled: 1
> archive_days: 30
> 
> 
> 
> In this way Cyrus could archive old mails in /archivio/maildata*
> But these partitions are used for other mailboxes too. For
> instance I can> 
> createmailbox user/john@example.com maildata1
> createmailbox user/john.doe/arch...@example.com arcmaildata1
> 
> In this way all messages moved or sent to "Archive" folder will stay
> under arcmaildata1.
> All mailboxes archived by "cyr_expire -A" will go to the same path of> 
> arcmaildata1 too.
> 
> Thank you very much
> Regards
> Marco
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/> To 
> Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

--
  Bron Gondwana, CEO, FastMail Pty Ltd
  br...@fastmailteam.com



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

archive and normal partition mixing question

[Marco]

Hello,

  I would like to create a quota root mailbox with a normal partition 
which is the same of the archive partition. Does Cyrus allow this?


For instance, I would know if this configuration is valid:

partition-maildata1: /maildata/maildata1
partition-maildata2: /maildata/maildata2
partition-arcmaildata1:  /archivio/maildata1
partition-arcmaildata2: /archivio/maildata2
archivepartition-maildata1: /archivio/maildata1
archivepartition-maildata2: /archivio/maildata2

metapartition-maildata1: /metamaildata/maildata1
metapartition-maildata2: /metamaildata/maildata2
metapartition-arcmaildata1:  /metarchivio/maildata1
metapartition-arcmaildata2: /metarchivio/maildata2

archive_enabled: 1
archive_days: 30



In this way Cyrus could archive old mails in /archivio/maildata*
But these partitions are used for other mailboxes too. For instance I can

createmailbox user/john@example.com maildata1
createmailbox user/john.doe/arch...@example.com arcmaildata1

In this way all messages moved or sent to "Archive" folder will stay 
under arcmaildata1.
All mailboxes archived by "cyr_expire -A" will go to the same path of 
arcmaildata1 too.


Thank you very much
Regards
Marco

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about getting release source packages

[ellie timoney]

On Sun, Apr 15, 2018, at 9:53 AM, David J. Weller-Fahy wrote:
> It may be useful to include a reference to those locations, but 
> I'll find an email address for the website to send that recommendation.

This mailing list is the right spot for that, thanks.  You're right, the 
download page should link to both FTP and HTTPS.  We'll get that fixed up. :)

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about getting release source packages

[David J. Weller-Fahy]

On Sat, Apr 14, 2018, at 15:17, Jason Englander wrote:
> On Sat, 14 Apr 2018, David J. Weller-Fahy wrote:
> 
> > the FTP location [1] referenced on github [2], I am prompted for a 
> > username and password.  I've tried anonymous, and various combinations 
> > thereof, but nothing allows me to access the release packages.
> >
> > [1]: ftp://ftp.cyrusimap.org/cyrus-imapd/
> > [2]: https://github.com/cyrusimap/cyrus-imapd#how-to-get-cyrus
> >
> > Could someone confirm whether this is just me?
> 
> Browser is no help, but commandline FTP gives me the following:
> 
> Connected to FTP-01.cyrusimap.org.
> 500 OOPS: failed to open vsftpd log file:/var/log/vsftpd.log
> 
> So, I'd go with the http download until someone fixes that.
> 
> Unless you are looking at different branches, patches, etc. I would 
> recommend the web site download page rather than github:
> 
> https://www.cyrusimap.org/download.html

Ah-hah!  Thanks for the nudge: because there was no reference to the HTTP 
download locations at the "Build and Install Yourself" [1] page, it never 
occurred to me to look in the release notes for such.  With your confirmation 
that there were HTTP download locations, I ended up finding them.  It may be 
useful to include a reference to those locations, but I'll find an email 
address for the website to send that recommendation.

[1]: https://www.cyrusimap.org/imap/download/getcyrus.html

Regards,
  -dave

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about getting release source packages (fwd)

[Jason Englander]

On Sat, 14 Apr 2018, David J. Weller-Fahy wrote:

the FTP location [1] referenced on github [2], I am prompted for a username 
and password.  I've tried anonymous, and various combinations thereof, but 
nothing allows me to access the release packages.


[1]: ftp://ftp.cyrusimap.org/cyrus-imapd/
[2]: https://github.com/cyrusimap/cyrus-imapd#how-to-get-cyrus

Could someone confirm whether this is just me?


Browser is no help, but commandline FTP gives me the following:

Connected to FTP-01.cyrusimap.org.
500 OOPS: failed to open vsftpd log file:/var/log/vsftpd.log

So, I'd go with the http download until someone fixes that.

Unless you are looking at different branches, patches, etc. I would recommend 
the web site download page rather than github:


https://www.cyrusimap.org/download.html

  Jason



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Question about getting release source packages

[David J. Weller-Fahy]

Greetings,

I'm exploring Cyrus-IMAP as a replacement for my fastmail.com service,  but am 
having trouble getting the release source packages.  When I go to the FTP 
location [1] referenced on github [2], I am prompted for a username and 
password.  I've tried anonymous, and various combinations thereof, but nothing 
allows me to access the release packages.

[1]: ftp://ftp.cyrusimap.org/cyrus-imapd/
[2]: https://github.com/cyrusimap/cyrus-imapd#how-to-get-cyrus

Could someone confirm whether this is just me?

Regards,
  -dave

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: 3.0.1 reference packages question

[Pongrácz István]

 Hi Ellie,

Thank you very much for your answer!

Regarding the reference deb packages, not a problem, but it should be better to 
remove the link from the website, from here: [Quickstart Guide — Cyrus IMAP 
3.0.1 (stable) documentation -> 
http://www.cyrusimap.org/quickstart.html#quick-install]

I already downloaded the source and compiled the latest 3.0.1 and I almost 
succeed to include tons of features, so, now I have a standalone debian jessie 
based cyrus 3.0.1 virtual machine. Only the pure debian netinst and all 
necessary dependencies which needed to compile cyrus.

It still need to configure (following the quickstart), but technically it seems 
pretty usable. Anyway, are there any reference virtual machine image? :) Maybe 
we can push it to somewhere to download...

Bye,

István

--- Config:

Cyrus Server configured components




 event notification: yes

 gssapi: yes

 autocreate: yes

 idled: yes

 httpd: yes

 kerberos V4: no

 murder: yes

 nntpd: yes

 replication: yes

 sieve: yes

 calalarmd: yes

 jmap: yes

 objectstore: no

 backup: yes




External dependencies:

 ldap: yes

 openssl: yes

 zlib: yes

 pcre: yes

 clamav: no

 ---

 caringo: no

 openio: no

 ---

 nghttp2: yes

 brotli: yes

 xml2: yes

 ical: yes

 icu4c: yes

 shapelib: no




Database support:

 mysql: yes

 postgresql: yes

 sqlite: yes

 lmdb: no




Search engine:

 squat: yes

 sphinx: no

 xapian: yes

 xapian_flavor: vanilla




Hardware support:

 SSE4.2: yes




Installation directories:

 prefix: /usr

 sysconfdir: /etc







Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: 3.0.1 reference packages question

[ellie timoney]

Hi István,

Historically, Cyrus has been a source-only distribution.  Deb packages
have been provided by the Debian team, and similarly for other package
management systems.
We're planning to start distributing a basic deb package (mostly, I
think, to act as a guide/reference for official packagers) -- hence the
mention of this in documentation.  But it wasn't ready in time for the
3.0.1 release.
> I started a debian stretch and tried to install it from source,
> pulling down some dependencies also in source format. Following the
> documentation, it almost worked :) (brotli, jmap, xapian etc. also
> compiled and supported). As I had some issues with running itself, I
> cancelled the test environment for a while.
Feel free to ask about these issues on the list :)

Cheers,

ellie

On Wed, Apr 26, 2017, at 09:37 PM, Pongrácz István wrote:
> Hi,


> First of all, thank you for your great job on cyrus-imap!


> I found the announce, the 3.0.1 version released and I planned to
> install it in a test environment.> I started a debian stretch and tried to 
> install it from source,
> pulling down some dependencies also in source format. Following the
> documentation, it almost worked :) (brotli, jmap, xapian etc. also
> compiled and supported). As I had some issues with running itself, I
> cancelled the test environment for a while.> So, I also found that, on your 
> Quickstart page there is a link to the
> reference packages of the 3.0.1, but the link is broken: there is no
> deb subdirectory with the deb packages.> Is that true at this moment, there 
> is no 3.x version (non-)officially
> available for a reference installation?> My idea was, build up a cyrus-imap 
> only server, which could accept
> emails from an other server via transport (ispconfig server -> postfix
> transport -> latest-greatest cyrus-imap server).> Thank you!


> Best regards,


> István


> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/> To 
> Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

3.0.1 reference packages question

[Pongrácz István]

Hi,

First of all, thank you for your great job on cyrus-imap!

I found the announce, the 3.0.1 version released and I planned to install it in 
a test environment.

I started a debian stretch and tried to install it from source, pulling down 
some dependencies also in source format. Following the documentation, it almost 
worked :) (brotli, jmap, xapian etc. also compiled and supported). As I had 
some issues with running itself, I cancelled the test environment for a while.

So, I also found that, on your Quickstart page there is a link to the reference 
packages of the 3.0.1, but the link is broken: there is no deb subdirectory 
with the deb packages.

Is that true at this moment, there is no 3.x version (non-)officially available 
for a reference installation?

My idea was, build up a cyrus-imap only server, which could accept emails from 
an other server via transport (ispconfig server -> postfix transport -> 
latest-greatest cyrus-imap server).

Thank you!

Best regards,

István

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Some question about murder and ptloader

[Carlos R Laguna via Info-cyrus]

El 19/04/16 a las 15:35, Carlos R Laguna via Info-cyrus escribió:
Hello everyone, for a couple weeks i had been reading the 
documentation and old mail in the list archives. So far so good 
mupdate can authenticate through sasl using a ldap backend, at the 
moment i have 1 frontend, 1 backend, and the mupdate(master) all 3 are 
running cyrus 2.5.7. However there are stuff that i can hardly grasp, 
so hopefully any of you can cast some light in the next 3 points.


1 There is a know limitations for the uses of spaces on ldap 
parameters? What i mean is:


/etc/saslauthd.conf

Case 1
ldap_bind_dn: uid=cyrus-admin,ou=services,dc=example,dc=org
Case 2
ldap_bind_s: uid=cyrus-admin,ou=special users,dc=example,dc=org

In case 1 both testsaslauthd and mupdatetest can authenticate just 
fine, but in case 2 only testsaslauthd will.


2 In a murder deployment like this, should ptloader be running on all 
server or just a part of it, backend? frontend? (M)mupdate?


3 In my attempt to be consistent through the murder setup i replicated 
some portion of the config in all 3 servers, overkill ?

e.g
sieve_extensions: fileinto reject envelope body vacation imapflags 
notify include regex subaddress relational copy date index

allowallsubscribe: 0
allowusermoves: 1
altnamespace: 1
hashimapspool: 1
anysievefolder: 1
fulldirhash: 0
sieveusehomedir: 0
sieve_allowreferrals: 0
lmtp_downcase_rcpt: 1
lmtp_fuzzy_mailbox_match: 1
username_tolower: 1
deletedprefix: DELETED
delete_mode: delayed
expunge_mode: delayed
postuser: shared

Thank all of you for your time. Best regards

Charles





Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


anyone...?




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Some question about murder and ptloader

[Carlos R Laguna via Info-cyrus]

Hello everyone, for a couple weeks i had been reading the documentation 
and old mail in the list archives. So far so good mupdate can 
authenticate through sasl using a ldap backend, at the moment i have 1 
frontend, 1 backend, and the mupdate(master) all 3 are running cyrus 
2.5.7. However there are stuff that i can hardly grasp, so hopefully any 
of you can cast some light in the next 3 points.


1 There is a know limitations for the uses of spaces on ldap parameters? 
What i mean is:


/etc/saslauthd.conf

Case 1
ldap_bind_dn: uid=cyrus-admin,ou=services,dc=example,dc=org
Case 2
ldap_bind_s: uid=cyrus-admin,ou=special users,dc=example,dc=org

In case 1 both testsaslauthd and mupdatetest can authenticate just fine, 
but in case 2 only testsaslauthd will.


2 In a murder deployment like this, should ptloader be running on all 
server or just a part of it, backend? frontend? (M)mupdate?


3 In my attempt to be consistent through the murder setup i replicated 
some portion of the config in all 3 servers, overkill ?

e.g
sieve_extensions: fileinto reject envelope body vacation imapflags 
notify include regex subaddress relational copy date index

allowallsubscribe: 0
allowusermoves: 1
altnamespace: 1
hashimapspool: 1
anysievefolder: 1
fulldirhash: 0
sieveusehomedir: 0
sieve_allowreferrals: 0
lmtp_downcase_rcpt: 1
lmtp_fuzzy_mailbox_match: 1
username_tolower: 1
deletedprefix: DELETED
delete_mode: delayed
expunge_mode: delayed
postuser: shared

Thank all of you for your time. Best regards

Charles





Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about moving mailboxes between partitions

[Egoitz Aurrekoetxea]

Hi Bron!

 El 13/6/2015, a las 1:21, Bron Gondwana br...@fastmail.fm escribió:
 
 On Fri, Jun 12, 2015, at 05:15 PM, Egoitz Aurrekoetxea wrote:
 
 
 Best regards,
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
 
 
 Anyone who could confirm this :) :) ?? Bron?? :)
 
 Correct - replication can only be to the same-named partition on the 
 destination server.  Replicas are supposed to have identical layout to 
 masters.

I have not seen that…

Assuming mailbox is now in mailstore1…

When you do a renm user/__@___. renm user/__@___. 
mailstore2

it moves to mailstore2 in the server you’re issuing the rename mailbox…. but it 
does not translate too in the slave automatically due to a renm in the master 
to mailstore2 too in the slave…. perhaps is 
something wrong here in this version or… ¿? I mean it’s just moved to 
mailstore2 on the master… not on the slave till you for example stop the 
replication (for avoid accesses there) and issue a renm in the slave too…..

Does it really send partition name when sending commands in the replication??? 
or just sais to the slave…. APPEND, MAILBOX… etc… to mailbox X ?


 
 (this might be something we can change after 3.0, but it's never going to be 
 changed in the 2.3 series)
 

We will be updating in some not long future…. yes….

 Bron.

Thanks a lot Bron!!

 
 -- 
  Bron Gondwana
  br...@fastmail.fm
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about moving mailboxes between partitions

[Egoitz Aurrekoetxea]

Another think I have noticed too… is that cyr_expire’s actions are not sent 
through sync_client… to sync_server am I wrong??. Do they should?

Best regards,

El 15/6/2015, a las 15:54, Egoitz Aurrekoetxea ego...@ramattack.net escribió:
 
 Hi Bron!
 
 El 13/6/2015, a las 1:21, Bron Gondwana br...@fastmail.fm escribió:
 
 On Fri, Jun 12, 2015, at 05:15 PM, Egoitz Aurrekoetxea wrote:
 
 
 Best regards,
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
 
 
 Anyone who could confirm this :) :) ?? Bron?? :)
 
 Correct - replication can only be to the same-named partition on the 
 destination server.  Replicas are supposed to have identical layout to 
 masters.
 
 I have not seen that…
 
 Assuming mailbox is now in mailstore1…
 
 When you do a renm user/__@___. renm user/__@___. 
 mailstore2
 
 it moves to mailstore2 in the server you’re issuing the rename mailbox…. but 
 it does not translate too in the slave automatically due to a renm in the 
 master to mailstore2 too in the slave…. perhaps is 
 something wrong here in this version or… ¿? I mean it’s just moved to 
 mailstore2 on the master… not on the slave till you for example stop the 
 replication (for avoid accesses there) and issue a renm in the slave too…..
 
 Does it really send partition name when sending commands in the 
 replication??? or just sais to the slave…. APPEND, MAILBOX… etc… to mailbox X 
 ?
 
 
 
 (this might be something we can change after 3.0, but it's never going to be 
 changed in the 2.3 series)
 
 
 We will be updating in some not long future…. yes….
 
 Bron.
 
 Thanks a lot Bron!!
 
 
 -- 
 Bron Gondwana
 br...@fastmail.fm
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
 
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about moving mailboxes between partitions

[Egoitz Aurrekoetxea]

 El 9/6/2015, a las 12:48, Egoitz Aurrekoetxea ego...@ramattack.net escribió:
 
 Good morning,
 
 We are running Cyrus 2.3.18 very happily. We have noticed that Cyrus mailbox 
 partition (and config partition) is starting to pass the 70% of used space. 
 So we have decided to add a new disk to the server 
 in order to create a new Cyrus mailbox partition. Later we’ll move some of 
 the big or some more of the littleler mailboxes to this new mailbox  
 partition.
 
 Have been doing some checks and have noticed of two things : 
 
 - The directory of the mailbox in the source partition is not being removed… 
 it stays totally empty but there…
 - In the slave replica (I’m using Cyrus replication) the mailbox is not being 
 moved automatically from partition one… to partition two.. the mailbox 
 destination (the new added mailbox partition)
 
 I wanted to ask, are these two behaviors considered normal? just for knowing 
 if perhaps the code could be doing something wrong…. And mainly talking about 
 the second question about the 
 renm and replication because I’m seeing it does automatically in the slave 
 relocate the mailbox in the second partition… perhaps this is normal too… but 
 IIRC Cyrus replication died if there weren’t 
 the same partitions in the master and the slave…. with the same names… or 
 does it just do that for being able to do cm commands only??.
 
 Best regards,
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


Anyone who could confirm this :) :) ?? Bron?? :)

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about moving mailboxes between partitions

[Bron Gondwana]

On Fri, Jun 12, 2015, at 05:15 PM, Egoitz Aurrekoetxea wrote:
 
  El 9/6/2015, a las 12:48, Egoitz Aurrekoetxea ego...@ramattack.net 
  escribió:
  
  Good morning,
  
  We are running Cyrus 2.3.18 very happily. We have noticed that Cyrus 
  mailbox partition (and config partition) is starting to pass the 70% of 
  used space. So we have decided to add a new disk to the server 
  in order to create a new Cyrus mailbox partition. Later we’ll move some of 
  the big or some more of the littleler mailboxes to this new mailbox  
  partition.
  
  Have been doing some checks and have noticed of two things : 
  
  - The directory of the mailbox in the source partition is not being 
  removed… it stays totally empty but there…
  - In the slave replica (I’m using Cyrus replication) the mailbox is not 
  being moved automatically from partition one… to partition two.. the 
  mailbox destination (the new added mailbox partition)
  
  I wanted to ask, are these two behaviors considered normal? just for 
  knowing if perhaps the code could be doing something wrong…. And mainly 
  talking about the second question about the 
  renm and replication because I’m seeing it does automatically in the slave 
  relocate the mailbox in the second partition… perhaps this is normal too… 
  but IIRC Cyrus replication died if there weren’t 
  the same partitions in the master and the slave…. with the same names… or 
  does it just do that for being able to do cm commands only??.
  
  Best regards,
  
  Cyrus Home Page: http://www.cyrusimap.org/
  List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
  To Unsubscribe:
  https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
 
 
 Anyone who could confirm this :) :) ?? Bron?? :)

Correct - replication can only be to the same-named partition on the 
destination server.  Replicas are supposed to have identical layout to masters.

(this might be something we can change after 3.0, but it's never going to be 
changed in the 2.3 series)

Bron.

-- 
  Bron Gondwana
  br...@fastmail.fm

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Question about moving mailboxes between partitions

[Egoitz Aurrekoetxea]

Good morning,

We are running Cyrus 2.3.18 very happily. We have noticed that Cyrus mailbox 
partition (and config partition) is starting to pass the 70% of used space. So 
we have decided to add a new disk to the server 
in order to create a new Cyrus mailbox partition. Later we’ll move some of the 
big or some more of the littleler mailboxes to this new mailbox  partition.

Have been doing some checks and have noticed of two things : 

- The directory of the mailbox in the source partition is not being removed… it 
stays totally empty but there…
- In the slave replica (I’m using Cyrus replication) the mailbox is not being 
moved automatically from partition one… to partition two.. the mailbox 
destination (the new added mailbox partition)

I wanted to ask, are these two behaviors considered normal? just for knowing if 
perhaps the code could be doing something wrong…. And mainly talking about the 
second question about the 
renm and replication because I’m seeing it does automatically in the slave 
relocate the mailbox in the second partition… perhaps this is normal too… but 
IIRC Cyrus replication died if there weren’t 
the same partitions in the master and the slave…. with the same names… or does 
it just do that for being able to do cm commands only??.

Best regards,

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: delayed delete_mode question

[Sebastian Hagedorn]

I didn't know about the delayed delete_mode option until finally taking
the time to comb through the man pages in detail.

This seems like a very useful feature, but I'm not sure I understand how
it's implemented.  Say some user deletes a message or folder.  Does s/he
have immediate access to the deleted mailboxes hierarchy so that they
can restore the deleted message/folder themselves, or does this require
administrator intervention?  If the former, does the deleted hierarchy
show up automatically, or do they have to subscribe to it?


Only admins can undelete or unexpunge.
--
Sebastian Hagedorn - Weyertal 121, Zimmer 2.02
Regionales Rechenzentrum (RRZK)
Universität zu Köln / Cologne University - Tel. +49-221-470-89578

p7seKEwopoyT3.p7s
Description: S/MIME cryptographic signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

delayed delete_mode question

[Patrick Goetz]

I didn't know about the delayed delete_mode option until finally taking 
the time to comb through the man pages in detail.

This seems like a very useful feature, but I'm not sure I understand how 
it's implemented.  Say some user deletes a message or folder.  Does s/he 
have immediate access to the deleted mailboxes hierarchy so that they 
can restore the deleted message/folder themselves, or does this require 
administrator intervention?  If the former, does the deleted hierarchy 
show up automatically, or do they have to subscribe to it?


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

saslauthd question

[Patrick Goetz]

Surely someone on this list will know the answer to this question.

Given sasl_pwcheck_method: saslauthd, with authentication mechanism=pam

I'm trying to track down how saslauthd knows that the cyrus PAM service 
file is called imap; i.e. /etc/pam.d/imap.

Is this just built in?  I can't find a configuration for it anywhere.




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: saslauthd question

[Patrick Boutilier]

On 12/11/2014 02:34 PM, Patrick Goetz wrote:

Surely someone on this list will know the answer to this question.

Given sasl_pwcheck_method: saslauthd, with authentication mechanism=pam

I'm trying to track down how saslauthd knows that the cyrus PAM service
file is called imap; i.e. /etc/pam.d/imap.

Is this just built in?  I can't find a configuration for it anywhere.




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus




Harcoded in imapd.c

if (sasl_server_new(imap, config_servername 
attachment: boutilpj.vcf
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: saslauthd question

[Andrew Morgan]

On Thu, 11 Dec 2014, Patrick Boutilier wrote:

 On 12/11/2014 02:34 PM, Patrick Goetz wrote:
 Surely someone on this list will know the answer to this question.
 
 Given sasl_pwcheck_method: saslauthd, with authentication mechanism=pam
 
 I'm trying to track down how saslauthd knows that the cyrus PAM service
 file is called imap; i.e. /etc/pam.d/imap.
 
 Is this just built in?  I can't find a configuration for it anywhere.
 
 
 
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
 


 Harcoded in imapd.c

 if (sasl_server_new(imap, config_servername 


I thought the PAM name was taken from the service name in /etc/cyrus.conf, 
but my own configuration seems to indicate that it must be hardcoded for 
each service.  I only have PAM files for imap, lmtp, and sieve 
although I have other service names for some of them.

I guess it's just the imapd.conf config variables that are allowed to be 
prefixed with the service name.

Andy

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: saslauthd question

[Dan White]

On 12/11/14 12:34 -0600, Patrick Goetz wrote:
Surely someone on this list will know the answer to this question.

Given sasl_pwcheck_method: saslauthd, with authentication mechanism=pam

I'm trying to track down how saslauthd knows that the cyrus PAM service
file is called imap; i.e. /etc/pam.d/imap.

Is this just built in?  I can't find a configuration for it anywhere.

saslauthd receives the service name via the unix domain socket protocol
exchange - see the OVERVIEW section in saslauthd-main.c.

The glue layer (libsasl2) provides the service name to saslauthd based on
what it's given in the call to sasl_server_new (See the manpage). Cyrus
imapd hard codes the service names, and they are not configurable. Grep
through the cyrus imap source for that function call to determine which pam
file to configure for each service.

-- 
Dan White

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: saslauthd question

[Patrick Goetz]

On 12/11/2014 12:45 PM, Andrew Morgan wrote:
 I only have PAM files for imap, lmtp, and sieve
 although I have other service names for some of them.


I don't understand why you have PAM files for lmtp and sieve, but most 
particularly lmtp.  lmtpd is just a local daemon that transfers stuff 
from your smtp server to cyrus.  Are you running cyrus and smtpd on 
different servers?  If so, what does the PAM lmtp configuration look like?

I don't know anything about sieve, but thought the filters where all 
internal, too; hence not in need of authentication.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: saslauthd question

[Simon Matter]

 On 12/11/2014 12:45 PM, Andrew Morgan wrote:
 I only have PAM files for imap, lmtp, and sieve
 although I have other service names for some of them.


 I don't understand why you have PAM files for lmtp and sieve, but most
 particularly lmtp.  lmtpd is just a local daemon that transfers stuff
 from your smtp server to cyrus.  Are you running cyrus and smtpd on
 different servers?  If so, what does the PAM lmtp configuration look like?

If you do lmtp over the network, you may want to authenticate who can
deliver mails. Otherwise you can just use lmtpd -a if the environment is
considered secure.


 I don't know anything about sieve, but thought the filters where all
 internal, too; hence not in need of authentication.

Sieve rules have to be managed per user, and therefore you need
authentication. The server itself doesn't need to auth anything to run the
filters.

Regards,
Simon


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: saslauthd question

[Andrew Morgan]

On Thu, 11 Dec 2014, Patrick Goetz wrote:

 On 12/11/2014 12:45 PM, Andrew Morgan wrote:
 I only have PAM files for imap, lmtp, and sieve
 although I have other service names for some of them.


 I don't understand why you have PAM files for lmtp and sieve, but most
 particularly lmtp.  lmtpd is just a local daemon that transfers stuff
 from your smtp server to cyrus.  Are you running cyrus and smtpd on
 different servers?  If so, what does the PAM lmtp configuration look like?

 I don't know anything about sieve, but thought the filters where all
 internal, too; hence not in need of authentication.

We have multiple smtp servers that accept incoming mail plus we run a 
Cyrus Murder cluster.  There is a lot of lmtp over the network happening. 
:)

The PAM configuration for lmtp, sieve, and imap is identical (auth against 
LDAP).

Andy

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question

[Clement Hermann (nodens)]

Le 25/01/2013 21:40, Charles Bradshaw a écrit :
 Andy

 We're nearly there, phew..

 Yes I want to use virtual domains.
 Yes I have virtdomains: userid in /etc/imapd.conf

 OK, so I understand why no imap INBOX, but sendmail and cyrusv2 are therefore
 delivering mail to the wrong mailbox, that is to user.test NOT 
 user.test@mydomain

 I have sendmail.mc containing:

 define(`confLOCAL_MAILER', `cyrusv2')dnl
 define(`CYRUSV2_MAILER_ARGS', `FILE /var/lib/imap/socket/lmtp')dnl
 MAILER(cyrusv2)dnl

 and mailertable containing:
 mydomain  cyrusv2:/var/lib/imap/socket/lmtp

 Obviously the mailertable entry is wrong?

 Or maybe I need something else to stop sendmail/cyrusv2 stripping mydomain
 from email sent to test@mydomain ?

Take a look at the documentation, the sendmail configuration for virtual
domain is explained. Here :
http://cyrusimap.web.cmu.edu/docs/cyrus-imapd/2.3.17/install-virtdomains.php
(search configuring sendmail).


-- 
Clement Hermann (nodens)
- L'air pur ? c'est pas en RL, ça ? c'est pas hors charte ?
Jean in L'Histoire des Pingouins, http://tnemeth.free.fr/fmbl/linuxsf/

Vous trouverez ma clef publique sur le serveur public pgp.mit.edu.
Please find my public key on the public keyserver pgp.mit.edu.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question

[Charles Bradshaw]

Andrew

Just a thought, should the mailbox name be 'user.test@mydomain' instead of
'user.test'?

Here is a dump of /var/lib/imap/mailboxes.db
# hexdump -c /var/lib/imap/mailboxes.db
000 241 002 213  \r   s   k   i   p   l   i   s   t   f   i   l
010   e  \0  \0  \0  \0  \0  \0 001  \0  \0  \0 002  \0  \0  \0 024
020  \0  \0  \0 001  \0  \0  \0 001  \0  \0  \0 320   Q 001   4 312
030  \0  \0 001 001  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0 220
040  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0
*
080  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0 377 377 377 377
090  \0  \0  \0 001  \0  \0  \0  \t   u   s   e   r   .   t   e   s
0a0   t  \0  \0  \0  \0  \0  \0 035   0   d   e   f   a   u   l
0b0   t   t   e   s   t  \t   l   r   s   w   i   p   k   x   t
0c0   e   c   d   a  \t  \0  \0  \0  \0  \0  \0  \0 377 377 377 377
0d0

I see a \tuser.test is the tab correct?

Also curiously cryadm cannot delete user.test giving Permission denied:

# cyradm -u cyrus localhost
Password: 
localhost lm
user.brad (\HasNoChildren)  
localhost dm user.brad
deletemailbox: Permission denied
localhost quit

Something fishy here.

Thanks for your help, Charles Bradshaw

On: Thu, 24 Jan 2013 13:11:02 -0800 (PST), Andrew Morgan wrote:

 On Thu, 24 Jan 2013, Charles Bradshaw wrote:
 
 
  On: Thu, 24 Jan 2013 12:37:18 -0800 (PST), Andy wrote:
 
  On Thu, 24 Jan 2013, Charles Bradshaw wrote:
 
  Output from cyradm:
 
  $ cyradm --user cyrus localhost
  Password:
  localhost lm *
  user.test (\HasNoChildren)
  localhost
 
  Perhaps the user does not permission to see the mailbox?  What does
  lam user.test in cyradm report?
 
 Andy
 
  # cyradm -u cyrus localhost
  Password:
  localhost lam user.test
  test lrswipkxtecda
  localhost
 
 Okay, can we confirm that you are connecting as the user test? 
  Check your syslog for a message similar to:
 
 imap[30372]: login: cyrus-fe3.onid.oregonstate.edu [128.193.4.145] 
 test PLAIN User logged in
 
 Perhaps we have a problem with virtualdomains.
 
   Andy
--- End of Original Message ---

Andy
Here is a complete /var/log/maillog for a session.

Jan 24 21:16:06 dell2600 imap[4844]: accepted connection
Jan 24 21:16:06 dell2600 master[5029]: about to exec /usr/lib/cyrus-imapd/imapd
Jan 24 21:16:06 dell2600 imap[5029]: executed
Jan 24 21:16:36 dell2600 imap[4844]: fetching user_deny.db entry for
'test@mydomain'
Jan 24 21:16:36 dell2600 imap[4844]: login: localhost [::1] test@mydomain
plaintext User logged in
SESSIONID=dell2600.bradcan.homelinux.com-4844-1359062166-1
Jan 24 21:16:36 dell2600 imap[4844]: fetching user_deny.db entry for
'test@mydomain'
Jan 24 21:16:51 dell2600 imap[4844]: fetching user_deny.db entry for
'test@mydomain'
Jan 24 21:16:59 dell2600 imap[4844]: USAGE test@mydomain user: 0.009998 sys:
0.009998
Jan 24 21:18:51 dell2600 master[4485]: process 4844 exited, status 0
Jan 24 21:19:06 dell2600 master[5036]: about to exec
/usr/lib/cyrus-imapd/ctl_cyrusdb
Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: checkpointing cyrus databases
Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: archiving database file:
/var/lib/imap/mailboxes.db
Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: archiving database file:
/var/lib/imap/annotations.db
Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: done checkpointing cyrus databases
Jan 24 21:19:06 dell2600 master[4485]: process 5036 exited, status 0

Also the telemetry log from /var/lib/imap/log/test@mydomain (I figured that I
need to name the directory user@realm)

1359062196a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte
QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
COMPRESS=DEFLATE IDLE] User logged in
SESSIONID=dell2600.bradcan.homelinux.com-4844-1359062166-1
1359062211a2 LIST  *
1359062211a2 OK Completed (0.000 secs)
1359062219a3 LOGOUT
1359062219* BYE LOGOUT received
a3 OK Completed

Charles Bradshaw

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question

[Patrick Boutilier]

On 01/25/2013 07:17 AM, Charles Bradshaw wrote:

Andrew

Just a thought, should the mailbox name be 'user.test@mydomain' instead of
'user.test'?

Here is a dump of /var/lib/imap/mailboxes.db
# hexdump -c /var/lib/imap/mailboxes.db
000 241 002 213  \r   s   k   i   p   l   i   s   t   f   i   l
010   e  \0  \0  \0  \0  \0  \0 001  \0  \0  \0 002  \0  \0  \0 024
020  \0  \0  \0 001  \0  \0  \0 001  \0  \0  \0 320   Q 001   4 312
030  \0  \0 001 001  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0 220
040  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0
*
080  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0 377 377 377 377
090  \0  \0  \0 001  \0  \0  \0  \t   u   s   e   r   .   t   e   s
0a0   t  \0  \0  \0  \0  \0  \0 035   0   d   e   f   a   u   l
0b0   t   t   e   s   t  \t   l   r   s   w   i   p   k   x   t
0c0   e   c   d   a  \t  \0  \0  \0  \0  \0  \0  \0 377 377 377 377
0d0

I see a \tuser.test is the tab correct?

Also curiously cryadm cannot delete user.test giving Permission denied:

# cyradm -u cyrus localhost
Password:
localhost lm
user.brad (\HasNoChildren)
localhost dm user.brad
deletemailbox: Permission denied
localhost quit

Something fishy here.




You have to give the cyrus user d rights to delete a mailbox. I use 
something like this from cyrusadm:


sam user.test cyrus lrswipdca



snip
attachment: boutilpj.vcf
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question

[Andrew Morgan]

Yes, the mailbox should be named user.test@mydomain, assuming you actually 
want to use virtual domains.  Do you have virtdomains set in imapd.conf?

Andy

On Fri, 25 Jan 2013, Charles Bradshaw wrote:

 Andrew

 Just a thought, should the mailbox name be 'user.test@mydomain' instead of
 'user.test'?

 Here is a dump of /var/lib/imap/mailboxes.db
 # hexdump -c /var/lib/imap/mailboxes.db
 000 241 002 213  \r   s   k   i   p   l   i   s   t   f   i   l
 010   e  \0  \0  \0  \0  \0  \0 001  \0  \0  \0 002  \0  \0  \0 024
 020  \0  \0  \0 001  \0  \0  \0 001  \0  \0  \0 320   Q 001   4 312
 030  \0  \0 001 001  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0 220
 040  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0
 *
 080  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0 377 377 377 377
 090  \0  \0  \0 001  \0  \0  \0  \t   u   s   e   r   .   t   e   s
 0a0   t  \0  \0  \0  \0  \0  \0 035   0   d   e   f   a   u   l
 0b0   t   t   e   s   t  \t   l   r   s   w   i   p   k   x   t
 0c0   e   c   d   a  \t  \0  \0  \0  \0  \0  \0  \0 377 377 377 377
 0d0

 I see a \tuser.test is the tab correct?

 Also curiously cryadm cannot delete user.test giving Permission denied:

 # cyradm -u cyrus localhost
 Password:
 localhost lm
 user.brad (\HasNoChildren)
 localhost dm user.brad
 deletemailbox: Permission denied
 localhost quit

 Something fishy here.

 Thanks for your help, Charles Bradshaw

 On: Thu, 24 Jan 2013 13:11:02 -0800 (PST), Andrew Morgan wrote:

 On Thu, 24 Jan 2013, Charles Bradshaw wrote:


 On: Thu, 24 Jan 2013 12:37:18 -0800 (PST), Andy wrote:

 On Thu, 24 Jan 2013, Charles Bradshaw wrote:

 Output from cyradm:

 $ cyradm --user cyrus localhost
 Password:
 localhost lm *
 user.test (\HasNoChildren)
 localhost

 Perhaps the user does not permission to see the mailbox?  What does
 lam user.test in cyradm report?

Andy

 # cyradm -u cyrus localhost
 Password:
 localhost lam user.test
 test lrswipkxtecda
 localhost

 Okay, can we confirm that you are connecting as the user test?
  Check your syslog for a message similar to:

 imap[30372]: login: cyrus-fe3.onid.oregonstate.edu [128.193.4.145]
 test PLAIN User logged in

 Perhaps we have a problem with virtualdomains.

  Andy
 --- End of Original Message ---

 Andy
 Here is a complete /var/log/maillog for a session.

 Jan 24 21:16:06 dell2600 imap[4844]: accepted connection
 Jan 24 21:16:06 dell2600 master[5029]: about to exec 
 /usr/lib/cyrus-imapd/imapd
 Jan 24 21:16:06 dell2600 imap[5029]: executed
 Jan 24 21:16:36 dell2600 imap[4844]: fetching user_deny.db entry for
 'test@mydomain'
 Jan 24 21:16:36 dell2600 imap[4844]: login: localhost [::1] test@mydomain
 plaintext User logged in
 SESSIONID=dell2600.bradcan.homelinux.com-4844-1359062166-1
 Jan 24 21:16:36 dell2600 imap[4844]: fetching user_deny.db entry for
 'test@mydomain'
 Jan 24 21:16:51 dell2600 imap[4844]: fetching user_deny.db entry for
 'test@mydomain'
 Jan 24 21:16:59 dell2600 imap[4844]: USAGE test@mydomain user: 0.009998 sys:
 0.009998
 Jan 24 21:18:51 dell2600 master[4485]: process 4844 exited, status 0
 Jan 24 21:19:06 dell2600 master[5036]: about to exec
 /usr/lib/cyrus-imapd/ctl_cyrusdb
 Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: checkpointing cyrus databases
 Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: archiving database file:
 /var/lib/imap/mailboxes.db
 Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: archiving database file:
 /var/lib/imap/annotations.db
 Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: done checkpointing cyrus databases
 Jan 24 21:19:06 dell2600 master[4485]: process 5036 exited, status 0

 Also the telemetry log from /var/lib/imap/log/test@mydomain (I figured that I
 need to name the directory user@realm)

 1359062196a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte
 QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
 MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
 THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
 QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
 COMPRESS=DEFLATE IDLE] User logged in
 SESSIONID=dell2600.bradcan.homelinux.com-4844-1359062166-1
 1359062211a2 LIST  *
 1359062211a2 OK Completed (0.000 secs)
 1359062219a3 LOGOUT
 1359062219* BYE LOGOUT received
 a3 OK Completed

 Charles Bradshaw


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question

[Charles Bradshaw]

Andy

We're nearly there, phew..

Yes I want to use virtual domains.
Yes I have virtdomains: userid in /etc/imapd.conf

OK, so I understand why no imap INBOX, but sendmail and cyrusv2 are therefore
delivering mail to the wrong mailbox, that is to user.test NOT 
user.test@mydomain

I have sendmail.mc containing:

define(`confLOCAL_MAILER', `cyrusv2')dnl
define(`CYRUSV2_MAILER_ARGS', `FILE /var/lib/imap/socket/lmtp')dnl
MAILER(cyrusv2)dnl

and mailertable containing:
mydomain  cyrusv2:/var/lib/imap/socket/lmtp

Obviously the mailertable entry is wrong?

Or maybe I need something else to stop sendmail/cyrusv2 stripping mydomain
from email sent to test@mydomain ?

Thanks for your patients with this old hack, Charles Bradshaw

On: Fri, 25 Jan 2013 12:04:15 -0800 (PST), Andrew Morgan wrote:

 Yes, the mailbox should be named user.test@mydomain, assuming you 
 actually want to use virtual domains.  Do you have virtdomains set 
 in imapd.conf?
 
   Andy
 
 On Fri, 25 Jan 2013, Charles Bradshaw wrote:
 
  Andrew
 
  Just a thought, should the mailbox name be 'user.test@mydomain' instead of
  'user.test'?
 
  Here is a dump of /var/lib/imap/mailboxes.db
  # hexdump -c /var/lib/imap/mailboxes.db
  000 241 002 213  \r   s   k   i   p   l   i   s   t   f   i   l
  010   e  \0  \0  \0  \0  \0  \0 001  \0  \0  \0 002  \0  \0  \0 024
  020  \0  \0  \0 001  \0  \0  \0 001  \0  \0  \0 320   Q 001   4 312
  030  \0  \0 001 001  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0 220
  040  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0
  *
  080  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0  \0 377 377 377 377
  090  \0  \0  \0 001  \0  \0  \0  \t   u   s   e   r   .   t   e   s
  0a0   t  \0  \0  \0  \0  \0  \0 035   0   d   e   f   a   u   l
  0b0   t   t   e   s   t  \t   l   r   s   w   i   p   k   x   t
  0c0   e   c   d   a  \t  \0  \0  \0  \0  \0  \0  \0 377 377 377 377
  0d0
 
  I see a \tuser.test is the tab correct?
 
  Also curiously cryadm cannot delete user.test giving Permission denied:
 
  # cyradm -u cyrus localhost
  Password:
  localhost lm
  user.brad (\HasNoChildren)
  localhost dm user.brad
  deletemailbox: Permission denied
  localhost quit
 
  Something fishy here.
 
  Thanks for your help, Charles Bradshaw
 
  On: Thu, 24 Jan 2013 13:11:02 -0800 (PST), Andrew Morgan wrote:
 
  On Thu, 24 Jan 2013, Charles Bradshaw wrote:
 
 
  On: Thu, 24 Jan 2013 12:37:18 -0800 (PST), Andy wrote:
 
  On Thu, 24 Jan 2013, Charles Bradshaw wrote:
 
  Output from cyradm:
 
  $ cyradm --user cyrus localhost
  Password:
  localhost lm *
  user.test (\HasNoChildren)
  localhost
 
  Perhaps the user does not permission to see the mailbox?  What does
  lam user.test in cyradm report?
 
   Andy
 
  # cyradm -u cyrus localhost
  Password:
  localhost lam user.test
  test lrswipkxtecda
  localhost
 
  Okay, can we confirm that you are connecting as the user test?
   Check your syslog for a message similar to:
 
  imap[30372]: login: cyrus-fe3.onid.oregonstate.edu [128.193.4.145]
  test PLAIN User logged in
 
  Perhaps we have a problem with virtualdomains.
 
 Andy
  --- End of Original Message ---
 
  Andy
  Here is a complete /var/log/maillog for a session.
 
  Jan 24 21:16:06 dell2600 imap[4844]: accepted connection
  Jan 24 21:16:06 dell2600 master[5029]: about to exec
/usr/lib/cyrus-imapd/imapd
  Jan 24 21:16:06 dell2600 imap[5029]: executed
  Jan 24 21:16:36 dell2600 imap[4844]: fetching user_deny.db entry for
  'test@mydomain'
  Jan 24 21:16:36 dell2600 imap[4844]: login: localhost [::1] test@mydomain
  plaintext User logged in
  SESSIONID=dell2600.bradcan.homelinux.com-4844-1359062166-1
  Jan 24 21:16:36 dell2600 imap[4844]: fetching user_deny.db entry for
  'test@mydomain'
  Jan 24 21:16:51 dell2600 imap[4844]: fetching user_deny.db entry for
  'test@mydomain'
  Jan 24 21:16:59 dell2600 imap[4844]: USAGE test@mydomain user: 0.009998 sys:
  0.009998
  Jan 24 21:18:51 dell2600 master[4485]: process 4844 exited, status 0
  Jan 24 21:19:06 dell2600 master[5036]: about to exec
  /usr/lib/cyrus-imapd/ctl_cyrusdb
  Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: checkpointing cyrus databases
  Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: archiving database file:
  /var/lib/imap/mailboxes.db
  Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: archiving database file:
  /var/lib/imap/annotations.db
  Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: done checkpointing cyrus 
  databases
  Jan 24 21:19:06 dell2600 master[4485]: process 5036 exited, status 0
 
  Also the telemetry log from /var/lib/imap/log/test@mydomain (I figured that 
  I
  need to name the directory user@realm)
 
  1359062196a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte
  QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
  THREAD=ORDEREDSUBJECT 

Re: Mailbox does not exist question

[Charles Bradshaw]

On: Wed, 23 Jan 2013 14:28:28 -0800 (PST), Andrew Morgan wrote:

 On Wed, 23 Jan 2013, Charles Bradshaw wrote:
 
  I'm seeing the following when I test cyrus-imapd using telnet.
 
  I seem to be missing some fundamental configuration.
 
  What am I doing wrong?
 
  Thanks in advance, Charles Bradshaw
 
  Telnet imap session:
 
  # telnet localhost imap
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
  AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] imap-host.mydomain Cyrus IMAP
  v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
  a1 LOGIN test@mydomain ***
  a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
  MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
  THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
  QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
  COMPRESS=DEFLATE IDLE] User logged in
  SESSIONID=imap-host.mydomain-1720-1358978359-1
  a2 LIST  *
  a2 OK Completed (0.000 secs)
 
  I expected something like '* LIST (\HasNoChildren) . INBOX', but the
  response is blank!
 
  ~ o ~
 
  Telnet pop session:
 
  # telnet localhost 110
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
  ready 1420303981.1358957093@imap-host.mydomain
  USER test@mydomain
  +OK Name is a valid mailbox
  PASS **
  -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist
 
  /val/log/maillog has:
  pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does
not exist
 
  ~ o ~
 
  However /var/spool/imap/t/user/test mailbox exists and contains mail:
 
  # ls -l /var/spool/imap/t/user/test
  total 24
  -rw---. 1 cyrus mail  602 Jan 23 14:36 1.
  -rw---. 1 cyrus mail  606 Jan 23 14:59 2.
  -rw---. 1 cyrus mail  603 Jan 23 15:49 3.
  -rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
  -rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
  -rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index
 
  # cat /etc/imapd.conf
  configdirectory: /var/lib/imap
  partition-default: /var/spool/imap
  admins: cyrus
  sievedir: /var/lib/imap/sieve
  sendmail: /usr/sbin/sendmail
  hashimapspool: true
  sasl_pwcheck_method: auxprop
  sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
  sasl_auxprop_plugin:sasldb
  allowplaintext: yes
  virtdomains: userid
  tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
  tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH
  +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
  ready 1420303981.1358957093@imap-host.mydomain
  USER test@mydomain
  +OK Name is a valid mailbox
  PASS **
  -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist
 
  /val/log/maillog has:
  pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does
not exist
 
  ~ o ~
 
  However /var/spool/imap/t/user/test mailbox exists and contains mail:
 
  # ls -l /var/spool/imap/t/user/test
  total 24
  -rw---. 1 cyrus mail  602 Jan 23 14:36 1.
  -rw---. 1 cyrus mail  606 Jan 23 14:59 2.
  -rw---. 1 cyrus mail  603 Jan 23 15:49 3.
  -rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
  -rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
  -rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index
 
  # cat /etc/imapd.conf
  configdirectory: /var/lib/imap
  partition-default: /var/spool/imap
  admins: cyrus
  sievedir: /var/lib/imap/sieve
  sendmail: /usr/sbin/sendmail
  hashimapspool: true
  sasl_pwcheck_method: auxprop
  sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
  sasl_auxprop_plugin:sasldb
  allowplaintext: yes
  virtdomains: userid
  tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
  tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH
 
 Run cyradm --user cyrus localhost and type lm *.  Is the mailbox 
 user.test in the output?
 
   Andy
--- End of Original Message ---

Output from cyradm:

$ cyradm --user cyrus localhost
Password: 
localhost lm *
user.test (\HasNoChildren)  
localhost

Charles Bradshaw


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question (is this the answer?)

[Charles Bradshaw]

I have enabled debug. (in imapd.conf debug: yes). Now when I start a telnet
imap session /var/log/maillog has this:

Jan 24 13:25:59 dell2600 imap[4507]: accepted connection
Jan 24 13:25:59 dell2600 master[4549]: about to exec /usr/lib/cyrus-imapd/imapd
Jan 24 13:25:59 dell2600 imap[4549]: executed
Jan 24 13:25:59 dell2600 imap[4549]: IOERROR: opening
/var/lib/imap/user_deny.db: No such file or directory

Is this the problem?

How do I create user_deny.db ?

Charles Bradshaw

On: Wed, 23 Jan 2013 14:28:28 -0800 (PST), Andrew Morgan wrote:

 On Wed, 23 Jan 2013, Charles Bradshaw wrote:
 
  I'm seeing the following when I test cyrus-imapd using telnet.
 
  I seem to be missing some fundamental configuration.
 
  What am I doing wrong?
 
  Thanks in advance, Charles Bradshaw
 
  Telnet imap session:
 
  # telnet localhost imap
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
  AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] imap-host.mydomain Cyrus IMAP
  v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
  a1 LOGIN test@mydomain ***
  a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
  MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
  THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
  QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
  COMPRESS=DEFLATE IDLE] User logged in
  SESSIONID=imap-host.mydomain-1720-1358978359-1
  a2 LIST  *
  a2 OK Completed (0.000 secs)
 
  I expected something like '* LIST (\HasNoChildren) . INBOX', but the
  response is blank!
 
  ~ o ~
 
  Telnet pop session:
 
  # telnet localhost 110
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
  ready 1420303981.1358957093@imap-host.mydomain
  USER test@mydomain
  +OK Name is a valid mailbox
  PASS **
  -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist
 
  /val/log/maillog has:
  pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does
not exist
 
  ~ o ~
 
  However /var/spool/imap/t/user/test mailbox exists and contains mail:
 
  # ls -l /var/spool/imap/t/user/test
  total 24
  -rw---. 1 cyrus mail  602 Jan 23 14:36 1.
  -rw---. 1 cyrus mail  606 Jan 23 14:59 2.
  -rw---. 1 cyrus mail  603 Jan 23 15:49 3.
  -rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
  -rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
  -rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index
 
  # cat /etc/imapd.conf
  configdirectory: /var/lib/imap
  partition-default: /var/spool/imap
  admins: cyrus
  sievedir: /var/lib/imap/sieve
  sendmail: /usr/sbin/sendmail
  hashimapspool: true
  sasl_pwcheck_method: auxprop
  sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
  sasl_auxprop_plugin:sasldb
  allowplaintext: yes
  virtdomains: userid
  tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
  tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH
  +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
  ready 1420303981.1358957093@imap-host.mydomain
  USER test@mydomain
  +OK Name is a valid mailbox
  PASS **
  -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist
 
  /val/log/maillog has:
  pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does
not exist
 
  ~ o ~
 
  However /var/spool/imap/t/user/test mailbox exists and contains mail:
 
  # ls -l /var/spool/imap/t/user/test
  total 24
  -rw---. 1 cyrus mail  602 Jan 23 14:36 1.
  -rw---. 1 cyrus mail  606 Jan 23 14:59 2.
  -rw---. 1 cyrus mail  603 Jan 23 15:49 3.
  -rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
  -rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
  -rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index
 
  # cat /etc/imapd.conf
  configdirectory: /var/lib/imap
  partition-default: /var/spool/imap
  admins: cyrus
  sievedir: /var/lib/imap/sieve
  sendmail: /usr/sbin/sendmail
  hashimapspool: true
  sasl_pwcheck_method: auxprop
  sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
  sasl_auxprop_plugin:sasldb
  allowplaintext: yes
  virtdomains: userid
  tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
  tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH
 
 Run cyradm --user cyrus localhost and type lm *.  Is the mailbox 
 user.test in the output?
 
   Andy
--- End of Original Message ---

Output from cyradm:

$ cyradm --user cyrus localhost
Password: 
localhost lm *
user.test (\HasNoChildren)  
localhost

Charles Bradshaw

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: 

Re: Mailbox does not exist question (NO it is NOT the answer!)

[Charles Bradshaw]

I have enabled debug. (in imapd.conf debug: yes). Now when I start a telnet
imap session /var/log/maillog has this:

Jan 24 13:25:59 dell2600 imap[4507]: accepted connection
Jan 24 13:25:59 dell2600 master[4549]: about to exec /usr/lib/cyrus-imapd/imapd
Jan 24 13:25:59 dell2600 imap[4549]: executed
Jan 24 13:25:59 dell2600 imap[4549]: IOERROR: opening
/var/lib/imap/user_deny.db: No such file or directory

Is this the problem?

How do I create user_deny.db ?

 ~ o ~

The debug exposed error has been eliminated by creating user_deny.db

#su cyrus
bash-4.2$ touch /var/lib/imap/user_deny.db

Telnet session still does NOT report the presence of INBOX:

$ telnet localhost imap
Trying ::1...
Connected to localhost.
Escape character is '^]'.
* OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] dell2600.bradcan.homelinux.com Cyrus
IMAP v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
a1 LOGIN b...@bradcan.homelinux.com wH3x14or
a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
COMPRESS=DEFLATE IDLE] User logged in
SESSIONID=dell2600.bradcan.homelinux.com-4597-1359054779-1
a2 LIST  *
a2 OK Completed (0.000 secs)

I am at a complete loss to understand how it is possible that mail is
delivered, but at the same time the INBOX is not being identified during the
imap session.

Is there some way to increase the bebug level of imapd ?

Charles Bradshaw

On: Wed, 23 Jan 2013 14:28:28 -0800 (PST), Andrew Morgan wrote:

 On Wed, 23 Jan 2013, Charles Bradshaw wrote:
 
  I'm seeing the following when I test cyrus-imapd using telnet.
 
  I seem to be missing some fundamental configuration.
 
  What am I doing wrong?
 
  Thanks in advance, Charles Bradshaw
 
  Telnet imap session:
 
  # telnet localhost imap
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
  AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] imap-host.mydomain Cyrus IMAP
  v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
  a1 LOGIN test@mydomain ***
  a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
  MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
  THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
  QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
  COMPRESS=DEFLATE IDLE] User logged in
  SESSIONID=imap-host.mydomain-1720-1358978359-1
  a2 LIST  *
  a2 OK Completed (0.000 secs)
 
  I expected something like '* LIST (\HasNoChildren) . INBOX', but the
  response is blank!
 
  ~ o ~
 
  Telnet pop session:
 
  # telnet localhost 110
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
  ready 1420303981.1358957093@imap-host.mydomain
  USER test@mydomain
  +OK Name is a valid mailbox
  PASS **
  -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist
 
  /val/log/maillog has:
  pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does
not exist
 
  ~ o ~
 
  However /var/spool/imap/t/user/test mailbox exists and contains mail:
 
  # ls -l /var/spool/imap/t/user/test
  total 24
  -rw---. 1 cyrus mail  602 Jan 23 14:36 1.
  -rw---. 1 cyrus mail  606 Jan 23 14:59 2.
  -rw---. 1 cyrus mail  603 Jan 23 15:49 3.
  -rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
  -rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
  -rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index
 
  # cat /etc/imapd.conf
  configdirectory: /var/lib/imap
  partition-default: /var/spool/imap
  admins: cyrus
  sievedir: /var/lib/imap/sieve
  sendmail: /usr/sbin/sendmail
  hashimapspool: true
  sasl_pwcheck_method: auxprop
  sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
  sasl_auxprop_plugin:sasldb
  allowplaintext: yes
  virtdomains: userid
  tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
  tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH
  +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
  ready 1420303981.1358957093@imap-host.mydomain
  USER test@mydomain
  +OK Name is a valid mailbox
  PASS **
  -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist
 
  /val/log/maillog has:
  pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does
not exist
 
  ~ o ~
 
  However /var/spool/imap/t/user/test mailbox exists and contains mail:
 
  # ls -l /var/spool/imap/t/user/test
  total 24
  -rw---. 1 cyrus 

Re: Mailbox does not exist question (NO it is NOT the answer!)

[Charles Bradshaw]

The file owner is root, but ps aux says:

cyrus 4844  0.0  0.1  50004  2224 ?S19:31   0:00 imapd

So the running daemon and the mailbox is owned by cyrus, which is correct.

The mail directory cannot be owned by the user because she is virtual and
therefore has no account. Instead cyrus is proxy.

I like your signature though :)

The only skill I have is perseverance! Charles Bradshaw

On: Thu, 24 Jan 2013 13:28:55 -0600,Dale wrote:

 No expert, but does the proper user own imap?  Is it writeable the 
 the mail user?
 
 On 01/24/2013 01:17 PM, Charles Bradshaw wrote:
  I have enabled debug. (in imapd.conf debug: yes). Now when I start a telnet
  imap session /var/log/maillog has this:
 
  Jan 24 13:25:59 dell2600 imap[4507]: accepted connection
  Jan 24 13:25:59 dell2600 master[4549]: about to exec
/usr/lib/cyrus-imapd/imapd
  Jan 24 13:25:59 dell2600 imap[4549]: executed
  Jan 24 13:25:59 dell2600 imap[4549]: IOERROR: opening
  /var/lib/imap/user_deny.db: No such file or directory
 
  Is this the problem?
 
  How do I create user_deny.db ?
 
~ o ~
 
  The debug exposed error has been eliminated by creating user_deny.db
 
  #su cyrus
  bash-4.2$ touch /var/lib/imap/user_deny.db
 
  Telnet session still does NOT report the presence of INBOX:
 
  $ telnet localhost imap
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
  AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] dell2600.bradcan.homelinux.com Cyrus
  IMAP v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
  a1 LOGIN b...@bradcan.homelinux.com wH3x14or
  a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
  MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
  THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
  QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
  COMPRESS=DEFLATE IDLE] User logged in
  SESSIONID=dell2600.bradcan.homelinux.com-4597-1359054779-1
  a2 LIST  *
  a2 OK Completed (0.000 secs)
 
  I am at a complete loss to understand how it is possible that mail is
  delivered, but at the same time the INBOX is not being identified during the
  imap session.
 
  Is there some way to increase the bebug level of imapd ?
 
  Charles Bradshaw
 
  On: Wed, 23 Jan 2013 14:28:28 -0800 (PST), Andrew Morgan wrote:
 
  On Wed, 23 Jan 2013, Charles Bradshaw wrote:
 
  I'm seeing the following when I test cyrus-imapd using telnet.
 
  I seem to be missing some fundamental configuration.
 
  What am I doing wrong?
 
  Thanks in advance, Charles Bradshaw
 
  Telnet imap session:
 
  # telnet localhost imap
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
  AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] imap-host.mydomain Cyrus IMAP
  v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
  a1 LOGIN test@mydomain ***
  a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
  MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ 
  SORT=DISPLAY
  THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
  QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
  COMPRESS=DEFLATE IDLE] User logged in
  SESSIONID=imap-host.mydomain-1720-1358978359-1
  a2 LIST  *
  a2 OK Completed (0.000 secs)
 
  I expected something like '* LIST (\HasNoChildren) . INBOX', but the
  response is blank!
 
  ~ o ~
 
  Telnet pop session:
 
  # telnet localhost 110
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
  ready1420303981.1358957093@imap-host.mydomain
  USER test@mydomain
  +OK Name is a valid mailbox
  PASS **
  -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist
 
  /val/log/maillog has:
  pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does
  not exist
  ~ o ~
 
  However /var/spool/imap/t/user/test mailbox exists and contains mail:
 
  # ls -l /var/spool/imap/t/user/test
  total 24
  -rw---. 1 cyrus mail  602 Jan 23 14:36 1.
  -rw---. 1 cyrus mail  606 Jan 23 14:59 2.
  -rw---. 1 cyrus mail  603 Jan 23 15:49 3.
  -rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
  -rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
  -rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index
 
  # cat /etc/imapd.conf
  configdirectory: /var/lib/imap
  partition-default: /var/spool/imap
  admins: cyrus
  sievedir: /var/lib/imap/sieve
  sendmail: /usr/sbin/sendmail
  hashimapspool: true
  sasl_pwcheck_method: auxprop
  sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
  sasl_auxprop_plugin:sasldb
  allowplaintext: yes
  virtdomains: userid
  tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  

Re: Mailbox does not exist question

[Andrew Morgan]

On Thu, 24 Jan 2013, Charles Bradshaw wrote:

 Output from cyradm:

 $ cyradm --user cyrus localhost
 Password:
 localhost lm *
 user.test (\HasNoChildren)
 localhost

Perhaps the user does not permission to see the mailbox?  What does lam 
user.test in cyradm report?

Andy

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question (is this the answer?)

[Andrew Morgan]

On Thu, 24 Jan 2013, Charles Bradshaw wrote:

 I have enabled debug. (in imapd.conf debug: yes). Now when I start a telnet
 imap session /var/log/maillog has this:

 Jan 24 13:25:59 dell2600 imap[4507]: accepted connection
 Jan 24 13:25:59 dell2600 master[4549]: about to exec 
 /usr/lib/cyrus-imapd/imapd
 Jan 24 13:25:59 dell2600 imap[4549]: executed
 Jan 24 13:25:59 dell2600 imap[4549]: IOERROR: opening
 /var/lib/imap/user_deny.db: No such file or directory

 Is this the problem?

 How do I create user_deny.db ?

No, user_deny is an optional feature.  There is no error if it is not 
found.

Andy

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question (NO it is NOT the answer!)

[Adam Tauno Williams]

On Thu, 2013-01-24 at 19:17 +, Charles Bradshaw wrote:
 I have enabled debug. (in imapd.conf debug: yes). Now when I start a telnet
 imap session /var/log/maillog has this:
 Jan 24 13:25:59 dell2600 imap[4507]: accepted connection
 Jan 24 13:25:59 dell2600 master[4549]: about to exec 
 /usr/lib/cyrus-imapd/imapd
 Jan 24 13:25:59 dell2600 imap[4549]: executed
 Jan 24 13:25:59 dell2600 imap[4549]: IOERROR: opening
 /var/lib/imap/user_deny.db: No such file or directory
 Is this the problem?
 How do I create user_deny.db ?

No, it is OK for user_deny to not exist.  [this is a chronically
confusing message;  you can't really tell DEBUG 'error' messages from
real error messages].

 Telnet session still does NOT report the presence of INBOX:

I don't understand this statement.

 $ telnet localhost imap
 Trying ::1...
 Connected to localhost.
 Escape character is '^]'.
 * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
 AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] dell2600.bradcan.homelinux.com Cyrus
 IMAP v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
 a1 LOGIN b...@bradcan.homelinux.com wH3x14or
 a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
 MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
 MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
 THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
 QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
 COMPRESS=DEFLATE IDLE] User logged in
 SESSIONID=dell2600.bradcan.homelinux.com-4597-1359054779-1
 a2 LIST  *
 a2 OK Completed (0.000 secs)
 I am at a complete loss to understand how it is possible that mail is
 delivered, but at the same time the INBOX is not being identified during the
 imap session.
 Is there some way to increase the bebug level of imapd ?

Have you enabled telemetry logging for that user?

Does the mailbox in question appear in the mailbox list?

-- 
Adam Tauno Williams  GPG D95ED383
Systems Administrator, Python Developer, LPI / NCLA


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question (NO it is NOT the answer!)

[Charles Bradshaw]

Dale
The installation is from cyrus-imapd.i686 2.4.14-1.fc17

Yes there have been file ownership problems, but you will observe from my
previous post that the mailbox has been written to by the cyrus mailer!
Therefore one would naturally expect imapd to be able to read it!

For the record /var/spool/imap/b/user/test are all 700 and the files in
/test are 600 and every thing is owner cyrus and group mail.

Yes I agree possibly a file ownership problem, but how?

One of the first things I tried was changing everything to 777 with no result!

More likely some quirk with BSD vis Fedora low level file access.

Most of the Fedora forum posts on the subject of cyrus-imapd say ! Oops
can't post it here. ;-)

Charles Bradshaw

On: Thu, 24 Jan 2013 14:11:09 -0600, Dale woote:

 The directory and files must be writeable by either the owner of the 
 process (cyrus) or the group the owner belongs to.
 
 I suggest you write down who owns the directory, make sure you 
 remember and chown to it.  Keep in mind that some directories may be 
 written by sendmail/postfix and/or read by cyrus.
 
 I suspect it's a permission problem, though.
 
 Did you compile yourself, rpm, package, ???
 
 What OS?
 
 On 01/24/2013 02:00 PM, Charles Bradshaw wrote:
  The file owner is root, but ps aux says:
 
  cyrus 4844  0.0  0.1  50004  2224 ?S19:31   0:00 imapd
 
  So the running daemon and the mailbox is owned by cyrus, which is correct.
 
  The mail directory cannot be owned by the user because she is virtual and
  therefore has no account. Instead cyrus is proxy.
 
  I like your signature though :)
 
  The only skill I have is perseverance! Charles Bradshaw
 
  On: Thu, 24 Jan 2013 13:28:55 -0600,Dale wrote:
 
  No expert, but does the proper user own imap?  Is it writeable the
  the mail user?
 
  On 01/24/2013 01:17 PM, Charles Bradshaw wrote:
  I have enabled debug. (in imapd.conf debug: yes). Now when I start a 
  telnet
  imap session /var/log/maillog has this:
 
  Jan 24 13:25:59 dell2600 imap[4507]: accepted connection
  Jan 24 13:25:59 dell2600 master[4549]: about to exec
  /usr/lib/cyrus-imapd/imapd
  Jan 24 13:25:59 dell2600 imap[4549]: executed
  Jan 24 13:25:59 dell2600 imap[4549]: IOERROR: opening
  /var/lib/imap/user_deny.db: No such file or directory
 
  Is this the problem?
 
  How do I create user_deny.db ?
 
 ~ o ~
 
  The debug exposed error has been eliminated by creating user_deny.db
 
  #su cyrus
  bash-4.2$ touch /var/lib/imap/user_deny.db
 
  Telnet session still does NOT report the presence of INBOX:
 
  $ telnet localhost imap
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
  AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] dell2600.bradcan.homelinux.com 
  Cyrus
  IMAP v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
  a1 LOGIN b...@bradcan.homelinux.com wH3x14or
  a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
  MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ 
  SORT=DISPLAY
  THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
  QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
  COMPRESS=DEFLATE IDLE] User logged in
  SESSIONID=dell2600.bradcan.homelinux.com-4597-1359054779-1
  a2 LIST  *
  a2 OK Completed (0.000 secs)
 
  I am at a complete loss to understand how it is possible that mail is
  delivered, but at the same time the INBOX is not being identified during 
  the
  imap session.
 
  Is there some way to increase the bebug level of imapd ?
 
  Charles Bradshaw
 
  On: Wed, 23 Jan 2013 14:28:28 -0800 (PST), Andrew Morgan wrote:
 
  On Wed, 23 Jan 2013, Charles Bradshaw wrote:
 
  I'm seeing the following when I test cyrus-imapd using telnet.
 
  I seem to be missing some fundamental configuration.
 
  What am I doing wrong?
 
  Thanks in advance, Charles Bradshaw
 
  Telnet imap session:
 
  # telnet localhost imap
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
  AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] imap-host.mydomain Cyrus IMAP
  v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
  a1 LOGIN test@mydomain ***
  a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
  MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ
SORT=DISPLAY
  THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED 
  WITHIN
  QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
  COMPRESS=DEFLATE IDLE] User logged in
  SESSIONID=imap-host.mydomain-1720-1358978359-1
  a2 LIST  *
  a2 OK Completed (0.000 secs)
 
  I expected something like '* LIST (\HasNoChildren) . INBOX', but the
  response is blank!
 
  ~ o ~
 
  Telnet pop session:
 
  # telnet localhost 110
  

Re: Mailbox does not exist question

[Charles Bradshaw]

On: Thu, 24 Jan 2013 12:37:18 -0800 (PST), Andy wrote:

 On Thu, 24 Jan 2013, Charles Bradshaw wrote:
 
  Output from cyradm:
 
  $ cyradm --user cyrus localhost
  Password:
  localhost lm *
  user.test (\HasNoChildren)
  localhost
 
 Perhaps the user does not permission to see the mailbox?  What does 
 lam user.test in cyradm report?
 
   Andy

# cyradm -u cyrus localhost
Password: 
localhost lam user.test
test lrswipkxtecda
localhost 

Charles Bradshaw

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question (NO it is NOT the answer!)

[Charles Bradshaw]

Adam

The telnet session is listed in full below.

Snip:
client: a2 LIST  *
   should be a list here containing something!
server: a2 OK Completed (0.000 secs)

Expected response like this: * LIST (\Unmarked \HasChildren) . INBOX

How do I enable telemetry logging ? I tried creating /var/lib/imap/log/test
but this remains empty!

The mailbox exists and has been written, ie contains email messages. (see my
earlier posts).

Charles Bradshaw

Sent: Thu, 24 Jan 2013 15:45:40 -0500, Adam wrote:
 On Thu, 2013-01-24 at 19:17 +, Charles Bradshaw wrote:
  I have enabled debug. (in imapd.conf debug: yes). Now when I start a telnet
  imap session /var/log/maillog has this:
  Jan 24 13:25:59 dell2600 imap[4507]: accepted connection
  Jan 24 13:25:59 dell2600 master[4549]: about to exec
/usr/lib/cyrus-imapd/imapd
  Jan 24 13:25:59 dell2600 imap[4549]: executed
  Jan 24 13:25:59 dell2600 imap[4549]: IOERROR: opening
  /var/lib/imap/user_deny.db: No such file or directory
  Is this the problem?
  How do I create user_deny.db ?
 
 No, it is OK for user_deny to not exist.  [this is a chronically
 confusing message;  you can't really tell DEBUG 'error' messages from
 real error messages].
 
  Telnet session still does NOT report the presence of INBOX:
 
 I don't understand this statement.
 
  $ telnet localhost imap
  Trying ::1...
  Connected to localhost.
  Escape character is '^]'.
  * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
  AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] dell2600.bradcan.homelinux.com Cyrus
  IMAP v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
  a1 LOGIN b...@bradcan.homelinux.com wH3x14or
  a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
  MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
  MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
  THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
  QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
  COMPRESS=DEFLATE IDLE] User logged in
  SESSIONID=dell2600.bradcan.homelinux.com-4597-1359054779-1
  a2 LIST  *
  a2 OK Completed (0.000 secs)
  I am at a complete loss to understand how it is possible that mail is
  delivered, but at the same time the INBOX is not being identified during the
  imap session.
  Is there some way to increase the bebug level of imapd ?
 
 Have you enabled telemetry logging for that user?
 
 Does the mailbox in question appear in the mailbox list?
 
 -- 
 Adam Tauno Williams  GPG D95ED383
 Systems Administrator, Python Developer, LPI / NCLA
 
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 To Unsubscribe:
 https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
--- End of Original Message ---


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question

[Andrew Morgan]

On Thu, 24 Jan 2013, Charles Bradshaw wrote:


 On: Thu, 24 Jan 2013 12:37:18 -0800 (PST), Andy wrote:

 On Thu, 24 Jan 2013, Charles Bradshaw wrote:

 Output from cyradm:

 $ cyradm --user cyrus localhost
 Password:
 localhost lm *
 user.test (\HasNoChildren)
 localhost

 Perhaps the user does not permission to see the mailbox?  What does
 lam user.test in cyradm report?

  Andy

 # cyradm -u cyrus localhost
 Password:
 localhost lam user.test
 test lrswipkxtecda
 localhost

Okay, can we confirm that you are connecting as the user test?  Check 
your syslog for a message similar to:

imap[30372]: login: cyrus-fe3.onid.oregonstate.edu [128.193.4.145] test PLAIN 
User logged in

Perhaps we have a problem with virtualdomains.

Andy

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question

[Charles Bradshaw]

On: Thu, 24 Jan 2013 13:11:02 -0800 (PST), Andrew Morgan wrote:

 On Thu, 24 Jan 2013, Charles Bradshaw wrote:
 
 
  On: Thu, 24 Jan 2013 12:37:18 -0800 (PST), Andy wrote:
 
  On Thu, 24 Jan 2013, Charles Bradshaw wrote:
 
  Output from cyradm:
 
  $ cyradm --user cyrus localhost
  Password:
  localhost lm *
  user.test (\HasNoChildren)
  localhost
 
  Perhaps the user does not permission to see the mailbox?  What does
  lam user.test in cyradm report?
 
 Andy
 
  # cyradm -u cyrus localhost
  Password:
  localhost lam user.test
  test lrswipkxtecda
  localhost
 
 Okay, can we confirm that you are connecting as the user test? 
  Check your syslog for a message similar to:
 
 imap[30372]: login: cyrus-fe3.onid.oregonstate.edu [128.193.4.145] 
 test PLAIN User logged in
 
 Perhaps we have a problem with virtualdomains.
 
   Andy
--- End of Original Message ---

Andy
Here is a complete /var/log/maillog for a session.

Jan 24 21:16:06 dell2600 imap[4844]: accepted connection
Jan 24 21:16:06 dell2600 master[5029]: about to exec /usr/lib/cyrus-imapd/imapd
Jan 24 21:16:06 dell2600 imap[5029]: executed
Jan 24 21:16:36 dell2600 imap[4844]: fetching user_deny.db entry for
'test@mydomain'
Jan 24 21:16:36 dell2600 imap[4844]: login: localhost [::1] test@mydomain
plaintext User logged in
SESSIONID=dell2600.bradcan.homelinux.com-4844-1359062166-1
Jan 24 21:16:36 dell2600 imap[4844]: fetching user_deny.db entry for
'test@mydomain'
Jan 24 21:16:51 dell2600 imap[4844]: fetching user_deny.db entry for
'test@mydomain'
Jan 24 21:16:59 dell2600 imap[4844]: USAGE test@mydomain user: 0.009998 sys:
0.009998
Jan 24 21:18:51 dell2600 master[4485]: process 4844 exited, status 0
Jan 24 21:19:06 dell2600 master[5036]: about to exec
/usr/lib/cyrus-imapd/ctl_cyrusdb
Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: checkpointing cyrus databases
Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: archiving database file:
/var/lib/imap/mailboxes.db
Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: archiving database file:
/var/lib/imap/annotations.db
Jan 24 21:19:06 dell2600 ctl_cyrusdb[5036]: done checkpointing cyrus databases
Jan 24 21:19:06 dell2600 master[4485]: process 5036 exited, status 0

Also the telemetry log from /var/lib/imap/log/test@mydomain (I figured that I
need to name the directory user@realm)

1359062196a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte
QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
COMPRESS=DEFLATE IDLE] User logged in
SESSIONID=dell2600.bradcan.homelinux.com-4844-1359062166-1
1359062211a2 LIST  *
1359062211a2 OK Completed (0.000 secs)
1359062219a3 LOGOUT
1359062219* BYE LOGOUT received
a3 OK Completed

Charles Bradshaw




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Mailbox does not exist question

[Charles Bradshaw]

I'm seeing the following when I test cyrus-imapd using telnet.

I seem to be missing some fundamental configuration.

What am I doing wrong?

Thanks in advance, Charles Bradshaw

Telnet imap session:

# telnet localhost imap
Trying ::1...
Connected to localhost.
Escape character is '^]'.
* OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] imap-host.mydomain Cyrus IMAP
v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
a1 LOGIN test@mydomain ***
a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
COMPRESS=DEFLATE IDLE] User logged in
SESSIONID=imap-host.mydomain-1720-1358978359-1
a2 LIST  *
a2 OK Completed (0.000 secs)

I expected something like '* LIST (\HasNoChildren) . INBOX', but the
response is blank!

 ~ o ~

Telnet pop session:

# telnet localhost 110
Trying ::1...
Connected to localhost.
Escape character is '^]'.
+OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
ready 1420303981.1358957093@imap-host.mydomain
USER test@mydomain
+OK Name is a valid mailbox
PASS **
-ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist

/val/log/maillog has:
pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does not 
exist

 ~ o ~

However /var/spool/imap/t/user/test mailbox exists and contains mail:

# ls -l /var/spool/imap/t/user/test
total 24
-rw---. 1 cyrus mail  602 Jan 23 14:36 1.
-rw---. 1 cyrus mail  606 Jan 23 14:59 2.
-rw---. 1 cyrus mail  603 Jan 23 15:49 3.
-rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
-rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
-rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index

# cat /etc/imapd.conf
configdirectory: /var/lib/imap
partition-default: /var/spool/imap
admins: cyrus
sievedir: /var/lib/imap/sieve
sendmail: /usr/sbin/sendmail
hashimapspool: true
sasl_pwcheck_method: auxprop
sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
sasl_auxprop_plugin:sasldb
allowplaintext: yes
virtdomains: userid
tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH
+OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
ready 1420303981.1358957093@imap-host.mydomain
USER test@mydomain
+OK Name is a valid mailbox
PASS **
-ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist

/val/log/maillog has:
pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does not 
exist

 ~ o ~

However /var/spool/imap/t/user/test mailbox exists and contains mail:

# ls -l /var/spool/imap/t/user/test
total 24
-rw---. 1 cyrus mail  602 Jan 23 14:36 1.
-rw---. 1 cyrus mail  606 Jan 23 14:59 2.
-rw---. 1 cyrus mail  603 Jan 23 15:49 3.
-rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
-rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
-rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index

# cat /etc/imapd.conf
configdirectory: /var/lib/imap
partition-default: /var/spool/imap
admins: cyrus
sievedir: /var/lib/imap/sieve
sendmail: /usr/sbin/sendmail
hashimapspool: true
sasl_pwcheck_method: auxprop
sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
sasl_auxprop_plugin:sasldb
allowplaintext: yes
virtdomains: userid
tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox does not exist question

[Andrew Morgan]

On Wed, 23 Jan 2013, Charles Bradshaw wrote:

 I'm seeing the following when I test cyrus-imapd using telnet.

 I seem to be missing some fundamental configuration.

 What am I doing wrong?

 Thanks in advance, Charles Bradshaw

 Telnet imap session:

 # telnet localhost imap
 Trying ::1...
 Connected to localhost.
 Escape character is '^]'.
 * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
 AUTH=CRAM-MD5 AUTH=DIGEST-MD5 SASL-IR] imap-host.mydomain Cyrus IMAP
 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server ready
 a1 LOGIN test@mydomain ***
 a1 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxte QUOTA
 MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN
 MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SORT SORT=MODSEQ SORT=DISPLAY
 THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE LIST-EXTENDED WITHIN
 QRESYNC SCAN XLIST URLAUTH URLAUTH=BINARY X-NETSCAPE LOGINDISABLED
 COMPRESS=DEFLATE IDLE] User logged in
 SESSIONID=imap-host.mydomain-1720-1358978359-1
 a2 LIST  *
 a2 OK Completed (0.000 secs)

 I expected something like '* LIST (\HasNoChildren) . INBOX', but the
 response is blank!

 ~ o ~

 Telnet pop session:

 # telnet localhost 110
 Trying ::1...
 Connected to localhost.
 Escape character is '^]'.
 +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
 ready 1420303981.1358957093@imap-host.mydomain
 USER test@mydomain
 +OK Name is a valid mailbox
 PASS **
 -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist

 /val/log/maillog has:
 pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does not 
 exist

 ~ o ~

 However /var/spool/imap/t/user/test mailbox exists and contains mail:

 # ls -l /var/spool/imap/t/user/test
 total 24
 -rw---. 1 cyrus mail  602 Jan 23 14:36 1.
 -rw---. 1 cyrus mail  606 Jan 23 14:59 2.
 -rw---. 1 cyrus mail  603 Jan 23 15:49 3.
 -rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
 -rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
 -rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index

 # cat /etc/imapd.conf
 configdirectory: /var/lib/imap
 partition-default: /var/spool/imap
 admins: cyrus
 sievedir: /var/lib/imap/sieve
 sendmail: /usr/sbin/sendmail
 hashimapspool: true
 sasl_pwcheck_method: auxprop
 sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
 sasl_auxprop_plugin:sasldb
 allowplaintext: yes
 virtdomains: userid
 tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
 tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
 tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
 tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH
 +OK imap-host.mydomain Cyrus POP3 v2.4.14-Fedora-RPM-2.4.14-1.fc17 server
 ready 1420303981.1358957093@imap-host.mydomain
 USER test@mydomain
 +OK Name is a valid mailbox
 PASS **
 -ERR [SYS/PERM] Unable to locate maildrop: Mailbox does not exist

 /val/log/maillog has:
 pop3s[13116]: Unable to locate maildrop mydomain!user.test: Mailbox does not 
 exist

 ~ o ~

 However /var/spool/imap/t/user/test mailbox exists and contains mail:

 # ls -l /var/spool/imap/t/user/test
 total 24
 -rw---. 1 cyrus mail  602 Jan 23 14:36 1.
 -rw---. 1 cyrus mail  606 Jan 23 14:59 2.
 -rw---. 1 cyrus mail  603 Jan 23 15:49 3.
 -rw---. 1 cyrus mail 1884 Jan 23 15:49 cyrus.cache
 -rw---. 1 cyrus mail  154 Jan 21 09:58 cyrus.header
 -rw---. 1 cyrus mail  416 Jan 23 15:49 cyrus.index

 # cat /etc/imapd.conf
 configdirectory: /var/lib/imap
 partition-default: /var/spool/imap
 admins: cyrus
 sievedir: /var/lib/imap/sieve
 sendmail: /usr/sbin/sendmail
 hashimapspool: true
 sasl_pwcheck_method: auxprop
 sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
 sasl_auxprop_plugin:sasldb
 allowplaintext: yes
 virtdomains: userid
 tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
 tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
 tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
 tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH

Run cyradm --user cyrus localhost and type lm *.  Is the mailbox 
user.test in the output?

Andy

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imap configuration question

[Charles Bradshaw]

Thanks Dan, Here are the details you asked for.

My /etc/imapd.conf :

configdirectory: /var/lib/imap
partition-default: /var/spool/imap
admins: cyrus
sievedir: /var/lib/imap/sieve
sendmail: /usr/sbin/sendmail
hashimapspool: true
sasl_pwcheck_method: auxprop
sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
sasl_auxprop_plugin:sasldb
#allowplaintext: no
#defaultdomain: mail
tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
# uncomment this if you're operating in a DSCP environment (RFC-4594)
# qosmarking: af13

I have played with allowplaintext and defaultdomain.
For the record the 3 sasl_... values are the same as the entries in
/etc/sasl2/Sendmail.conf

Directory ownership:

ls -ld /var/lib/imap
drwxr-x---. 18 cyrus mail 4096 Jan 19 19:37 lib/imap

ls -l lib/imap
total 72
drwx--. 2 cyrus mail 4096 Jan 20 03:35 backup
drwx--. 2 cyrus mail 4096 Jan 19 19:37 db
drwx--. 2 cyrus mail 4096 Jan 19 19:37 db.backup1
drwx--. 2 cyrus mail 4096 Jan 19 16:45 db.backup2
-rw---. 1 cyrus mail  144 Jan 19 12:20 deliver.db
drwx--. 2 cyrus mail 4096 Mar 15  2012 log
-rw---. 1 root  root  144 Jan 14 07:13 mailboxes.db
drwx--. 2 cyrus mail 4096 Mar 15  2012 md5
drwx--. 2 cyrus mail 4096 Mar 15  2012 meta
drwx--. 2 cyrus mail 4096 Mar 15  2012 msg
drwx--. 2 cyrus mail 4096 Mar 15  2012 proc
drwx--. 2 cyrus mail 4096 Mar 15  2012 ptclient
drwx--. 2 cyrus mail 4096 Mar 15  2012 quota
drwx--. 2 cyrus mail 4096 Jan 19 15:29 rpm
drwx--. 2 cyrus mail 4096 Mar 15  2012 sieve
drwxr-x---. 2 cyrus mail 4096 Jan 19 19:37 socket
drwx--. 2 cyrus mail 4096 Mar 15  2012 sync
drwx--. 2 cyrus mail 4096 Mar 15  2012 user

ls -ld /var/spool/imap
drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 /var/spool/imap

ls -l /var/spool/imap
total 8
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.

stage. and sync. are empty

The only possibility I see above is mailboxes.db is root:root  IS THIS THE
PROBLEM?

I assume this was created during:
[root@dell2600 ~]# su cyrus
bash-4.2$ /usr/lib/cyrus-imapd/mkimap

Charles Bradshaw


-- Original Message ---

On: Sat, 19 Jan 2013 18:46:38 -0600, Dan wrote

 On 01/19/13 17:51 +, Charles Bradshaw wrote:
 I'm tying to configure cyrus-imap on a Fedora 17 system.
 
 cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17
 
 I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5 working.
 
 I have gone through the cyrus-imap configuration procedure, but when I try to
 start the server:
 
 # systemctl start cyrus-imapd.service
 Job failed. See system journal and 'systemctl status' for details.
 
 # systemctl status cyrus-imapd.service
 cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service; disabled)
Active: failed (Result: exit-code) since Sat, 19 Jan 2013 13:29:32 
  +;
 28s ago
   Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper 
  start
 (code=exited, status=75)
CGroup: name=systemd:/system/cyrus-imapd.service
 
 If I start the master process manually or in debug mode:
 # /usr/lib/cyrus-imapd/cyrus-master -D  (or -d)
 fatal error: can't read mailboxes file
 ctl_cyrusdb: unable to archive environment
 
 On 01/19/13 18:17 +, Charles Bradshaw wrote:
 File permissions are:
 
 # cd /var/spool
 # ls -l imap
 total 8
 drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
 drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.
 [root@dell2600 spool]# ls -ld imap
 drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 imap
 
 # cd /var
 # ls -ld imap
 drwxr-x---. 2 cyrus mail 4096 Jan 19 11:32 imap
 
 Your 'configdirectory' option in /etc/imapd.conf should point to the
 location of your cyrus database files, including the mailboxes database.
 That directory, and all files underneath it, should be owned by cyrus:mail.
 
 If permissions look correct, please provide the contents of your
 /etc/imapd.conf file, and a directory listing of the 
 'configdirectory' directory.
 
 -- 
 Dan White
--- End of Original Message ---


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imap configuration question

[Patrick Boutilier]

On 01/20/2013 06:40 AM, Charles Bradshaw wrote:

Thanks Dan, Here are the details you asked for.

My /etc/imapd.conf :

configdirectory: /var/lib/imap
partition-default: /var/spool/imap
admins: cyrus
sievedir: /var/lib/imap/sieve
sendmail: /usr/sbin/sendmail
hashimapspool: true
sasl_pwcheck_method: auxprop
sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
sasl_auxprop_plugin:sasldb
#allowplaintext: no
#defaultdomain: mail
tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
# uncomment this if you're operating in a DSCP environment (RFC-4594)
# qosmarking: af13

I have played with allowplaintext and defaultdomain.
For the record the 3 sasl_... values are the same as the entries in
/etc/sasl2/Sendmail.conf

Directory ownership:

ls -ld /var/lib/imap
drwxr-x---. 18 cyrus mail 4096 Jan 19 19:37 lib/imap

ls -l lib/imap
total 72
drwx--. 2 cyrus mail 4096 Jan 20 03:35 backup
drwx--. 2 cyrus mail 4096 Jan 19 19:37 db
drwx--. 2 cyrus mail 4096 Jan 19 19:37 db.backup1
drwx--. 2 cyrus mail 4096 Jan 19 16:45 db.backup2
-rw---. 1 cyrus mail  144 Jan 19 12:20 deliver.db
drwx--. 2 cyrus mail 4096 Mar 15  2012 log
-rw---. 1 root  root  144 Jan 14 07:13 mailboxes.db
drwx--. 2 cyrus mail 4096 Mar 15  2012 md5
drwx--. 2 cyrus mail 4096 Mar 15  2012 meta
drwx--. 2 cyrus mail 4096 Mar 15  2012 msg
drwx--. 2 cyrus mail 4096 Mar 15  2012 proc
drwx--. 2 cyrus mail 4096 Mar 15  2012 ptclient
drwx--. 2 cyrus mail 4096 Mar 15  2012 quota
drwx--. 2 cyrus mail 4096 Jan 19 15:29 rpm
drwx--. 2 cyrus mail 4096 Mar 15  2012 sieve
drwxr-x---. 2 cyrus mail 4096 Jan 19 19:37 socket
drwx--. 2 cyrus mail 4096 Mar 15  2012 sync
drwx--. 2 cyrus mail 4096 Mar 15  2012 user

ls -ld /var/spool/imap
drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 /var/spool/imap

ls -l /var/spool/imap
total 8
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.

stage. and sync. are empty

The only possibility I see above is mailboxes.db is root:root  IS THIS THE
PROBLEM?




mailboxes.db should be owned by cyrus user.

























I assume this was created during:
[root@dell2600 ~]# su cyrus
bash-4.2$ /usr/lib/cyrus-imapd/mkimap

Charles Bradshaw


-- Original Message ---

On: Sat, 19 Jan 2013 18:46:38 -0600, Dan wrote


On 01/19/13 17:51 +, Charles Bradshaw wrote:

I'm tying to configure cyrus-imap on a Fedora 17 system.

cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17

I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5 working.

I have gone through the cyrus-imap configuration procedure, but when I try to
start the server:

# systemctl start cyrus-imapd.service
Job failed. See system journal and 'systemctl status' for details.

# systemctl status cyrus-imapd.service
cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
  Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service; disabled)
  Active: failed (Result: exit-code) since Sat, 19 Jan 2013 13:29:32 
+;
28s ago
 Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper 
start
(code=exited, status=75)
  CGroup: name=systemd:/system/cyrus-imapd.service

If I start the master process manually or in debug mode:
# /usr/lib/cyrus-imapd/cyrus-master -D  (or -d)
fatal error: can't read mailboxes file
ctl_cyrusdb: unable to archive environment


On 01/19/13 18:17 +, Charles Bradshaw wrote:

File permissions are:

# cd /var/spool
# ls -l imap
total 8
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.
[root@dell2600 spool]# ls -ld imap
drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 imap

# cd /var
# ls -ld imap
drwxr-x---. 2 cyrus mail 4096 Jan 19 11:32 imap


Your 'configdirectory' option in /etc/imapd.conf should point to the
location of your cyrus database files, including the mailboxes database.
That directory, and all files underneath it, should be owned by cyrus:mail.

If permissions look correct, please provide the contents of your
/etc/imapd.conf file, and a directory listing of the
'configdirectory' directory.

--
Dan White

--- End of Original Message ---


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus



attachment: boutilpj.vcf
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imap configuration question SOLVED

[Charles Bradshaw]

Thanks All,

Well yes, ahem.. obviously!  Since I'm a complete beginner at this, who, what
and how did the ownership of mailboxes.db get set wrongly in the first place?

The script /usr/lib/cyrus-imapd/mkimap was run as user cyrus, as per the
instructions.

Surely cyrus CANNOT create a root owned file ??

Observation:

Just as a quick experiment I changed mailboxes.db permissions to 666 and low
it works! But something knows and changed the ownership to cyrus:mail with
permissions 600

Something very fishy there.

 ~ o ~

While on the subject of incorrect permissions. The file
/var/lib/imap/db/skipstamp was also root:root and causing this from systemctl
status cyrus-imapd after a SUCCESSFUL start.

Jan 20 12:15:44 blanked.com ctl_cyrusdb[1652]: DBERROR: writing
/var/lib/imap/db/skipstamp: Permission denied

I have know idea why these Permission denied messages are not in
/var/log/messages, perhaps it has something to do with SELinux !!

Thanks for all the help, Charles Bradshaw

On: Sun, 20 Jan 2013 07:20:18 -0400, Patrick wrote:
 On 01/20/2013 06:40 AM, Charles Bradshaw wrote:
  Thanks Dan, Here are the details you asked for.
 
  My /etc/imapd.conf :
 
  configdirectory: /var/lib/imap
  partition-default: /var/spool/imap
  admins: cyrus
  sievedir: /var/lib/imap/sieve
  sendmail: /usr/sbin/sendmail
  hashimapspool: true
  sasl_pwcheck_method: auxprop
  sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
  sasl_auxprop_plugin:sasldb
  #allowplaintext: no
  #defaultdomain: mail
  tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
  # uncomment this if you're operating in a DSCP environment (RFC-4594)
  # qosmarking: af13
 
  I have played with allowplaintext and defaultdomain.
  For the record the 3 sasl_... values are the same as the entries in
  /etc/sasl2/Sendmail.conf
 
  Directory ownership:
 
  ls -ld /var/lib/imap
  drwxr-x---. 18 cyrus mail 4096 Jan 19 19:37 lib/imap
 
  ls -l lib/imap
  total 72
  drwx--. 2 cyrus mail 4096 Jan 20 03:35 backup
  drwx--. 2 cyrus mail 4096 Jan 19 19:37 db
  drwx--. 2 cyrus mail 4096 Jan 19 19:37 db.backup1
  drwx--. 2 cyrus mail 4096 Jan 19 16:45 db.backup2
  -rw---. 1 cyrus mail  144 Jan 19 12:20 deliver.db
  drwx--. 2 cyrus mail 4096 Mar 15  2012 log
  -rw---. 1 root  root  144 Jan 14 07:13 mailboxes.db
  drwx--. 2 cyrus mail 4096 Mar 15  2012 md5
  drwx--. 2 cyrus mail 4096 Mar 15  2012 meta
  drwx--. 2 cyrus mail 4096 Mar 15  2012 msg
  drwx--. 2 cyrus mail 4096 Mar 15  2012 proc
  drwx--. 2 cyrus mail 4096 Mar 15  2012 ptclient
  drwx--. 2 cyrus mail 4096 Mar 15  2012 quota
  drwx--. 2 cyrus mail 4096 Jan 19 15:29 rpm
  drwx--. 2 cyrus mail 4096 Mar 15  2012 sieve
  drwxr-x---. 2 cyrus mail 4096 Jan 19 19:37 socket
  drwx--. 2 cyrus mail 4096 Mar 15  2012 sync
  drwx--. 2 cyrus mail 4096 Mar 15  2012 user
 
  ls -ld /var/spool/imap
  drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 /var/spool/imap
 
  ls -l /var/spool/imap
  total 8
  drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
  drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.
 
  stage. and sync. are empty
 
  The only possibility I see above is mailboxes.db is root:root  IS THIS 
  THE
  PROBLEM?
 
 mailboxes.db should be owned by cyrus user.
 
 
  I assume this was created during:
  [root@dell2600 ~]# su cyrus
  bash-4.2$ /usr/lib/cyrus-imapd/mkimap
 
  Charles Bradshaw
 
 
  -- Original Message ---
 
  On: Sat, 19 Jan 2013 18:46:38 -0600, Dan wrote
 
  On 01/19/13 17:51 +, Charles Bradshaw wrote:
  I'm tying to configure cyrus-imap on a Fedora 17 system.
 
  cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17
 
  I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5 
  working.
 
  I have gone through the cyrus-imap configuration procedure, but when I
try to
  start the server:
 
  # systemctl start cyrus-imapd.service
  Job failed. See system journal and 'systemctl status' for details.
 
  # systemctl status cyrus-imapd.service
  cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
  Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service; disabled)
  Active: failed (Result: exit-code) since Sat, 19 Jan 2013 13:29:32 
  +;
  28s ago
 Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper 
  start
  (code=exited, status=75)
  CGroup: name=systemd:/system/cyrus-imapd.service
 
  If I start the master process manually or in debug mode:
  # /usr/lib/cyrus-imapd/cyrus-master -D  (or -d)
  fatal error: can't read mailboxes file
  ctl_cyrusdb: unable to archive environment
 
  On 01/19/13 18:17 +, Charles Bradshaw wrote:
  File permissions are:
 
  # cd /var/spool
  # ls -l imap
  total 8
  drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
  drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.
  [root@dell2600 spool]# ls -ld imap
  drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 

Re: cyrus-imap configuration question SOLVED

[Simon Matter]

 Thanks All,

 Well yes, ahem.. obviously!  Since I'm a complete beginner at this, who,
 what
 and how did the ownership of mailboxes.db get set wrongly in the first
 place?

 The script /usr/lib/cyrus-imapd/mkimap was run as user cyrus, as per the
 instructions.

I think you should follow the instructions mentioned in the Fedora rpm
docs and not the generic instructions of the cyrus docs. IMHO things like
mkimap should not be needed with a packaged version of cyrus (but of
course it should not break things). If it still fails after following the
package docs you may report this to Fedora as the package could have a bug
then.

Regards,
Simon


 Surely cyrus CANNOT create a root owned file ??

 Observation:

 Just as a quick experiment I changed mailboxes.db permissions to 666 and
 low
 it works! But something knows and changed the ownership to cyrus:mail with
 permissions 600

 Something very fishy there.

  ~ o ~

 While on the subject of incorrect permissions. The file
 /var/lib/imap/db/skipstamp was also root:root and causing this from
 systemctl
 status cyrus-imapd after a SUCCESSFUL start.

 Jan 20 12:15:44 blanked.com ctl_cyrusdb[1652]: DBERROR: writing
 /var/lib/imap/db/skipstamp: Permission denied

 I have know idea why these Permission denied messages are not in
 /var/log/messages, perhaps it has something to do with SELinux !!

 Thanks for all the help, Charles Bradshaw

 On: Sun, 20 Jan 2013 07:20:18 -0400, Patrick wrote:
 On 01/20/2013 06:40 AM, Charles Bradshaw wrote:
  Thanks Dan, Here are the details you asked for.
 
  My /etc/imapd.conf :
 
  configdirectory: /var/lib/imap
  partition-default: /var/spool/imap
  admins: cyrus
  sievedir: /var/lib/imap/sieve
  sendmail: /usr/sbin/sendmail
  hashimapspool: true
  sasl_pwcheck_method: auxprop
  sasl_mech_list: PLAIN DIGEST-MD5 CRAM-MD5
  sasl_auxprop_plugin:sasldb
  #allowplaintext: no
  #defaultdomain: mail
  tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem
  tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt
  # uncomment this if you're operating in a DSCP environment (RFC-4594)
  # qosmarking: af13
 
  I have played with allowplaintext and defaultdomain.
  For the record the 3 sasl_... values are the same as the entries in
  /etc/sasl2/Sendmail.conf
 
  Directory ownership:
 
  ls -ld /var/lib/imap
  drwxr-x---. 18 cyrus mail 4096 Jan 19 19:37 lib/imap
 
  ls -l lib/imap
  total 72
  drwx--. 2 cyrus mail 4096 Jan 20 03:35 backup
  drwx--. 2 cyrus mail 4096 Jan 19 19:37 db
  drwx--. 2 cyrus mail 4096 Jan 19 19:37 db.backup1
  drwx--. 2 cyrus mail 4096 Jan 19 16:45 db.backup2
  -rw---. 1 cyrus mail  144 Jan 19 12:20 deliver.db
  drwx--. 2 cyrus mail 4096 Mar 15  2012 log
  -rw---. 1 root  root  144 Jan 14 07:13 mailboxes.db
  drwx--. 2 cyrus mail 4096 Mar 15  2012 md5
  drwx--. 2 cyrus mail 4096 Mar 15  2012 meta
  drwx--. 2 cyrus mail 4096 Mar 15  2012 msg
  drwx--. 2 cyrus mail 4096 Mar 15  2012 proc
  drwx--. 2 cyrus mail 4096 Mar 15  2012 ptclient
  drwx--. 2 cyrus mail 4096 Mar 15  2012 quota
  drwx--. 2 cyrus mail 4096 Jan 19 15:29 rpm
  drwx--. 2 cyrus mail 4096 Mar 15  2012 sieve
  drwxr-x---. 2 cyrus mail 4096 Jan 19 19:37 socket
  drwx--. 2 cyrus mail 4096 Mar 15  2012 sync
  drwx--. 2 cyrus mail 4096 Mar 15  2012 user
 
  ls -ld /var/spool/imap
  drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 /var/spool/imap
 
  ls -l /var/spool/imap
  total 8
  drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
  drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.
 
  stage. and sync. are empty
 
  The only possibility I see above is mailboxes.db is root:root  IS
 THIS THE
  PROBLEM?

 mailboxes.db should be owned by cyrus user.

 
  I assume this was created during:
  [root@dell2600 ~]# su cyrus
  bash-4.2$ /usr/lib/cyrus-imapd/mkimap
 
  Charles Bradshaw
 
 
  -- Original Message ---
 
  On: Sat, 19 Jan 2013 18:46:38 -0600, Dan wrote
 
  On 01/19/13 17:51 +, Charles Bradshaw wrote:
  I'm tying to configure cyrus-imap on a Fedora 17 system.
 
  cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17
 
  I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5
 working.
 
  I have gone through the cyrus-imap configuration procedure, but when
 I
 try to
  start the server:
 
  # systemctl start cyrus-imapd.service
  Job failed. See system journal and 'systemctl status' for details.
 
  # systemctl status cyrus-imapd.service
  cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
 Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service;
 disabled)
 Active: failed (Result: exit-code) since Sat, 19 Jan 2013
 13:29:32 +;
  28s ago
Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper
 start
  (code=exited, status=75)
 CGroup: name=systemd:/system/cyrus-imapd.service
 
  If I start the master process manually or in debug mode:
  # /usr/lib/cyrus-imapd/cyrus-master -D  

cyrus-imap configuration question

[Charles Bradshaw]

I'm tying to configure cyrus-imap on a Fedora 17 system.

cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17

I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5 working.

I have gone through the cyrus-imap configuration procedure, but when I try to
start the server:

# systemctl start cyrus-imapd.service
Job failed. See system journal and 'systemctl status' for details.

# systemctl status cyrus-imapd.service
cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
  Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service; disabled)
  Active: failed (Result: exit-code) since Sat, 19 Jan 2013 13:29:32 
+;
28s ago
 Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper 
start
(code=exited, status=75)
  CGroup: name=systemd:/system/cyrus-imapd.service

If I start the master process manually or in debug mode:
# /usr/lib/cyrus-imapd/cyrus-master -D  (or -d)
fatal error: can't read mailboxes file
ctl_cyrusdb: unable to archive environment

At this point ps -A reports:
cyrus-master
imapd defunct
imapd
pop3 defunct
pop3d
lmtpd

Top reports imapd  pop3d are sporning and are being zombied at a rate of
about 1 second!  Surely this is not right?

Looks like the deamons are crashing imediately!

Telnet seems to connect, but there is NO imap OK .. Ready response:
$ telnet localhost 143 (or 993)
Trying ::1...
Connected to localhost.
Escape character is '^]'.

The telnet connection must then be killed.

Similarly if I run imtest or cyradm both just hang.

Am I doing something wrong?

Thanks in advance, Charles Bradshaw

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imap configuration question

[Andrew Morgan]

On Sat, 19 Jan 2013, Charles Bradshaw wrote:

 I'm tying to configure cyrus-imap on a Fedora 17 system.

 cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17

 I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5 working.

 I have gone through the cyrus-imap configuration procedure, but when I try to
 start the server:

 # systemctl start cyrus-imapd.service
 Job failed. See system journal and 'systemctl status' for details.

 # systemctl status cyrus-imapd.service
 cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
 Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service; disabled)
 Active: failed (Result: exit-code) since Sat, 19 Jan 2013 13:29:32 
 +;
 28s ago
Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper 
 start
 (code=exited, status=75)
 CGroup: name=systemd:/system/cyrus-imapd.service

 If I start the master process manually or in debug mode:
 # /usr/lib/cyrus-imapd/cyrus-master -D  (or -d)
 fatal error: can't read mailboxes file
 ctl_cyrusdb: unable to archive environment

 At this point ps -A reports:
 cyrus-master
 imapd defunct
 imapd
 pop3 defunct
 pop3d
 lmtpd

 Top reports imapd  pop3d are sporning and are being zombied at a rate of
 about 1 second!  Surely this is not right?

 Looks like the deamons are crashing imediately!

What do you see in your syslog for Cyrus?  I assume you will see an error 
message about unable to open mailboxes file.  We need to figure out where 
the mailboxes file is located and whether the cyrus user owns it and has 
the correct permissions on it.

To me, this sounds like a problem with an incorrectly created Cyrus 
configuration directory and/or mail spool directory.

I'm not familiar with the Fedora Cyrus package, but maybe there is 
something the package is supposed to do when it is installed?  If someone 
else knows the Fedora package, hopefully they will speak up.

Either way, we can fix this!

Andy

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imap configuration question

[J. Roeleveld]

Charles Bradshaw b...@bradcan.homelinux.com wrote:

I'm tying to configure cyrus-imap on a Fedora 17 system.

cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17

I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5
working.

I have gone through the cyrus-imap configuration procedure, but when I
try to
start the server:

# systemctl start cyrus-imapd.service
Job failed. See system journal and 'systemctl status' for details.

# systemctl status cyrus-imapd.service
cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
 Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service;
disabled)
 Active: failed (Result: exit-code) since Sat, 19 Jan 2013 13:29:32
+;
28s ago
Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper
start
(code=exited, status=75)
 CGroup: name=systemd:/system/cyrus-imapd.service

If I start the master process manually or in debug mode:
# /usr/lib/cyrus-imapd/cyrus-master -D  (or -d)
fatal error: can't read mailboxes file
ctl_cyrusdb: unable to archive environment

At this point ps -A reports:
cyrus-master
imapd defunct
imapd
pop3 defunct
pop3d
lmtpd

Top reports imapd  pop3d are sporning and are being zombied at a rate
of
about 1 second!  Surely this is not right?

Looks like the deamons are crashing imediately!

Telnet seems to connect, but there is NO imap OK .. Ready response:
$ telnet localhost 143 (or 993)
Trying ::1...
Connected to localhost.
Escape character is '^]'.

The telnet connection must then be killed.

Similarly if I run imtest or cyradm both just hang.

Am I doing something wrong?

Thanks in advance, Charles Bradshaw

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Are the permissions for the filesystem locations correct?

--
Joost
-- 
Sent from my Android phone with K-9 Mail. Please excuse my brevity.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imap configuration question

[Charles Bradshaw]

File permissions are: 

# cd /var/spool
# ls -l imap
total 8
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.
[root@dell2600 spool]# ls -ld imap
drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 imap

# cd /var
# ls -ld imap
drwxr-x---. 2 cyrus mail 4096 Jan 19 11:32 imap

Date: Sat, 19 Jan 2013 19:12:41 +0100  Download Re: cyrus-imap configuration
question .msg
From: J. Roeleveld jo...@antarean.orgImport addresses
jo...@antarean.org  Block email jo...@antarean.org   Block SMTP Relay
smtp2.tb.mail.iss.as9143.net
To: b...@bradcan.homelinux.com, Charles Bradshaw b...@bradcan.homelinux.com,
info-cyru .
Subject: Re: cyrus-imap configuration question  All headers
 
Charles Bradshaw  b...@bradcan.homelinux.com wrote:

I'm tying to configure cyrus-imap on a Fedora 17 system.

cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17

I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5
working.

I have gone through the cyrus-imap configuration procedure, but when I
try to
start the server:

# systemctl start cyrus-imapd.service
Job failed. See system journal and 'systemctl status' for details.

# systemctl status cyrus-imapd.service
cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
   Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service;
disabled)
   Active: failed (Result: exit-code) since Sat, 19 Jan 2013 13:29:32
+;
28s ago
  Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper
start
(code=exited, status=75)
   CGroup: name=systemd:/system/cyrus-imapd.service

If I start the master process manually or in debug mode:
# /usr/lib/cyrus-imapd/cyrus-master -D  (or -d)
fatal error: can't read mailboxes file
ctl_cyrusdb: unable to archive environment

At this point ps -A reports:
cyrus-master
imapd  defunct
imapd
pop3  defunct
pop3d
lmtpd

Top reports imapd  pop3d are sporning and are being zombied at a rate
of
about 1 second!  Surely this is not right?

Looks like the deamons are crashing imediately!

Telnet seems to connect, but there is NO imap OK .. Ready response:
$ telnet localhost 143 (or 993)
Trying ::1...
Connected to localhost.
Escape character is '^]'.

The telnet connection must then be killed.

Similarly if I run imtest or cyradm both just hang.

Am I doing something wrong?

Thanks in advance, Charles Bradshaw

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imap configuration question

[Dan White]

On 01/19/13 17:51 +, Charles Bradshaw wrote:
I'm tying to configure cyrus-imap on a Fedora 17 system.

cyrus-imapd version cyrus-imapd.i686 2.4.14-1.fc17

I have sendmail and saslauthd working using DIGEST-MD5 and CRAM-MD5 working.

I have gone through the cyrus-imap configuration procedure, but when I try to
start the server:

# systemctl start cyrus-imapd.service
Job failed. See system journal and 'systemctl status' for details.

# systemctl status cyrus-imapd.service
cyrus-imapd.service - Cyrus-imapd IMAP/POP3 email server
 Loaded: loaded (/usr/lib/systemd/system/cyrus-imapd.service; disabled)
 Active: failed (Result: exit-code) since Sat, 19 Jan 2013 13:29:32 
 +;
28s ago
Process: 2049 ExecStartPre=/usr/lib/cyrus-imapd/cyr_systemd_helper 
 start
(code=exited, status=75)
 CGroup: name=systemd:/system/cyrus-imapd.service

If I start the master process manually or in debug mode:
# /usr/lib/cyrus-imapd/cyrus-master -D  (or -d)
fatal error: can't read mailboxes file
ctl_cyrusdb: unable to archive environment

On 01/19/13 18:17 +, Charles Bradshaw wrote:
File permissions are:

# cd /var/spool
# ls -l imap
total 8
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 stage.
drwxr-xr-x. 2 cyrus mail 4096 Jan 19 11:39 sync.
[root@dell2600 spool]# ls -ld imap
drwxr-x---. 4 cyrus mail 4096 Jan 19 11:39 imap

# cd /var
# ls -ld imap
drwxr-x---. 2 cyrus mail 4096 Jan 19 11:32 imap

Your 'configdirectory' option in /etc/imapd.conf should point to the
location of your cyrus database files, including the mailboxes database.
That directory, and all files underneath it, should be owned by cyrus:mail.

If permissions look correct, please provide the contents of your
/etc/imapd.conf file, and a directory listing of the 'configdirectory'
directory.

-- 
Dan White

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Weird vanishing e-mail question

[Ken Smith]

Hi all, I've been using Cyrus-imap for ages. Its excellent. Currently on 
2.3.7 on a Centos 5 setup.

I was editing a mail using Seamonkey as the mua on one machine. I saved 
the mail to drafts and opened it on another machine again with 
Seamonkey, made the changes I wanted and saved the mail to drafts again. 
The draft message has vanished. Both machines had active sessions to 
Cyrus at the same time.

I have seen this previously, but I had put some care into the wording of 
the message I was writing.

Opening the draft mailbox with mutt reveals no trace of the message. 
Searching directly in the filesystem on the imap server for files 
created today reveals the expected things, (such as this message in 
draft form),  but not the vanished message.

Any ideas? Have I triggered an anomaly?

Thanks

Ken

-- 


-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Weird vanishing e-mail question

[Joseph Brennan]

--On September 4, 2012 12:02:11 +0100 Ken Smith k...@kensnet.org wrote:

 I was editing a mail using Seamonkey as the mua on one machine. I saved
 the mail to drafts and opened it on another machine again with
 Seamonkey, made the changes I wanted and saved the mail to drafts again.
 The draft message has vanished. Both machines had active sessions to
 Cyrus at the same time.


Does the second Seamonkey save to a local drafts folder instead of imap?

I assume you are not using delayed expunge on cyrus.

Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Weird vanishing e-mail question

[Ken Smith]

Joseph Brennan wrote:

 --On September 4, 2012 12:02:11 +0100 Ken Smithk...@kensnet.org  wrote:


 {snip}


 Does the second Seamonkey save to a local drafts folder instead of imap?

 I assume you are not using delayed expunge on cyrus.



No the 2nd Seamonkey is set to save drafts into the drafts on the imap 
server. I've looked in its local drafts - no trace.

No delayed expunge.

I re-written the mail.

Its a puzzle. Oh well

:-) Ken

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Question about 2.4.x mailbox rename/locking behaviour

[Greg Banks]

On Fri, Aug 10, 2012, at 06:04 AM, Bill Ryder wrote:
 Hi all,


Hi Bill,

Sorry for the slow reply, I was away Friday.

 We have two problems with cyrus in our environment which is constantly
 used as ammunition against it.
 
 We are running 2.3.16 right now.
 
 The problems are
 
 1. Can not unreserve a mailbox without restarting cyrus - these can be
 caused by number 2 below
 2. Mailbox renames - or deletes - can take a LONG time - and delivery
 stops eventually.
 [...]
 Has anything changed in 2.4 that will stop this kind of thing from
 happening?

So I joined the project at the point when 2.3 was already in the past,
but on examining the source I see that both 2.4 and the development
branch that will be 2.5 both have the same behaviour you describe.  Each
individual file in a folder in linked to its new location and unlinked
again from it's old location, while keeping the mailbox lock.  This is a
long way south of optimal for the common case where an entire user is on
the same filesystem, but that code path is designed to handle all the
cases and handle them safely.

 Depending on fileserver load etc it can take 30 minutes to do one of
 these moves (artists often have wacom email folder drag and 
 drop events which can start huge unexpected mailbox renames)

Cyrus' design generally assumes that folder management is something you
do rarely and deliberately, because this is true for the majority of
people.   Perhaps your email client can be convinced to disable folder
renames via dragging?

OTOH, there's no really good reason for renames to be slow in the common
case, and we've fixed worse problems. We have spoken about improving
folder deletes and renames several times, but there's been no real
impetus.  Raise a bug and we can have a discussion there.

 if the mailbox is large I have to kill the imapd doing the move and clean it
 up. This leads to a reserved mailbox that I can't clear without a reboot.

In 2.4 mailbox reserving is no longer used (unless you're running a
Cyrus murder).

-- 
Greg.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Question about 2.4.x mailbox rename/locking behaviour

[Bill Ryder]

Hi all,

We've been running cyrus for over a decade now but I have management that 
really wants to put in dovecot.

We have two problems with cyrus in our environment which is constantly used as 
ammunition against it.

We are running 2.3.16 right now.

The problems are

1. Can not unreserve a mailbox without restarting cyrus - these can be caused 
by number 2 below
2. Mailbox renames - or deletes - can take a LONG time - and delivery stops 
eventually.


The renames (and mailbox deletes which for us are renames into Trash) are the 
killer since the mailbox is locked during a move. 
We  have about a 1,000 users many of whom with 10 years of email. 100,000 
emails in a folder is not uncommon.

A lot of our traffic is mailling lists and we deliver in batches of 50 to get a 
balance between hardlinking and parallelism, So 
one locked mailbox in that batch hangs the entire batch.

Depending on fileserver load etc it can take 30 minutes to do one of these 
moves (artists often have wacom email folder drag and 
drop events which can start huge unexpected mailbox renames) - in these cases 
if the mailbox is large I have to kill the imapd 
doing the move and clean it up. This leads to a reserved mailbox that I can't 
clear without a reboot.

During these moves all dellivers into that folder lock up because cyrus.header 
is locked and the lmtp's try to get a lock on that 
folder and they stop until postfix times out the delivery and defers it. 
Eventually we end up with a massive backlog because of 
the batch delivers.


Has anything changed in 2.4 that will stop this kind of thing from happening?


I see in the release  notes a lot of locking has been reworked. I didn't see 
anything about mailbox moves (I could have missed it).

We don't have separate filesystems so a directory rename would be the most 
efficient way for us to do the mailbox moves - but of 
course cyrus is designed to handle a more general case and in 2.3.x it links 
the messages into the new destination  folder and 
unlinks them from the source which of course is the safe way to do it.


Has the mailbox rename code changed to do directory renames if the source and 
destination are on the same filesystem? That would 
fix our problem.



(and yup - I realise there are more efficient things to use than mailling lists 
but I don't have control over that end of it)

Thanks!

Bill Ryder
Weta Digital


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Question about murder and lmtp

[Eero Hänninen]

Hello,

I'm new in murder setup. I got it almost to work but I have question,
is there way to use lmtp as preauthed so that no extra auth required?

Currently, mail-relay host connects to frontend server successfully 
(frontend server running lmtpproxyd with -a option and backend server 
running lmtpd with -a option), but in log appears line:
Mar  7 13:33:10 front02 lmtp[79887]: couldn't authenticate to backend 
server: no mechanism available
Mar  7 13:33:10 front02 lmtp[79887]: USAGE vaike401 user: 0.014101 sys: 
0.00

And when I do tcpdump between backend and frontend server, there seems 
no auth like actions or something else:

B: 220 back07 Cyrus LMTP Murder v2.4.13 server ready
F: LHLO lmtpproxyd
B: 250-mh7
B: 250-8BITMIME
B: 250-ENHANCEDSTATUSCODES
B: 250-PIPELINING
B: 250-SIZE
B: 250-AUTH EXTERNAL
B: 250 IGNOREQUOTA
F:
B: 421 4.4.1 bye end of file reached

In last frontend server seems send nothing to backend server and 
backend server disconnects after that.
This nothing looks like:
13:32:29.375260 IP 10.4.0.43.51977  10.4.0.118.2003: Flags [F.], seq 
18, ack 175, win 1026, length 0
 0x:  0050 56bf 0072 0050 56bf 00b3 0800 4500  
.PV..r.PV.E.
 0x0010:  0028 c2a8 4000 4006 637f 0a04 002b 0a04  
.(..@.@.c+..
 0x0020:  0076 cb09 07d3 24ef aa55 2c23 0755 5011  
.v$..U,#.UP.
 0x0030:  0402 14c3    ..

Best Regards,
Eero

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Question about murder and lmtp

[Dan White]

On 03/07/12 14:55 +0200, Eero Hänninen wrote:
Hello,

I'm new in murder setup. I got it almost to work but I have question,
is there way to use lmtp as preauthed so that no extra auth required?

Currently, mail-relay host connects to frontend server successfully
(frontend server running lmtpproxyd with -a option and backend server
running lmtpd with -a option), but in log appears line:
Mar  7 13:33:10 front02 lmtp[79887]: couldn't authenticate to backend
server: no mechanism available
Mar  7 13:33:10 front02 lmtp[79887]: USAGE vaike401 user: 0.014101 sys:
0.00

And when I do tcpdump between backend and frontend server, there seems
no auth like actions or something else:

B: 220 back07 Cyrus LMTP Murder v2.4.13 server ready
F: LHLO lmtpproxyd
B: 250-mh7
B: 250-8BITMIME
B: 250-ENHANCEDSTATUSCODES
B: 250-PIPELINING
B: 250-SIZE
B: 250-AUTH EXTERNAL
B: 250 IGNOREQUOTA
F:
B: 421 4.4.1 bye end of file reached

In last frontend server seems send nothing to backend server and
backend server disconnects after that.

lmtpproxyd is probably expecting to receive a:

250-AUTH mech list

One roundabout way of supporting this would be to used the
'*_sasl_pwcheck_method: alwaystrue' configuration on the backend
(assuming that your sasl library was compiled with --enable-alwaystrue).

On your backend, remove the '-a' option (or run a second lmtp instance
that does not use -a). If your lmtp service name in /etc/cyrus.conf is
'lmtp', then add this in /etc/imapd.conf:

proxyservers: some_user
lmtp_sasl_pwcheck_method: alwaystrue
lmtp_sasl_mech_list: plain
lmtp_sasl_minimum_layer: 0

And on your frontend, configure 'proxy_authname: some_user', and a dummy
password.

There are obvious security problems with this approach that I assume you
understand.

-- 
Dan White

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Question about Cyrus Murder

[Michael Menge]

Hi,

Quoting Andrew Morgan mor...@orst.edu:


On Tue, 22 Mar 2011, Milos Zupancic wrote:


Hi,

I have a general question if this setup is an option.
We have a cyrus murder setup with 2 backends, 1 mupdate, and 2 frontservers
(servers are within our LAN). Everything is working as it should.
For external mail access we atm use a webmail solution.
Some of our employees would still like to use a imap access instead of
webmail. Now the question is, is there a way that i could set up an
additional
external frontend (outside of our LAN) server and in some way connect it to
the existing mupdate and backend.
What ports would I need to forward (3905 tcp - mupdate ) in order to
make this working, what options to enable or disable.


Sure, that will work fine.  The frontend needs to be able to connect to
the backends on the imap and imaps ports and the mupdate server on the
mupdate port.



You need to disaable mailbox referrals.
See proxyd_disable_mailbox_referrals in imapd.conf manpage


M.MengeTel.: (49) 7071/29-70316
Universität Tübingen   Fax.: (49) 7071/29-5912
Zentrum für Datenverarbeitung  mail:  
michael.me...@zdv.uni-tuebingen.de

Wächterstraße 76
72074 Tübingen

smime.p7s
Description: S/MIME Signatur

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Question about Cyrus Murder

[Milos Zupancic]

Hi,

I have a general question if this setup is an option.
We have a cyrus murder setup with 2 backends, 1 mupdate, and 2 frontservers
(servers are within our LAN). Everything is working as it should.
For external mail access we atm use a webmail solution.
Some of our employees would still like to use a imap access instead of
webmail. Now the question is, is there a way that i could set up an
additional
external frontend (outside of our LAN) server and in some way connect it to
the existing mupdate and backend.
What ports would I need to forward (3905 tcp - mupdate ) in order to
make this working, what options to enable or disable.

Any suggestion to other solutions would be welcomed.

Milos Zupancic

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Question about Cyrus Murder

[Andrew Morgan]

On Tue, 22 Mar 2011, Milos Zupancic wrote:

 Hi,

 I have a general question if this setup is an option.
 We have a cyrus murder setup with 2 backends, 1 mupdate, and 2 frontservers
 (servers are within our LAN). Everything is working as it should.
 For external mail access we atm use a webmail solution.
 Some of our employees would still like to use a imap access instead of
 webmail. Now the question is, is there a way that i could set up an
 additional
 external frontend (outside of our LAN) server and in some way connect it to
 the existing mupdate and backend.
 What ports would I need to forward (3905 tcp - mupdate ) in order to
 make this working, what options to enable or disable.

Sure, that will work fine.  The frontend needs to be able to connect to 
the backends on the imap and imaps ports and the mupdate server on the 
mupdate port.

Andy

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Seen file question(s) with cvt_cyrusdb

[Bill Ryder]

Hi all,

When I do this:

cvt_cyrusdb /tech/home/bryder/cyrus/check_seen/bryder.seen.flat  
/cyrus/cyrusMetadata/user/b/bryder.seen skiplist

And then this:

cvt_cyrusdb /cyrus/cyrusMetadata/user/b/bryder.seen skiplist 
/tech/home/bryder/cyrus/check_seen/bryder.seen.flat.new flat

The new flat file has about 18 mailboxes I removed from the original 
.flat file - they came back magically.

In the first .flat file I removed any mboxes that I couldn't find the 
name of using the output from
mbexamine user.bryder

I removed them because I thought something had gone wrong with the seen 
database at some point and it had some left over mailboxes that didn't 
exist anymore so I thought I'd tidy it up.

But they returned - even when I completely removed the .seen database 
before running the cvt_cyrusdb the second time.

What could the mystery mailboxes be?


On a somewhat related note -  is this seen file line  valid?

45e4b8253dea69f41 1291767021 633050 1291767604 
1:629170,629181:629187,629197:629302,629306,629317:629576,629581:629682,629702:629707,629711,629713:629779,629781:629910,629913:629914,629916:629919,629921:629924,629937:629938,629940:629975,629977,629982:629984,630070:630072,630082:630083,630124:630457,630461:630463,630467:630673,630682,630690:630702,630709,630716:630717,630719:630853,630855,630859:631609,631614:631844,631847:632453,632455:632458,632480,632482,632491:632492,632495:632508,632519:632941,632943:633057

Or to abbreviate it

45e4b8253dea69f41 1291767021 633050 1291767604 1:633057

The last read id is  less than the last read id from the range. That 
doesn't seem valid.

This is cyrus 2.3.16

(this all started because I had a user who's mail magically showed up as 
being read - when she hadn't read it - in her case I changed the last id 
to match the highest number in the range of read ids and her problem 
went away)








Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Seen file question(s) with cvt_cyrusdb

[Bill Ryder]

And as I think about it I guess that makes sense because cvt_cyrusdb 
uses the normal database stuff - so it doesn't actually clear out the 
destination database before it starts. It assumes it's supposed to 
update the database.

So changed records get replaced and new records get added but existing 
records remain unchanged.

Sorry for talking to myself!

On 08/12/10 13:49, Bill Ryder wrote:


 On 08/12/10 13:32, Bill Ryder wrote:
 Hi all,

 When I do this:

 cvt_cyrusdb /tech/home/bryder/cyrus/check_seen/bryder.seen.flat  
 /cyrus/cyrusMetadata/user/b/bryder.seen skiplist

 And then this:

 cvt_cyrusdb /cyrus/cyrusMetadata/user/b/bryder.seen skiplist 
 /tech/home/bryder/cyrus/check_seen/bryder.seen.flat.new flat

 OK.

 So this gets stranger.

 If I have an empty file as my new flat file - the lines remain.

 But if I copy /dev/null to the file and then run it the lines are gone.

 So I guess cvt_cyrusdb flat does some kind of merge?


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Replication question

[Michael D. Sofka]

I have a new 2.3.16 back-end server and a replication server.  (For 
those following my saga, I decided to upgrade the to-be-retired 2.2.12 
rsync backup server to 2.3.16.  I did this so I could test replication. 
Turns out this server was previously built with source RPMs, and the 
upgrade was a breeze.  A big Thank You to Simon!)


In testing replication I discovered that partition names must match. 
That is, the replication server has a single 1T default partition, while 
the new back-end server has a series of .5T partitions.

As an experiment I configured the replication server thus:

partition-default: /var/spool/imap
defaultpartition: default
partition-par1: /var/spool/imap

That is, both default and par1 pointing to /var/spool/imap.  And, this 
works!

Is there any reason I should not do this?

Note, this machine will be both the rsync server from the current 2.2.12 
backend, and the replication server for the new 2.3.16 backend during 
the transition.  Once all the mailboxes are moved to the new back end 
I'll have a free machine I can upgrade (OS, disks and Cyrus) to be the 
new replication server.  (As an aside, it would no doubt be more cost 
effective to buy new hardware, but that's not going to happen.)

A simple question, how does guid_mode: sha1 work?  Does it need to be 
set on both master and replication server, and will it, for example, 
affect the unique ids returned by pop3?  We have too many pop3 users.

Mike

-- 
Michael D. Sofka   sof...@rpi.edu
CMT Sr. Systems Programmer,   Email, HPC, TeX, Epistemology
Rensselaer Polytechnic Institute, Troy, NY.  http://www.rpi.edu/~sofkam/

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Replication question

[Bron Gondwana]

On Tue, Oct 19, 2010 at 04:55:48PM -0400, Michael D. Sofka wrote:
 I have a new 2.3.16 back-end server and a replication server.  (For 
 those following my saga, I decided to upgrade the to-be-retired 2.2.12 
 rsync backup server to 2.3.16.  I did this so I could test replication. 
 Turns out this server was previously built with source RPMs, and the 
 upgrade was a breeze.  A big Thank You to Simon!)

Yay Simon!

 In testing replication I discovered that partition names must match. 
 That is, the replication server has a single 1T default partition, while 
 the new back-end server has a series of .5T partitions.
 
 As an experiment I configured the replication server thus:
 
 partition-default: /var/spool/imap
 defaultpartition: default
 partition-par1: /var/spool/imap
 
 That is, both default and par1 pointing to /var/spool/imap.  And, this 
 works!
 
 Is there any reason I should not do this?

Should be fine.  There's actually explicit checks for this situation
in the code to make sure we don't do anything stupid when moving
mailboxes around.

In my perfect world[tm] this partition name matching requirement would
not exist, but that's a long way off.  I've talked about it to lots of
people now, but it's a lot of work.  Unified murder/replication.  It
will rock.  Gotta find some spare cycles to write and test the damn
thing though.

 Note, this machine will be both the rsync server from the current 2.2.12 
 backend, and the replication server for the new 2.3.16 backend during 
 the transition.  Once all the mailboxes are moved to the new back end 
 I'll have a free machine I can upgrade (OS, disks and Cyrus) to be the 
 new replication server.  (As an aside, it would no doubt be more cost 
 effective to buy new hardware, but that's not going to happen.)
 
 A simple question, how does guid_mode: sha1 work?  Does it need to be 
 set on both master and replication server, and will it, for example, 
 affect the unique ids returned by pop3?  We have too many pop3 users.

Yes, set it on both.  No, it doesn't affect the UIDL for pop3, which
will still be UIDVALIDITY.UID.

It works by calculating the sha1 of the rfc822 message both (i.e. the
file stored on disk) and embedding it in the index record.  This
allows efficient de-duplication of copies on the replica, because the
messages have the same GUID.

In Cyrus 2.4, sha1 GUID is the only supported mode, and is required,
and is checked for correctness during replication, so you can't
accidentally replicate bogus information.

Bron.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

RE: A beginner question about Murder

[Michel Sébastien]

 So we use about ten common Intel based servers for BEs (sized to
 support loss of 2/3 servers) and store data on NAS. Users are active
 and filer is about tens of thousand nfsop/s at the busy hour.

 About 10% to 20% of the users connect at least one time a day, globally
 4 million connections per day.

 These are quite massive figures -- I'm thoroughly impressed. I am
 assuming that your back-ends experience 50,000-100,000 concurrent IMAP
 connections during certain parts of the day. This means that each BE
 takes 5,000-10,000 parallel connections. Can an ordinary Intel server
 handle such loads? What's the CPU and RAM of each?

We don't have to handle such load. Most of end-users connect on pop3d (we 
provide a pop3 optimizer to reduce I/O, see 
http://www.mail-archive.com/cyrus-de...@lists.andrew.cmu.edu/msg01194.html) , 
others connect on the webmail (our webmail uses disconnected imapd sessions and 
is optimized thanks to Cyrus statuscache db).

 Also, how many NAS servers/appliances are being used? I would have
 thought that something like NFS would be too slow for such heavy IO
 loads, but evidently I'm wrong.

One huge is enough and cheaper than a SAN. Also we have very experienced system 
admins to tune the filer !


Ce message et les pièces jointes sont confidentiels et réservés à l'usage 
exclusif de ses destinataires. Il peut également être protégé par le secret 
professionnel. Si vous recevez ce message par erreur, merci d'en avertir 
immédiatement l'expéditeur et de le détruire. L'intégrité du message ne pouvant 
être assurée sur Internet, la responsabilité du groupe Atos Origin ne pourra 
être recherchée quant au contenu de ce message. Bien que les meilleurs efforts 
soient faits pour maintenir cette transmission exempte de tout virus, 
l'expéditeur ne donne aucune garantie à cet égard et sa responsabilité ne 
saurait être recherchée pour tout dommage résultant d'un virus transmis.

This e-mail and the documents attached are confidential and intended solely for 
the addressee; it may also be privileged. If you receive this e-mail in error, 
please notify the sender immediately and destroy it. As its integrity cannot be 
secured on the Internet, the Atos Origin group liability cannot be triggered 
for the message content. Although the sender endeavours to maintain a computer 
virus-free network, the sender does not warrant that this transmission is 
virus-free and will not be liable for any damages resulting from any virus 
transmitted.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

RE: A beginner question about Murder

[Michel Sébastien]

Hi,
we use a modified traditional murder, i.e. without murder daemon, to host 
more than 2 million mailboxes (dozen million entries in mboxlist with folders)

We started to host 200.000 mailboxes on the traditional murder, configured 
with berkeley as cyrusdb backend due to lot of corruptions with default 
skiplist format (cyrus 2.3.9).
However we had a lot of locks and contentions with berkeleydb, so we migrated 
later to cyrus 2.3.13 on a skiplist backend. Unfortunately the more we hosted 
mailboxes the more we had production issues. Indeed database resync is not 
incremental and servers restart were increasingly longer. Moreover we had 
instability with skiplist backend around 7.8 million entries and failed to 
reach 8 million entries.

Finally we chose to develop a customized mysql backend. Front-ends and 
back-ends are all connected to the same DB but SQL results are rewritten with 
plugins to make them happy (return mailbox type 1 for proxy en mailbox type 0 
for backend). Now there is no more latency or issue and mysql allows us to host 
more several dozens million of entries.

So, we are totally murderless. FEs are scalable thanks to mysql replication and 
BEs are almost high available (our mysql failover is read-only and don't permit 
acl or folder management, but it is acceptable for us).
We developed our owns mysql backend and we can share the source code if someone 
is interested (perhaps need some clean-up and code rewrite to adapt to the 
official sql backend)

Sébastien

-Message d'origine-
De : info-cyrus-bounces+sebastien.michel=atosorigin@lists.andrew.cmu.edu 
[mailto:info-cyrus-bounces+sebastien.michel=atosorigin@lists.andrew.cmu.edu]
 De la part de Wesley Craig
Envoyé : jeudi 9 septembre 2010 20:16
À : Andrew Morgan
Cc : Shuvam Misra; info-cyrus@lists.andrew.cmu.edu
Objet : Re: A beginner question about Murder

On 08 Sep 2010, at 16:41, Andrew Morgan wrote:
 Unfortunately, I've never setup a unified Murder, so I don't fully
 understand what the advantages and disadvantages of it compared to a
 traditional Murder.  Maybe someone else can jump in here with their
 experiences.

The main advantage is that BEs can proxy for other BEs, no FEs are required.  
In m observation, the FEs are typically CPU bound, while the BEs are typically 
IO bound.  Since the BEs have an excess of CPU, it makes some sense to combine 
the two roles.

Other than the bugs one finds in new code, unified is logically superior to 
traditional and in the long run traditional should be retired.

In the future, I'd like to add unified replication, masterless murder, and 
auto failover. In my ideal minimum system, there are two machines, replicating 
to each other, providing high availability, proxying, etc.

:wes

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/



Ce message et les pièces jointes sont confidentiels et réservés à l'usage 
exclusif de ses destinataires. Il peut également être protégé par le secret 
professionnel. Si vous recevez ce message par erreur, merci d'en avertir 
immédiatement l'expéditeur et de le détruire. L'intégrité du message ne pouvant 
être assurée sur Internet, la responsabilité du groupe Atos Origin ne pourra 
être recherchée quant au contenu de ce message. Bien que les meilleurs efforts 
soient faits pour maintenir cette transmission exempte de tout virus, 
l'expéditeur ne donne aucune garantie à cet égard et sa responsabilité ne 
saurait être recherchée pour tout dommage résultant d'un virus transmis.

This e-mail and the documents attached are confidential and intended solely for 
the addressee; it may also be privileged. If you receive this e-mail in error, 
please notify the sender immediately and destroy it. As its integrity cannot be 
secured on the Internet, the Atos Origin group liability cannot be triggered 
for the message content. Although the sender endeavours to maintain a computer 
virus-free network, the sender does not warrant that this transmission is 
virus-free and will not be liable for any damages resulting from any virus 
transmitted.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

RE: A beginner question about Murder

[Shuvam Misra]

Dear Michel,

 we use a modified traditional murder, i.e. without murder daemon,
 to host more than 2 million mailboxes (dozen million entries in mboxlist
 with folders)

Wow, that's some figure. Care to share some details with the list? What
kind of hardware (both for servers and storage), what performance
observations, etc? How many of these 2 million mailboxes see at least one
login a day?

Shuvam

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

RE: A beginner question about Murder

[Michel Sébastien]

Hi,
yes I can share some little details.
So we use about ten common Intel based servers for BEs (sized to support loss 
of 2/3 servers) and store data on NAS. Users are active and filer is about tens 
of thousand nfsop/s at the busy hour.
About 10% to 20% of the users connect at least one time a day, globally 4 
million connections per day.

Sébastien

-Message d'origine-
De : info-cyrus-bounces+sebastien.michel=atosorigin@lists.andrew.cmu.edu 
[mailto:info-cyrus-bounces+sebastien.michel=atosorigin@lists.andrew.cmu.edu]
 De la part de Shuvam Misra
Envoyé : jeudi 16 septembre 2010 10:48
À : info-cyrus@lists.andrew.cmu.edu
Objet : RE: A beginner question about Murder

Dear Michel,

 we use a modified traditional murder, i.e. without murder daemon,
 to host more than 2 million mailboxes (dozen million entries in mboxlist
 with folders)

Wow, that's some figure. Care to share some details with the list? What
kind of hardware (both for servers and storage), what performance
observations, etc? How many of these 2 million mailboxes see at least one
login a day?

Shuvam

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/



Ce message et les pièces jointes sont confidentiels et réservés à l'usage 
exclusif de ses destinataires. Il peut également être protégé par le secret 
professionnel. Si vous recevez ce message par erreur, merci d'en avertir 
immédiatement l'expéditeur et de le détruire. L'intégrité du message ne pouvant 
être assurée sur Internet, la responsabilité du groupe Atos Origin ne pourra 
être recherchée quant au contenu de ce message. Bien que les meilleurs efforts 
soient faits pour maintenir cette transmission exempte de tout virus, 
l'expéditeur ne donne aucune garantie à cet égard et sa responsabilité ne 
saurait être recherchée pour tout dommage résultant d'un virus transmis.

This e-mail and the documents attached are confidential and intended solely for 
the addressee; it may also be privileged. If you receive this e-mail in error, 
please notify the sender immediately and destroy it. As its integrity cannot be 
secured on the Internet, the Atos Origin group liability cannot be triggered 
for the message content. Although the sender endeavours to maintain a computer 
virus-free network, the sender does not warrant that this transmission is 
virus-free and will not be liable for any damages resulting from any virus 
transmitted.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/