Re: [Dovecot] Special user

2010-02-17 Thread Dennis Guhl

Daniel L. Miller schrieb:

[..]

Example:  accountspaya...@mydomain.com - is an alias for 
j...@mydomain.com, j...@mydomain.com, and j...@mydomain.com.  However - 
any mails sent (from a particular client software) should all only show 
accountspayable as the sender.


If you yust want to appear like comming to your clients with 'From: 
accountspaya...@mydomain.com' it might be the easiest to define a 
new identity in your MUA with accountspaya...@mydomain.com for your 
email address.


Else you create accountspaya...@mydomain.com as a normal user but 
prohibit him to login with imap or pop (like Timo suggested). In 
this case you can also implement a public mailbox with shared flags.


[..]

Dennis


Re: [Dovecot] Dovecot design-question

2010-02-17 Thread Werner
Hi Timo,

 I'm currently running Tests for concurrent delivery via dovecot-deliver to
 a mailbox on a nfs-share with postal. And so far, i did not notice any 
 problems
 when incoming SMTP is directed via LVS to two Mailservers which in parallel
 drop messages with dovecot-deliver to the users mailbox and updates dovecots
 index.files (btw. dovecot 1.2.10 in use, mail_nfs_storage = yes, 
 mail_nfs_index = yes).
 
 How heavily were you stress testing it?

Well, I've initated the test with the double amount of email that's currently 
handeled by
the current system. Tests have been initiated from external servers with postal:

srv1: postal -t 20 -r 100 -m 4192 -s 10 lvsmail.example.com user-list
srv2: postal -t 20 -r 100 -m 4192 -s 10 lvsmail.example.com user-list

(20 parallel sessions, 100 messages per Minute, maximal size of one email 4MB, 
one Mailbox)
After the Test I ran pflogsumm on the Mailserver-Nodes behind the LVS (before 
I've started
the Benchmark, Logs have been cleared). Bandwith on the Storage-Side was quite 
heavy
(83Mbit/s IN, 37MBit/s OUT) but LOAD (max 0.5) and CPU-USAGE (max 10%) of the 
Storage was
really OK.

In summary, I've admitted about 19841 Messages over 2 Nodes to the users 
mailbox. Dovecot
Deliver only had 5 times a problem (like mentioned) and deferred those 
messages. More Detailed
Pflogsumm-Output for the two MX-Nodes is found under [1] and [2].


 The only thing I've found so far:

 Feb 16 17:33:46 cmx2 postfix/pipe[24221]: DD3F118A22A: 
 to=wer...@example.com, relay=dovecot, delay=3.4, delays=0.75/0/0/2.6, 
 dsn=4.3.0,
 status=deferred (temporary failure. Command output: Internal error occurred. 
 Refer to server log for more information. [2010-02-16 17:33:43])

 That looks like exactly the kind of error I was talking about. Looking at 
 Dovecot's log would show what the internal error was.

sadly, I did not find any more specific hints in the Maillog (mail_debug=yes) 
than this line :-(
So, I assume it could work to have to servers for incoming SMTP active, even if 
dovecot-deliver
is used as LDA?

kind regards,
Werner


[1] Node1: (pflogsumm counts incoming mails twice because of smtpd_proxy_filter)


Grand Totals

messages

9656 received
4821 delivered
0 forwarded
4 deferred (4 deferrals)
9898m bytes received
9902m bytes delivered

Per-Hour Traffic Summary
time received delivered deferred bounced rejected

1700-1800 2872 1434 2 0 64
1800-1900 3622 1809 1 0 42
1900-2000 3162 1578 1 0 37

message deferral detail
---
pipe (total: 4)
1 04:03]
1 33:43]
1 43:46]
1 49:00]


[2] Node2: (pflogsumm counts incoming mails twice because of smtpd_proxy_filter)


Grand Totals

messages

30052 received
15020 delivered
0 forwarded
1 deferred (1 deferrals)
30576m bytes received
30614m bytes delivered

Per-Hour Traffic Summary
time received delivered deferred bounced rejected

1700-1800 9166 4573 0 0 46
1800-1900 11297 5651 0 0 98
1900-2000 9589 4796 1 0 79


message deferral detail
---
pipe (total: 1)
1 24:10]


Re: [Dovecot] Dovecot design-question

2010-02-17 Thread Timo Sirainen
On 17.2.2010, at 16.05, Werner wrote:

 Feb 16 17:33:46 cmx2 postfix/pipe[24221]: DD3F118A22A: 
 to=wer...@example.com, relay=dovecot, delay=3.4, delays=0.75/0/0/2.6, 
 dsn=4.3.0,
 status=deferred (temporary failure. Command output: Internal error 
 occurred. Refer to server log for more information. [2010-02-16 17:33:43])
 
 That looks like exactly the kind of error I was talking about. Looking at 
 Dovecot's log would show what the internal error was.
 
 sadly, I did not find any more specific hints in the Maillog (mail_debug=yes) 
 than this line :-(

It really should have logged something. http://wiki.dovecot.org/LDA#logging 
and/or http://wiki.dovecot.org/Logging may give hints.

 So, I assume it could work to have to servers for incoming SMTP active, even 
 if dovecot-deliver
 is used as LDA?

Well, it's not error free, as you said you got 5 errors already. But if you can 
live with random errors, sure..



Re: [Dovecot] quota problem

2010-02-17 Thread Andre Hübner

Hello,


this is unfortunately not compatible with dovecot 1.0, is not working


i switched now to dovecot 1.2.10, which  is current stable release.
unfortunately my userquoata is not working, just global quota ist active and 
is not overwritten by userquota from userdb
I cannot go on with my setup, the devil's in the detail but i dont find 
it...

I repeat my setup, maybe somebody is seeing something.

this is my mysql-table i use for auth and quota:

login varchar(255)
password varchar(64)
home varchar(128)
uid int(11)
gid int(11)
quota_bytes varchar(15)
active char(1)

typical dataset:
username| 027c57a0bda1922cb475b39817e08c0514651a03| /home/popuser/username 
|508| 500| 10| Y


my password_query:
password_query = SELECT login as user, password FROM mail_users WHERE login 
= '%u' AND active='Y'


my user_query:
user_query = SELECT  home, uid, gid, concat('*:storage=', quota_bytes,'M') 
AS quota_rule FROM mail_users WHERE login = '%u'


quota/imap_quota is activated for pop/imap/lda
lda is used to deliver mails:
plugin-section is:

plugin {
   quota = dirsize:user
   quota_rule = *:storage=1000G
}

I have no idea why its not working. Quota is only effective if i decrease 
global quota lower values, it gets not overwritten with data from userdb.
in verbose mailog i can see queries to mysql, i double checked format etc. 
but have no solution.


Thanks,
Andre 



Re: [Dovecot] Sieve libexec /usr/lib/dovecot/deliver

2010-02-17 Thread Filip Dvořák

Hello,

I have solved it. It isn`t dovecot fault but mine.

Wrong postfix configuration.
master.cf:

dovecot   unix  -   n   n   -   -   pipe.
   flags=DRhu user=vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d  
${recipient}


I had /usr/libexec/dovecot/deliver .

Thanks all for this great software.
Filip


Dne Mon, 15 Feb 2010 09:08:24 +0100 Filip Dvořák f...@pruda.com  
napsal/-a:




Hi,

I have installed dovecot(1.2.10) with --libexecdir=/usr/lib .
Dovecot sieve(0.1.15) is compiled with --with-dovecot
but still uses /usr/libexec/dovecot/deliver instead of  
/usr/lib/dovecot/deliver.


How should be dovecot sieve configured to use /usr/lib/dovecot/deliver

thanks in advance

Filip

# dovecot configuration:
./configure --prefix=/usr --sysconfdir=/etc/dovecot --localstatedir=/var  
\
 --libexecdir=/usr/lib   
--with-moduledir=/usr/lib/dovecot/modules \

 --with-db --with-mysql --with-pgsql --with-sqlite \
 --with-ssl=openssl --with-ssldir=/etc/dovecot/ssl \
 --with-gssapi --with-ldap=plugin --enable-header-install  
--with-docs


# dovecot sieve configuration:
./configure --prefix=/usr --with-dovecot=/usr/lib/dovecot

# /usr/lib/dovecot/dovecot-config:
CFLAGS=-std=gnu99 -march=i686 -mtune=generic -O2 -pipe -Wall -W  
-Wmissing-prototypes -Wmissing-declarations -Wpointer-arith  
-Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2   

LIBS= -lrt
SSL_LIBS=-lssl -lcrypto -ldl -lz  

STORAGE_LIBS=$(top_builddir)/src/lib-storage/register/libstorage-register.a  
$(top_builddir)/src/lib-storage/list/libstorage_list.a   
$(top_builddir)/src/lib-storage/index/cydir/libstorage_cydir.a  
$(top_builddir)/src/lib-storage/index/dbox/libstorage_dbox.a  
$(top_builddir)/src/lib-storage/index/maildir/libstorage_maildir.a  
$(top_builddir)/src/lib-storage/index/mbox/libstorage_mbox.a  
$(top_builddir)/src/lib-storage/index/raw/libstorage_raw.a  
$(top_builddir)/src/lib-storage/index/shared/libstorage_shared.a  
$(top_builddir)/src/lib-storage/index/libstorage_index.a  
$(top_builddir)/src/lib-storage/libstorage.a  
$(top_builddir)/src/lib-index/libindex.a  
$(top_builddir)/src/lib-imap/libimap.a  
$(top_builddir)/src/lib-mail/libmail.a  
$(top_builddir)/src/lib-auth/libauth.a  
$(top_builddir)/src/lib-charset/libcharset.a  
$(top_builddir)/src/lib/liblib.a

LIBICONV=
MODULE_LIBS=-export-dynamic -ldl

dovecot_incdir=/usr/include/dovecot
moduledir=/usr/lib/dovecot/modules


CFLAGS=-std=gnu99 -march=i686 -mtune=generic -O2 -pipe -Wall -W  
-Wmissing-prototypes -Wmissing-declarations -Wpointer-arith  
-Wchar-subscri

LIBS= -lrt
SSL_LIBS=-lssl -lcrypto -ldl -lz  

STORAGE_LIBS=$(top_builddir)/src/lib-storage/register/libstorage-register.a  
$(top_builddir)/src/lib-storage/list/libstorage_list.a  $(top_

LIBICONV=
MODULE_LIBS=-export-dynamic -ldl

dovecot_incdir=/usr/include/dovecot
moduledir=/usr/lib/dovecot/modules
# end of dovecot-config


dovecot -n output:
# 1.2.10: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.27-lts i686  ext3
protocols: imap imaps pop3 pop3s
ssl_cert_file: /etc/ssl/mail.pruda.com/cert.pem
ssl_key_file: /etc/ssl/mail.pruda.com/key.pem
disable_plaintext_auth: no
login_dir: /var/run/dovecot/login
login_executable(default): /usr/lib/dovecot/imap-login
login_executable(imap): /usr/lib/dovecot/imap-login
login_executable(pop3): /usr/lib/dovecot/pop3-login
mail_location: maildir:/home/vmail/%u
mail_executable(default): /usr/lib/dovecot/imap
mail_executable(imap): /usr/lib/dovecot/imap
mail_executable(pop3): /usr/lib/dovecot/pop3
mail_plugin_dir(default): /usr/lib/dovecot/modules/imap
mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap
mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3
lda:
   postmaster_address: postmas...@pruda.com
   mail_plugins: sieve
   sieve_global_path: /home/vmail/dovecot-global.sieve
   sendmail_path: /usr/sbin/sendmail
auth default:
   user: nobody
   passdb:
 driver: sql
 args: /etc/dovecot/dovecot-mysql.conf
   userdb:
 driver: sql
 args: /etc/dovecot/dovecot-mysql.conf
   socket:
 type: listen
 master:
   path: /var/run/dovecot/auth-master
   mode: 432
   user: vmail
   group: vmail
plugin:
   sieve: /home/vmail/%u/dovecot.sieve
   home: /home/vmail/%u









Re: [Dovecot] quota problem

2010-02-17 Thread aledr
On Wed, Feb 17, 2010 at 12:26 PM, Andre Hübner andre.hueb...@gmx.de wrote:
 ...
 I have no idea why its not working. Quota is only effective if i decrease
 global quota lower values, it gets not overwritten with data from userdb.
 in verbose mailog i can see queries to mysql, i double checked format etc.
 but have no solution.

I have the same problem here running 1.2.10. No userdb quota_rule is
applied to users, only dovecot.conf ones and if I remove them no
quota_rules are loaded.
No answers on IRC too.

Regards.
--
[ ]'s
Aledr - Alexandre
OpenSource Solutions for SmallBusiness Problems


Re: [Dovecot] passing parameters to deliver

2010-02-17 Thread Steffen Kaiser

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Fri, 12 Feb 2010, Kamil Jońca wrote:


Is any posibility to pass parameters/environment variables to deliver
with sieve plugin?


No. But you could check the extdata extension posted by Stephan Bosch 
lately.


Regards,

- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)

iQEVAwUBS3wO2L+Vh58GPL/cAQImYwf7BcJmElNVVVaXSkkuSucGrAUnTu5lXrW+
+f1TCfAlhyd5DDUYvYjKV2/gGzLSQt3u+BRQ5VmQaQOibdceb0Q4L3NTp8CHhqg9
PiMRsEqbvGkLlKRQSiX1M6yomAkfdBrpDHE7P5327pl8i62ySPeMF+Axcrk2aRcL
344uqfk/gNz1mZOdqMD3tXdHB+iXR9eKMAvJ/iaTwIclGXH/RIF+xq+d0FcG8M81
LL1LqXD0B2iGRBj7k2DUBdA5VxIDgZrqjRkBDcGEFvJgC5MZNNN4EuH7rMqWj0Ue
uONwEO0zloRRdmfFBOsrNmGrGy2rTQidE0JTFh9MtLogIvn4kENx6w==
=lBus
-END PGP SIGNATURE-

[Dovecot] 2nd REPOST: mbox vs maildir

2010-02-17 Thread Ashley M. Kirchner


   I'm going to assume this is just not possible, or that no one has an 
answer, which would lead me back to uw-imap since it does work as-is. 
So I'll post it again, hoping that there is a solution for this setup 
and that folks have just been too busy to help think about it and/or 
help come up with a possible solution.


-

   Ignoring my previous message just for a second, I realized that my
config wasn't correct.  First the layout:

~mail/
~mail/Drafts
~mail/Ashley-Feb09
~mail/Others-Feb09

~mail-Archives/
~mail-Archives/2009/
~mail-Archives/2009/Ashley/
~mail-Archives/2009/Ashley/Ashley-Dec09
~mail-Archives/2009/Ashley/Ashley-Nov09
~mail-Archives/2009/Ashley/Ashley-Oct09


   So I (now) have this for namespaces:

namespace private {
   separator = /
   prefix = mail/
   location = mbox:~/mail:INBOX=/var/mail/%u
   inbox = yes
   hidden = no
   list = yes   # for v1.1+
}

namespace private {
   separator = /
   prefix = mail-Archives/
   location = maildir:~/mail-Archives:LAYOUT=fs
   inbox = no
   hidden = no
   list = yes
   subscriptions = yes
}


   But when I'm in Thunderbird and I try to subscribe to anything that
falls inside of ~/mail-Archives/ it won't work.  I can browser all the
way down to the folder, but I can't see anything within that folder.

   For example, consider the full path to the following 'Ashley-Dec09'
mailbox:

   ~mail-Archives/2009/Ashley/Ashley-Dec09

   In Thunderbird, when I hit 'Subscribe' I can browse down to '2009'
and I can see 'Ashley', but I can't drill down into it and subscribe to
'Ashley-Jan09'.

   What am I missing here?



Re: [Dovecot] Courier-Dovecot Migration Issue

2010-02-17 Thread Tony Rutherford

Tony Rutherford wrote:

For testing purposes, on a small set of users, we've run the
courier-dovecot-migrate.pl script.   We are converting from Courier 0.43 to
Dovecot 1.2.9.  For the most part, things seem to be ok.  However, an iPhone
IMAP client user is reporting a problem where some of her messages don't
show up.  Even stranger is the fact that these same messages do appear when
using Outlook 2k7 for instance.  The common denominator for when the
messages are missing seems to be whether or not the message appeared in both
the Courier IMAP and Courier POP3 uid files.  The missing messages appear in
the CourierIMAP file, but NOT the Courier POP file.  Here is a snippet from
the resulting Dovecot-uidlist file:

 


3 V1141844265 N12392

9338 P00cf2eb6_fadc_4992_ad3a_57cc83a16eab W5146
:00cf2eb6_fadc_4992_ad3a_57cc83a16eab:2,S

9788 P0b18a2d6_97dd_4712_a09c_23c7a3d59467 W4055
:0b18a2d6_97dd_4712_a09c_23c7a3d59467:2,S

9942 P0b3cfd0b_1fc7_47b3_805f_b369a3bb6c65 W4359
:0b3cfd0b_1fc7_47b3_805f_b369a3bb6c65:2,S

10100 Pe178f1ed_d648_47e8_807a_3e2d655d7f84 W12028
:e178f1ed_d648_47e8_807a_3e2d655d7f84:2,S

10101 Pe3f28a53_a4d4_4f3d_babe_5df72bc35b47 W13974
:e3f28a53_a4d4_4f3d_babe_5df72bc35b47:2,S

10102 Pf3c3024b_2850_43ef_a397_d5cae5c8f537 W7177
:f3c3024b_2850_43ef_a397_d5cae5c8f537:2,S

10104 P6e808a68_0a7b_4528_aa67_4cc16361c56b W10817
:6e808a68_0a7b_4528_aa67_4cc16361c56b:2,S

10105 P65c8218d_7b2a_43b7_82a4_2743025bd954 W3579
:65c8218d_7b2a_43b7_82a4_2743025bd954:2,S

10106 P963cc43e_0355_481e_99d5_5468708bc28f W6410
:963cc43e_0355_481e_99d5_5468708bc28f:2,S

10107 P1405aefc_b98b_4a35_a7dd_a69199f724d0 W4703
:1405aefc_b98b_4a35_a7dd_a69199f724d0:2,S

10108 P67908fad_ec0a_4786_b0f1_c7cfaa23d09a W127288
:67908fad_ec0a_4786_b0f1_c7cfaa23d09a:2,S

10109 :9176f3b2_1927_4657_baa8_bfe4c39e89d4:2,S

10110 :79047185_aef7_48ec_aff2_6b71bd566acd:2,S

10111 :efe275a0_a7a8_4f47_b638_45a18bc0b108:2,S

 


The last three entries exist in the Courier IMAP file, but NOT the Courier
POP file.  The resulting dovecot-uidlist format is different, but to be
honest, I haven't been able to find the exact specification for the format
of the dovecot-uidlist file (if it exists).

 


What is really strange to me is: If there was a problem with the migration
script and resulting dovecot-uidlist file, why would these messages show up
fine in some client (ex. Outlook) and not others (ex. iPhone).

 


Regards,

Tony


  
During the migration, it appears that the emphasis is placed on 
maintaining the Pop3 message sequence...at the cost of possibly changing 
IMAP UIDs.  The iPhone appears to go very strictly by the actual order 
of the IMAP uids...and since they're now out of sync...the messages 
appear to be out of order on the iPhone client.  I understand the 
importance of ensuring that pop clients don't redownload  messages...so 
tough to argue.


Here's a question though.  If the dovecot-uidlist file is deleted (for 
whatever reason), it gets rebuilt by Dovecot.  But, how does it get 
rebuilt?  It does not appear to generate uids based on the date of 
messages...I believe that to be true.  Is there any flag/option in 
Dovecot to build the uidlist file based on message date (uids ordered by 
date)?  The problem is that if they're not ordered by date, again, when 
the iPhone gets the first 200 messages, they may not necessarily be the 
latest 200 messages.  Also...this behaviour does not appear in other 
clients we've tested...TB and Outlook2007.


Tony


Re: [Dovecot] quota problem

2010-02-17 Thread aledr
Figured It out...
You need to return quota rules in password_query just as you do in
user_query. Remember to add userdb_ prefix.

Regards.

On Wed, Feb 17, 2010 at 12:38 PM, aledr matrixworkstat...@gmail.com wrote:
 On Wed, Feb 17, 2010 at 12:26 PM, Andre Hübner andre.hueb...@gmx.de wrote:
 ...
 I have no idea why its not working. Quota is only effective if i decrease
 global quota lower values, it gets not overwritten with data from userdb.
 in verbose mailog i can see queries to mysql, i double checked format etc.
 but have no solution.

 I have the same problem here running 1.2.10. No userdb quota_rule is
 applied to users, only dovecot.conf ones and if I remove them no
 quota_rules are loaded.
 No answers on IRC too.

 Regards.
 --
 [ ]'s
 Aledr - Alexandre
 OpenSource Solutions for SmallBusiness Problems

--
[ ]'s
Aledr - Alexandre
OpenSource Solutions for SmallBusiness Problems


Re: [Dovecot] Dovecot design-question

2010-02-17 Thread Werner
Hi,

 I will set log_path = /var/log/dovecot-deliver-errors.log within the 
 LDA-Section and will produce the temporary
 failure again. I will get back to you.

Done - I've reproduced the error, here's the output from dovecot-deliver for 
those temporary Failures in the maillog:

2010-02-17 17:52:21 deliver(wer...@example.com): Error: Corrupted transaction 
log file /mailhome/wernertest/dovecot.index.log seq 24: Invalid
transaction log size (67988 vs 68080): /mailhome/wernertest/dovecot.index.log 
(sync_offset=67988)

Is this something to worry about ?

Thanks,
Werner


Re: [Dovecot] Highly Performance and Availability

2010-02-17 Thread Ed W
I think Stan pretty much covered how to do this stuff *properly*, 
however, for those following along in the bedroom, there are a couple of 
interesting projects what might get you some of the ESX features (surely 
at the expense of far more support and likely reliability, but needs 
always vary...)


Note, I have no experience with any of these projects, they simply 
caught my eye for further research...


- Latest KVM+QEMU includes some of the desirable ESX features including 
hot migration

- Apparently Redhat have a nice management utility for this
- Or try ProxMox: http://pve.proxmox.com/wiki/Main_Page

(cheap) High availability storage seems to come down to:
- iSCSI
- Add redundancy to the storage using DRDB (I believe a successful 
strategy with Dovecot is pairs of servers, replicated to each other - 
run each at 50% capacity and if one dies the other picks up the slack)
- Interesting developing ideas are: PVFS, GlusterFS (they have an 
interesting appliance which might get reliability to production 
levels?), CEPH (reviews suggest it's very easily days)


None of these solutions gets you an enterprise or proper high end 
solution as described by Stan, but may give some others some things to 
investigate


Cheers

Ed W


[Dovecot] GlusterFs - Any new progress reports?

2010-02-17 Thread Ed W
GlusterFs always strikes me as being the solution (one day...).  It's 
had a lot of growing pains, but there have been a few on the list had 
success using it already.


Given some time has gone by since I last asked - has anyone got any more 
recent experience with it and how has it worked out with particular 
emphasis on Dovecot maildir storage? How has version 3 worked out for you?


Anyone had success using some other clustered/HA filestore with dovecot 
who can share their experience? (OCFS/GFS over DRBD, etc?)


My interest is more in bootstrapping a more highly available system from 
lower quality (commodity) components than very high end use


Thanks

Ed W


Re: [Dovecot] Dovecot design-question

2010-02-17 Thread Ed W

On 01/02/2010 10:05, Werner wrote:

Hi everybody,

we're currently in the process of drafting our new mailserver-setup.
Instead of a single-server-setup we'd like to have two equal servers
behind a loadbalancer like LVS and shared mailhomes on NFS.

We'd like to use dovecot for POP/IMAP, dovecot-deliver as LDA.

- It's probably the best idea to direct SMTP and POP/IMAP always to
the same server behind the loadbalancer (because dovecot-deliver is
used which updates indexes?)

- If we think of a active/passive setup: dovecot index-files locally
or on the nfs-share?

   


At least one other user on the list had success using Dovecot proxy and 
a backend servers are the frontend servers setup.  Basically the user 
comes into a random frontend server, the dovecot proxy has a 50:50 
chance to discover they are already on the right machine and gets out of 
the way, otherwise it proxy's the connection to the other machine.


I guess this will waste 25% internal bandwidth on average (external b/w 
should remain the same).  Apparently cpu requirements are very low for 
proxying and additional memory requirements can be measured, but may be 
satisfactory


If one server fails then you have to update the loadbalancer to redirect 
only to the working server AND update the proxy not to try and send 
users to the other machine.  Depending how you configure things this 
extra step can be done very easily though.


Good luck

Ed W


Re: [Dovecot] GlusterFs - Any new progress reports?

2010-02-17 Thread alex handle

 Anyone had success using some other clustered/HA filestore with dovecot who
 can share their experience? (OCFS/GFS over DRBD, etc?)

 My interest is more in bootstrapping a more highly available system from
 lower quality (commodity) components than very high end use

we use drbd with ext3 in a active/passive setup for more than 1 mailboxes.
works like a charm!

I'm not really trusting cluster filesystems and most cluster
filesystems are not made for small
files.


Alex


Re: [Dovecot] GlusterFs - Any new progress reports?

2010-02-17 Thread Steve

 Original-Nachricht 
 Datum: Wed, 17 Feb 2010 20:15:30 +0100
 Von: alex handle alex.han...@gmail.com
 An: Dovecot Mailing List dovecot@dovecot.org
 Betreff: Re: [Dovecot] GlusterFs - Any new progress reports?

 
  Anyone had success using some other clustered/HA filestore with dovecot
 who
  can share their experience? (OCFS/GFS over DRBD, etc?)
 
  My interest is more in bootstrapping a more highly available system from
  lower quality (commodity) components than very high end use
 
 we use drbd with ext3 in a active/passive setup for more than 1
 mailboxes.
 works like a charm!
 
 I'm not really trusting cluster filesystems and most cluster
 filesystems are not made for small
 files.
 
I use GlusterFS with Dovecot and it works without issues. The GlusterFS team 
has made huge progress since 2.0 and with the new 3.0 version they have again 
proved that GlusterFS can get better.


 Alex

Steve

-- 
Sicherer, schneller und einfacher. Die aktuellen Internet-Browser -
jetzt kostenlos herunterladen! http://portal.gmx.net/de/go/chbrowser


[Dovecot] tls not working on ubuntu

2010-02-17 Thread zhong ming wu
Hello List,

I'm new to dovecot.  I have sucessfully configured dovecot with just
virtual users on a centos linux box to my satisfaction; I can connect
with TLS with disable_plaintext_auth = yes.  This dovecot is also
version  1.   Can't post exact version right now but it's what comes
with Centos 5.4.

On a Ubuntu 9.10 box here, I cannot connect with TLS (port 110) but I
can connect with plain SSL (port 995).  The config files between
centos and ubuntu boxes are the same except for minor details.

The following is the log entry

Feb 17 21:38:18 ubuntu dovecot: pop3-login: Disconnected (no auth
attempts): rip=192.168.0.101, lip=192.168.0.108

The output below is from a binary compiled from source.  I have also
tested with 1.1.11 (that I get from apt-get install) with the same
config file.
I have tested ubuntu with both Thunderbird 3 and thunderbird 2.
I have also searched google as well as dovecot website.

Thanks

mr.wu

# 1.2.10: /usr/local/etc/dovecot.conf
# OS: Linux 2.6.31-14-server x86_64 Ubuntu 9.10 ext4
base_dir: /var/run/dovecot/
protocols: pop3 pop3s
listen: 192.168.0.108
ssl_cert_file: /usr/local/etc/pop.crt
ssl_key_file: /usr/local/etc/pop.key
ssl_parameters_regenerate: 29
disable_plaintext_auth: no
verbose_ssl: yes
login_dir: /var/run/dovecot//login
login_executable: /usr/local/libexec/dovecot/pop3-login
mail_location: maildir:/var/vmail/%d/%n
mail_executable: /usr/local/libexec/dovecot/pop3
mail_plugin_dir: /usr/local/lib/dovecot/pop3
auth default:
  user: authdove
  debug: yes
  passdb:
driver: passwd-file
args: /usr/local/etc/%d/passwd
  userdb:
driver: static
args: uid=2000 gid=2000 home=/var/vmail/%d/%n


Re: [Dovecot] tls not working on ubuntu

2010-02-17 Thread Timo Sirainen
On Wed, 2010-02-17 at 22:03 -0500, zhong ming wu wrote:

 On a Ubuntu 9.10 box here, I cannot connect with TLS (port 110) but I
 can connect with plain SSL (port 995).  The config files between
 centos and ubuntu boxes are the same except for minor details.

Probably something on your client side prevents this. Antivirus/firewall
software is a common reason.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] GlusterFs - Any new progress reports?

2010-02-17 Thread Eric Rostetter

Quoting Ed W li...@wildgooses.com:

Anyone had success using some other clustered/HA filestore with  
dovecot who can share their experience? (OCFS/GFS over DRBD, etc?)


GFS2 over DRBD in an active-active setup works fine IMHO.   Not perfect,
but it was cheap and works well...  Let's me reboot machines with
no downtime which was one of my main goals when implementing it...

My interest is more in bootstrapping a more highly available system  
from lower quality (commodity) components than very high end use


GFS+DRBD should fit the bill...  You need several nics and cables,
but they are dirt cheap...  Just 2 machines with the same disk setup,
and a handful of nics and cables, and you are off and running...


Thanks

Ed W


--
Eric Rostetter
The Department of Physics
The University of Texas at Austin

Go Longhorns!


Re: [Dovecot] 2nd REPOST: mbox vs maildir

2010-02-17 Thread Stan Hoeppner
Ashley M. Kirchner put forth on 2/17/2010 9:46 AM:

Hi Ashley, sorry no one had tried to help you yet.  I'm not a dovecot expert,
just a user, but I'll try to help.

But when I'm in Thunderbird and I try to subscribe to anything that
 falls inside of ~/mail-Archives/ it won't work.  I can browser all the
 way down to the folder, but I can't see anything within that folder.

Not to be a jerk, but there is stuff in this folder, yes?  What version of
T-Bird, on what OS?

For example, consider the full path to the following 'Ashley-Dec09'
 mailbox:
 
~mail-Archives/2009/Ashley/Ashley-Dec09

In Thunderbird, when I hit 'Subscribe' I can browse down to '2009'
 and I can see 'Ashley', but I can't drill down into it and subscribe to
 'Ashley-Jan09'.

Do you have any other IMAP clients working in this scenario, such as Outlook,
Eudora, or webmail such as Roundcube or Squirrelmail?  Eliminate the client as
the source of the problem first, then troubleshoot dovecot.  You can't know if
it's a dovecot problem if you're only testing with one client.

Test a couple of others clients and see if they suffer this problem.  I use TB
3.0.1, but I'm all mbox format here, so I can't duplicate your issue.

Also, these folders already existed, correct?  T-Bird did not create them,
correct?  If you can, within TB, create another folder tree the same number of
layers deep, and see if you run into the same or similar problems.  Perform this
test with two other IMAP clients as well.

-- 
Stan



Re: [Dovecot] Highly Performance and Availability

2010-02-17 Thread Stan Hoeppner
Ed W put forth on 2/17/2010 12:25 PM:
 I think Stan pretty much covered how to do this stuff *properly*,

At least for a VMware ESX + SAN environment, yes.

 however, for those following along in the bedroom, there are a couple of
 interesting projects what might get you some of the ESX features (surely
 at the expense of far more support and likely reliability, but needs
 always vary...)

Surely.  I hate the licensing cost of VMware ESX and the options.  Also, the
first time I was told about VMware ESX I was extremely skeptical.  Once I
started using it, and built out a SAN architecture under it, I was really,
really impressed by what it can do, and its management capabilities.  It will be
a long time until a FOSS equivalent even comes close to its performance,
reliability, capability, and ease of management.  It really is a great solution.
 HA, Consolidated Backup, and a couple of other technologies are what really
make this an enterprise solution, providing near 24x7x365 uptime and rapid
redeployment of an infrastructure after catastrophic loss of the datacenter.

 Note, I have no experience with any of these projects, they simply
 caught my eye for further research...
 
 - Latest KVM+QEMU includes some of the desirable ESX features including
 hot migration
 - Apparently Redhat have a nice management utility for this

I'll have to look into this.

 - Or try ProxMox: http://pve.proxmox.com/wiki/Main_Page
 
 (cheap) High availability storage seems to come down to:
 - iSCSI

1Gbe iSCSI is great for targeted applications on moderate load SANs.  With any
kind of heavy lifting, you need either 10Gbe iSCSCI or Fiber Channel.  Both of
those are a bit more expensive, and 10Gbe iSCSI usually costing quite a bit more
than FC because of the switch and HBA costs.  Either is suitable for an HA SAN
with live backup.  1Gbe iSCSI is not--simply too little bandwidth and too much
latency.

 - Add redundancy to the storage using DRDB (I believe a successful
 strategy with Dovecot is pairs of servers, replicated to each other -
 run each at 50% capacity and if one dies the other picks up the slack)

DRDB is alright for a couple of replicated hosts with moderate volume.  If you
run two load balanced hot hosts with DRDB, and your load increases to the point
you need more capacity, a 3rd hot host, expanding with DRDB gets a bit messy.
With an iSCSI or FC SAN you merely plug in a 3rd host, install and configure the
cluster FS software, expose the shared LUN to the host, and basically you're up
and running in little time.  All 3 hosts share the exact same data on disk, so
you have no replication issues, no matter how many systems you stick into the
cluster.  The only limitation is the throughput of your SAN array.

 - Interesting developing ideas are: PVFS, GlusterFS (they have an
 interesting appliance which might get reliability to production
 levels?), CEPH (reviews suggest it's very easily days)

GlusterFS isn't designed as a primary storage system for servers or server
clusters.  A good description of it would be cloud storage.  It is designed to
mask, or make irrelevant, the location of data storage devices and the distance
to them.  Server and datacenter architects need to know the latency
characteristics and bandwidth of storage devices backing the servers.  GlusterFS
is the antithesis of this.

 None of these solutions gets you an enterprise or proper high end
 solution as described by Stan, but may give some others some things to
 investigate

Enterprise capability, performance, and reliability don't necessarily have to
come with an Enterprise price tag. ;)

Eric Rostetter is already using GFS2 over DRDB with two hot nodes.  IIRC he
didn't elaborate a lot on the performance or his hardware config.  He seemed to
think the performance was more than satisfactory.

Eric, can you tell us more about your setup, in detail?  I promise I'll sit
quiet and just listen.  Everyone else may appreciate your information.

-- 
Stan