[xmail] POP3 UIDL PROBLEM
I have over 1 EMAILS but when I test UIDL, Sometimes, it's not sorting by ID. it's a file system -rw-rw-r-- 1 root root 30558 Jun 1 04:46 1433105179992.70d12960.34c.3f8be2.bravo-rw-rw-r-- 1 root root 989 Jun 1 05:04 1433106257177.5ace6960.34c.3fafbd..bravo-rw-rw-r-- 1 root root 162486 Jun 1 13:04 1433135071576.71513960.34c.43c7a9.bravo-rw-rw-r-- 1 root root 21401 Jun 1 13:47 1433137677235.6fd10960.34c.4428cc.bravo-rw-rw-r-- 1 root root 54084 Jun 1 22:24 1433168674933.6ed0e960.34c.48d596.bravo-rw-rw-r-- 1 root root 9112 Jun 2 02:35 1433183738295.6ed0e960.34c.4acc30..bravo-rw-rw-r-- 1 root root 9142 Jun 2 02:35 1433183738434.5f4ef960.34c.4acc39.bravo-rw-rw-r-- 1 root root 5342 Jun 2 03:26 1433186769695.70511960.34c.4b30b7.bravo-rw-rw-r-- 1 root root 1238 Jun 2 04:02 1433188925598.6dd0c960.34c.4b7832.bravo-rw-rw-r-- 1 root root 1020 Jun 2 04:02 1433188949218..69d04960.34c.4b78f7.bravo-rw-rw-r-- 1 root root 22474 Jun 2 06:32 1433197934458.6f50f960.34c.4ca2e8.bravo-rw-rw-r-- 1 root root 2615 Jun 2 07:40 1433202046360.59ce4960.34c.4d2b2f.bravo-rw-rw-r-- 1 root root 2678 Jun 2 07:43 1433202184456.4fcd0960.34c.4d2fbe.bravo-rw-rw-r-- 1 root root 3272 Jun 2 08:04 1433203475828.55cdc960.34c.4d5ab8.bravo-rw-rw-r-- 1 root root 2863 Jun 2 08:26 1433204809317.57ce0960.34c.4d8766.bravo-rw-rw-r-- 1 root root 41748 Jun 2 11:30 1433215840379.72d16960.34c.4f3bf6.bravo-rw-rw-r-- 1 root root 1857 Jun 2 11:39 1433216376230.73d18960.34c..4f5305.bravo-rw-rw-r-- 1 root root 6157 Jun 2 11:44 1433216684073.71d14960.34c.4f5e9a.bravo-rw-rw-r-- 1 root root 5402 Jun 2 12:55 1433220946062.6f50f960.34c.500170.bravo-rw-rw-r-- 1 root root 29790 Jun 2 14:03 1433224988810.70511960.34c.5092ca.bravo-rw-rw-r-- 1 root root 10473 Jun 2 22:11 1433254291563.4a4c5960.34c.553526.bravo-rw-rw-r-- 1 root root 1238 Jun 3 04:02 1433275327112.6f50f960.34c.580f59.bravo-rw-rw-r-- 1 root root 1020 Jun 3 04:02 1433275353273.654fb960.34c.581041.bravo-rw-rw-r-- 1 root root 988 Jun 3 05:14 1433279643381.5ecee960.34c.589f69.bravo-rw-rw-r-- 1 root root 15235 Jun 3 07:50 1433289052265.614f3960.34c.59db64.bravo-rw-rw-r-- 1 root root 3985615 Jun 3 08:36 1433291762335.49cc4960.34c.5a40b9.bravo-rw-rw-r-- 1 root root 30149 Jun 3 14:52 1433314331266.71513960.34c.5dab73.bravo-rw-rw-r-- 1 root root 5382 Jun 3 14:54 1433314498740.6dd0c960.34c.5db2ce.bravo-rw-rw-r-- 1 root root 44713 Jun 3 16:55 1433321724856.74d1a960.34c.5ed68c.bravo-rw-rw-r-- 1 root root 110709 Jun 3 17:54 1433325240897.6dd0c960.34c.5f65fa.bravo-rw-rw-r-- 1 root root 322169 Jun 3 18:56 143332954.6e50d960.34c.5fff22.bravo-rw-rw-r-- 1 root root 14174 Jun 3 20:57 146272368.6e50d960.34c.610ed5.bravo-rw-rw-r-- 1 root root 27877 Jun 4 00:03 1433347390242.7fc51afdd700.bca.152b.bravo-rw-rw-r-- 1 root root 8116 Jun 4 03:06 1433358408984.5c450960.24ad.336b.bravo-rw-rw-r-- 1 root root 9831 Jun 4 14:05 1433397936295.7347e960.24ad.635a7.bravo-rw-rw-r-- 1 root root 90604 Jun 4 19:59 1433399979747.5ec55960.24ad.6860d.bravo-rw-rw-r-- 1 root root 2193650 Jun 4 20:00 1433412426056.43c1f960.24ad.8919a.bravo-rw-rw-r-- 1 root root 2783 Jun 4 20:07 1433419665957.6ead6960.649d.6e32.bravo-rw-rw-r-- 1 root root 4651 Jun 4 20:23 1433420596561.73ae0960.649d.90c8.bravo 13873 1433105179992.70d12960.34c.3f8be2.bravo13874 1433106257177.5ace6960.34c.3fafbd.bravo13875 1433135071576.71513960.34c.43c7a9.bravo13876 1433137677235.6fd10960.34c.4428cc.bravo13877 1433168674933.6ed0e960.34c..48d596.bravo13878 1433183738295.6ed0e960.34c.4acc30.bravo13879 1433183738434.5f4ef960.34c.4acc39.bravo13880 1433186769695.70511960.34c.4b30b7.bravo13881 1433188925598.6dd0c960.34c.4b7832.bravo13882 1433188949218.69d04960.34c.4b78f7.bravo13883 1433197934458.6f50f960.34c.4ca2e8.bravo13884 1433202046360.59ce4960.34c.4d2b2f.bravo13885 1433202184456.4fcd0960.34c.4d2fbe.bravo13886 1433203475828.55cdc960.34c.4d5ab8.bravo13887 1433204809317.57ce0960.34c.4d8766.bravo13888 1433215840379.72d16960.34c.4f3bf6.bravo13889 1433216376230.73d18960.34c.4f5305.bravo13890 1433216684073.71d14960.34c.4f5e9a.bravo13891 1433220946062.6f50f960.34c.500170.bravo13892 1433224988810.70511960.34c.5092ca.bravo13893 1433254291563.4a4c5960.34c.553526.bravo13894 1433275327112.6f50f960.34c.580f59.bravo13895 1433275353273.654fb960.34c.581041.bravo13896 1433279643381.5ecee960.34c.589f69.bravo13897 1433289052265.614f3960.34c.59db64.bravo13898 1433291762335.49cc4960.34c.5a40b9.bravo13899 1433314331266.71513960.34c.5dab73.bravo13900 1433314498740.6dd0c960.34c.5db2ce.bravo13901 1433321724856.74d1a960.34c.5ed68c.bravo13902 1433325240897.6dd0c960.34c.5f65fa.bravo13903 143332954.6e50d960.34c.5fff22.bravo13904 146272368.6e50d960.34c.610ed5.bravo13905 1433347390242.7fc51afdd700.bca.152b.bravo13906 1433358408984.5c450960.24ad.336b.bravo13907 1433397936295.7347e960.24ad.635a7.bravo13908 1433402316803.6fc77960.24ad.6e7cc.bravo It will let some android email app not display correctly by first 25 messages or somethings like that. So I need to download all emails on android.
Re: [xmail] BUG : XMAIL 1.27 with SSL
Now I am using original XMAIL-1.27.tar.gz source without simultaneous POP3
logins, no STUNNEL, use NATIVE XMAIL SSL. The problem still exists, K9-MAIL
will report IllegalFormatConversonException when I receive more then 100-200
emails. So It should be XMAIL SSL problem. Because When I reuse STUNNEL to do a
POP3 tunnel again, the problem will fix.
Original Message
From: Bart Mortelmans b...@bim.be
To: t...@os.st, XMail Users Mailing List xmail@xmailserver.org
Sent: Tue, May 26, 2015, 3:13 PM
Subject: Re: [xmail] BUG : XMAIL 1.27 with SSL
Is there any way for you to test if the problem exists if you don't
allow simultaneous POP3 logins?
Oversea Site via xmail schreef op 26/05/15 om 08:14:
POP3Utils.cpp - ADD POP3 Concurrent Login. I used this function over 5
years.. I don't know C++ programming. Sorry :)
}
if (pPOPMD-ulFlags POPF_MSG_DELETED) {
UPopSendErrorResponse(hBSock, ERR_MSG_DELETED,
pPOPSD-iTimeout);
ErrSetErrorCode(ERR_MSG_DELETED);
return ERR_MSG_DELETED;
}
UsrGetMailboxPath(pPOPSD-pUI, szMsgFilePath,
sizeof(szMsgFilePath), 1);
StrNCat(szMsgFilePath, pPOPMD-szMsgName, sizeof(szMsgFilePath));
/*
* ADDED CODE START
*/
FILE *pMsgFile = fopen(szMsgFilePath, rb);
if (pMsgFile == NULL) {
UPopSendErrorResponse(hBSock, ERR_FILE_OPEN, pPOPSD-iTimeout);
ErrSetErrorCode(ERR_FILE_OPEN);
return ERR_FILE_OPEN;
}
fclose(pMsgFile);
/*
* ADDED CODE END
*/
SysSNPrintf(szResponse, sizeof(szResponse) - 1,
+OK SYS_OFFT_FMT bytes, pPOPMD-llMsgSize);
if (BSckSendString(hBSock, szResponse, pPOPSD-iTimeout) 0)
return ErrGetErrorCode();
if (pPOPMD-llMsgSize 0
Original Message
From: Oversea Site via xmail xmail@xmailserver.org
To: XMail Users Mailing List xmail@xmailserver.org
Sent: Tue, May 26, 2015, 1:56 PM
Subject: Re: [xmail] BUG : XMAIL 1.27 with SSL
FEDORA 4 X86_64 GLIBC 2.3.6-3 (I can't upgrade it to the lastest version..
Because I have a chiliasp 3.6.2 32-bit run ASP VBSCRIPT on APACHE 1.3
32-bit software, it need GLIBC 2.3.x and Kernel 2.6)
KERNEL 3.3 MOD FROM FC15 (It will display KERNEL 2.6.43 Number). Kernel is
not a main problem. Because I have been test 2.6.32 or other. same problem
was found.
REAL HARDWARE - INTEL B85M i3-4150 16G RAM SATA3 RAID 1 LINUX SOFTRAID1
MDADM
Corp. Email System is not heavily use when I test it in HK TIME midnight..
Anyway I will test this issue in other linux distribution in VM, such as
CentOS. (You can give me any linux distribution, let's build the same
platform in VM. I use virtualbox.
[root@bravo logs]# uname -a
Linux bravo 2.6.43-gcc402 #3 SMP Sun May 17 23:10:29 HKT 2015 x86_64 x86_64
x86_64 GNU/Linux
[root@bravo logs]#
[root@bravo logs]# ldd /var/MailRoot/bin/XMail127v3
linux-vdso.so.1 = (0x77f0e000)
libssl.so.0.9.8 = /usr/local/ssl/lib/libssl.so.0.9.8
(0x7f43b00bc000)
libcrypto.so.0.9.8 = /usr/local/ssl/lib/libcrypto.so.0.9.8
(0x7f43afd35000)
libdl.so.2 = /lib64/libdl.so.2 (0x003e1820)
libpthread.so.0 = /lib64/libpthread.so.0 (0x003e1860)
libstdc++.so.6 = /usr/lib64/libstdc++.so.6 (0x7f43afa37000)
libm.so.6 = /lib64/libm.so.6 (0x003e1800)
libgcc_s.so.1 = /lib64/libgcc_s.so.1 (0x003e1940)
libc.so.6 = /lib64/libc.so.6 (0x003e17d0)
/lib64/ld-linux-x86-64.so.2 (0x003e17b0)
***
/var/MailRoot/bin/XMail127v3 -Md -Ms /var/MailRoot -Sl -Pl -Cl \
-SI 0.0.0.0:8025 -SI 0.0.0.0:25 \
-PI 0.0.0.0:8110 -PI 0.0.0.0:110 \
-BI 0.0.0.0:995 \
-XI 0.0.0.0:465 \
-Ql -Ln 256 -Pt 60 -St 150 -F- -SX 2048 -Mx 64 \
-Qn 64 -PX 2048 -Qr 1 -Qt 1 -QT 150 -Qg -CX 256
***
Original Message
From: U.Mutlu um4...@mutluit.com
To: t...@os.st, XMail Users Mailing List xmail@xmailserver.org
Sent: Tue, May 26, 2015, 1:06 PM
Subject: Re: [xmail] BUG : XMAIL 1.27 with SSL
Oversea Site via xmail wrote on 05/26/2015 05:14 AM:
No Log Error. No Fatal Error log. No Core Dump
It's not RAM or HW problem. It's XMAIL internal issue, because when I
switch to stunnel, all problems solved. And then when I test K9-MAIL with
XMAIL+STUNNEL, K9 Client will not have any JAVA somethings Exception Error
Two tests
1. Very Important Thing in Xmail 1.27 Native SSL
If the emailbox has many emails such as 1, Microsoft Outlook with SSL
or NON-SSL download them, it WILL NOT have this issue.
Some Tencent Foxmail for Windows, after finish ssl session, it will take
the server be FIN_WAIT2 (some version, not all
[xmail] BUG : XMAIL 1.27 with SSL
I found the bug on XMAIL 1.27 with SSL (POP3S is main), SSMTP servicemaybe has asame bugtoo 1. it will have too many FIN_WAIT_2on POP3Swith two many requests, It is becauseof some non-popular WINDOWS CLIENT e.g. tencent foxmail , outlook will not have this issue. 2. If you're using XMAIL'Sinternal SSL POP3S with any openssl lib. (tested 0.9.8za 1.0.0, tested gcc 4.0.2/4.0.4/4.3.6)and the email accountcontain too many emails (1000-2000 emails),the mobile clientPOP3such as Samsung internal Email Client is using SSL, K9-MAIL on any android devicesusing SSL, some iPhone devices (connect with XMAIL SSL port 995), will not download them successfully (Android Error - Java Exception Error) and some iPhonedevicewill stuck with it, it will not download all emails successfully. But if you disable XMAIL'S internal POP3Swith -B-startup option, and switch stunnel5.17 port 995 tunnel toport 110, it will solve this problem and kick outFIN_WAIT_2 * stunnel 5.17 config * [pop3s]accept = 995connect = 110cert = /etc/stunnel/stunnel.pem *** ___ xmail mailing list xmail@xmailserver.org http://xmailserver.org/mailman/listinfo/xmail
Re: [xmail] BUG : XMAIL 1.27 with SSL
FEDORA 4 X86_64 GLIBC 2.3.6-3 (I can't upgrade it to the lastest version. Because I have a chiliasp 3.6.2 32-bit run ASP VBSCRIPT on APACHE 1.3 32-bit software, it need GLIBC 2.3.x and Kernel 2.6) KERNEL 3.3 MOD FROM FC15 (It will display KERNEL 2.6.43 Number). Kernel is not a main problem. Because I have been test 2.6.32 or other. same problem was found. REAL HARDWARE - INTEL B85M i3-4150 16G RAM SATA3 RAID 1 LINUX SOFTRAID1 MDADM Corp. Email System is not heavily use when I test it in HK TIME midnight. Anyway I will test this issue in other linux distribution in VM, such as CentOS. (You can give me any linux distribution, let's build the same platform in VM. I use virtualbox. [root@bravo logs]# uname -a Linux bravo 2.6.43-gcc402 #3 SMP Sun May 17 23:10:29 HKT 2015 x86_64 x86_64 x86_64 GNU/Linux [root@bravo logs]# [root@bravo logs]# ldd /var/MailRoot/bin/XMail127v3 linux-vdso.so.1 = (0x77f0e000) libssl.so.0.9.8 = /usr/local/ssl/lib/libssl.so.0.9.8 (0x7f43b00bc000) libcrypto.so.0.9.8 = /usr/local/ssl/lib/libcrypto.so.0.9.8 (0x7f43afd35000) libdl.so.2 = /lib64/libdl.so.2 (0x003e1820) libpthread.so.0 = /lib64/libpthread.so.0 (0x003e1860) libstdc++.so.6 = /usr/lib64/libstdc++.so.6 (0x7f43afa37000) libm.so.6 = /lib64/libm.so.6 (0x003e1800) libgcc_s.so.1 = /lib64/libgcc_s.so.1 (0x003e1940) libc.so.6 = /lib64/libc.so.6 (0x003e17d0) /lib64/ld-linux-x86-64.so.2 (0x003e17b0) *** /var/MailRoot/bin/XMail127v3 -Md -Ms /var/MailRoot -Sl -Pl -Cl \ -SI 0.0.0.0:8025 -SI 0.0.0.0:25 \ -PI 0.0.0.0:8110 -PI 0.0.0.0:110 \ -BI 0.0.0.0:995 \ -XI 0.0.0.0:465 \ -Ql -Ln 256 -Pt 60 -St 150 -F- -SX 2048 -Mx 64 \ -Qn 64 -PX 2048 -Qr 1 -Qt 1 -QT 150 -Qg -CX 256 *** Original Message From: U.Mutlu um4...@mutluit.com To: t...@os.st, XMail Users Mailing List xmail@xmailserver.org Sent: Tue, May 26, 2015, 1:06 PM Subject: Re: [xmail] BUG : XMAIL 1.27 with SSL Oversea Site via xmail wrote on 05/26/2015 05:14 AM: No Log Error. No Fatal Error log. No Core Dump It's not RAM or HW problem. It's XMAIL internal issue, because when I switch to stunnel, all problems solved. And then when I test K9-MAIL with XMAIL+STUNNEL, K9 Client will not have any JAVA somethings Exception Error Two tests 1. Very Important Thing in Xmail 1.27 Native SSL If the emailbox has many emails such as 1, Microsoft Outlook with SSL or NON-SSL download them, it WILL NOT have this issue. Some Tencent Foxmail for Windows, after finish ssl session, it will take the server be FIN_WAIT2 (some version, not all) But K9-MAIL for Android, Download first 1000, it will appear the error in K9-MAIL randomly. 2. Xmail 1.27 + Stunnel Proxy If the emailbox has many emails such as 1, Microsoft Outlook with SSL or NON-SSL download them, it WILL NOT have this issue. Some Tencent Foxmail for Windows, after finish ssl session, it WILL NOT have any problem. Server WILL NOT TAKE FIN_WAIT_2 K9-MAIL for Android, Download first 1000, it will NOT DISPLAY any error when it finished download emails. I would need full description about the server HW and SW (OS version, xmail start params etc., any xmail patches applied etc.). There is of course also the possibility that the bug lies in the said mobile client program, especially if it goes online via unstable mobile links as it seems to be a link latency problem, or the client does not close the socket cleanly. Take a look at these: https://github.com/Automattic/socket.io/issues/1380 http://stackoverflow.com/questions/5328155/preventing-fin-wait2-when-closing-socket cu Uenal Original Message From: U.Mutlu um4...@mutluit.com To: t...@os.st, XMail Users Mailing List xmail@xmailserver.org Sent: Tue, May 26, 2015, 10:11 AM Subject: Re: [xmail] BUG : XMAIL 1.27 with SSL Oversea Site via xmail wrote on 05/25/2015 09:23 PM: I found the bug on XMAIL 1.27 with SSL (POP3S is main), SSMTP service maybe has a same bug too 1. it will have too many FIN_WAIT_2 on POP3S with two many requests, It is because of some non-popular WINDOWS CLIENT e.g. tencent foxmail , outlook will not have this issue. 2. If you're using XMAIL'S internal SSL POP3S with any openssl lib. (tested 0.9.8za 1.0.0, tested gcc 4.0.2/4.0.4/4.3.6) and the email account contain too many emails (1000-2000 emails), the mobile client POP3 such as Samsung internal Email Client is using SSL, K9-MAIL on any android devices using SSL, some iPhone devices (connect with XMAIL SSL port 995), will not download them successfully (Android Error - Java Exception Error) and some iPhone device will stuck with it, it will not download all emails successfully. But if you disable XMAIL'S internal POP3S with -B- startup option
Re: [xmail] BUG : XMAIL 1.27 with SSL
No Log Error. No Fatal Error log. No Core Dump It's not RAM or HW problem. It's XMAIL internal issue, because when I switch to stunnel, all problems solved. And then when I test K9-MAIL with XMAIL+STUNNEL, K9 Client will not have any JAVA somethings Exception Error Two tests 1. Very Important Thing in Xmail 1.27 Native SSL If the emailbox has many emails such as 1, Microsoft Outlook with SSL or NON-SSL download them, it WILL NOT have this issue. Some Tencent Foxmail for Windows, after finish ssl session, it will take the server be FIN_WAIT2 (some version, not all) But K9-MAIL for Android, Download first 1000, it will appear the error in K9-MAIL randomly. 2. Xmail 1.27 + Stunnel Proxy If the emailbox has many emails such as 1, Microsoft Outlook with SSL or NON-SSL download them, it WILL NOT have this issue. Some Tencent Foxmail for Windows, after finish ssl session, it WILL NOT have any problem. Server WILL NOT TAKE FIN_WAIT_2 K9-MAIL for Android, Download first 1000, it will NOT DISPLAY any error when it finished download emails. Original Message From: U.Mutlu um4...@mutluit.com To: t...@os.st, XMail Users Mailing List xmail@xmailserver.org Sent: Tue, May 26, 2015, 10:11 AM Subject: Re: [xmail] BUG : XMAIL 1.27 with SSL Oversea Site via xmail wrote on 05/25/2015 09:23 PM: I found the bug on XMAIL 1.27 with SSL (POP3S is main), SSMTP service maybe has a same bug too 1. it will have too many FIN_WAIT_2 on POP3S with two many requests, It is because of some non-popular WINDOWS CLIENT e.g. tencent foxmail , outlook will not have this issue. 2. If you're using XMAIL'S internal SSL POP3S with any openssl lib. (tested 0.9.8za 1.0.0, tested gcc 4.0.2/4.0.4/4.3.6) and the email account contain too many emails (1000-2000 emails), the mobile client POP3 such as Samsung internal Email Client is using SSL, K9-MAIL on any android devices using SSL, some iPhone devices (connect with XMAIL SSL port 995), will not download them successfully (Android Error - Java Exception Error) and some iPhone device will stuck with it, it will not download all emails successfully. But if you disable XMAIL'S internal POP3S with -B- startup option, and switch stunnel 5.17 port 995 tunnel to port 110, it will solve this problem and kick out FIN_WAIT_2 * stunnel 5.17 config * [pop3s] accept = 995 connect = 110 cert = /etc/stunnel/stunnel.pem *** What do the logs (server, client) say about the errors? I think you need a faster server HW and/or need to optimize the resources, for example the number of threads, and possibly also RAM. An excerpt from the doc: If you have an heavily loaded server remember to setup the best number of XMAIL threads by specifying the '-Qn nthreads' option (you must do some tentatives to find the best value for your needs). Also you can limit the number of SMTP, POP3 and CTRL service threads by specifying the options '-SX maxthreads', '-PX maxthreads' and '-CX maxthreads'. If there are mail filters, you can put them into a ramdisk and set PATH accordingly, or use an absolute path to them. See also XMAIL_TEMP in the doc. In task manager / system monitor you can see how the resource usage is, especially CPU, memory, and network. -- cu Uenal ___ xmail mailing list xmail@xmailserver.org http://xmailserver.org/mailman/listinfo/xmail
