Re[4]: [SOGo] Large Inbox issues with Sogo 3.1 and EAS

2016-05-24 Thread Thomas (aon) Fuehrer
You have to verify the ServerId and ParentId relationship of *ALL* mail-folders.

On Monday, May 23, 2016 20:47 CEST, "\"Qmail\"" (qm...@top-consulting.net) 
 wrote:

> It looks like this:
>  1
>  oc10_testdomain_lan_28ae_1cf350a8_0
>   20
>mail%2F1f0a2428afd7ca538ec4a63ae627
>0
>INBOX
>2
> Is there something special about this account ? How come others work just 
> fine ?
>
> On Mon, May 23, 2016 at 02:24 PM, Thomas (aon) Fuehrer  wrote:
> OK, then have a close look into the FolderSync response. Check whether 
> ParentId is either 0 or point to a valid ServerId.
> You can send me an extract from your sogo.log and I'll have a look.
>
> Regards,
> Thomas
>
> Am Montag, 23. Mai 2016 17:12 CEST, ""Qmail"" (qm...@top-consulting.net 
> (mailto:qm...@top-consulting.net))  schrieb:
>
> There are no such requests. Only . I removed the user entirely using 
> sogo-tool remove and from Outlook.
> I then re-added the account to Outlook and it added just fine - came up right 
> away with 'All folders are up to date'
> In sogo logs, the only post Outlook does is:
>
> May 23 10:52:22 sogod [10414]: |SOGo| starting method 'POST' on uri 
> '/SOGo/Microsoft-Server-ActiveSync?Cmd=FolderSync=b...@testdomain.com 
> (mailto:b...@testdomain.com)=F61F834D9A4B441DAF76A478712AEE71=WindowsOutlook15'
> May 23 10:52:24 sogod [10414]: 195.24.238.40 "POST 
> /SOGo/Microsoft-Server-ActiveSync?Cmd=FolderSync=b...@testdomain.com 
> (mailto:b...@testdomain.com)=F61F834D9A4B441DAF76A478712AEE71=WindowsOutlook15
>  HTTP/1.1" 200 1417/13 1.380 - - 1M
> It replies with a long response for:
> Other devices/Outlook also send Cmd=Sync, but not on this account.
> Even if I hit Send / Receive, all I see is the above: Cmd=FolderSync
> Thanks
> On Mon, May 23, 2016 at 05:54 AM, Thomas (aon) Fuehrer  wrote:
> Hi!
>
> is not meaningful here, it will only find data on new profiles or if there 
> are changes to the folder hierarchy.
>
> Search for   requests and their responses when you recreate the account or 
> after you used sogo-tool manage-eas resetfolder.
>
> Regards,
> Thomas
>
> On Sunday, May 22, 2016 21:12 CEST, ""Qmail"" (qm...@top-consulting.net 
> (mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
> (mailto:qm...@top-consulting.net)))  wrote:
>
> Well,
> we ran more tests and here's the EAS response for Outlook 2013:
> May 22 14:54:52 sogod [8860]:  EAS - response for device 
> 5E79CCA89F054884A128928537618624:
> 1
> oc10_testsever_lan_1009_1cef97c8_0
> 0
> However, I think the issue is related to the number of messages in the user's 
> Inbox. For example, when attempting to view the Inbox in SOGO webmail, it 
> takes a solid 8-9 minutes to display it. Debugging that behavior, shows this 
> IMAP command to be responsible for this delay:
> UID SORT (REVERSE DATE) UTF-8 NOT DELETED
> The user has about 70 000 messages in his Inbox and I'm assuming that takes a 
> while. SOGO webmail keeps spinning while that command completes and 
> eventually displays the messages.
> EAS, from what I see just displays data it finds in SQL but it returns empty 
> so that's why it shows 'Folders are up to date' right away.
> Is this a bug ? Shouldn't EAS hold while the Inbox gets sorted ?
> On a related note, wouldn't it be faster to not have the IMAP server sort the 
> messages but rather pull them all and sort them in the application ?
> Thank you
> On Sat, May 21, 2016 at 04:23 AM, Thomas (aon) Fuehrer  wrote:
> Recreate the profile in outlook  with SOGoEASDebugEnabled = YES and look into 
> sogo.log to see what sogo send to the Client.
>
> Regards,
> Thomas
>
> Am Freitag, 20. Mai 2016 21:49 CEST, ""Qmail"" (qm...@top-consulting.net 
> (mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
> (mailto:qm...@top-consulting.net)) (mailto:qm...@top-consulting.net 
> (mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
> (mailto:qm...@top-consulting.net  schrieb:
>
> We have a user with 70 000 messages in his Inbox that fails to sync via 
> ActiveSync and Outlook 2013.
> There are no errors anywhere, Outlook shows: All folders are up to date but 
> no data gets sent over. There are also no errors in the logs.
> The EAS related settings are:
> WOWorkersCount = 120;
> SOGoMaximumPingInterval = 3540;
> SOGoMaximumSyncInterval = 3540;
> SOGoInternalSyncInterval = 60;
> SOGoMaximumSyncWindowSize = 512;
> SOGoMaximumSyncResponseSize= 4096;
> WOWatchDogRequestTimeout=60;
> SxVMemLimit = 6100;
> Any ideas ?
>
> Thank you
> --
> users@sogo.nu (mailto:users@sogo.nu) (mailto:users@sogo.nu 
> (mailto:users@sogo.nu)) (mailto:users@sogo.nu (mailto:users@sogo.nu) 
> (mailto:users@sogo.nu (mailto:users@sogo.nu)))
> https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
> (https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists)) 
> (https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
> (https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists)))
>
> --
> users@sogo.nu 

Re[4]: [SOGo] Large Inbox issues with Sogo 3.1 and EAS

2016-05-23 Thread "Qmail"
It looks like this:
 1
 oc10_testdomain_lan_28ae_1cf350a8_0
  20
   mail%2F1f0a2428afd7ca538ec4a63ae627
   0
   INBOX
   2
Is there something special about this account ? How come others work just fine ?

On Mon, May 23, 2016 at 02:24 PM, Thomas (aon) Fuehrer  wrote:
OK, then have a close look into the FolderSync response. Check whether ParentId 
is either 0 or point to a valid ServerId.
You can send me an extract from your sogo.log and I'll have a look.

Regards,
Thomas

Am Montag, 23. Mai 2016 17:12 CEST, ""Qmail"" (qm...@top-consulting.net 
(mailto:qm...@top-consulting.net))  schrieb:

There are no such requests. Only . I removed the user entirely using sogo-tool 
remove and from Outlook.
I then re-added the account to Outlook and it added just fine - came up right 
away with 'All folders are up to date'
In sogo logs, the only post Outlook does is:

May 23 10:52:22 sogod [10414]: |SOGo| starting method 'POST' on uri 
'/SOGo/Microsoft-Server-ActiveSync?Cmd=FolderSync=b...@testdomain.com 
(mailto:b...@testdomain.com)=F61F834D9A4B441DAF76A478712AEE71=WindowsOutlook15'
May 23 10:52:24 sogod [10414]: 195.24.238.40 "POST 
/SOGo/Microsoft-Server-ActiveSync?Cmd=FolderSync=b...@testdomain.com 
(mailto:b...@testdomain.com)=F61F834D9A4B441DAF76A478712AEE71=WindowsOutlook15
 HTTP/1.1" 200 1417/13 1.380 - - 1M
It replies with a long response for:
Other devices/Outlook also send Cmd=Sync, but not on this account.
Even if I hit Send / Receive, all I see is the above: Cmd=FolderSync
Thanks
On Mon, May 23, 2016 at 05:54 AM, Thomas (aon) Fuehrer  wrote:
Hi!

is not meaningful here, it will only find data on new profiles or if there are 
changes to the folder hierarchy.

Search for   requests and their responses when you recreate the account or 
after you used sogo-tool manage-eas resetfolder.

Regards,
Thomas

On Sunday, May 22, 2016 21:12 CEST, ""Qmail"" (qm...@top-consulting.net 
(mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
(mailto:qm...@top-consulting.net)))  wrote:

Well,
we ran more tests and here's the EAS response for Outlook 2013:
May 22 14:54:52 sogod [8860]:  EAS - response for device 
5E79CCA89F054884A128928537618624:
1
oc10_testsever_lan_1009_1cef97c8_0
0
However, I think the issue is related to the number of messages in the user's 
Inbox. For example, when attempting to view the Inbox in SOGO webmail, it takes 
a solid 8-9 minutes to display it. Debugging that behavior, shows this IMAP 
command to be responsible for this delay:
UID SORT (REVERSE DATE) UTF-8 NOT DELETED
The user has about 70 000 messages in his Inbox and I'm assuming that takes a 
while. SOGO webmail keeps spinning while that command completes and eventually 
displays the messages.
EAS, from what I see just displays data it finds in SQL but it returns empty so 
that's why it shows 'Folders are up to date' right away.
Is this a bug ? Shouldn't EAS hold while the Inbox gets sorted ?
On a related note, wouldn't it be faster to not have the IMAP server sort the 
messages but rather pull them all and sort them in the application ?
Thank you
On Sat, May 21, 2016 at 04:23 AM, Thomas (aon) Fuehrer  wrote:
Recreate the profile in outlook  with SOGoEASDebugEnabled = YES and look into 
sogo.log to see what sogo send to the Client.

Regards,
Thomas

Am Freitag, 20. Mai 2016 21:49 CEST, ""Qmail"" (qm...@top-consulting.net 
(mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
(mailto:qm...@top-consulting.net)) (mailto:qm...@top-consulting.net 
(mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
(mailto:qm...@top-consulting.net  schrieb:

We have a user with 70 000 messages in his Inbox that fails to sync via 
ActiveSync and Outlook 2013.
There are no errors anywhere, Outlook shows: All folders are up to date but no 
data gets sent over. There are also no errors in the logs.
The EAS related settings are:
WOWorkersCount = 120;
SOGoMaximumPingInterval = 3540;
SOGoMaximumSyncInterval = 3540;
SOGoInternalSyncInterval = 60;
SOGoMaximumSyncWindowSize = 512;
SOGoMaximumSyncResponseSize= 4096;
WOWatchDogRequestTimeout=60;
SxVMemLimit = 6100;
Any ideas ?

Thank you
--
users@sogo.nu (mailto:users@sogo.nu) (mailto:users@sogo.nu 
(mailto:users@sogo.nu)) (mailto:users@sogo.nu (mailto:users@sogo.nu) 
(mailto:users@sogo.nu (mailto:users@sogo.nu)))
https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists)) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists)))

--
users@sogo.nu (mailto:users@sogo.nu) (mailto:users@sogo.nu 
(mailto:users@sogo.nu)) (mailto:users@sogo.nu (mailto:users@sogo.nu) 
(mailto:users@sogo.nu (mailto:users@sogo.nu)))
https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists)) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
(https://inverse.ca/sogo/lists 

Re[4]: [SOGo] Large Inbox issues with Sogo 3.1 and EAS

2016-05-23 Thread "Qmail"
I've setup another account via Outlook and the FolderSync looks similar, except 
in this case it somehow proceeds to do a Sync call after
   mail%2F13efb72de65877550f7dc72b6ff5
   0
   INBOX
   2
On Mon, May 23, 2016 at 02:24 PM, Thomas (aon) Fuehrer  wrote:
OK, then have a close look into the FolderSync response. Check whether ParentId 
is either 0 or point to a valid ServerId.
You can send me an extract from your sogo.log and I'll have a look.

Regards,
Thomas

Am Montag, 23. Mai 2016 17:12 CEST, ""Qmail"" (qm...@top-consulting.net 
(mailto:qm...@top-consulting.net))  schrieb:

There are no such requests. Only . I removed the user entirely using sogo-tool 
remove and from Outlook.
I then re-added the account to Outlook and it added just fine - came up right 
away with 'All folders are up to date'
In sogo logs, the only post Outlook does is:

May 23 10:52:22 sogod [10414]: |SOGo| starting method 'POST' on uri 
'/SOGo/Microsoft-Server-ActiveSync?Cmd=FolderSync=b...@testdomain.com 
(mailto:b...@testdomain.com)=F61F834D9A4B441DAF76A478712AEE71=WindowsOutlook15'
May 23 10:52:24 sogod [10414]: 195.24.238.40 "POST 
/SOGo/Microsoft-Server-ActiveSync?Cmd=FolderSync=b...@testdomain.com 
(mailto:b...@testdomain.com)=F61F834D9A4B441DAF76A478712AEE71=WindowsOutlook15
 HTTP/1.1" 200 1417/13 1.380 - - 1M
It replies with a long response for:
Other devices/Outlook also send Cmd=Sync, but not on this account.
Even if I hit Send / Receive, all I see is the above: Cmd=FolderSync
Thanks
On Mon, May 23, 2016 at 05:54 AM, Thomas (aon) Fuehrer  wrote:
Hi!

is not meaningful here, it will only find data on new profiles or if there are 
changes to the folder hierarchy.

Search for   requests and their responses when you recreate the account or 
after you used sogo-tool manage-eas resetfolder.

Regards,
Thomas

On Sunday, May 22, 2016 21:12 CEST, ""Qmail"" (qm...@top-consulting.net 
(mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
(mailto:qm...@top-consulting.net)))  wrote:

Well,
we ran more tests and here's the EAS response for Outlook 2013:
May 22 14:54:52 sogod [8860]:  EAS - response for device 
5E79CCA89F054884A128928537618624:
1
oc10_testsever_lan_1009_1cef97c8_0
0
However, I think the issue is related to the number of messages in the user's 
Inbox. For example, when attempting to view the Inbox in SOGO webmail, it takes 
a solid 8-9 minutes to display it. Debugging that behavior, shows this IMAP 
command to be responsible for this delay:
UID SORT (REVERSE DATE) UTF-8 NOT DELETED
The user has about 70 000 messages in his Inbox and I'm assuming that takes a 
while. SOGO webmail keeps spinning while that command completes and eventually 
displays the messages.
EAS, from what I see just displays data it finds in SQL but it returns empty so 
that's why it shows 'Folders are up to date' right away.
Is this a bug ? Shouldn't EAS hold while the Inbox gets sorted ?
On a related note, wouldn't it be faster to not have the IMAP server sort the 
messages but rather pull them all and sort them in the application ?
Thank you
On Sat, May 21, 2016 at 04:23 AM, Thomas (aon) Fuehrer  wrote:
Recreate the profile in outlook  with SOGoEASDebugEnabled = YES and look into 
sogo.log to see what sogo send to the Client.

Regards,
Thomas

Am Freitag, 20. Mai 2016 21:49 CEST, ""Qmail"" (qm...@top-consulting.net 
(mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
(mailto:qm...@top-consulting.net)) (mailto:qm...@top-consulting.net 
(mailto:qm...@top-consulting.net) (mailto:qm...@top-consulting.net 
(mailto:qm...@top-consulting.net  schrieb:

We have a user with 70 000 messages in his Inbox that fails to sync via 
ActiveSync and Outlook 2013.
There are no errors anywhere, Outlook shows: All folders are up to date but no 
data gets sent over. There are also no errors in the logs.
The EAS related settings are:
WOWorkersCount = 120;
SOGoMaximumPingInterval = 3540;
SOGoMaximumSyncInterval = 3540;
SOGoInternalSyncInterval = 60;
SOGoMaximumSyncWindowSize = 512;
SOGoMaximumSyncResponseSize= 4096;
WOWatchDogRequestTimeout=60;
SxVMemLimit = 6100;
Any ideas ?

Thank you
--
users@sogo.nu (mailto:users@sogo.nu) (mailto:users@sogo.nu 
(mailto:users@sogo.nu)) (mailto:users@sogo.nu (mailto:users@sogo.nu) 
(mailto:users@sogo.nu (mailto:users@sogo.nu)))
https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists)) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists)))

--
users@sogo.nu (mailto:users@sogo.nu) (mailto:users@sogo.nu 
(mailto:users@sogo.nu)) (mailto:users@sogo.nu (mailto:users@sogo.nu) 
(mailto:users@sogo.nu (mailto:users@sogo.nu)))
https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists)) 
(https://inverse.ca/sogo/lists (https://inverse.ca/sogo/lists) 
(https://inverse.ca/sogo/lists