RE: Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-31 Thread aki.tuomi


> On 31/12/2020 13:18 Marc Roos  wrote:
> 
>  
> >
> >
> >
> >>  
> >> Looks like this mail client has problems with the archive 
> >> namespace[1], I assume I have nothing strange in there because other 
> >> clients just issue around ~50 cmds. So I guess this is just bad 
> >> programming of some new flashy trendy tool someone has downloaded?
> >> 
> >> The raw in log has 
> >> nr
> >>   34212 LIST ""
> >>   35190 SELECT Archive
> >> 
> >> Like this:
> >> 
> >
> >> ..(more mailboxes)..
> >> 
> >>   mailbox Archive {
> >> auto = create
> >> autoexpunge = 0
> >> autoexpunge_max_mails = 0
> >> comment =
> >> driver =
> >> special_use = \Archive
> >>   }
> >>   mailbox "Archived mail" {
> >> auto = no
> >> autoexpunge = 0
> >> autoexpunge_max_mails = 0
> >> comment =
> >> driver =
> >> special_use = \Archive
> >>   }
> >>   mailbox "Archived messages" {
> >> auto = no
> >> autoexpunge = 0
> >> autoexpunge_max_mails = 0
> >> comment =
> >> driver =
> >> special_use = \Archive
> >>   }
> >> ..(more mailboxes)..
> >> 
> >>   order = 0
> >>   prefix =
> >>   separator = /
> >>   subscriptions = yes
> >>   type = private
> >> }
> >
> >Bit curious config, do you have an INBOX namespace somewhere as 
> >well? This looks like root namespace as it has no prefix.
> >
> 
> Yes I have inbox namespace[1]. I think this config comes from in the 
> past wanting to have different mail locations and being bound to the 
> /var/spool/mail mbox files of sendmail. 
> 
> [1]
> namespace inbox {
>   disabled = no
>   hidden = no
>   ignore_on_failure = no
>   inbox = yes
>   list = yes
>   location =
>   mailbox Deleted {
> auto = no
> autoexpunge = 0
> autoexpunge_max_mails = 0
> comment =
> driver =
> special_use = \Trash
>   }
> 
> ..
>   
>   mailbox Trash {
> auto = create
> autoexpunge = 0
> autoexpunge_max_mails = 0
> comment =
> driver =
> special_use = \Trash
>   }
>   order = 0
>   prefix =
>   separator = /
>   subscriptions = yes
>   type = private
> }

You are not supposed to have more than one namespace with same prefix.

Aki


RE: Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-31 Thread Marc Roos
>
>
>
>>  
>> Looks like this mail client has problems with the archive 
>> namespace[1], I assume I have nothing strange in there because other 
>> clients just issue around ~50 cmds. So I guess this is just bad 
>> programming of some new flashy trendy tool someone has downloaded?
>> 
>> The raw in log has 
>> nr
>>   34212 LIST ""
>>   35190 SELECT Archive
>> 
>> Like this:
>> 
>
>> ..(more mailboxes)..
>> 
>>   mailbox Archive {
>> auto = create
>> autoexpunge = 0
>> autoexpunge_max_mails = 0
>> comment =
>> driver =
>> special_use = \Archive
>>   }
>>   mailbox "Archived mail" {
>> auto = no
>> autoexpunge = 0
>> autoexpunge_max_mails = 0
>> comment =
>> driver =
>> special_use = \Archive
>>   }
>>   mailbox "Archived messages" {
>> auto = no
>> autoexpunge = 0
>> autoexpunge_max_mails = 0
>> comment =
>> driver =
>> special_use = \Archive
>>   }
>> ..(more mailboxes)..
>> 
>>   order = 0
>>   prefix =
>>   separator = /
>>   subscriptions = yes
>>   type = private
>> }
>
>Bit curious config, do you have an INBOX namespace somewhere as 
>well? This looks like root namespace as it has no prefix.
>

Yes I have inbox namespace[1]. I think this config comes from in the 
past wanting to have different mail locations and being bound to the 
/var/spool/mail mbox files of sendmail. 

[1]
namespace inbox {
  disabled = no
  hidden = no
  ignore_on_failure = no
  inbox = yes
  list = yes
  location =
  mailbox Deleted {
auto = no
autoexpunge = 0
autoexpunge_max_mails = 0
comment =
driver =
special_use = \Trash
  }

..
  
  mailbox Trash {
auto = create
autoexpunge = 0
autoexpunge_max_mails = 0
comment =
driver =
special_use = \Trash
  }
  order = 0
  prefix =
  separator = /
  subscriptions = yes
  type = private
}


RE: Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-31 Thread aki.tuomi


> On 31/12/2020 11:51 Marc Roos  wrote:
> 
>  
> Looks like this mail client has problems with the archive namespace[1], 
> I assume I have nothing strange in there because other clients just 
> issue around ~50 cmds. So I guess this is just bad programming of some 
> new flashy trendy tool someone has downloaded?
> 
> The raw in log has 
> nr
>   34212 LIST ""
>   35190 SELECT Archive
> 
> Like this:
> 

> ..(more mailboxes)..
> 
>   mailbox Archive {
> auto = create
> autoexpunge = 0
> autoexpunge_max_mails = 0
> comment =
> driver =
> special_use = \Archive
>   }
>   mailbox "Archived mail" {
> auto = no
> autoexpunge = 0
> autoexpunge_max_mails = 0
> comment =
> driver =
> special_use = \Archive
>   }
>   mailbox "Archived messages" {
> auto = no
> autoexpunge = 0
> autoexpunge_max_mails = 0
> comment =
> driver =
> special_use = \Archive
>   }
> ..(more mailboxes)..
> 
>   order = 0
>   prefix =
>   separator = /
>   subscriptions = yes
>   type = private
> }

Bit curious config, do you have an INBOX namespace somewhere as well? This 
looks like root namespace as it has no prefix.

Aki


RE: Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-31 Thread Marc Roos
 
Looks like this mail client has problems with the archive namespace[1], 
I assume I have nothing strange in there because other clients just 
issue around ~50 cmds. So I guess this is just bad programming of some 
new flashy trendy tool someone has downloaded?

The raw in log has 
nr
  34212 LIST ""
  35190 SELECT Archive

Like this:

350 SELECT Archive
2351 LIST "" "*"
2352 SELECT Archive
2353 LIST "" "*"
2354 SELECT Archive
2355 LIST "" "*"
2356 SELECT Archive
2357 LIST "" "*"
2358 SELECT Archive
2359 LIST "" "*"
2360 SELECT Archive
2361 LIST "" "*"
2362 SELECT Archive
2363 LIST "" "*"
2364 SELECT Archive
2365 LIST "" "*"
2366 SELECT Archive
2367 LIST "" "*"
2368 SELECT Archive
2369 LIST "" "*"
2370 SELECT Archive
2371 LIST "" "*"
2372 SELECT Archive
2373 LIST "" "*"
2374 SELECT Archive
2375 LIST "" "*"
2376 SELECT Archive
2377 LIST "" "*"
2378 SELECT Archive
2379 LIST "" "*"
2380 SELECT Archive
2381 LIST "" "*"
2382 SELECT Archive
2383 LIST "" "*"
2384 SELECT Archive
2385 LIST "" "*"
2386 SELECT Archive
2387 LIST "" "*"
2388 SELECT Archive
2389 LIST "" "*"
2390 SELECT Archive
2391 LIST "" "*"
2392 SELECT Archive
2393 LIST "" "*"
2394 SELECT Archive
2395 LIST "" "*"
2396 SELECT Archive
2397 LIST "" "*"
2398 SELECT Archive
2399 LIST "" "*"
2400 SELECT Archive
2401 LIST "" "*"
2402 SELECT Archive
2403 LIST "" "*"
2404 SELECT Archive

[1]
namespace 4archives {
  disabled = no
  hidden = no
  ignore_on_failure = no
  inbox = no
  list = yes
  location = 
mdbox:/home/mail-archive/%u/Archive/:CONTROL=/home/mail-archive/%u/Archi
ve/control:INDEX=/home/archiveindex/%u/index

..(more mailboxes)..

  mailbox Archive {
auto = create
autoexpunge = 0
autoexpunge_max_mails = 0
comment =
driver =
special_use = \Archive
  }
  mailbox "Archived mail" {
auto = no
autoexpunge = 0
autoexpunge_max_mails = 0
comment =
driver =
special_use = \Archive
  }
  mailbox "Archived messages" {
auto = no
autoexpunge = 0
autoexpunge_max_mails = 0
comment =
driver =
special_use = \Archive
  }
..(more mailboxes)..

  order = 0
  prefix =
  separator = /
  subscriptions = yes
  type = private
}


RE: Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-30 Thread Marc Roos
>>  
>> >
>> >> 
>> >>  
>> >> I am playing a bit with the monitoring, and I have noticed there 
is
>> one
>> >> client of the chart with ~7500, while the others are between ~17 
>> >> and
>> ~60
>> >> (dovecot_user_num_cmds).
>> >> 
>> >> I assume this is related to the client, or is it possible 
something
>> is
>> >> wrong on the server side? Is someone having also such numbers or 
is
>> this
>> >> really strange. Is it possible to limit these cmd's?
>> >
>> >Maybe you should look into what command(s) are being executed first?
>> >
>> >event_exporter cmd_export {
>> >  format = json
>> >  format_args = time-rfc3339
>> >  transport = log
>> >}
>> >
>> >metric imap_command {
>> >   event_name = imap_command_finished
>> >   filter {
>> >  user = anomalous
>> >   }
>> >   exporter = cmd_export
>> >}
>> >
>> 
>> Is there also a way to do this on dovecot 2.2?
>
>With rawlogs, I suppose.
>

If I get this raw log, I am getting huge amount of lists

cut -d ' ' -f2 20201230-181651-16624.out |sort | uniq -c | sort -n

..
 17 FLAGS
 20 0
328 NO
   1284 )
   1284
   9021 OK
 133350 LIST




RE: Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-30 Thread aki.tuomi


> On 30/12/2020 12:06 Marc Roos  wrote:
> 
>  
> >
> >> 
> >>  
> >> I am playing a bit with the monitoring, and I have noticed there is 
> one 
> >> client of the chart with ~7500, while the others are between ~17 and 
> ~60 
> >> (dovecot_user_num_cmds).
> >> 
> >> I assume this is related to the client, or is it possible something 
> is 
> >> wrong on the server side? Is someone having also such numbers or is 
> this 
> >> really strange. Is it possible to limit these cmd's?
> >
> >Maybe you should look into what command(s) are being executed first?
> >
> >event_exporter cmd_export {
> >  format = json
> >  format_args = time-rfc3339
> >  transport = log
> >}
> >
> >metric imap_command {
> >   event_name = imap_command_finished
> >   filter {
> >  user = anomalous
> >   }
> >   exporter = cmd_export
> >}
> >
> 
> Is there also a way to do this on dovecot 2.2?

With rawlogs, I suppose.

Aki


RE: Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-30 Thread Marc Roos
>
>> 
>>  
>> I am playing a bit with the monitoring, and I have noticed there is 
one 
>> client of the chart with ~7500, while the others are between ~17 and 
~60 
>> (dovecot_user_num_cmds).
>> 
>> I assume this is related to the client, or is it possible something 
is 
>> wrong on the server side? Is someone having also such numbers or is 
this 
>> really strange. Is it possible to limit these cmd's?
>
>Maybe you should look into what command(s) are being executed first?
>
>event_exporter cmd_export {
>  format = json
>  format_args = time-rfc3339
>  transport = log
>}
>
>metric imap_command {
>   event_name = imap_command_finished
>   filter {
>  user = anomalous
>   }
>   exporter = cmd_export
>}
>

Is there also a way to do this on dovecot 2.2?




Re: Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-30 Thread Aki Tuomi


> On 30/12/2020 11:46 Marc Roos  wrote:
> 
>  
> I am playing a bit with the monitoring, and I have noticed there is one 
> client of the chart with ~7500, while the others are between ~17 and ~60 
> (dovecot_user_num_cmds).
> 
> I assume this is related to the client, or is it possible something is 
> wrong on the server side? Is someone having also such numbers or is this 
> really strange. Is it possible to limit these cmd's?

Maybe you should look into what command(s) are being executed first?

event_exporter cmd_export {
  format = json
  format_args = time-rfc3339
  transport = log
}

metric imap_command {
   event_name = imap_command_finished
   filter {
  user = anomalous
   }
   exporter = cmd_export
}

Aki


Imap client with ~7500 imap cmds ~250/~500 read() syscall

2020-12-30 Thread Marc Roos


I am playing a bit with the monitoring, and I have noticed there is one 
client of the chart with ~7500, while the others are between ~17 and ~60 
(dovecot_user_num_cmds).

I assume this is related to the client, or is it possible something is 
wrong on the server side? Is someone having also such numbers or is this 
really strange. Is it possible to limit these cmd's?