Nicholas, I'm fairly certain that the issue is being caused by dovecot performing a chroot prior to initializing its epoll handle. (On both native SmartOS and LX, epoll is implemented in terms of /dev/poll.) Could you look to see if there is a configuration option for chroot which you could temporarily disable to confirm the theory?
Thanks, -Patrick On 1 September 2015 at 17:27, Nicholas Lee <[email protected]> wrote: > [root@node7 /zones/e7449320-115b-4cdb-95b5-33692bc5c9c3/root/etc/ssl]# > uname -v > joyent_20150820T062742Z > > > On 2 September 2015 at 09:01, Robert Mustacchi <[email protected]> wrote: > >> Can you confirm what version of the SmartOS platform you're running? >> That's the output from uname -v. >> >> Thanks, >> Robert >> >> On 9/1/15 13:58 , Nicholas Lee wrote: >> > I'm following [1]. It seems to be having SASL issues between dovecot and >> > postfix - error message below and telnet localhost 25 hangs. >> > >> > >> > It may be user (admin) error, but this version was second attempt after >> a >> > clean wipe. Both had the same issues. >> > >> > >> > mail.err: >> > Sep 1 05:37:17 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 05:37:17 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 2 secs >> > Sep 1 05:56:24 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 05:56:24 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 2 secs >> > Sep 1 06:18:35 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 4 secs >> > Sep 1 06:18:35 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:18:35 mail dovecot: imap-login: Error: read(anvil) failed: EOF >> > Sep 1 06:18:39 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:18:39 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 8 secs >> > Sep 1 06:18:39 mail dovecot: auth: Error: read(anvil-auth-penalty) >> failed: >> > EOF >> > Sep 1 06:18:39 mail dovecot: auth: Error: >> > net_connect_unix(anvil-auth-penalty) failed: Permission denied >> > Sep 1 06:21:08 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:21:08 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 16 secs >> > Sep 1 06:21:08 mail dovecot: imap-login: Error: read(anvil) failed: EOF >> > Sep 1 06:21:57 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:21:57 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 32 secs >> > Sep 1 06:21:57 mail dovecot: imap-login: Error: read(anvil) failed: EOF >> > Sep 1 06:22:39 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:22:39 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 60 secs >> > Sep 1 06:22:39 mail dovecot: imap-login: Error: read(anvil) failed: EOF >> > Sep 1 06:23:50 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:23:50 mail dovecot: imap-login: Error: read(anvil) failed: EOF >> > Sep 1 06:24:50 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:24:50 mail dovecot: auth: Error: read(anvil-auth-penalty) >> failed: >> > EOF >> > Sep 1 06:24:50 mail dovecot: auth: Error: >> > net_connect_unix(anvil-auth-penalty) failed: Permission denied >> > Sep 1 06:24:50 mail dovecot: message repeated 2 times: [ master: Error: >> > service(anvil): command startup failed, throttling for 60 secs] >> > >> > mail.log: >> > >> > Sep 1 06:16:46 mail postfix/master[31883]: warning: >> > /usr/lib/postfix/pickup: bad command startup -- throttling >> > Sep 1 06:17:47 mail postfix/master[31883]: warning: process >> > /usr/lib/postfix/pickup pid 32175 exit status 1 >> > Sep 1 06:17:47 mail postfix/master[31883]: warning: >> > /usr/lib/postfix/pickup: bad command startup -- throttling >> > Sep 1 06:18:35 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 4 secs >> > Sep 1 06:18:35 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:18:35 mail dovecot: imap-login: Error: read(anvil) failed: EOF >> > Sep 1 06:18:35 mail postfix/submission/smtpd[32186]: warning: >> > dict_nis_init: NIS domain name not set - NIS lookups disabled >> > Sep 1 06:18:35 mail dovecot: imap-login: Aborted login (no auth >> attempts >> > in 0 secs): user=<>, rip=121.98.188.241, lip=103.247.155.14, >> > session=<7sMchakenQB5Yrzx> >> > Sep 1 06:18:36 mail postfix/master[31883]: warning: process >> > /usr/lib/postfix/tlsmgr pid 32189 exit status 1 >> > Sep 1 06:18:36 mail postfix/master[31883]: warning: >> > /usr/lib/postfix/tlsmgr: bad command startup -- throttling >> > Sep 1 06:18:39 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > Sep 1 06:18:39 mail dovecot: master: Error: service(anvil): command >> > startup failed, throttling for 8 secs >> > Sep 1 06:18:39 mail dovecot: auth: Error: read(anvil-auth-penalty) >> failed: >> > EOF >> > Sep 1 06:18:39 mail dovecot: auth: Error: >> > net_connect_unix(anvil-auth-penalty) failed: Permission denied >> > Sep 1 06:18:48 mail postfix/master[31883]: warning: process >> > /usr/lib/postfix/pickup pid 32199 exit status 1 >> > Sep 1 06:18:48 mail postfix/master[31883]: warning: >> > /usr/lib/postfix/pickup: bad command startup -- throttling >> > Sep 1 06:19:37 mail postfix/master[31883]: warning: process >> > /usr/lib/postfix/tlsmgr pid 32200 exit status 1 >> > Sep 1 06:19:37 mail postfix/master[31883]: warning: >> > /usr/lib/postfix/tlsmgr: bad command startup -- throttling >> > Sep 1 06:19:49 mail postfix/master[31883]: warning: process >> > /usr/lib/postfix/pickup pid 32201 exit status 1 >> > Sep 1 06:19:49 mail postfix/master[31883]: warning: >> > /usr/lib/postfix/pickup: bad command startup -- throttling >> > Sep 1 06:20:16 mail postfix/master[31883]: warning: unix_trigger_event: >> > read timeout for service private/tlsmgr >> > Sep 1 06:20:38 mail postfix/master[31883]: warning: process >> > /usr/lib/postfix/tlsmgr pid 32210 exit status 1 >> > Sep 1 06:20:38 mail postfix/master[31883]: warning: >> > /usr/lib/postfix/tlsmgr: bad command startup -- throttling >> > Sep 1 06:20:49 mail postfix/master[31883]: terminating on signal 15 >> > Sep 1 06:20:50 mail postfix/master[32346]: daemon started -- version >> > 2.11.0, configuration /etc/postfix >> > Sep 1 06:20:51 mail postfix/master[32346]: warning: process >> > /usr/lib/postfix/pickup pid 32349 exit status 1 >> > Sep 1 06:20:51 mail postfix/master[32346]: warning: >> > /usr/lib/postfix/pickup: bad command startup -- throttling >> > Sep 1 06:21:08 mail dovecot: anvil: Fatal: epoll_create(): No such >> file or >> > directory >> > >> > >> > The zone isn't big. >> > >> > [root@node7 /zones/e7449320-115b-4cdb-95b5-33692bc5c9c3/root/etc/ssl]# >> df >> > -h | grep e74 >> > zones/e7449320-115b-4cdb-95b5-33692bc5c9c3 500G 578M 500G >> 1% >> > /zones/e7449320-115b-4cdb-95b5-33692bc5c9c3 >> > zones/cores/e7449320-115b-4cdb-95b5-33692bc5c9c3 100G 96K >> 100G >> > 1% /zones/e7449320-115b-4cdb-95b5-33692bc5c9c3/cores >> > >> > >> > >> > I can either 1) switch the ssl key to a snakeoil version, tar-gzip it >> up, >> > and send the archive to you guys, or 2) do a history | grep install; >> create >> > a new generic 14.04 zone; then do a diff on /etc/ between the two zones. >> > >> > I'm travelling to Europe in a few days, but a planning to get one of my >> > laptops setup with vagrant. I could try reproduce with a very simple >> > dovecot/postfix/sasl setup. >> > >> > [1] >> > >> https://www.exratione.com/2014/05/a-mailserver-on-ubuntu-1404-postfix-dovecot-mysql/ >> > >> > >> > Nicholas >> > >> > On 2 September 2015 at 01:59, Bryan Cantrill <[email protected]> >> > wrote: >> > >> >> The problem that Patrick is working on is very esoteric (namely, >> epoll'ing >> >> on an epoll descriptor) and is not consistent with what you saw -- for >> the >> >> vast majority of apps epoll is currently completely functional. So >> assuming >> >> you would like us to debug your issue, you will need to either get us >> >> instructions on reproducing it, get us more data (strace output would >> be a >> >> start), or reproduce this in the Joyent Public Cloud where we are >> running >> >> LX in production. >> >> >> >> - Bryan >> >> On Sep 1, 2015 5:40 AM, "Nicholas Lee" <[email protected]> wrote: >> >> >> >>> joyent_20150820T062742Z. with: >> >>> c8d68a9e-4682-11e5-9450-4f4fadd0936d ubuntu-14.04 20150819 linux >> >>> 2015-08-19T14:58:43Z >> >>> >> >>> I've reverted to kvm for now. I'll keep the lx/zone around and try it >> out >> >>> again when the epoll is done. >> >>> >> >>> >> >>> Nicholas >> >>> >> >>> >> >>> On 2 September 2015 at 00:14, Jerry Jelinek <[email protected] >> > >> >>> wrote: >> >>> >> >>>> In general, nothing lx related has been upstreamed yet, so the >> illumos >> >>>> bug list isn't usually the right place to look. All of the open >> SmartOS >> >>>> bugs can be found here https://smartos.org/bugview/index.html. >> There is >> >>>> an epoll issue Patrick Mooney is currently working on but I don't >> know if >> >>>> it is related to the problem you're seeing. What build are you >> running? >> >>>> What version of Ubuntu? >> >>>> >> >>>> Thanks, >> >>>> Jerry >> >>>> >> >>>> >> >>>> On Tue, Sep 1, 2015 at 2:39 AM, Nicholas Lee <[email protected]> >> >>>> wrote: >> >>>> >> >>>>> Are there some epoll issues with lx/ubuntu and dovecot at the >> moment? >> >>>>> >> >>>>> >> >>>>> >> >>>>> Sep 1 08:12:56 mail dovecot: anvil: Fatal: epoll_create(): No such >> >>>>> file or directory >> >>>>> Sep 1 08:12:56 mail dovecot: master: Error: service(anvil): command >> >>>>> startup failed, throttling for 8 secs >> >>>>> >> >>>>> >> >>>>> I notice this says 90% complete: >> >>>>> https://www.illumos.org/issues/5640 >> >>>>> >> >>>>> Nicholas >> >>>>> >> >>>>> >> >>>> >> >>> *smartos-discuss* | Archives >> >> <https://www.listbox.com/member/archive/184463/=now> >> >> <https://www.listbox.com/member/archive/rss/184463/25241303-ebebecbc> >> | >> >> Modify >> >> <https://www.listbox.com/member/?&> >> >> Your Subscription <http://www.listbox.com> >> >> >> >> >> > >> > >> >> >> http://www.listbox.com >> > > *smartos-discuss* | Archives > <https://www.listbox.com/member/archive/184463/=now> > <https://www.listbox.com/member/archive/rss/184463/26937779-40cf8a10> | > Modify > <https://www.listbox.com/member/?&> > Your Subscription <http://www.listbox.com> > ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
