Re: wanna help with filters ?

2014-04-15 Thread Gilles Chehade
On Mon, Apr 14, 2014 at 04:20:27PM +0200, Gilles Chehade wrote:
 Ohai,
 
 In June, we will be having a private hackathon with Charles and Eric, to
 work on the filter API and infrastructure. This will happen at my place,
 it's kind of unofficial and it's unrelated to OpenBSD's hackathons.
 
 [...]

 From JUN-16 to JUN-22, you can join us on #OpenSMTPD @ irc.freenode.net
 

Just clarifying something as a couple people misunderstood:

- Charles, Eric and I will be having a hackthon at my place;
- You guys are invited to participate on IRC during our hackathon;

I can't possibly invite everyone to come over to my huge mansion :-)

But it's nice to seee that there is interest in an IRL event so I'll try
to keep that in mind for when we're bigger

-- 
Gilles Chehade

https://www.poolp.org  @poolpOrg

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



Re: OpenSMTPD crashes on authentication

2014-04-15 Thread Gilles Chehade
On Tue, Apr 15, 2014 at 06:47:26AM +0200, Martin Braun wrote:

 [...]
 
 I am running snapshot.
 
 [...]


When you say you are running a snapshot, you meant an OpenBSD snapshot
I assume from this:



 info: OpenSMTPD 5.4.3 starting


You need to either get a later snapshot or update src/usr.sbin/smtpd and
make clean; make; make install
the issue will then go away

 
 Is this a bug or have I messed up the configuration?
 

see:

https://www.mail-archive.com/misc@openbsd.org/msg128272.html

and:

https://www.mail-archive.com/misc@opensmtpd.org/msg00899.html



-- 
Gilles Chehade

https://www.poolp.org  @poolpOrg

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



Re: OpenSMTPD crashes on authentication

2014-04-15 Thread Denis Fondras
Le 15/04/2014 06:47, Martin Braun a C)crit :
 
 And OpenSMTPD is crashed.
 
 Is this a bug or have I messed up the configuration?
 

I really hope this would a misconfiguration as I have the same problem
(OpenSMTPd latest snapshot with Debian 7.0 amd64) :p

No problem with table uauth { denis = denis:mypass } but crash with
table uauth passwd:/etc/dovecot/users.db

Denis


-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



Re: OpenSMTPD crashes on authentication

2014-04-15 Thread Gilles Chehade
On Tue, Apr 15, 2014 at 08:56:41AM +0200, Denis Fondras wrote:
 Le 15/04/2014 06:47, Martin Braun a C)crit :
  
  And OpenSMTPD is crashed.
  
  Is this a bug or have I messed up the configuration?
  
 
 I really hope this would a misconfiguration as I have the same problem
 (OpenSMTPd latest snapshot with Debian 7.0 amd64) :p
 
 No problem with table uauth { denis = denis:mypass } but crash with
 table uauth passwd:/etc/dovecot/users.db
 
 Denis
 
 

I think there's a confusion arising from everyone using the term
snapshot to mean something different :-)

Where does the Debian snapshot come from ?

-- 
Gilles Chehade

https://www.poolp.org  @poolpOrg

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



Re: OpenSMTPD dies after a while!

2014-04-15 Thread Gilles Chehade
On Tue, Apr 15, 2014 at 08:57:30AM +0200, Gilles Chehade wrote:
 On Sat, Apr 12, 2014 at 11:03:13PM +0200, Stefan Sieg wrote:
  
  Hello,
  
  i had the same problem on OpenBSD -current with this fix applied
  
  http://www.openbsd.org/cgi-bin/cvsweb/src/usr.sbin/smtpd/lka.c.diff?r1=1.165;r2=1.166;f=h

  
  but smtpd still exits with 
  
  smtpd: session_imsg: unexpected IMSG_LKA_AUTHENTICATE imsg
  warn: parent - pony: pipe closed
  warn: queue - pony: pipe closed
  warn: control - pony: pipe closed
  warn: scheduler - queue: pipe closed
  warn: lka - pony: pipe closed
  
  
  after changing another IMSG_LKA_AUTHENTICATE - IMSG_SMTP_AUTHENTICATE
  opensmtpd works again. (hoping its not complete bullshit)
  
  --- lka.c  Sat Apr 12 22:44:03 2014
  +++ lka.c   Sat Apr 12 22:44:27 2014
  @@ -209,7 +209,7 @@
   
  ret = lka_authenticate(tablename, username, 
  password);
   
  -   m_create(p, IMSG_LKA_AUTHENTICATE, 0, 0, -1);
  +   m_create(p, IMSG_SMTP_AUTHENTICATE, 0, 0, -1);
  m_add_id(p, reqid);
  
  
  Greetings and thank you very much for OpenSMPTD!
  
 
 Hi,
 
 your mail got lost in a thread, I'll have a look at it this morning
 

fixed, thanks for your diff


-- 
Gilles Chehade

https://www.poolp.org  @poolpOrg

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



Re: OpenSMTPD crashes on authentication

2014-04-15 Thread Denis Fondras
Hi Gilles,

Le 15/04/2014 09:00, Gilles Chehade a icrit :
 
 I think there's a confusion arising from everyone using the term
 snapshot to mean something different :-)
 
 Where does the Debian snapshot come from ?
 

I mean I compiled it myself with the source from
http://www.opensmtpd.org/archives/opensmtpd-portable-latest.tar.gz

Denis

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



[OpenSMTPD] master snapshot opensmtpd-201404151425 available

2014-04-15 Thread gilles
User gilles has just rebuilt a master snapshot, available from:

http://www.OpenSMTPD.org/archives/opensmtpd-201404151425.tar.gz

Checksum:

  SHA256 (opensmtpd-201404151425.tar.gz) =
  334f501b5c9717c613f94b5cfff9ac908c86d8745c40858cd4487ea43982e21b

A summary of the content of this snapshot is available below.

Please test and let us know if it breaks something!

If this snapshot doesn't work, please also test with a previous one,
to help us spot where the issue is coming from. You can access all
previous snapshots here:

http://www.opensmtpd.org/archives/

The OpenSMTPD team ;-)


Summary of changes since last snapshot (opensmtpd-201403261203):
---

- disable imsg buffers profiling unless requested
- do not add user-agent in enqueuer
- queue user is mandatory !
- remove old instructions about sendmail
- do not call purge_task every 10 seconds
- enqueuer updates domain in headers
- reword some error messages
- cleanup mda forking
- huge imsg cleanup to remove ambiguities
- smtp/mda/mta/mfa processes merged
- add back deliver to lmtp/mda ... as foobar to fork mda as user foobar
- do not linger on close

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



[OpenSMTPD] portable snapshot opensmtpd-201404151432p1 available

2014-04-15 Thread gilles
User gilles has just rebuilt a portable snapshot, available from:

http://www.OpenSMTPD.org/archives/opensmtpd-201404151432p1.tar.gz

Checksum:

  SHA256 (opensmtpd-201404151432p1.tar.gz) =
  793c9fd3abf046103c55190e561e7ddec7369e0acac3031974734162c72977bf

A summary of the content of this snapshot is available below.

Please test and let us know if it breaks something!

If this snapshot doesn't work, please also test with a previous one,
to help us spot where the issue is coming from. You can access all
previous snapshots here:

http://www.opensmtpd.org/archives/

The OpenSMTPD team ;-)


Summary of changes since last snapshot (opensmtpd-201403261207p1):
-

- disable imsg buffers profiling unless requested   

- do not add user-agent in enqueuer 

- queue user is mandatory ! 

- remove old instructions about sendmail

- do not call purge_task every 10 seconds   

- enqueuer updates domain in headers

- reword some error messages

- cleanup mda forking   

- huge imsg cleanup to remove ambiguities   

- smtp/mda/mta/mfa processes merged 

- add back deliver to lmtp/mda ... as foobar to fork mda as user foobar 

- do not linger on close

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



README: the latest snapshots

2014-04-15 Thread Gilles Chehade
Ohai,

As mentioned in a previous mail, we have done a lot of work on OpenSMTPD
to make it more friendly to low CPU/memory environments.

While at it we cleaned up a bit the daemon infrastructure and decided to
merge some of the processes. This is quite visible:

`top` output before:

29704 _smtpd 20 2124K 3824K sleep/1   kqread2:33  0.00% smtpd: 
lookup
24134 _smtpd 20 2052K 2652K sleep/1   kqread1:44  0.00% smtpd: 
control
20270 _smtpd 20 2720K 4376K sleep/1   kqread1:27  0.00% smtpd: smtp
15552 _smtpd 20 3528K 5664K sleep/0   kqread1:02  0.00% smtpd: 
transfer
20194 _smtpd 20 2824K 3344K sleep/1   kqread0:46  0.00% smtpd: 
filter
31356 _smtpd 20 1572K 2200K sleep/2   kqread0:28  0.00% smtpd: 
scheduler
19458 _smtpd 20 1728K 2288K sleep/1   kqread0:28  0.00% smtpd: 
delivery
12412 _smtpq 20 2560K 3356K sleep/2   kqread1:22  0.00% smtpd: queue


`top` output now:

 4091 _smtpd 20 1420K 1972K sleep/3   kqread0:00  0.00% smtpd: 
control
24761 _smtpd 20 1396K 3052K sleep/3   kqread0:00  0.00% smtpd: pony 
express
 1952 _smtpd 20 1428K 1956K sleep/1   kqread0:00  0.00% smtpd: 
lookup
21912 _smtpd 20 1224K 1784K sleep/2   kqread0:00  0.00% smtpd: 
scheduler
31961 _smtpq 20 1428K 2036K sleep/2   kqread0:00  0.00% smtpd: queue


This has no functional changes whatsoever, we are running with this code
in a very heavy loaded environment and there's no contention of any sort
due to the merging.

Now, for the sad part:

The change was very invasive and it was impossible to merge back into
our development branch with the filters and latest cleanups.

We have therefore decided to take a few steps back, get to the latest
version without filters that we could merge to and we will start
adding back the filters code on top of this new clean base.

As a result:

1- filters are not part of the snapshot we just published;
2- you will want to build and report any issue with the snapshot;

The code itself is safe, what is maybe broken is the build stuff

Voila !

-- 
Gilles Chehade

https://www.poolp.org  @poolpOrg

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



Problem with PostgreSQL configuration

2014-04-15 Thread Mimoza

Hi,
Someone have an exemple of Postgre/MySQL configuration file ? The 
postgresql.conf not the smptd.conf.

I have some trouble with my configuration.

Thx in advance

--
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org



OpenSMTPD talking with Dovecot

2014-04-15 Thread Martin Braun
I finally got OpenSMTPD talking with Dovecot. I am using a users.db
file which OpenSMTPD has no problems reading and authenticating
against, but I am getting really tired of Dovecot and its HUGE
configuration mess (IMHO).

So foo sends an email to bar and when OpenSMTPD sends the mail
through to Dovecot it looks like this:

SNIP
debug: smtp: new client on listener: 0x7acc5000
smtp-in: New session 5318eda411b4f299 from host 192.168.60.8 [192.168.60.8]
debug: lka: looking up pki serv1.example.com
debug: session_start_ssl: switching to SSL
smtp-in: Started TLS on session 5318eda411b4f299: version=TLSv1/SSLv3,
cipher=DHE-RSA-AES128-SHA, bits=128
debug: lka: authenticating for vpasswd:foo
smtp-in: Accepted authentication for user foo on session 5318eda411b4f299
debug: smtp: SIZE in MAIL FROM command
debug: aliases_virtual_get: 'b...@example.com' resolved to 1 nodes
debug: 0x8184b000: end of message, msgflags=0x
smtp-in: Accepted message 16dbd93c on session 5318eda411b4f299:
from=f...@example.com, to=b...@example.com, size=310, ndest=1,
proto=ESMTP
debug: scheduler: evp:16dbd93c11fc0afc scheduled (mda)
mda: new user 5318eda56c11fc0d for getpwnam:bar
smtp-in: Closing session 5318eda411b4f299
debug: lka: userinfo getpwnam:bar
debug: smtp: 0x8184b000: deleting session: done
debug: mda: new session 5318eda6263cb9cc for user getpwnam:bar
evpid 16dbd93c11fc0afc
debug: mda: no more envelope for getpwnam:bar
debug: mda: got message fd 4 for session 5318eda6263cb9cc evpid 16dbd93c11fc0afc
debug: mda: querying mda fd for session 5318eda6263cb9cc evpid 16dbd93c11fc0afc
debug: smtpd: forking mda for session 5318eda6263cb9cc:
/usr/local/libexec/dovecot/dovecot-lda -f f...@example.com -d
b...@example.com as bar
debug: mda: got mda fd 5 for session 5318eda6263cb9cc evpid 16dbd93c11fc0afc
debug: mda: end-of-file for session 5318eda6263cb9cc evpid 16dbd93c11fc0afc
debug: mda: all data sent for session 5318eda6263cb9cc evpid 16dbd93c11fc0afc
/SNIP

So OpenSMTPD has no problems authenticating foo.

But, Dovecot throws this in maillog:

SNIP
Apr 16 04:42:15 serv1 dovecot: lda: Error: userdb lookup(f...@bar.com):
Disconnected unexpectedly
Apr 16 04:42:15 serv1 dovecot: lda: Fatal: Internal error occurred.
Refer to server log for more information.
Apr 16 04:42:16 serv1 dovecot: master: Dovecot v2.2.10 starting up for
imap, lmtp
Apr 16 04:42:16 serv1 dovecot: master: Error: pipe() failed: Too many open files
/SNIP

I have no idear how to proceed from here other than trashing Dovecot
for something simpler? If any exists.

The /etc/smtpd/users.db is shared between the two and it looks like this:

SNIP
foo:$2a$08$Vks5ezM0TWja.fYQ6nCfgOMgKp8VC2QddqtTUw3D0Ykp61pkGkGEC:5000:5000::/var/vmail:/bin/nologin
bar:$2a$05$7MrgSQcqiphFHhvY9qGTWuihNeF5Hcgt8I0ozkO.lBgAMy39npmYG:5000:5000::/var/vmail:/bin/nologin
/SNIP

I actually prefered when Dovecot had just one huge configuration file
instead of the one gazillion files it has now.

Any ideas?

-- 
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org