Re: e-mail server farm question
On Mon, May 22, 2006 at 11:16:41PM -0500, Vulpes Velox wrote: Maildir makes it easy to distribute it across multiple machines as well. Cyrus Murder looks even better --- take a look at http://cyrusimap.web.cmu.edu/configuration.html There is, of course, a catch --- you can only access the mail store via IMAP/POP3/LMTP (you cannot touch the files directly, though it _is_ easy to extract the data in case you decide you do not want to see Cyrus any more), but that can be considered an advantage. (I have stardet reading this thread in the middle, if you have already considered cyrus, just ignore me) mf -- May God bless and keep the Tsar far away from us. pgpG2SQ1rKXLK.pgp Description: PGP signature
Re: e-mail server farm question
Vulpes Velox wrote: On Mon, 22 May 2006 11:54:02 -0500 Kevin Kinsey [EMAIL PROTECTED] wrote: At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Derek Ragona wrote: If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. Well, it's pretty obvious that they aren't using a stock SendMail: # telnet mx2.mail.yahoo.com 25 Trying 67.28.113.72... Connected to mx2.mail.yahoo.com. Escape character is '^]'. 220 mta309.mail.re4.yahoo.com ESMTP YSmtp service ready Short of finding an article written by someone 'in the know', or an answer for someone like that, we can only guess. I'd probably start with guessing a big DB on a large SAN; which pretty much negates the which server to read from question (up to a point). Everything else is pretty academic. SMTP, IMAP, POP. Maildir makes it easy to distribute it across multiple machines as well. What do you mean exactly? distributing 1 user's mails into seperate machines? I didnt understand how Maildir helps to this actually. Thanks, Evren ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
On May 23, 2006, at 1:35 AM, Evren Yurtesen wrote: Vulpes Velox wrote: On Mon, 22 May 2006 11:54:02 -0500 Kevin Kinsey [EMAIL PROTECTED] wrote: At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Derek Ragona wrote: If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. Well, it's pretty obvious that they aren't using a stock SendMail: # telnet mx2.mail.yahoo.com 25 Trying 67.28.113.72... Connected to mx2.mail.yahoo.com. Escape character is '^]'. 220 mta309.mail.re4.yahoo.com ESMTP YSmtp service ready Short of finding an article written by someone 'in the know', or an answer for someone like that, we can only guess. I'd probably start with guessing a big DB on a large SAN; which pretty much negates the which server to read from question (up to a point). Everything else is pretty academic. SMTP, IMAP, POP. Maildir makes it easy to distribute it across multiple machines as well. What do you mean exactly? distributing 1 user's mails into seperate machines? I didnt understand how Maildir helps to this actually. I am not sure anyone was talking about distributing 1 person's mail across separate machines. The discussion seemed to be how to handle large amounts of mail spread out across machines, which maildir helps with as you can have one or more file servers and lots of consumers (imap/pop) and deliverers (mta) accessing those maildirs on your file servers. Combine with a backend database of some sort (we use an ldap db that includes the path for a specific accounts mail) and voilá. Chad --- Chad Leigh -- Shire.Net LLC Your Web App and Email hosting provider chad at shire.net ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
Chad Leigh -- Shire.Net LLC wrote: On May 23, 2006, at 1:35 AM, Evren Yurtesen wrote: Vulpes Velox wrote: On Mon, 22 May 2006 11:54:02 -0500 Kevin Kinsey [EMAIL PROTECTED] wrote: At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Derek Ragona wrote: If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. Well, it's pretty obvious that they aren't using a stock SendMail: # telnet mx2.mail.yahoo.com 25 Trying 67.28.113.72... Connected to mx2.mail.yahoo.com. Escape character is '^]'. 220 mta309.mail.re4.yahoo.com ESMTP YSmtp service ready Short of finding an article written by someone 'in the know', or an answer for someone like that, we can only guess. I'd probably start with guessing a big DB on a large SAN; which pretty much negates the which server to read from question (up to a point). Everything else is pretty academic. SMTP, IMAP, POP. Maildir makes it easy to distribute it across multiple machines as well. What do you mean exactly? distributing 1 user's mails into seperate machines? I didnt understand how Maildir helps to this actually. I am not sure anyone was talking about distributing 1 person's mail across separate machines. The discussion seemed to be how to handle large amounts of mail spread out across machines, which maildir helps with as you can have one or more file servers and lots of consumers (imap/pop) and deliverers (mta) accessing those maildirs on your file servers. Combine with a backend database of some sort (we use an ldap db that includes the path for a specific accounts mail) and voilá. Chad Ah sorry, I didnt think it that way for a moment. I thought you meant Maildir stores mails in seperate files compred to mbox format used by sendmail so...anyhow my mistake :) But it is possible to make changes to sendmail so that it will store to different folders also. I think the conclusion is a database, multiple smtp servers querying database to see where to forward received e-mails, multiple pop3/imap servers querying database to see from where to read the e-mails and multiple storage machines. This way it can scale to an unlimited size. So it requires a lot of coding :) Thanks, Evren ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
Evren Yurtesen wrote: Chad Leigh -- Shire.Net LLC wrote: On May 23, 2006, at 1:35 AM, Evren Yurtesen wrote: Vulpes Velox wrote: On Mon, 22 May 2006 11:54:02 -0500 Kevin Kinsey [EMAIL PROTECTED] wrote: At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Derek Ragona wrote: If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. Well, it's pretty obvious that they aren't using a stock SendMail: # telnet mx2.mail.yahoo.com 25 Trying 67.28.113.72... Connected to mx2.mail.yahoo.com. Escape character is '^]'. 220 mta309.mail.re4.yahoo.com ESMTP YSmtp service ready Short of finding an article written by someone 'in the know', or an answer for someone like that, we can only guess. I'd probably start with guessing a big DB on a large SAN; which pretty much negates the which server to read from question (up to a point). Everything else is pretty academic. SMTP, IMAP, POP. Maildir makes it easy to distribute it across multiple machines as well. What do you mean exactly? distributing 1 user's mails into seperate machines? I didnt understand how Maildir helps to this actually. I am not sure anyone was talking about distributing 1 person's mail across separate machines. The discussion seemed to be how to handle large amounts of mail spread out across machines, which maildir helps with as you can have one or more file servers and lots of consumers (imap/pop) and deliverers (mta) accessing those maildirs on your file servers. Combine with a backend database of some sort (we use an ldap db that includes the path for a specific accounts mail) and voilá. Chad Ah sorry, I didnt think it that way for a moment. I thought you meant Maildir stores mails in seperate files compred to mbox format used by sendmail so...anyhow my mistake :) But it is possible to make changes to sendmail so that it will store to different folders also. I think the conclusion is a database, multiple smtp servers querying database to see where to forward received e-mails, multiple pop3/imap servers querying database to see from where to read the e-mails and multiple storage machines. This way it can scale to an unlimited size. So it requires a lot of coding :) Not really, we have a large system which required little coding except for script tools. We have two FreeBSD servers as public gateways running Sendmail + Milter-Ahead + MailScanner. These 'gateways' scan mail for viruses and then forward the delivery on to three toasters which are FreeBSD servers running qmail + vpopmail + Spamd + SquirrelMail. The toasters each mount an NFS share from a Sun Enterprise to store the mail. Vpopmail answers the validation reqests from Milter-Ahead and gets all it's storage/authentication information such as Maildir delivery, forwarding, SpamAssassin settings, etc from a common MySQL DB. All very stock and the system can grow as large as the mail store server allows. When it is incapable, we will replace it with a larger machine. Just because I know you will ask, the mail store server is raid5, dual power supply, dual nic. The gateways, toasters, and mail store all communicate via a private network which is 1gb. It has proven very robust during the past two years. DAve -- This message was checked by forty monkeys and found to not contain any SPAM whatsoever. Your monkeys may vary ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
Not really, we have a large system which required little coding except for script tools. We have two FreeBSD servers as public gateways running Sendmail + Milter-Ahead + MailScanner. These 'gateways' scan mail for viruses and then forward the delivery on to three toasters which are FreeBSD servers running qmail + vpopmail + Spamd + SquirrelMail. Why you have chosed sendmail on the gateways? What are the advangtages..i think it is not the speed? ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
Iantcho Vassilev wrote: Not really, we have a large system which required little coding except for script tools. We have two FreeBSD servers as public gateways running Sendmail + Milter-Ahead + MailScanner. These 'gateways' scan mail for viruses and then forward the delivery on to three toasters which are FreeBSD servers running qmail + vpopmail + Spamd + SquirrelMail. Why you have chosed sendmail on the gateways? What are the advangtages..i think it is not the speed? I've used Sendmail, Postfix, and qmail. Sendmail is the MTA the author of MailScanner has the most experience with, so I used it as well. In my situation, all mail is pushed back out via static routes in mailertable to toasters. Sendmail is doing nothing but filling an in-queue, and emptying an out-queue. Pretty simple stuff, everything is inbound, speed has not been an issue. DAve -- This message was checked by forty monkeys and found to not contain any SPAM whatsoever. Your monkeys may vary ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
On Tue, 23 May 2006 10:35:51 +0300 Evren Yurtesen [EMAIL PROTECTED] wrote: Vulpes Velox wrote: On Mon, 22 May 2006 11:54:02 -0500 Kevin Kinsey [EMAIL PROTECTED] wrote: At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Derek Ragona wrote: If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. Well, it's pretty obvious that they aren't using a stock SendMail: # telnet mx2.mail.yahoo.com 25 Trying 67.28.113.72... Connected to mx2.mail.yahoo.com. Escape character is '^]'. 220 mta309.mail.re4.yahoo.com ESMTP YSmtp service ready Short of finding an article written by someone 'in the know', or an answer for someone like that, we can only guess. I'd probably start with guessing a big DB on a large SAN; which pretty much negates the which server to read from question (up to a point). Everything else is pretty academic. SMTP, IMAP, POP. Maildir makes it easy to distribute it across multiple machines as well. What do you mean exactly? distributing 1 user's mails into seperate machines? I didnt understand how Maildir helps to this actually. Maildir is nfs safe and does not require locking. Thus multiple programs can safely use it. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
On Tue, 23 May 2006 11:26:36 +0300 Evren Yurtesen [EMAIL PROTECTED] wrote: Chad Leigh -- Shire.Net LLC wrote: On May 23, 2006, at 1:35 AM, Evren Yurtesen wrote: Vulpes Velox wrote: On Mon, 22 May 2006 11:54:02 -0500 Kevin Kinsey [EMAIL PROTECTED] wrote: At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Derek Ragona wrote: If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. Well, it's pretty obvious that they aren't using a stock SendMail: # telnet mx2.mail.yahoo.com 25 Trying 67.28.113.72... Connected to mx2.mail.yahoo.com. Escape character is '^]'. 220 mta309.mail.re4.yahoo.com ESMTP YSmtp service ready Short of finding an article written by someone 'in the know', or an answer for someone like that, we can only guess. I'd probably start with guessing a big DB on a large SAN; which pretty much negates the which server to read from question (up to a point). Everything else is pretty academic. SMTP, IMAP, POP. Maildir makes it easy to distribute it across multiple machines as well. What do you mean exactly? distributing 1 user's mails into seperate machines? I didnt understand how Maildir helps to this actually. I am not sure anyone was talking about distributing 1 person's mail across separate machines. The discussion seemed to be how to handle large amounts of mail spread out across machines, which maildir helps with as you can have one or more file servers and lots of consumers (imap/pop) and deliverers (mta) accessing those maildirs on your file servers. Combine with a backend database of some sort (we use an ldap db that includes the path for a specific accounts mail) and voilá. Chad Ah sorry, I didnt think it that way for a moment. I thought you meant Maildir stores mails in seperate files compred to mbox format used by sendmail so...anyhow my mistake :) But it is possible to make changes to sendmail so that it will store to different folders also. Maildir does store mail in serperate files. Each email is a file. http://en.wikipedia.org/wiki/Maildir I think the conclusion is a database, multiple smtp servers querying database to see where to forward received e-mails, multiple pop3/imap servers querying database to see from where to read the e-mails and multiple storage machines. This way it can scale to an unlimited size. So it requires a lot of coding :) Nah, once you get everything installed and configured it is easy. Dovecot and qmail are both easy to set up. Then just a bit of shell scripting for a user adding and removing script. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
e-mail server farm question
Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Thanks, Evren ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. -Derek At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Thanks, Evren ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED] -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. MailScanner thanks transtec Computers for their support. -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. MailScanner thanks transtec Computers for their support. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Derek Ragona wrote: If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. Well, it's pretty obvious that they aren't using a stock SendMail: # telnet mx2.mail.yahoo.com 25 Trying 67.28.113.72... Connected to mx2.mail.yahoo.com. Escape character is '^]'. 220 mta309.mail.re4.yahoo.com ESMTP YSmtp service ready Short of finding an article written by someone 'in the know', or an answer for someone like that, we can only guess. I'd probably start with guessing a big DB on a large SAN; which pretty much negates the which server to read from question (up to a point). Everything else is pretty academic. SMTP, IMAP, POP. Kevin Kinsey -- You never realize how many friends you have until you rent a house at the beach. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: e-mail server farm question
On Mon, 22 May 2006 11:54:02 -0500 Kevin Kinsey [EMAIL PROTECTED] wrote: At 07:17 AM 5/22/2006, Evren Yurtesen wrote: Hello, I was wondering how does services like yahoo mail is storing e-mails. Somehow the smtp server should know where to deliver the mail inside the system and webmail should know from which server to read it from. Does anybody have any practical ideas about how it is done? Derek Ragona wrote: If you are using sendmail, as most FreeBSD users are, you can check the sendmail.org site for information on mail handling. There are a number of methods that depend on your setup. Well, it's pretty obvious that they aren't using a stock SendMail: # telnet mx2.mail.yahoo.com 25 Trying 67.28.113.72... Connected to mx2.mail.yahoo.com. Escape character is '^]'. 220 mta309.mail.re4.yahoo.com ESMTP YSmtp service ready Short of finding an article written by someone 'in the know', or an answer for someone like that, we can only guess. I'd probably start with guessing a big DB on a large SAN; which pretty much negates the which server to read from question (up to a point). Everything else is pretty academic. SMTP, IMAP, POP. Maildir makes it easy to distribute it across multiple machines as well. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
