Re: HW/SW for license server
Thanks to all of you for your suggestions. And shana tova. Valery From: Marc Volovic marcvolo...@me.com To: Valery Reznic valery_rez...@yahoo.com Cc: linux-il@cs.huji.ac.il linux-il@cs.huji.ac.il Sent: Sunday, September 25, 2011 5:38 PM Subject: Re: HW/SW for license server 4th is 4gb with iPhone autocorrect. Fuck apple. DL1xx is is HP. Check their site. 1000/sec is special Sent from my iPhone On Sep 25, 2011, at 12:25, Valery Reznic valery_rez...@yahoo.com wrote: Thank you, Mark. A few more questions: - what is HP DL1xx-class box with 4th ram - 6 request/second is trivial. On each ratio do you think it will need something special? Valery From: Marc Volovic marcvolo...@me.com To: Valery Reznic valery_rez...@yahoo.com Sent: Friday, September 23, 2011 12:03 PM Subject: Re: HW/SW for license server Dear valery, 6 requests per second is trivial. Get the cheapest HP DL1xx-class box with 4th ram and the cheapest CPU you can manage. M Sent from my iPhone On Sep 23, 2011, at 11:19, Valery Reznic valery_rez...@yahoo.com wrote: Hi, All. I need to setup license server and looking for advice what hardware/software to use General schema is following: There are about 20K clients all of them periodically (let say once a week) query license server for license via https I'll try my best to spread all those requests over the week, but in worse case scenario all those 20K request can came during 1hour, spread relative evenly i.e about 6 request/sec When license server get request it query database ~20K records with 2-3 small fields, generate license and return it to client. License generation is light - md5sum of the very small input ( few hundreds bytes) I think use following software for it 1. CentOS 6 2. Apache with mod_python 3. Mysql My questions about software are: 1. License server software is likely to be written in python, hence mod_python. If I'll use python as CGI instead of Apache module, will it result in significant performance drop? 2. How configure apache - what is reasonable settings for MaxClient parameter? Any other important settings? 3. Use Mysql or Postgres? Or something else? Hardware questions are: 1. What computer should I use for this task i386 or x86-64? how much memory? disk spaces? 2. What hosting company to buy this server from? Do you have any experience or suggestions to share? Thank you, Valery. ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
On Sun, Sep 25, 2011 at 12:33 PM, Valery Reznic valery_rez...@yahoo.comwrote: Thanks, Shimi. I was thinking about Nginx of lightttpd too. While they may have a serious performance benefits I am very short in time The first time I used Nginx to replace Apache, it took me around 30 minutes to grasp all what's needed to know (which basically is: the default buffer sizes are pretty small; for sites that pass huge cookies / headers, they need to be increased, you might not even need that...). After those 30 minutes, I went from a 12 loadavg and 6GB RAM to 0.5 loadavg with 80MB RAM for my webserver+php ... Nginx is SO MUCH simpler than Apache, the config is *simple*. I do advise you to try it anyways and forget about downtime later. Ever since then, I am not installing any new Apaches, unless it's for things like an SVN server with LDAP authentication, where you need Apache's swissknife. Funny thing is, Apache (from performance/simpleness/resources POV) is probably good for anything *but* simple web serving ;) With Apache configuration I am a bit familiar bit total stranger to the former two. So was I :) So I think, I'll go with Apache for now and replace it with one of them later if I'll experience performance problems. Your call :) Is it make sense to run this service on non-standart http(s) port? You mean security by obscurity ? Always remember that one day corporate firewalls will bite you... Any recommendation about choice MySQL/postgres/whatever? Most comparisons say Postgres is better in almost everything . While that might true, MySQL is probably way more common, and every DB has its own pile of... you know. So for a simple app like the one you're describing, I think the answer would be (contrary to the web server ;)) - go with what you know best... -- Shimi ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
Thanks, Shimi. I was thinking about Nginx of lightttpd too. While they may have a serious performance benefits I am very short in time With Apache configuration I am a bit familiar bit total stranger to the former two. So I think, I'll go with Apache for now and replace it with one of them later if I'll experience performance problems. Is it make sense to run this service on non-standart http(s) port? Any recommendation about choice MySQL/postgres/whatever? Valery. From: shimi linux...@shimi.net To: Valery Reznic valery_rez...@yahoo.com Cc: Linux-IL linux-il@cs.huji.ac.il Sent: Saturday, September 24, 2011 7:50 PM Subject: Re: HW/SW for license server 2011/9/23 Valery Reznic valery_rez...@yahoo.com Hi, All.I think use following software for it 1. CentOS 6 2. Apache with mod_python 3. Mysql As usual I will suggest you use Nginx instead of Apache. Can't see a reason to use Apache unless nginx can't do what you want. Nginx also supports uWSGI[1] if you choose Python as your language. As for where to get a servers, rumors has it that Linode gives nice VPSs, if you go abroad... don't know about good hosting in Israel. HTH, -- Shimi [1] http://wiki.nginx.org/HttpUwsgiModule ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
Thank you Didi. I'll keep it in mind. Valery. From: Yedidyah Bar-David linux...@didi.bardavid.org To: Valery Reznic valery_rez...@yahoo.com Cc: Linux-IL linux-il@cs.huji.ac.il Sent: Saturday, September 24, 2011 11:16 PM Subject: Re: HW/SW for license server On Fri, Sep 23, 2011 at 01:19:51AM -0700, Valery Reznic wrote: Hi, All. I need to setup license server and looking for advice what hardware/software to use General schema is following: There are about 20K clients all of them periodically (let say once a week) query license server for license via https I'll try my best to spread all those requests over the week, but in worse case scenario all those 20K request can came during 1hour, spread relative evenly i.e about 6 request/sec When license server get request it query database ~20K records with 2-3 small fields, generate license and return it to client. License generation is light - md5sum of the very small input ( few hundreds bytes) I think use following software for it 1. CentOS 6 2. Apache with mod_python 3. Mysql Just a short note - make sure you configure mysql to do query caching. google for 'mysql query cache'. It wasn't on by default in centos5, I did not check 6 yet. It has, just as any cache, the potential to improve performance dramatically. -- Didi ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
On Fri, Sep 23, 2011 at 01:19:51AM -0700, Valery Reznic wrote: 1. CentOS 6 2. Apache with mod_python 3. Mysql I'm not sure how it is packaged in Centos6. In Debian the different MPMs of Apache are packaged separately. It is common to use PHP, and mod_php does not work with any multi-threaded MPM. I suspect mod_python does not have those issues. -- Tzafrir Cohen | tzaf...@jabber.org | VIM is http://tzafrir.org.il || a Mutt's tzaf...@cohens.org.il || best tzaf...@debian.org|| friend ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
On Sun, Sep 25, 2011 at 1:28 PM, Valery Reznic valery_rez...@yahoo.comwrote: I am tempted to try :) What do you think is better Nginx or lighttpd? Last time I tried lighttpd, it was a pain over time. It did work, but its memory consumption has been growing. Searching on the net shows memory leaks to be a Known Issue (TM) with this product. But I haven't touched in for quite a while, so I wouldn't know. I don't remember the configuration, but I didn't feel a breeze like in Nginx. I have Nginx running for *months* with pretty much static memory consumption... also, the super-cool feature I like about Nginx is that you can upgrade it's version _without downtime_ i.e. no client is ever refused a request. It does so in a quite intelligent way, by loading the new server by the old one, and transferring the connections from the old one to the new one. For now I see that I'll need https, mod_python, password protected directories. HTTPs CHECK, mod_python, no, mod_* is an Apache thing. In Nginx, the web server does web serving, and the application server (WSGI which I mentioned before), runs the application. Every software does what it does best, which is, IMHO, the Proven Unix Way (TM). Web server connects to backend app server via a well-known protocol, like WSGI or FastCGI, over TCP/IP (so you can separate web serving from App server, and scale up easily), or Unix Socket (if running locally on the same machine...) Got your point about non-standard http ports Let's stick to to the standard. :-) Valery -- Shimi ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
2011/9/23 Valery Reznic valery_rez...@yahoo.com Hi, All. I need to setup license server and looking for advice what hardware/software to use General schema is following: There are about 20K clients all of them periodically (let say once a week) query license server for license via https I'll try my best to spread all those requests over the week, but in worse case scenario all those 20K request can came during 1hour, spread relative evenly i.e about 6 request/sec When license server get request it query database ~20K records with 2-3 small fields, generate license and return it to client. License generation is light - md5sum of the very small input ( few hundreds bytes) I think use following software for it 1. CentOS 6 2. Apache with mod_python 3. Mysql My questions about software are: 1. License server software is likely to be written in python, hence mod_python. If I'll use python as CGI instead of Apache module, will it result in significant performance drop? CGI is preferrable to my POV. 2. How configure apache - what is reasonable settings for MaxClient parameter? Any other important settings? MaxClient 10 will be good starting point 3. Use Mysql or Postgres? Or something else? Anything you know good. DB don't seem to be bottleneck in this case. Note, NOSQL is trendy those days. If it meets your requests MongoDB have nice Python bindings. how much memory? disk spaces? 2. What hosting company to buy this server from? Begin with some known VPS provider, Linode, RackSpace etc.. Do you have any experience or suggestions to share? Prototype, run simulations, and then you'll know demands better. Thank you, Valery. ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il -- So long, and thanks for all the fish. ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
4th is 4gb with iPhone autocorrect. Fuck apple. DL1xx is is HP. Check their site. 1000/sec is special Sent from my iPhone On Sep 25, 2011, at 12:25, Valery Reznic valery_rez...@yahoo.com wrote: Thank you, Mark. A few more questions: - what is HP DL1xx-class box with 4th ram - 6 request/second is trivial. On each ratio do you think it will need something special? Valery From: Marc Volovic marcvolo...@me.com To: Valery Reznic valery_rez...@yahoo.com Sent: Friday, September 23, 2011 12:03 PM Subject: Re: HW/SW for license server Dear valery, 6 requests per second is trivial. Get the cheapest HP DL1xx-class box with 4th ram and the cheapest CPU you can manage. M Sent from my iPhone On Sep 23, 2011, at 11:19, Valery Reznic valery_rez...@yahoo.com wrote: Hi, All. I need to setup license server and looking for advice what hardware/software to use General schema is following: There are about 20K clients all of them periodically (let say once a week) query license server for license via https I'll try my best to spread all those requests over the week, but in worse case scenario all those 20K request can came during 1hour, spread relative evenly i.e about 6 request/sec When license server get request it query database ~20K records with 2-3 small fields, generate license and return it to client. License generation is light - md5sum of the very small input ( few hundreds bytes) I think use following software for it 1. CentOS 6 2. Apache with mod_python 3. Mysql My questions about software are: 1. License server software is likely to be written in python, hence mod_python. If I'll use python as CGI instead of Apache module, will it result in significant performance drop? 2. How configure apache - what is reasonable settings for MaxClient parameter? Any other important settings? 3. Use Mysql or Postgres? Or something else? Hardware questions are: 1. What computer should I use for this task i386 or x86-64? how much memory? disk spaces? 2. What hosting company to buy this server from? Do you have any experience or suggestions to share? Thank you, Valery. ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
2011/9/23 Valery Reznic valery_rez...@yahoo.com Hi, All. I think use following software for it 1. CentOS 6 2. Apache with mod_python 3. Mysql As usual I will suggest you use Nginx instead of Apache. Can't see a reason to use Apache unless nginx can't do what you want. Nginx also supports uWSGI[1] if you choose Python as your language. As for where to get a servers, rumors has it that Linode gives nice VPSs, if you go abroad... don't know about good hosting in Israel. HTH, -- Shimi [1] http://wiki.nginx.org/HttpUwsgiModule ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: HW/SW for license server
On Fri, Sep 23, 2011 at 01:19:51AM -0700, Valery Reznic wrote: Hi, All. I need to setup license server and looking for advice what hardware/software to use General schema is following: There are about 20K clients all of them periodically (let say once a week) query license server for license via https I'll try my best to spread all those requests over the week, but in worse case scenario all those 20K request can came during 1hour, spread relative evenly i.e about 6 request/sec When license server get request it query database ~20K records with 2-3 small fields, generate license and return it to client. License generation is light - md5sum of the very small input ( few hundreds bytes) I think use following software for it 1. CentOS 6 2. Apache with mod_python 3. Mysql Just a short note - make sure you configure mysql to do query caching. google for 'mysql query cache'. It wasn't on by default in centos5, I did not check 6 yet. It has, just as any cache, the potential to improve performance dramatically. -- Didi ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
HW/SW for license server
Hi, All. I need to setup license server and looking for advice what hardware/software to use General schema is following: There are about 20K clients all of them periodically (let say once a week) query license server for license via https I'll try my best to spread all those requests over the week, but in worse case scenario all those 20K request can came during 1hour, spread relative evenly i.e about 6 request/sec When license server get request it query database ~20K records with 2-3 small fields, generate license and return it to client. License generation is light - md5sum of the very small input ( few hundreds bytes) I think use following software for it 1. CentOS 6 2. Apache with mod_python 3. Mysql My questions about software are: 1. License server software is likely to be written in python, hence mod_python. If I'll use python as CGI instead of Apache module, will it result in significant performance drop? 2. How configure apache - what is reasonable settings for MaxClient parameter? Any other important settings? 3. Use Mysql or Postgres? Or something else? Hardware questions are: 1. What computer should I use for this task i386 or x86-64? how much memory? disk spaces? 2. What hosting company to buy this server from? Do you have any experience or suggestions to share? Thank you, Valery.___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
