high traffic Tomcat sites out there?
For my Tomcat cluster I'm looking for an upper limit on the estimation of how much traffic it may face. Say, would thousands of HTTP req/s be too 'astronomical' for a 4-node Dual P4 Xeon cluster to achieve? (I'm talking about dynamic pages such as stock quotes and news) Does anyone know of any high traffic JSP/servlet sites(running Tomcat or similar servlet container)? I'm mostly interested to know what's the typical magnitude of their HTTP throughput (e.g. hundreds or thousands of HTTP/s) and what kinds of apps are they running. Joseph Lam - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: high traffic Tomcat sites out there?
On Mon Nov 22 11:55:08 CET 2004 LAM Kwun Wa Joseph [EMAIL PROTECTED] wrote: For my Tomcat cluster I'm looking for an upper limit on the estimation of how much traffic it may face. Say, would thousands of HTTP req/s be too 'astronomical' for a 4-node Dual P4 Xeon cluster to achieve? (I'm talking about dynamic pages such as stock quotes and news) Does anyone know of any high traffic JSP/servlet sites(running Tomcat or similar servlet container)? I'm mostly interested to know what's the typical magnitude of their HTTP throughput (e.g. hundreds or thousands of HTTP/s) and what kinds of apps are they running. Joseph Lam Hello, I am also interested in some realworld figures. Our configuration is this. 2-node cluster of 2-cpu P4-2.8Ghz machines. The web-application is a database application (with a lot of updates and non-index queries) for logged-in users. We have about 1500 logged in persons doing 70 req/s. Half of the requests go to Tomcat, the other half to Apache for static content. The average (Tomcat) req takes about 250 ms in our system. But I have no idea if this is an high/average/low load compared to other systems. Btw, we are using Tomcat 5.0.28, JDK 1.4.2, Debian Sarge (linux 2.6.x), Apache 1.3.x/mod_jk 1.2.6. Ronald.
Re: high traffic Tomcat sites out there?
250ms response time is rock solid. Getting the total response time lower than 250ms is pretty darn tough. based on your info, that means each tomcat is getting on average 15-16 concurrent requests. one way to improve the response time would be to use smart caching and avoid the cost of making a real insert/update to the database. that will mainly depend on the requirements of your application. 35 pageviews/second is good amount of traffic, but it's not the crazy traffic that yahoo or google support :) then again yahoo and google both have tens of thousands of servers. peter On Mon, 22 Nov 2004 14:36:47 +0100 (CET), Ronald Klop [EMAIL PROTECTED] wrote: On Mon Nov 22 11:55:08 CET 2004 LAM Kwun Wa Joseph [EMAIL PROTECTED] wrote: For my Tomcat cluster I'm looking for an upper limit on the estimation of how much traffic it may face. Say, would thousands of HTTP req/s be too 'astronomical' for a 4-node Dual P4 Xeon cluster to achieve? (I'm talking about dynamic pages such as stock quotes and news) Does anyone know of any high traffic JSP/servlet sites(running Tomcat or similar servlet container)? I'm mostly interested to know what's the typical magnitude of their HTTP throughput (e.g. hundreds or thousands of HTTP/s) and what kinds of apps are they running. Joseph Lam Hello, I am also interested in some realworld figures. Our configuration is this. 2-node cluster of 2-cpu P4-2.8Ghz machines. The web-application is a database application (with a lot of updates and non-index queries) for logged-in users. We have about 1500 logged in persons doing 70 req/s. Half of the requests go to Tomcat, the other half to Apache for static content. The average (Tomcat) req takes about 250 ms in our system. But I have no idea if this is an high/average/low load compared to other systems. Btw, we are using Tomcat 5.0.28, JDK 1.4.2, Debian Sarge (linux 2.6.x), Apache 1.3.x/mod_jk 1.2.6. Ronald. - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: high traffic Tomcat sites out there?
look at the poweredby list http://wiki.apache.org/jakarta-tomcat/PoweredBy the biggest factor in how much bandwidth your 4 node cluster is primarily going to be network bandwidth and database performance. Normally, since buckle due to database crashing. I know of a directory site that gets millions of pageviews per day. Just look at the top 3 and you'll find it. peter On Mon, 22 Nov 2004 18:55:08 +0800 (HKT), LAM Kwun Wa Joseph [EMAIL PROTECTED] wrote: For my Tomcat cluster I'm looking for an upper limit on the estimation of how much traffic it may face. Say, would thousands of HTTP req/s be too 'astronomical' for a 4-node Dual P4 Xeon cluster to achieve? (I'm talking about dynamic pages such as stock quotes and news) Does anyone know of any high traffic JSP/servlet sites(running Tomcat or similar servlet container)? I'm mostly interested to know what's the typical magnitude of their HTTP throughput (e.g. hundreds or thousands of HTTP/s) and what kinds of apps are they running. Joseph Lam - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: high traffic Tomcat sites out there?
We have three Tomcat systems in front of a large database. We use JMeter to test our site, and have pushed each system with 1000 requests per minute and not noticed any problems at all. Our servers only have one processor and 1GB of RAM. The only time we start to see any performance issues is due to the size of the database pool and the responsiveness of the DB connections under extreme load. Your code and the Tomcat config can all effect your performance. In our case, it took a year for us to get our code cleaned up and have enough benchmarks to know we made solid configuration changes for the sake of scalability. Best of luck to you, Al G - Original Message - From: LAM Kwun Wa Joseph [EMAIL PROTECTED] Date: Monday, November 22, 2004 4:55 am Subject: high traffic Tomcat sites out there? For my Tomcat cluster I'm looking for an upper limit on the estimation of how much traffic it may face. Say, would thousands of HTTP req/s be too 'astronomical' for a 4-node Dual P4 Xeon cluster to achieve? (I'm talkingabout dynamic pages such as stock quotes and news) Does anyone know of any high traffic JSP/servlet sites(running Tomcat or similar servlet container)? I'm mostly interested to know what's the typical magnitude of their HTTP throughput (e.g. hundreds or thousandsof HTTP/s) and what kinds of apps are they running. Joseph Lam --- -- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: high traffic Tomcat sites out there?
I would be very careful using tomcat for 'High-Performance' internet applications. You will need to disable keepalives - or use some form of keep-alive proxy to stop tomcat creating too many connections. How many simultaneous users are you planning on having? What operating system are you planning on using - With linux, make sure you use the new threading library - (NPTL). Be careful with the ORB you choose, (should you be using an application server) as it to can create way tooo many threads. Thousands of request/ sec means that you will probably need to have your data in RAM - you may find it difficult to find a database/ filesystem that can deliver you the data quickly enough - would need to know more about the applications. Do not underestimate the problems with keepalives and number of connections/ threads. Regards Andrew Al Gidden wrote: We have three Tomcat systems in front of a large database. We use JMeter to test our site, and have pushed each system with 1000 requests per minute and not noticed any problems at all. Our servers only have one processor and 1GB of RAM. The only time we start to see any performance issues is due to the size of the database pool and the responsiveness of the DB connections under extreme load. Your code and the Tomcat config can all effect your performance. In our case, it took a year for us to get our code cleaned up and have enough benchmarks to know we made solid configuration changes for the sake of scalability. Best of luck to you, Al G - Original Message - From: LAM Kwun Wa Joseph [EMAIL PROTECTED] Date: Monday, November 22, 2004 4:55 am Subject: high traffic Tomcat sites out there? For my Tomcat cluster I'm looking for an upper limit on the estimation of how much traffic it may face. Say, would thousands of HTTP req/s be too 'astronomical' for a 4-node Dual P4 Xeon cluster to achieve? (I'm talkingabout dynamic pages such as stock quotes and news) Does anyone know of any high traffic JSP/servlet sites(running Tomcat or similar servlet container)? I'm mostly interested to know what's the typical magnitude of their HTTP throughput (e.g. hundreds or thousandsof HTTP/s) and what kinds of apps are they running. Joseph Lam --- -- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: high traffic Tomcat sites out there?
Hi, You can search the wiki (there's a who's using Tomcat section) and archives of this list: there are sites that serve hundreds of concurrent requests for long periods of time, and millions of hits per day. Of course, your question itself is not that appropriate, because any answer is meaningless as it does not apply to your specific apps. Go run stress testers and figure out your max supported load for yourselves. Yoav Shapira http://www.yoavshapira.com -Original Message- From: Ronald Klop [mailto:[EMAIL PROTECTED] Sent: Monday, November 22, 2004 8:37 AM To: Tomcat Users List Cc: LAM Kwun Wa Joseph Subject: Re: high traffic Tomcat sites out there? On Mon Nov 22 11:55:08 CET 2004 LAM Kwun Wa Joseph [EMAIL PROTECTED] wrote: For my Tomcat cluster I'm looking for an upper limit on the estimation of how much traffic it may face. Say, would thousands of HTTP req/s be too 'astronomical' for a 4-node Dual P4 Xeon cluster to achieve? (I'm talking about dynamic pages such as stock quotes and news) Does anyone know of any high traffic JSP/servlet sites(running Tomcat or similar servlet container)? I'm mostly interested to know what's the typical magnitude of their HTTP throughput (e.g. hundreds or thousands of HTTP/s) and what kinds of apps are they running. Joseph Lam Hello, I am also interested in some realworld figures. Our configuration is this. 2-node cluster of 2-cpu P4-2.8Ghz machines. The web-application is a database application (with a lot of updates and non-index queries) for logged-in users. We have about 1500 logged in persons doing 70 req/s. Half of the requests go to Tomcat, the other half to Apache for static content. The average (Tomcat) req takes about 250 ms in our system. But I have no idea if this is an high/average/low load compared to other systems. Btw, we are using Tomcat 5.0.28, JDK 1.4.2, Debian Sarge (linux 2.6.x), Apache 1.3.x/mod_jk 1.2.6. Ronald. This e-mail, including any attachments, is a confidential business communication, and may contain information that is confidential, proprietary and/or privileged. This e-mail is intended only for the individual(s) to whom it is addressed, and may not be saved, copied, printed, disclosed or used by anyone else. If you are not the(an) intended recipient, please immediately delete this e-mail from your computer system and notify the sender. Thank you. - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: high traffic Tomcat sites out there?
Joseph, Our site runs using Apache (1.3.x) and Tomcat (4.1.x) on 5 servers using LVS (www.linuxvirtualserver.org) for load balancing. This setup performs over 20M page impressions per month although we do cheat slightly by caching the front page every 60s and letting Apache serve it as a static page. In reality you can make a small app run like a mammoth one if the coding is poor. On the other hand, with the right planning and coding a mammoth app could run like a small one (just consuming more RAM). The only way to know for you app / environment is to perform some sort of testing e.g. httperf. PJ LAM Kwun Wa Joseph wrote: For my Tomcat cluster I'm looking for an upper limit on the estimation of how much traffic it may face. Say, would thousands of HTTP req/s be too 'astronomical' for a 4-node Dual P4 Xeon cluster to achieve? (I'm talking about dynamic pages such as stock quotes and news) Does anyone know of any high traffic JSP/servlet sites(running Tomcat or similar servlet container)? I'm mostly interested to know what's the typical magnitude of their HTTP throughput (e.g. hundreds or thousands of HTTP/s) and what kinds of apps are they running. Joseph Lam - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: high traffic Tomcat sites out there?
On Monday 22 November 2004 15:52, Shapira, Yoav wrote: Of course, your question itself is not that appropriate, because any answer is meaningless as it does not apply to your specific apps. Go run stress testers and figure out your max supported load for yourselves. I tend to agree. You need to do your own research in order to obtain the best configuration for your unique site, taking into account WAN/LAN speeds and such like. Our system is for Internal use only and serves over 600 concurrent sessions country wide and does on average 5 DB queries/insert/update every minute. We are running off a SUN Fire v40z using Tomcat 5, PostgresQL and all running off SuSE Linux 9.2 Professional. The SUN machine currently has 2 CPUs (the other two CPUs are on their way) and has 8GB of RAM. The biggest page we have takes on average 15 seconds to load (remotely), but it took a lot of Tomcat and PostgresQL tweaking to get it that way. I have spent many a night trying various little tweaks to get it just right, too many tweaks and the server gets too slow, too little tweaks and the server gets even slower. What I am trying to say is that there are no fast and hard rules that someone can tell you how many concurrent connections you should be able to serve. There are too many factors involved in this calculation that are unique to you and your site. Good luck. Q -- Quinton Delpeche Internal Systems Developer Softline VIP Telephone: +27 12 420 7000 Direct:+27 12 420 7007 Facsimile: +27 12 420 7344 http://www.vippayroll.co.za/ Sex is a natural bodily process, like a stroke. pgpVvaWTGASxW.pgp Description: PGP signature
