+1. We actually went through this pain Not only did we separate them out, but we moved Zookeeper to physical machines. (instead of virtual) If this is a production system, I would keep them separate and stick with the 9.
-brian --- Brian O'Neill Chief Technology Officer Health Market Science, a LexisNexis Company 215.588.6024 Mobile @boneill42 <http://www.twitter.com/boneill42> This information transmitted in this email message is for the intended recipient only and may contain confidential and/or privileged material. If you received this email in error and are not the intended recipient, or the person responsible to deliver it to the intended recipient, please contact the sender at the email above and delete this email and any attachments and destroy any copies thereof. Any review, retransmission, dissemination, copying or other use of, or taking any action in reliance upon, this information by persons or entities other than the intended recipient is strictly prohibited. From: Harsha <[email protected]> Reply-To: <[email protected]> Date: Monday, March 9, 2015 at 11:05 AM To: "<Adaryl Bob Wakefield>", MBA <[email protected]>, <[email protected]> Subject: Re: Lamda architecture and multi-tenancy Adaryl, IMO I would suggest you to go with 9 machines . The reason being both Kafka and Zookeeper are disk intensive putting both on the same machine is risky and not a best practice. Also Storm & Kafka both are heavy users zookeeper i.e frequent updates and reads from zookeeper. Having all of them on the same machines is risky and performance will suffer. -Harsha > > > > On March 8, 2015 at 11:26:05 PM, Adaryl Bob Wakefield, MBA > ([email protected]) wrote: >> >> Let¹s say you put together a real time streaming solution using Storm, Kafka, >> and the necessary Zookeeper and whatever storage tech you decide. Is it true >> that these applications are so resource intensive that they all need to live >> by themselves on their own machine? Put another way, for the ingestion >> portion, is the minimum number of machines required here 9? >> >> Adaryl "Bob" Wakefield, MBA >> Principal >> Mass Street Analytics, LLC >> 913.938.6685 >> www.linkedin.com/in/bobwakefieldmba >> Twitter: @BobLovesData
