Hi, What does « 1.3 for overhead » mean in this calculation ?
Regards From: Mirko Kämpf [mailto:[email protected]] Sent: Wednesday 9 July 2014 18:09 To: [email protected] Subject: Re: Need to evaluate a cluster Hello, if I follow your numbers I see one missing fact: What is the number of HDDs per DataNode? Let's assume you use machines with 6 x 3TB HDDs per box, you would need about 60 DataNodes per year (0.75 TB per day x 3 for replication x 1.3 for overhead / ( nr of HDDs per node x capacity per HDD )). With 12 HDD you would only need 30 servers per year. How did you calculate the number of 367 datanodes? Cheers, Mirko 2014-07-09 17:59 GMT+02:00 YIMEN YIMGA Gael <[email protected]<mailto:[email protected]>>: Hello Dear, I made an estimation of a number of nodes of a cluster that can be supplied by 720GB of data/day. My estimation gave me 367 datanodes in a year. I’m a bit afraid by that amount of datanodes. The assumptions, I used are the followings : - Daily supply (feed) : 720GB - HDFS replication factor: 3 - Booked space for each disk outside HDFS: 30% - Size of a disk: 3TB. I have two questions. First, I would like to know if my assumptions are well taken? Secondly, could someone help me to evaluate that cluster, to let me be sure that my results are not to excessive, please ? Standing by for your feedback Warm regard ************************************************************************* This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information. Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration. Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified. Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products. ************ Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes par le secret professionnel. Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite. Tout message electronique est susceptible d'alteration. La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie. Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives. *************************************************************************
