Hi Samarth -
AFAIK we've never actually tested Whirr with VPC. I guess you can make it work eventually but probably you will need to make many changes. Can you tell me a bit more about your use case? Why VPC and not standard EC2? -- Andrei Savu - https://www.linkedin.com/in/sandrei On Mon, Oct 28, 2013 at 10:10 PM, Samarth Gupta <samarthgupta...@gmail.com>wrote: > Hi, > > I have launched cluster using whirr and tried using HDFS API's to transfer > data on the started cluster. However got the following error : > > "There are 1 datanode(s) running and 1 node(s) are excluded from the > operation" > > which was same as > http://stackoverflow.com/questions/14544055/copyfromlocalfile-doesnt-work-in-cdh4 > > > On setting up VPC and VPN and launching cluster through whirr i faced the > problem of "No default VPC assigned" , for which i made a change a whirr > source code and passed the VPC ID while launching clusters. > > I was able to start the cluster using the same, but faced trouble in : > > 1. Configuration scripts for installing hadoop were unsuccessful > 2. Security groups API was throwing error since VPC already had a assigned > security group and whirr was trying to create one more. > > > I wanted to check, if anyone is using whirr with AWS VPC and help me with > the same ... > > Thanks: > Samarth >
