Re: install bigtop hadoop on a t2.micro instance

2014-11-16 Thread Olivier Renault
After formatting the namenode, it will shutdown, you will then need to start it again. It looks like the init script with the init command is just formatting the namenode. Do you get an error when starting the namenode ? Also may I ask why you've installed 2.0.5-alpha ? The latest stable is

Configure Rack Numbers

2014-11-16 Thread Abdul Navaz
Hello, I have hadoop cluster with 9 nodes. All belongs to /default racks. But I want the setup something similar to this. (All are in same subnets) Rack 0: DataNode1,Datanode2,DataNode3 and top of rack switch1. Rack 1: DataNode4,Datanode5,DataNode6 and top of rack switch2. Rack 3:

Values getting duplicated in Hive table(Partitioned)

2014-11-16 Thread unmesha sreeveni
I created a Hive table with *partition* and inserted data into Partioned Hive table. Refered site https://blog.safaribooksonline.com/2012/12/03/tip-partitioning-data-in-hive/ 1. *Initially created one Non -partioned table and then using select query and loaded data into partioned

RE: Configure Rack Numbers

2014-11-16 Thread Brahma Reddy Battula
Hi Navaz, you have to configure the following two properties in namenode(after that you need to restart the namenode). property nametopology.node.switch.mapping.impl/name valueorg.apache.hadoop.net.ScriptBasedMapping/value description The default implementation of the DNSToSwitchMapping.

Re: Configure Rack Numbers

2014-11-16 Thread Serge Blazhievsky
The effective technique to fix block distribution after changes in rack awareness is to increase replication factor and decrease it back Regards, Serge On Nov 16, 2014, at 21:10, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Hi Navaz, you have to configure the following

Fwd: Values getting duplicated in Hive table(Partitioned)

2014-11-16 Thread unmesha sreeveni
In non partitioned table I am getting the correct values. Is my update query wrong? INSERT OVERWRITE TABLE Unm_Parti_Trail PARTITION (Department = 'A') SELECT employeeid,firstname,designation, CASE WHEN employeeid=19 THEN '5 ELSE salary END AS salary FROM Unm_Parti_Trail; What I tried to