RE: yarn spark job submit problem

2017-01-09 Thread Chinnappan Chandrasekaran
Hi I suspect the code wrong, try the following file:///home/spark/spark-1.5.1-bin-hadoop2.6/local/spark-b9c155cf-4624-4c68-9d0d-d3b9d5748601/__spark_conf__6786864409197988390.zip Regards Chandrasekaran Technical Consultant Big Data & Analytics Business Solution Group Jardine OneSolution (2001)

Cloudera Manager 5.7.1

2016-06-22 Thread Chinnappan Chandrasekaran
Dear all, I have installed cloudera manager 5.7.1 with 5 node installed then I have added one more node and commissioned. Later I try to remove the particular node using decommission, remove from cluster and delete. When I refresh the home page the deleted node appear again. Also I having prob

RE: Sqoop import Mysql to hive import Partitions

2016-02-04 Thread Chinnappan Chandrasekaran
sqoop import --table tablename\ --connect jdbc:mysql:servername\dbname --username dbuser --password pw \ --fields-terminated-by "\t" -- hive-partition-key -- hive-import /--hive-partition-key is Name of a hive field to partition are sharded on Thanks & Regards Chandrasekaran Technical Consulta

RE: Getting ERROR 2118: Permission denied: while running PIG script using HCATALOG

2015-12-29 Thread Chinnappan Chandrasekaran
Try this $ chown username:groupname /user/hive/warehouse/ -R Thanks & Regards Chandrasekaran Technical Consultant Business Solutions Group Jardine OneSolution (2001) Pte Ltd Tel +65 6551 9608 | Mobile +65 8138 4761 | Email chiranchan...@jos.com.sg 55, Ubi Av

HA Hadoop 2.6.0

2015-10-07 Thread Chinnappan Chandrasekaran
Hi All, I have configured High Availably Hadoop 2.6.0 environment. But it is not automatically fired failover Manual Failover successfully fired hdfs haadmin -failover M1031 m1032 All its configuration done perfect. Chandrasekaran Technical Consultant Business Solutions Group Jardine OneS

RE: Copy Data From HDFS to FTP

2015-08-23 Thread Chinnappan Chandrasekaran
hadoop fs -cp ftp://userid@youipaddress/directory From: unmesha sreeveni [mailto:unmeshab...@gmail.com] Sent: Monday, 24 August, 2015 12:45 PM To: User Hadoop Subject: Copy Data From HDFS to FTP Hi How can I copy my HDFS data to an FTP server? -- Thanks & Regards Unmesha Sreeveni U.B Hadoop,

RE: Unable to use ./hdfs dfsadmin -report with HDFS Federation

2015-08-23 Thread Chinnappan Chandrasekaran
hdfs dfsadmin -report The above command will show entire cluster status From: Todd [mailto:bit1...@163.com] Sent: Monday, 24 August, 2015 11:54 AM To: user@hadoop.apache.org Subject: Unable to use ./hdfs dfsadmin -report with HDFS Federation Hi, our hadoop cluster is using HDFS Federation, but

RE: Hadoop logs show "Not scanning suspicious block"

2015-08-06 Thread Chinnappan Chandrasekaran
Hi This might be a Namespace id mapping problem. you should remove the version .../data/..current/VERSION file from the data location (if multimode remove everything) and format format your name node Note: if it is production please think about more. Regards chiranchandra From: mohit.ka