Hi All,
Can anyone help?
adding few more investigations I have move all files to the destination
cluster hdfs and I have run below command:-
sudo -u hdfs hbase org.apache.hadoop.hbase.mapreduce.Import test_table
hdfs://<IP>:8020/data/ExportedFiles
I am getting below error
17/10/23 16:13:50 INFO mapreduce.Job: Task Id :
attempt_1505781444745_0070_m_000003_0, Status : FAILED
Error: java.io.IOException: keyvalues=NONE read 2 bytes, should read 121347
at
org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:2306)
at
org.apache.hadoop.mapreduce.lib.input.SequenceFileRecordReader.nextKeyValue(SequenceFileRecordReader.java:78)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
can anyone suggest how to migrate data?
Thanks
Manjeet Singh
Hi All,
I have query regarding hbase data migration from one cluster to another
cluster in same N/W, but with a different version of hbase one is 0.94.27
(source cluster hbase) and another is destination cluster hbase version is
1.2.1.
I have used below command to take backup of hbase table on source cluster
is:
./hbase org.apache.hadoop.hbase.mapreduce.Export SPDBRebuild
/data/backupData/
below files were genrated by using above command:-
drwxr-xr-x 3 root root 4096 Dec 9 2016 _logs
-rw-r--r-- 1 root root 788227695 Dec 16 2016 part-m-00000
-rw-r--r-- 1 root root 1098757026 Dec 16 2016 part-m-00001
-rw-r--r-- 1 root root 906973626 Dec 16 2016 part-m-00002
-rw-r--r-- 1 root root 1981769314 Dec 16 2016 part-m-00003
-rw-r--r-- 1 root root 2099785782 Dec 16 2016 part-m-00004
-rw-r--r-- 1 root root 4118835540 Dec 16 2016 part-m-00005
-rw-r--r-- 1 root root 14217981341 Dec 16 2016 part-m-00006
-rw-r--r-- 1 root root 0 Dec 16 2016 _SUCCESS
in order to restore these files I am assuming I have to move these files in
destination cluster and have to run below command
hbase org.apache.hadoop.hbase.mapreduce.Import <tablename> /data/backupData/
Please suggest if I am on correct direction, second if anyone have another
option.
I have tryed this with test data but above command took very long time and
at end it gets fails
17/10/23 11:54:21 INFO mapred.JobClient: map 0% reduce 0%
17/10/23 12:04:24 INFO mapred.JobClient: Task Id :
attempt_201710131340_0355_m_000002_0, Status : FAILED
Task attempt_201710131340_0355_m_000002_0 failed to report status for 600
seconds. Killing!
Thanks
Manjeet Singh
--
luv all
