[jira] [Updated] (HBASE-5663) MultithreadedTableMapper doesn't work.
[
https://issues.apache.org/jira/browse/HBASE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhihong Yu updated HBASE-5663:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
MultithreadedTableMapper doesn't work.
--
Key: HBASE-5663
URL: https://issues.apache.org/jira/browse/HBASE-5663
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 0.94.0
Reporter: Takuya Ueshin
Assignee: Takuya Ueshin
Fix For: 0.94.0, 0.96.0
Attachments: 5663+5636.txt, HBASE-5663.patch
MapReduce job using MultithreadedTableMapper goes down throwing the following
Exception:
{noformat}
java.io.IOException: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:260)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper.run(MultithreadedTableMapper.java:133)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at java.lang.Class.getConstructor0(Class.java:2706)
at java.lang.Class.getConstructor(Class.java:1657)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:241)
... 8 more
{noformat}
This occured when the tasks are creating MapRunner threads.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5663) MultithreadedTableMapper doesn't work.
[
https://issues.apache.org/jira/browse/HBASE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated HBASE-5663:
-
Attachment: HBASE-5663.patch
I attached a patch file.
Could someone please review and refactor it?
I think this is a little dirty code but I couldn't find a better way.
MultithreadedTableMapper doesn't work.
--
Key: HBASE-5663
URL: https://issues.apache.org/jira/browse/HBASE-5663
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 0.94.0
Reporter: Takuya Ueshin
Attachments: HBASE-5663.patch
MapReduce job using MultithreadedTableMapper goes down throwing the following
Exception:
{noformat}
java.io.IOException: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:260)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper.run(MultithreadedTableMapper.java:133)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at java.lang.Class.getConstructor0(Class.java:2706)
at java.lang.Class.getConstructor(Class.java:1657)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:241)
... 8 more
{noformat}
This occured when the tasks are creating MapRunner threads.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5663) MultithreadedTableMapper doesn't work.
[
https://issues.apache.org/jira/browse/HBASE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhihong Yu updated HBASE-5663:
--
Hadoop Flags: Reviewed
Status: Patch Available (was: Open)
MultithreadedTableMapper doesn't work.
--
Key: HBASE-5663
URL: https://issues.apache.org/jira/browse/HBASE-5663
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 0.94.0
Reporter: Takuya Ueshin
Attachments: HBASE-5663.patch
MapReduce job using MultithreadedTableMapper goes down throwing the following
Exception:
{noformat}
java.io.IOException: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:260)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper.run(MultithreadedTableMapper.java:133)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at java.lang.Class.getConstructor0(Class.java:2706)
at java.lang.Class.getConstructor(Class.java:1657)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:241)
... 8 more
{noformat}
This occured when the tasks are creating MapRunner threads.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5663) MultithreadedTableMapper doesn't work.
[
https://issues.apache.org/jira/browse/HBASE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhihong Yu updated HBASE-5663:
--
Attachment: 5663+5636.txt
Combined patch for HBASE-5663 and HBASE-5636
MultithreadedTableMapper doesn't work.
--
Key: HBASE-5663
URL: https://issues.apache.org/jira/browse/HBASE-5663
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 0.94.0
Reporter: Takuya Ueshin
Attachments: 5663+5636.txt, HBASE-5663.patch
MapReduce job using MultithreadedTableMapper goes down throwing the following
Exception:
{noformat}
java.io.IOException: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:260)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper.run(MultithreadedTableMapper.java:133)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at java.lang.Class.getConstructor0(Class.java:2706)
at java.lang.Class.getConstructor(Class.java:1657)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:241)
... 8 more
{noformat}
This occured when the tasks are creating MapRunner threads.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5663) MultithreadedTableMapper doesn't work.
[
https://issues.apache.org/jira/browse/HBASE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhihong Yu updated HBASE-5663:
--
Fix Version/s: 0.96.0
0.94.0
MultithreadedTableMapper doesn't work.
--
Key: HBASE-5663
URL: https://issues.apache.org/jira/browse/HBASE-5663
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 0.94.0
Reporter: Takuya Ueshin
Fix For: 0.94.0, 0.96.0
Attachments: 5663+5636.txt, HBASE-5663.patch
MapReduce job using MultithreadedTableMapper goes down throwing the following
Exception:
{noformat}
java.io.IOException: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:260)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper.run(MultithreadedTableMapper.java:133)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at java.lang.Class.getConstructor0(Class.java:2706)
at java.lang.Class.getConstructor(Class.java:1657)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:241)
... 8 more
{noformat}
This occured when the tasks are creating MapRunner threads.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5663) MultithreadedTableMapper doesn't work.
[
https://issues.apache.org/jira/browse/HBASE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated HBASE-5663:
-
Affects Version/s: (was: 0.92.1)
0.94.0
MultithreadedTableMapper doesn't work.
--
Key: HBASE-5663
URL: https://issues.apache.org/jira/browse/HBASE-5663
Project: HBase
Issue Type: Bug
Components: mapreduce
Affects Versions: 0.94.0
Reporter: Takuya Ueshin
MapReduce job using MultithreadedTableMapper goes down throwing the following
Exception:
{noformat}
java.io.IOException: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:260)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper.run(MultithreadedTableMapper.java:133)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.NoSuchMethodException:
org.apache.hadoop.mapreduce.Mapper$Context.init(org.apache.hadoop.conf.Configuration,
org.apache.hadoop.mapred.TaskAttemptID,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordReader,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapRecordWriter,
org.apache.hadoop.hbase.mapreduce.TableOutputCommitter,
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$SubMapStatusReporter,
org.apache.hadoop.hbase.mapreduce.TableSplit)
at java.lang.Class.getConstructor0(Class.java:2706)
at java.lang.Class.getConstructor(Class.java:1657)
at
org.apache.hadoop.hbase.mapreduce.MultithreadedTableMapper$MapRunner.init(MultithreadedTableMapper.java:241)
... 8 more
{noformat}
This occured when the tasks are creating MapRunner threads.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
