Aditya Kishore created HBASE-6455:
-------------------------------------
Summary: org.apache.hadoop.hbase.PerformanceEvaluation sets the
map reduce output path as a child of input path
Key: HBASE-6455
URL: https://issues.apache.org/jira/browse/HBASE-6455
Project: HBase
Issue Type: Bug
Components: performance
Affects Versions: 0.94.0, 0.96.0
Reporter: Aditya Kishore
Assignee: Aditya Kishore
Priority: Minor
Attachments: HBASE-6455_trunk.patch
I was the running PerformanceEvaluation test with a modified job configuration
where the job output path is created before the splits and that unmasked the
issue because the the PeInputFormat.getSplits() function expects to find only
files under the input path.
The attached patch addresses both the issues.
# Creates separate input and output path rooted under a single folder e.g.
"<user_home>/performance_evaluation/<yyyyMMddHHmmss>/inputs" and
"<user_home>/performance_evaluation/<yyyyMMddHHmmss>/outputs", and
# The PeInputFormat.getSplits(), now skips any folder found under the input
path and process only files.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira