[ 
https://issues.apache.org/jira/browse/HBASE-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453002#comment-13453002
 ] 

Michael Drzal commented on HBASE-6455:
--------------------------------------

[[email protected]] can we close this out?
                
> org.apache.hadoop.hbase.PerformanceEvaluation sets the map reduce output path 
> as a child of input path
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-6455
>                 URL: https://issues.apache.org/jira/browse/HBASE-6455
>             Project: HBase
>          Issue Type: Bug
>          Components: performance
>    Affects Versions: 0.94.0, 0.96.0
>            Reporter: Aditya Kishore
>            Assignee: Aditya Kishore
>            Priority: Minor
>              Labels: benchmark
>             Fix For: 0.96.0
>
>         Attachments: HBASE-6455_trunk.patch
>
>
> I was the running PerformanceEvaluation test with a modified job 
> configuration where the job output path is created before the splits and that 
> unmasked the issue because the the PeInputFormat.getSplits() function expects 
> to find only files under the input path.
> The attached patch addresses both the issues.
> # Creates separate input and output path rooted under a single folder e.g. 
> "<user_home>/performance_evaluation/<yyyyMMddHHmmss>/inputs" and  
> "<user_home>/performance_evaluation/<yyyyMMddHHmmss>/outputs", and
> # The PeInputFormat.getSplits(), now skips any folder found under the input 
> path and process only files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to