Use a UUID for HFileOutputFormat partition path name
----------------------------------------------------
Key: HBASE-4992
URL: https://issues.apache.org/jira/browse/HBASE-4992
Project: HBase
Issue Type: Bug
Components: mapreduce
Reporter: Scott Chen
Priority: Minor
HFileOutputFormat uses timestamps for the path name to avoid collision.
It is possible the path name still collide and causing MR job fails.
Caused by: java.io.IOException: File:
hdfs://ubasedev001-snc3-dfs-nn.data.facebook.com:9000/user/hadoop/partitions_1316142976586#_\
partition.lst has changed on HDFS since job started
at
org.apache.hadoop.filecache.DistributedCache.ifExistsAndFresh(DistributedCache.java:572)
at
org.apache.hadoop.filecache.DistributedCache.checkCacheStatusValidity(DistributedCache.java:465)
at
org.apache.hadoop.filecache.DistributedCache.getLocalCache(DistributedCache.java:230)
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:208)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
