[
https://issues.apache.org/jira/browse/HBASE-24111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Dimiduk updated HBASE-24111:
---------------------------------
Fix Version/s: (was: 2.4.0)
> Enable CompactionTool executions on non-HDFS filesystems
> --------------------------------------------------------
>
> Key: HBASE-24111
> URL: https://issues.apache.org/jira/browse/HBASE-24111
> Project: HBase
> Issue Type: Improvement
> Components: Compaction, mapreduce, tooling
> Reporter: Peter Somogyi
> Assignee: Peter Somogyi
> Priority: Major
> Fix For: 3.0.0-alpha-1, 2.3.0, 2.2.5
>
>
> CompactionTool on non-HDFS filesystems does not work because the used
> filesystems are mixed up. To collect the StoreFiles the
> {{Filesystem.get(conf)}} method is used instead of relying on the root dir
> filesystem.
> With YARN the delegation tokens are not handled correctly with a different
> filesystem and the mappers only get delegation token for the staging
> directory's filesystem.
> Another issue is in MapReduce mode when YARN is used. In this case the TMP
> directory ({{hbase.tmp.dir}}) is created under
> {{yarn.nodemanager.local-dirs}} but this directory is created (even on HDFS a
> regular user can't create this directory) on the Storefile's filesystem where
> a local filesystem temp directory shouldn't be used.
> In this ticket I plan to clean up the used filesystems, remove the custom
> temp directory (use the regions' .tmp directory) and collect delegation
> tokens for staging dir + store dir paths' FileSystems.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
