[
https://issues.apache.org/jira/browse/HBASE-24111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077203#comment-17077203
]
Hudson commented on HBASE-24111:
--------------------------------
Results for branch master
[build #1691 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/1691/]: (x)
*{color:red}-1 overall{color}*
----
details (if available):
(x) {color:red}-1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1691/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1691/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1691/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1691/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
-- Something went wrong with this stage, [check relevant console
output|https://builds.apache.org/job/HBase%20Nightly/job/master/1691//console].
> Enable CompactionTool executions on non-HDFS filesystems
> --------------------------------------------------------
>
> Key: HBASE-24111
> URL: https://issues.apache.org/jira/browse/HBASE-24111
> Project: HBase
> Issue Type: Improvement
> Components: Compaction, mapreduce, tooling
> Reporter: Peter Somogyi
> Assignee: Peter Somogyi
> Priority: Major
> Fix For: 3.0.0, 2.3.0, 2.4.0, 2.2.5
>
>
> CompactionTool on non-HDFS filesystems does not work because the used
> filesystems are mixed up. To collect the StoreFiles the
> {{Filesystem.get(conf)}} method is used instead of relying on the root dir
> filesystem.
> With YARN the delegation tokens are not handled correctly with a different
> filesystem and the mappers only get delegation token for the staging
> directory's filesystem.
> Another issue is in MapReduce mode when YARN is used. In this case the TMP
> directory ({{hbase.tmp.dir}}) is created under
> {{yarn.nodemanager.local-dirs}} but this directory is created (even on HDFS a
> regular user can't create this directory) on the Storefile's filesystem where
> a local filesystem temp directory shouldn't be used.
> In this ticket I plan to clean up the used filesystems, remove the custom
> temp directory (use the regions' .tmp directory) and collect delegation
> tokens for staging dir + store dir paths' FileSystems.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
