[
https://issues.apache.org/jira/browse/HBASE-19528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351446#comment-16351446
]
stack commented on HBASE-19528:
-------------------------------
[~churromorales] What you think of the hadoop build failures?
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.6.1:compile (default-compile)
on project hbase-server: Compilation failure: Compilation failure:
[ERROR]
/testptch/hbase/hbase-server/src/main/java/org/apache/hadoop/hbase/fs/HFileSystem.java:[49,39]
cannot find symbol
[ERROR] symbol: class BlockStoragePolicy
[ERROR] location: package org.apache.hadoop.hdfs.protocol
[ERROR]
/testptch/hbase/hbase-server/src/main/java/org/apache/hadoop/hbase/fs/HFileSystem.java:[55,53]
cannot find symbol
[ERROR] symbol: class BlockStoragePolicySuite
[ERROR] location: package org.apache.hadoop.hdfs.server.blockmanagement
[ERROR]
/testptch/hbase/hbase-server/src/main/java/org/apache/hadoop/hbase/fs/HFileSystem.java:[477,35]
cannot find symbol
[ERROR] symbol: class BlockStoragePolicySuite
[ERROR] location: class org.apache.hadoop.hbase.fs.HFileSystem
[ERROR]
/testptch/hbase/hbase-server/src/main/java/org/apache/hadoop/hbase/fs/HFileSystem.java:[478,64]
cannot find symbol
[ERROR] symbol: class BlockStoragePolicySuite
[ERROR] location: class org.apache.hadoop.hbase.fs.HFileSystem
[ERROR]
/testptch/hbase/hbase-server/src/main/java/org/apache/hadoop/hbase/fs/HFileSystem.java:[480,40]
cannot find symbol
[ERROR] symbol: method getStoragePolicy()
[ERROR] location: variable status of type
org.apache.hadoop.hdfs.protocol.HdfsFileStatus
[ERROR]
/testptch/hbase/hbase-server/src/main/java/org/apache/hadoop/hbase/fs/HFileSystem.java:[482,13]
cannot find symbol
[ERROR] symbol: class BlockStoragePolicy
[ERROR] location: class org.apache.hadoop.hbase.fs.HFileSystem
[ERROR]
/testptch/hbase/hbase-server/src/main/java/org/apache/hadoop/hbase/fs/HFileSystem.java:[482,48]
cannot find symbol
[ERROR] symbol: method getStoragePolicies()
[ERROR] location: variable dfs of type
org.apache.hadoop.hdfs.DistributedFileSystem
[ERROR]
/testptch/hbase/hbase-server/src/main/java/org/apache/hadoop/hbase/fs/HFileSystem.java:[483,18]
cannot find symbol
[ERROR] symbol: class BlockStoragePolicy
[ERROR] location: class org.apache.hadoop.hbase.fs.HFileSystem
[ERROR] -> [Help 1]
[ERROR]
Using API that is not in the old Hadoops? Thanks.
> Major Compaction Tool
> ----------------------
>
> Key: HBASE-19528
> URL: https://issues.apache.org/jira/browse/HBASE-19528
> Project: HBase
> Issue Type: New Feature
> Reporter: churro morales
> Assignee: churro morales
> Priority: Major
> Fix For: 2.0.0-beta-2
>
> Attachments: 0001-HBASE-19528-Major-Compaction-Tool-ADDENDUM.patch,
> HBASE-19528.branch-1.patch, HBASE-19528.patch, HBASE-19528.v1.branch-1.patch,
> HBASE-19528.v1.patch, HBASE-19528.v2.branch-1.patch,
> HBASE-19528.v2.branch-1.patch, HBASE-19528.v2.branch-1.patch,
> HBASE-19528.v2.branch-1.patch, HBASE-19528.v8.patch
>
>
> The basic overview of how this tool works is:
> Parameters:
> Table
> Stores
> ClusterConcurrency
> Timestamp
> So you input a table, desired concurrency and the list of stores you wish to
> major compact. The tool first checks the filesystem to see which stores need
> compaction based on the timestamp you provide (default is current time). It
> takes that list of stores that require compaction and executes those requests
> concurrently with at most N distinct RegionServers compacting at a given
> time. Each thread waits for the compaction to complete before moving to the
> next queue. If a region split, merge or move happens this tool ensures those
> regions get major compacted as well.
> This helps us in two ways, we can limit how much I/O bandwidth we are using
> for major compaction cluster wide and we are guaranteed after the tool
> completes that all requested compactions complete regardless of moves, merges
> and splits.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
