a LayoutVersion support SNAPSHOT, it must support
FSIMAGE_NAME_OPTIMIZATION. (szetszwo)
+HDFS-7260. Change DFSOutputStream.MAX_PACKETS to be configurable.
(szetszwo)
+
BREAKDOWN OF HDFS-6581 SUBTASKS AND RELATED JIRAS
HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit
a LayoutVersion support SNAPSHOT, it must support
FSIMAGE_NAME_OPTIMIZATION. (szetszwo)
+HDFS-7260. Change DFSOutputStream.MAX_PACKETS to be configurable.
(szetszwo)
+
BREAKDOWN OF HDFS-6581 SUBTASKS AND RELATED JIRAS
HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal
replication when a DN storage fails.
+(Ming Ma via szetszwo)
+
BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
HDFS-6387. HDFS CLI admin tool for creating deleting an
http://git-wip-us.apache.org/repos/asf/hadoop/blob/41980c56/hadoop-hdfs-project/hadoop-hdfs
-7185. The active NameNode will not accept an fsimage sent from the
standby during rolling upgrade. (jing9)
+HDFS-7208. NN doesn't schedule replication when a DN storage fails.
+(Ming Ma via szetszwo)
+
BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
schedule replication when a DN storage fails.
+(Ming Ma via szetszwo)
+
BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
HDFS-6387. HDFS CLI admin tool for creating deleting an
http://git-wip-us.apache.org/repos/asf/hadoop/blob/603293da/hadoop-hdfs-project
-project/hadoop-hdfs/CHANGES.txt
@@ -962,6 +962,9 @@ Release 2.6.0 - UNRELEASED
HDFS-7208. NN doesn't schedule replication when a DN storage fails.
(Ming Ma via szetszwo)
+HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support
+FSIMAGE_NAME_OPTIMIZATION. (szetszwo
-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -610,6 +610,9 @@ Release 2.6.0 - UNRELEASED
HDFS-7208. NN doesn't schedule replication when a DN storage fails.
(Ming Ma via szetszwo)
+HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support
+FSIMAGE_NAME_OPTIMIZATION. (szetszwo
/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -567,6 +567,9 @@ Release 2.6.0 - UNRELEASED
HDFS-7208. NN doesn't schedule replication when a DN storage fails.
(Ming Ma via szetszwo)
+HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support
+FSIMAGE_NAME_OPTIMIZATION
. The command hdfs namenode -rollingUpgrade throws
+ArrayIndexOutOfBoundsException. (szetszwo)
+
BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
HDFS-6387. HDFS CLI admin tool for creating deleting an
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f6d0b889/hadoop
. The command hdfs namenode -rollingUpgrade throws
+ArrayIndexOutOfBoundsException. (szetszwo)
+
BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
HDFS-6387. HDFS CLI admin tool for creating deleting an
http://git-wip-us.apache.org/repos/asf/hadoop/blob
method for each NFS response.
(Brandon Li via wheat9)
+HDFS-7169. Add SE_BAD_FIELD to findbugsExcludeFile.xml. (szetszwo)
+
OPTIMIZATIONS
HDFS-6690. Deduplicate xattr names in memory. (wang)
http://git-wip-us.apache.org/repos/asf/hadoop/blob/3affad9e/hadoop-hdfs-project/hadoop
parser method for each NFS response.
(Brandon Li via wheat9)
+HDFS-7169. Add SE_BAD_FIELD to findbugsExcludeFile.xml. (szetszwo)
+
OPTIMIZATIONS
HDFS-6690. Deduplicate xattr names in memory. (wang)
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e5e9cf21/hadoop-hdfs-project
)
- BREAKDOWN OF HDFS-6584 ARCHIVAL STORAGE
-
-HDFS-6677. Change INodeFile and FSImage to support storage policy ID.
-(szetszwo)
-
-HDFS-6670. Add block storage policy support with default HOT, WARM and COLD
-policies. (szetszwo)
-
-HDFS-6671. Change BlockPlacementPolicy
http://git-wip-us.apache.org/repos/asf/hadoop/blob/022474c8/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/022474c8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/022474c8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/util/EnumCounters.java
--
diff --git
to support storage policy ID.
+(szetszwo)
+
+HDFS-6670. Add block storage policy support with default HOT, WARM and COLD
+policies. (szetszwo)
+
+HDFS-6671. Change BlockPlacementPolicy to consider block storage policy
+in replicaiton. (szetszwo)
+
+HDFS-6710. Change
http://git-wip-us.apache.org/repos/asf/hadoop/blob/022474c8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/mover/Mover.java
--
diff --git
Repository: hadoop
Updated Branches:
refs/heads/branch-2 fd3aa3823 - 022474c80
http://git-wip-us.apache.org/repos/asf/hadoop/blob/022474c8/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java
..2c6bf0e 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
+++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -6,8 +6,8 @@ Release 2.6.0 - UNRELEASED
NEW FEATURES
-HDFS-6584. Support archival storage; see the detail subtasks in the
-breakdown section. (szetszwo)
+HDFS-6584
-HDFS-6584: Archival Storage
-
-HDFS-6677. Change INodeFile and FSImage to support storage policy ID.
-(szetszwo)
-
-HDFS-6670. Add block storage policy support with default HOT, WARM and COLD
-policies. (szetszwo)
-
-HDFS-6671. Change BlockPlacementPolicy to consider block
/CHANGES.txt
+++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -698,6 +698,8 @@ Release 2.6.0 - UNRELEASED
HDFS-7088. Archival Storage: fix TestBalancer and
TestBalancerWithMultipleNameNodes. (szetszwo via jing9)
+HDFS-7095. TestStorageMover often fails in Jenkins. (jing9)
+
Release
HDFS-7081. Add new DistributedFileSystem API for getting all the existing
storage policies. Contributed by Jing Zhao.
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HDFS-7140. Add a tool to list all the existing block storage policies.
Contributed by Jing Zhao.
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 ba3182c60 - 87f07e67b
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f83096d4/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSAdmin.java
/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
index a888da2..8719849 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
+++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -73,6 +73,9 @@ HDFS-6584: Archival Storage
HDFS-6864. Archival Storage: add user documentation. (szetszwo via jing9
HADOOP-11065. Rat check should exclude **/build/**. (kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ba4fc931
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ba4fc931
Diff:
Repository: hadoop
Updated Branches:
refs/heads/trunk fad4cd85b - 98f7bfe99
Merging r1617377 through r1617565 from trunk.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617566
13f79535-47bb-0310-9956-ffa450edef68
Project:
HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c828b8aa
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c828b8aa
Diff:
HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs
(aw)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a149afd9
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a149afd9
Diff:
Merge changes from trunk
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/432b8637
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/432b8637
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/432b8637
Branch:
HDFS-6906. Archival Storage: Add more tests for BlockStoragePolicy. Contributed
by Tsz Wo Nicholas Sze.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619628
13f79535-47bb-0310-9956-ffa450edef68
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Merge trunk into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8de20a19
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8de20a19
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/8de20a19
Merge branch 'trunk' into HDFS-6584
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HDFS-7062. Archival Storage: skip under construction block for migration.
Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2689b6ca
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2689b6ca
HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c5ef9c9e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c5ef9c9e
Diff:
HDFS-6969. Archival Storage: INode#getStoragePolicyID should always return the
latest storage policy. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3e2a0b54
Tree:
HDFS-6961. Archival Storage: BlockPlacementPolicy#chooseTarget should check
each valid storage type in each choosing round.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e08701ec
Tree:
HDFS-7028: FSDirectory should not get storage policy id from symlinks
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4124905a
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4124905a
Diff:
Merge remote-tracking branch 'origin/trunk' into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6997c1c6
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6997c1c6
Diff:
Merge trunk into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/300cb12b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/300cb12b
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/300cb12b
HDFS-7039. Archival Storage: fix Balancer tests. Contributed by Tsz Wo Nicholas
Sze.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dc27ee9a
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/dc27ee9a
Diff:
Merge remote-tracking branch 'origin/trunk' into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ece3ecab
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ece3ecab
Diff:
HDFS-7052. Archival Storage: Add Mover into hdfs script. Contributed by Jing
Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2e4033e8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2e4033e8
Diff:
Merge changes from trunk
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/db41a1b7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/db41a1b7
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/db41a1b7
Branch:
HDFS-6801. Archival Storage: Add a new data migration tool. Contributed by Tsz
Wo Nicholas Sze.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618675
13f79535-47bb-0310-9956-ffa450edef68
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Merge r1609845 through r1618416 from trunk.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618417
13f79535-47bb-0310-9956-ffa450edef68
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HDFS-7034. Archival Storage: Fix TestBlockPlacement and TestStorageMover.
Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0d85f7e5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0d85f7e5
HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2cd5b4f2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2cd5b4f2
Diff:
@@ HDFS-6584: Archival Storage
HDFS-6847. Support storage policy on directories and include storage
policy
in HdfsFileStatus. (Jing Zhao via szetszwo)
+HDFS-7072. Fix TestBlockManager and TestStorageMover. (Jing Zhao
+via szetszwo)
+
Trunk (Unreleased)
INCOMPATIBLE
Merge branch 'trunk' into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/70dfe9cf
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/70dfe9cf
Diff:
Merge branch 'trunk' into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dba52ce0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/dba52ce0
Diff:
HDFS-7029. Archival Storage: fix TestDFSInotifyEventInputStream and
TestDistributedFileSystem. Contributed by Tsz Wo Nicholas Sze.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/867f0f14
Tree:
HDFS-6997: add more tests for data migration and replicaion.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/22a41dce
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/22a41dce
Diff:
Merge r1609845 through r1618763 from trunk.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618764
13f79535-47bb-0310-9956-ffa450edef68
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Fix TestOfflineEditsViewer after merging.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/54767d3f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/54767d3f
Diff:
HDFS-6863. Archival Storage: Support migration for snapshot paths. Contributed
by Jing Zhao.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619627
13f79535-47bb-0310-9956-ffa450edef68
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HDFS-6998. warning message 'ssl.client.truststore.location has not been set'
gets printed for hftp command. (Contributed by Xiaoyu Yao)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fc683370
Tree:
: Archival Storage
HDFS-6686. Change BlockPlacementPolicy to use fallback when some storage
types are unavailable. (szetszwo)
+HDFS-6847. Support storage policy on directories and include storage
policy
+in HdfsFileStatus. (Jing Zhao via szetszwo)
+
Trunk (Unreleased
HDFS-6875. Archival Storage: support migration for a list of specified paths.
Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2b5c528a
Tree:
Merge r1609845 through r1619277 from trunk.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619293
13f79535-47bb-0310-9956-ffa450edef68
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Merge changes from trunk
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/45d5b132
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/45d5b132
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/45d5b132
Branch:
Merge changes from trunk
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/911979c8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/911979c8
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/911979c8
Branch:
-project/hadoop-hdfs/CHANGES.txt
+++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -20,11 +20,56 @@ HDFS-6584: Archival Storage
HDFS-6686. Change BlockPlacementPolicy to use fallback when some storage
types are unavailable. (szetszwo)
+HDFS-6835. Add a new API to set storage policy
HDFS-6920. Archival Storage: check the storage type of delNodeHintStorage when
deleting a replica. Contributed by Tsz Wo Nicholas Sze.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b7ded466
Tree:
HDFS-6835. Archival Storage: Add a new API to set storage policy. Contributed
by Jing Zhao.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617568
13f79535-47bb-0310-9956-ffa450edef68
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HDFS-6911. Archival Storage: check if a block is already scheduled in Mover.
Contributed by Tsz Wo Nicholas Sze.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8ea20b53
Tree:
HDFS-6944. Archival Storage: add retry and termination logic for Mover.
Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a26aa6bd
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a26aa6bd
HDFS-6876. Archival Storage: support set/get storage policy in DFSAdmin.
Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/185200e7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/185200e7
HDFS-7027. Archival Storage: Mover does not terminate when some storage type is
out of space. Contributed by Tsz Wo Nicholas Sze.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/74a7e227
Tree:
Merge branch 'trunk' into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/aaa7e217
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/aaa7e217
Diff:
Merge branch 'HDFS-6584' into trunk
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/98f7bfe9
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/98f7bfe9
Diff:
and FSImage to support storage policy ID.
-(szetszwo)
-
-HDFS-6670. Add block storage policy support with default HOT, WARM and COLD
-policies. (szetszwo)
-
-HDFS-6671. Change BlockPlacementPolicy to consider block storage policy
-in replicaiton. (szetszwo)
-
-HDFS-6710. Change
subtasks in the
-breakdown section. (szetszwo)
+HDFS-6584. Support archival storage. (See breakdown of tasks below for
+features and contributors)
IMPROVEMENTS
types are unavailable. (szetszwo)
+HDFS-6835. Add a new API to set storage policy. (jing9)
+
HDFS-6847. Support storage policy on directories and include storage
policy
in HdfsFileStatus. (Jing Zhao via szetszwo)
-HDFS-7072. Fix TestBlockManager and TestStorageMover. (Jing
HDFS-7078. Fix listEZs to work correctly with snapshots. (wang)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0ecefe60
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0ecefe60
Diff:
YARN-2558. Updated ContainerTokenIdentifier#read/write to use
ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f4886111
Tree:
HDFS-7004. Update KeyProvider instantiation to create by URI. (wang)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/10e8602f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/10e8602f
Diff:
HDFS-7075. hadoop-fuse-dfs fails because it cannot find
JavaKeyStoreProvider$Factory. (cmccabe)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f2302485
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f2302485
YARN-2559. Fixed NPE in SystemMetricsPublisher when retrieving
FinalApplicationStatus. Contributed by Zhijie Shen
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ee21b13c
Tree:
HADOOP-11040. Return value of read(ByteBuffer buf) in CryptoInputStream is
incorrect in some cases. (Yi Liu via wang)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/47e5e198
Tree:
Move some HDFS JIRAs to the correct CHANGES.txt
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bf38793c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/bf38793c
Diff:
Repository: hadoop
Updated Branches:
refs/heads/HDFS-6584 911979c8a - 2d2b0009e
HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e3803d00
Tree:
HDFS-6843. Add to CHANGES.txt
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f24ac429
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f24ac429
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f24ac429
Merge branch 'trunk' into HDFS-6584
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2d2b0009
Tree:
Merge branch 'trunk' into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/aaa7e217
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/aaa7e217
Diff:
Repository: hadoop
Updated Branches:
refs/heads/HDFS-6584 432b86371 - aaa7e2175
YARN-1250. Generic history service should support application-acls.
(Contributed by Zhijie Shen)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
YARN-1250. Addendum
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0e7d1dbf
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0e7d1dbf
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/0e7d1dbf
Branch:
+23,9 @@ HDFS-6584: Archival Storage
HDFS-6847. Support storage policy on directories and include storage
policy
in HdfsFileStatus. (Jing Zhao via szetszwo)
+HDFS-7072. Fix TestBlockManager and TestStorageMover. (Jing Zhao
+via szetszwo)
+
Trunk (Unreleased)
INCOMPATIBLE
HADOOP-11074. Add JIRA to CHANGES.txt
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6c083397
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6c083397
Diff:
YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. Contributed by
Xuan Gong.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/469ea3dc
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/469ea3dc
Diff:
YARN-2229. Changed the integer field of ContainerId to be long type.
Contributed by Tsuyoshi OZAWA
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3122daa8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3122daa8
Repository: hadoop
Updated Branches:
refs/heads/HDFS-6584 dc27ee9ae - dba52ce0b
HADOOP-11083. After refactoring of HTTP proxyuser to common, doAs param is case
sensitive. (tucu)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Update CHANGES.txt to set the release date for 2.5.1
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/17ffbe08
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/17ffbe08
Diff:
HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file
path separator. Contributed by Chris Nauroth.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d6ce2698
Tree:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/6b8b1608/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java
Merge branch 'trunk' into HDFS-6584
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dba52ce0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/dba52ce0
Diff:
YARN-2033. Merging generic-history into the Timeline Store (Contributed by
Zhijie Shen)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6b8b1608
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6b8b1608
Diff:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/6b8b1608/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/AppAttemptBlock.java
--
diff --git
YARN-2459. RM crashes if App gets rejected for any reason and HA is enabled.
Contributed by Jian He
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/47bdfa04
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/47bdfa04
401 - 500 of 1279 matches
Mail list logo