HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI.
Contributed by Haohui Mai.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/456e901a
Tree:
HDFS-8813. Erasure Coding: Client no need to decode missing parity blocks.
Contributed by Walter Su.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c2c26e6e
Tree:
HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2e7b7e2c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2e7b7e2c
Diff:
HADOOP-12060. Fix ByteBuffer usage for raw erasure coders. Contributed by Kai
Zheng.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/29495cb8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/29495cb8
Diff:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/cc10933a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
--
diff --cc
Addendum fix for HDFS-8323 (adding back a mistakenly deleted line).
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/42a1d0db
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/42a1d0db
Diff:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/cc10933a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
--
diff --cc
HDFS-8769. Erasure coding: unit test for SequentialBlockGroupIdGenerator.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4a72be6e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4a72be6e
HDFS-8202. Improve end to end stirpping file test to add erasure recovering
test. Contributed by Xinwei Qin.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ba90c028
Tree:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/cc10933a/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/ClientProtocol.java
--
diff --cc
HDFS-8563. Erasure Coding: fsck handles file smaller than a full stripe.
Contributed by Walter Su.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2470a7bf
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2470a7bf
HDFS-8433. Erasure coding: set blockToken in LocatedStripedBlock. Contributed
by Walter Su.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/06394e37
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/06394e37
Diff:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/456e901a/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/static/jquery.dataTables.min.js
--
diff --git
HDFS-8253. DFSStripedOutputStream.closeThreads releases cellBuffers multiple
times. Contributed by Kai Sasaki
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/093907d7
Tree:
HDFS-8798. Erasure Coding: fix DFSStripedInputStream/DFSStripedOutputStream
re-fetch token when expired. Contributed by Walter Su.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/95b499a3
Tree:
HDFS-8824. Do not use small blocks for balancing the cluster.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2bc0a4f2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2bc0a4f2
Diff:
Repository: hadoop
Updated Branches:
refs/heads/HDFS-7285-merge 5c31bf7a1 - cc10933a0 (forced update)
HDFS-8567. Erasure Coding: SafeMode handles file smaller than a full stripe.
Contributed by Walter Su.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HDFS-8220. Erasure Coding: StripedDataStreamer fails to handle the
blocklocations which doesn't satisfy BlockGroupSize.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b57c9a35
Tree:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/1d37a881/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestEncryptionZones.java
--
diff --git
Merge commit '456e901a4c5c639267ee87b8e5f1319f256d20c2' (HDFS-6407. Add sorting
and pagination in the datanode tab of the NN Web UI. Contributed by Haohui
Mai.) into HDFS-7285-merge
Conflicts:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/cc10933a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSStripedOutputStream.java
--
diff --cc
HDFS-8760. Erasure Coding: reuse BlockReader when reading the same block in
pread. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f8f7a923
Tree:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/4fdd9abd/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestBlockUnderConstruction.java
--
diff --git
HDFS-8719. Erasure Coding: client generates too many small packets when writing
parity data. Contributed by Li Bo.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/48f3830f
Tree:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/cc10933a/hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/ClientNamenodeProtocol.proto
--
diff --cc
HDFS-8669. Erasure Coding: handle missing internal block locations in
DFSStripedInputStream. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b1e6429a
Tree:
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dc7a0616
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/dc7a0616
Diff:
HDFS-8484. Erasure coding: Two contiguous blocks occupy IDs belong to same
striped group. Contributed by Walter Su.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e692c7dd
Tree:
HDFS-8734. Erasure Coding: fix one cell need two packets. Contributed by Walter
Su.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0a93712f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0a93712f
Diff:
HDFS-8781. Erasure Coding: Correctly handle BlockManager#InvalidateBlocks for
striped block. Contributed by Yi Liu.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5956d23b
Tree:
HDFS-8804. Erasure Coding: use DirectBufferPool in DFSStripedInputStream for
buffer allocation. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9312b168
Tree:
HDFS-8461. Erasure coding: fix priority level of UnderReplicatedBlocks for
striped block. Contributed by Walter Su.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2c494a84
Tree:
HDFS-8827. Erasure Coding: Fix NPE when NameNode processes over-replicated
striped blocks. Contributed by Walter Su and Takuya Fukudome.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fbf7e81c
Tree:
HDFS-8744. Erasure Coding: the number of chunks in packet is not updated when
writing parity data. Contributed by Li Bo
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f4098dfa
Tree:
HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed
by Anu Engineer.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a7862d5f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a7862d5f
HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1569228e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1569228e
Diff:
Repository: hadoop
Updated Branches:
refs/heads/YARN-1197 9ece5c481 - e258bd4b4
YARN-3868. Recovery support for container resizing. Contributed by Meng Ding
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e258bd4b
Tree:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 c8f109798 - 27ced8253
YARN-3986. getTransferredContainers in AbstractYarnScheduler should be present
in YarnScheduler interface
(cherry picked from commit 22de7c1dca1be63d523de833163ae51bfe638a79)
Project:
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
Moved CHANGES.txt entry to 2.7.2
(cherry picked from commit b0564c9f3c501bf7806f07649929038624dea10f)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 29819e724 - c8f109798
refs/heads/branch-2.7 f333e367e - ba0f66984
refs/heads/trunk 2ba90c93d - b0564c9f3
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
Moved CHANGES.txt entry to 2.7.2
Project:
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
(cherry picked from commit dc7a061668a3f4d86fe1b07a40d46774b5386938)
(cherry picked from commit 2edfc3ce715e47ce8deb1525f0040635fd8cf3a6)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
YARN-2923. Support configuration based NodeLabelsProvider Service in
Distributed Node Label Configuration Setup. (Naganarasimha G R)
(cherry picked from commit fc07464d1a48b0413da5e921614430e41263fdb7)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 cd0c6b578 - 6452b3176
YARN-4055. Report node resource utilization in heartbeat. (Inigo Goiri via
kasha)
(cherry picked from commit 13604bd5f119fc81b9942190dfa366afad61bc92)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Repository: hadoop
Updated Branches:
refs/heads/trunk 36b1a1e78 - 80a29906b
HDFS-8884. Fail-fast check in BlockPlacementPolicyDefault#chooseTarget. (yliu)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/80a29906
Tree:
Repository: hadoop
Updated Branches:
refs/heads/trunk 7642f64c2 - c8bca6271
HDFS-8809. HDFS fsck reports under construction blocks as CORRUPT. Contributed
by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 a0450b96a - cd0c6b578
HDFS-8809. HDFS fsck reports under construction blocks as CORRUPT. Contributed
by Jing Zhao.
(cherry picked from commit c8bca62718203a1dad9b70d164bdf10cc71b40cd)
Project:
Repository: hadoop
Updated Branches:
refs/heads/branch-2.6 04a7000c8 - 537d7a624
Creating 2.6.2 entries in CHANGES.txt files.
(cherry picked from commit 33474939a048ac7bbe07df772fc84979722f)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 9da81a395 - 29819e724
MAPREDUCE-6357. MultipleOutputs.write() API should document that output
committing is not utilized when input path is absolute. Contributed by Dustin
Cote.
(cherry picked from commit
Repository: hadoop
Updated Branches:
refs/heads/trunk 33474939a - 2ba90c93d
MAPREDUCE-6357. MultipleOutputs.write() API should document that output
committing is not utilized when input path is absolute. Contributed by Dustin
Cote.
Project:
Repository: hadoop
Updated Branches:
refs/heads/trunk c8bca6271 - 33474939a
Creating 2.6.2 entries in CHANGES.txt files.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/33474939
Tree:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 6452b3176 - 45be1240d
Creating 2.6.2 entries in CHANGES.txt files.
(cherry picked from commit 33474939a048ac7bbe07df772fc84979722f)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 45be1240d - 9da81a395
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed
cache files so that child processes running hadoop scripts can access these
files. Contributed by Junping Du.
Project:
Repository: hadoop
Updated Branches:
refs/heads/branch-2.7 d4b6c4a3c - f333e367e
Creating 2.6.2 entries in CHANGES.txt files.
(cherry picked from commit 33474939a048ac7bbe07df772fc84979722f)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2.6 537d7a624 - d4b86e6f4
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed
cache files so that child processes running hadoop scripts can access these
files. Contributed by Junping Du.
(cherry picked from
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed
cache files so that child processes running hadoop scripts can access these
files. Contributed by Junping Du.
(cherry picked from commit 9da81a395584cb1dbfdee01fd4de53522681)
Project:
Repository: hadoop
Updated Branches:
refs/heads/HDFS-7285-merge cc10933a0 - d94493b69
Fix minor issues when merging trunk (DFS-6407) to HDFS-7285 branch.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d94493b6
Tree:
Repository: hadoop
Updated Branches:
refs/heads/trunk 0bc15cb6e - fc07464d1
YARN-2923. Support configuration based NodeLabelsProvider Service in
Distributed Node Label Configuration Setup. (Naganarasimha G R)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/trunk 80a29906b - 5e8fe8943
HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed.
(Kihwal Lee via yliu)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 63bdbb779 - 146db49f7
HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed.
(Kihwal Lee via yliu)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/YARN-1197 4dd004b7d - 9ece5c481
YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to
support container resizing. Contributed by Meng Ding
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/trunk fc07464d1 - 7642f64c2
HDFS-8922. Link the native_mini_dfs test library with libdl, since IBM Java
requires it (Ayappan via Colin P. McCabe)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/trunk 5e8fe8943 - 0bc15cb6e
HDFS-8828. Utilize Snapshot diff report to build diff copy list in distcp.
(Yufei Gu via Yongjun Zhang)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/HADOOP-12111 d3b5c4cf7 - 2c4208f2b
HADOOP-12303. test-patch pylint plugin fails silently and votes +1 incorrectly
(Kengo Seki via aw)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 146db49f7 - b085c5ef6
HDFS-8828. Utilize Snapshot diff report to build diff copy list in distcp.
(Yufei Gu via Yongjun Zhang)
(cherry picked from commit 0bc15cb6e60dc60885234e01dec1c7cb4557a926)
Project:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 b085c5ef6 - a0450b96a
HDFS-8922. Link the native_mini_dfs test library with libdl, since IBM Java
requires it (Ayappan via Colin P. McCabe)
(cherry picked from commit 7642f64c24961d2b4772591a0957e2699162a083)
Project:
HDFS-8774. Implement FileSystem and InputStream API for libhdfspp. Contributed
by Haohui Mai.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2a98ab5b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2a98ab5b
Diff:
Repository: hadoop
Updated Branches:
refs/heads/HDFS-8707 172623de9 - 2a98ab5bc
HDFS-8775. SASL support for data transfer protocol in libhdfspp. Contributed by
Haohui Mai.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HDFS-8857. Erasure Coding: Fix ArrayIndexOutOfBoundsException in
TestWriteStripedFileWithFailure. Contributed by Li Bo
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8799363d
Tree:
HDFS-8684. Erasure Coding: fix some block number calculation for striped block.
(yliu)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ee01a095
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ee01a095
Diff:
MAPREDUCE-5817. Mappers get rescheduled on node transition even after all
reducers are completed. (Sangjin Lee via kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/27d24f96
Tree:
HDFS-8058. Erasure coding: use BlockInfo[] for both striped and contiguous
blocks in INodeFile. Contributed by Zhe Zhang and Yi Liu.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7e091de1
Tree:
HDFS-8702. Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic
for striped block. Contributed by Kai Sasaki.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6ff957be
Tree:
HDFS-8787. Erasure coding: rename BlockInfoContiguousUC and BlockInfoStripedUC
to be consistent with trunk.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4fdd9abd
Tree:
YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/def12933
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/def12933
Diff:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/1d37a881/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/ErasureCodingWorker.java
--
diff --git
HDFS-8399. Erasure Coding: unit test the behaviour of BlockManager recovery
work for the deleted blocks. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4de48211
Tree:
MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the
allocate call. (Anubhav Dhoot via kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8dfec7a1
Tree:
77 matches
Mail list logo