hadoop git commit: HADOOP-15802. start-build-env.sh creates an invalid /etc/sudoers.d/hadoop-build-${USER_ID} file entry. Contributed by Jon Boone.
Repository: hadoop
Updated Branches:
refs/heads/trunk 22f85f292 -> e3342a1ab
HADOOP-15802. start-build-env.sh creates an invalid
/etc/sudoers.d/hadoop-build-${USER_ID} file entry. Contributed by Jon Boone.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e3342a1a
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e3342a1a
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/e3342a1a
Branch: refs/heads/trunk
Commit: e3342a1abaff71823ebd952baf24a6143e711b99
Parents: 22f85f2
Author: Akira Ajisaka
Authored: Wed Oct 17 10:11:44 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 17 10:12:57 2018 +0900
--
start-build-env.sh | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e3342a1a/start-build-env.sh
--
diff --git a/start-build-env.sh b/start-build-env.sh
index c5581ca..bf6b411 100755
--- a/start-build-env.sh
+++ b/start-build-env.sh
@@ -61,7 +61,7 @@ docker build -t "hadoop-build-${USER_ID}" -
<
"/etc/sudoers.d/hadoop-build-${USER_ID}"
+RUN echo -e "${USER_NAME}\tALL=NOPASSWD: ALL" >
"/etc/sudoers.d/hadoop-build-${USER_ID}"
ENV HOME /home/${USER_NAME}
UserSpecificDocker
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15802. start-build-env.sh creates an invalid /etc/sudoers.d/hadoop-build-${USER_ID} file entry. Contributed by Jon Boone.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.2 fc25def7d -> 83769b63d
HADOOP-15802. start-build-env.sh creates an invalid
/etc/sudoers.d/hadoop-build-${USER_ID} file entry. Contributed by Jon Boone.
(cherry picked from commit e3342a1abaff71823ebd952baf24a6143e711b99)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/83769b63
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/83769b63
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/83769b63
Branch: refs/heads/branch-3.2
Commit: 83769b63d494bd0e5f62d9e7073c7e87dd9a3458
Parents: fc25def
Author: Akira Ajisaka
Authored: Wed Oct 17 10:11:44 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 17 10:14:30 2018 +0900
--
start-build-env.sh | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/83769b63/start-build-env.sh
--
diff --git a/start-build-env.sh b/start-build-env.sh
index c5581ca..bf6b411 100755
--- a/start-build-env.sh
+++ b/start-build-env.sh
@@ -61,7 +61,7 @@ docker build -t "hadoop-build-${USER_ID}" -
<
"/etc/sudoers.d/hadoop-build-${USER_ID}"
+RUN echo -e "${USER_NAME}\tALL=NOPASSWD: ALL" >
"/etc/sudoers.d/hadoop-build-${USER_ID}"
ENV HOME /home/${USER_NAME}
UserSpecificDocker
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15802. start-build-env.sh creates an invalid /etc/sudoers.d/hadoop-build-${USER_ID} file entry. Contributed by Jon Boone.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 7c40f9b37 -> ddd7da52c
HADOOP-15802. start-build-env.sh creates an invalid
/etc/sudoers.d/hadoop-build-${USER_ID} file entry. Contributed by Jon Boone.
(cherry picked from commit e3342a1abaff71823ebd952baf24a6143e711b99)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ddd7da52
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ddd7da52
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ddd7da52
Branch: refs/heads/branch-3.1
Commit: ddd7da52c982cb61a3d25c6c51d2635ddb80bde8
Parents: 7c40f9b
Author: Akira Ajisaka
Authored: Wed Oct 17 10:11:44 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 17 10:14:49 2018 +0900
--
start-build-env.sh | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/ddd7da52/start-build-env.sh
--
diff --git a/start-build-env.sh b/start-build-env.sh
index 4da55af..6c8ddb33 100755
--- a/start-build-env.sh
+++ b/start-build-env.sh
@@ -61,7 +61,7 @@ docker build -t "hadoop-build-${USER_ID}" -
<
"/etc/sudoers.d/hadoop-build-${USER_ID}"
+RUN echo -e "${USER_NAME}\tALL=NOPASSWD: ALL" >
"/etc/sudoers.d/hadoop-build-${USER_ID}"
ENV HOME /home/${USER_NAME}
UserSpecificDocker
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
Repository: hadoop
Updated Branches:
refs/heads/trunk a0c0b793c -> 8f97d6f2c
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed
by Jason Lowe.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8f97d6f2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8f97d6f2
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/8f97d6f2
Branch: refs/heads/trunk
Commit: 8f97d6f2cdfccefba5457ae3d561e9ce0109da3f
Parents: a0c0b79
Author: Akira Ajisaka
Authored: Wed Oct 24 13:49:28 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 24 13:49:28 2018 +0900
--
dev-support/docker/Dockerfile| 1 +
.../hadoop/io/compress/zstd/ZStandardDecompressor.java | 4 ++--
.../apache/hadoop/io/compress/zstd/ZStandardCompressor.c | 11 +++
.../hadoop/io/compress/zstd/ZStandardDecompressor.c | 1 +
.../zstd/TestZStandardCompressorDecompressor.java| 10 --
5 files changed, 15 insertions(+), 12 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8f97d6f2/dev-support/docker/Dockerfile
--
diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile
index 7679500..67140c9 100644
--- a/dev-support/docker/Dockerfile
+++ b/dev-support/docker/Dockerfile
@@ -63,6 +63,7 @@ RUN apt-get -q update \
libsnappy-dev \
libssl-dev \
libtool \
+libzstd1-dev \
locales \
make \
pinentry-curses \
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8f97d6f2/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
index 73d73e1..bc9d29c 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
@@ -262,8 +262,8 @@ public class ZStandardDecompressor implements Decompressor {
int originalPosition = dst.position();
int n = inflateBytesDirect(
-src, src.position(), src.remaining(), dst, dst.position(),
-dst.remaining()
+src, src.position(), src.limit(), dst, dst.position(),
+dst.limit()
);
dst.position(originalPosition + n);
if (bytesInCompressedBuffer > 0) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8f97d6f2/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
index 055683a..289554b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
@@ -195,10 +195,13 @@ JNIEXPORT jint
Java_org_apache_hadoop_io_compress_zstd_ZStandardCompressor_defla
ZSTD_inBuffer input = { uncompressed_bytes, uncompressed_direct_buf_len,
uncompressed_direct_buf_off };
ZSTD_outBuffer output = { compressed_bytes, compressed_direct_buf_len, 0 };
-size_t size = dlsym_ZSTD_compressStream(stream, &output, &input);
-if (dlsym_ZSTD_isError(size)) {
-THROW(env, "java/lang/InternalError", dlsym_ZSTD_getErrorName(size));
-return (jint) 0;
+size_t size;
+if (uncompressed_direct_buf_len != 0) {
+size = dlsym_ZSTD_compressStream(stream, &output, &input);
+if (dlsym_ZSTD_isError(size)) {
+THROW(env, "java/lang/InternalError",
dlsym_ZSTD_getErrorName(size));
+return (jint) 0;
+}
}
if (finish && input.pos == input.size) {
// end the stream, flush and write the frame epilogue
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8f97d6f2/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
b/hadoop-common-p
hadoop git commit: HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.2 709775592 -> 63396beab
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed
by Jason Lowe.
(cherry picked from commit 8f97d6f2cdfccefba5457ae3d561e9ce0109da3f)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/63396bea
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/63396bea
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/63396bea
Branch: refs/heads/branch-3.2
Commit: 63396beab4178f3855be27c869bfb78336c71166
Parents: 7097755
Author: Akira Ajisaka
Authored: Wed Oct 24 13:49:28 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 24 13:50:30 2018 +0900
--
dev-support/docker/Dockerfile| 1 +
.../hadoop/io/compress/zstd/ZStandardDecompressor.java | 4 ++--
.../apache/hadoop/io/compress/zstd/ZStandardCompressor.c | 11 +++
.../hadoop/io/compress/zstd/ZStandardDecompressor.c | 1 +
.../zstd/TestZStandardCompressorDecompressor.java| 10 --
5 files changed, 15 insertions(+), 12 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/63396bea/dev-support/docker/Dockerfile
--
diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile
index 7679500..67140c9 100644
--- a/dev-support/docker/Dockerfile
+++ b/dev-support/docker/Dockerfile
@@ -63,6 +63,7 @@ RUN apt-get -q update \
libsnappy-dev \
libssl-dev \
libtool \
+libzstd1-dev \
locales \
make \
pinentry-curses \
http://git-wip-us.apache.org/repos/asf/hadoop/blob/63396bea/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
index 73d73e1..bc9d29c 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
@@ -262,8 +262,8 @@ public class ZStandardDecompressor implements Decompressor {
int originalPosition = dst.position();
int n = inflateBytesDirect(
-src, src.position(), src.remaining(), dst, dst.position(),
-dst.remaining()
+src, src.position(), src.limit(), dst, dst.position(),
+dst.limit()
);
dst.position(originalPosition + n);
if (bytesInCompressedBuffer > 0) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/63396bea/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
index 055683a..289554b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
@@ -195,10 +195,13 @@ JNIEXPORT jint
Java_org_apache_hadoop_io_compress_zstd_ZStandardCompressor_defla
ZSTD_inBuffer input = { uncompressed_bytes, uncompressed_direct_buf_len,
uncompressed_direct_buf_off };
ZSTD_outBuffer output = { compressed_bytes, compressed_direct_buf_len, 0 };
-size_t size = dlsym_ZSTD_compressStream(stream, &output, &input);
-if (dlsym_ZSTD_isError(size)) {
-THROW(env, "java/lang/InternalError", dlsym_ZSTD_getErrorName(size));
-return (jint) 0;
+size_t size;
+if (uncompressed_direct_buf_len != 0) {
+size = dlsym_ZSTD_compressStream(stream, &output, &input);
+if (dlsym_ZSTD_isError(size)) {
+THROW(env, "java/lang/InternalError",
dlsym_ZSTD_getErrorName(size));
+return (jint) 0;
+}
}
if (finish && input.pos == input.size) {
// end the stream, flush and write the frame epilogue
http://git-wip-us.apache.org/repos/asf/hadoop/blob/63396bea/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/sr
hadoop git commit: HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.2.0 7031fe17e -> e213563c3
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed
by Jason Lowe.
(cherry picked from commit 8f97d6f2cdfccefba5457ae3d561e9ce0109da3f)
(cherry picked from commit 63396beab4178f3855be27c869bfb78336c71166)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e213563c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e213563c
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/e213563c
Branch: refs/heads/branch-3.2.0
Commit: e213563c3cb924c5d3d029fe3a5b72f5e851e189
Parents: 7031fe1
Author: Akira Ajisaka
Authored: Wed Oct 24 13:49:28 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 24 13:50:57 2018 +0900
--
dev-support/docker/Dockerfile| 1 +
.../hadoop/io/compress/zstd/ZStandardDecompressor.java | 4 ++--
.../apache/hadoop/io/compress/zstd/ZStandardCompressor.c | 11 +++
.../hadoop/io/compress/zstd/ZStandardDecompressor.c | 1 +
.../zstd/TestZStandardCompressorDecompressor.java| 10 --
5 files changed, 15 insertions(+), 12 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e213563c/dev-support/docker/Dockerfile
--
diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile
index 7679500..67140c9 100644
--- a/dev-support/docker/Dockerfile
+++ b/dev-support/docker/Dockerfile
@@ -63,6 +63,7 @@ RUN apt-get -q update \
libsnappy-dev \
libssl-dev \
libtool \
+libzstd1-dev \
locales \
make \
pinentry-curses \
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e213563c/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
index 73d73e1..bc9d29c 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
@@ -262,8 +262,8 @@ public class ZStandardDecompressor implements Decompressor {
int originalPosition = dst.position();
int n = inflateBytesDirect(
-src, src.position(), src.remaining(), dst, dst.position(),
-dst.remaining()
+src, src.position(), src.limit(), dst, dst.position(),
+dst.limit()
);
dst.position(originalPosition + n);
if (bytesInCompressedBuffer > 0) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e213563c/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
index 055683a..289554b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
@@ -195,10 +195,13 @@ JNIEXPORT jint
Java_org_apache_hadoop_io_compress_zstd_ZStandardCompressor_defla
ZSTD_inBuffer input = { uncompressed_bytes, uncompressed_direct_buf_len,
uncompressed_direct_buf_off };
ZSTD_outBuffer output = { compressed_bytes, compressed_direct_buf_len, 0 };
-size_t size = dlsym_ZSTD_compressStream(stream, &output, &input);
-if (dlsym_ZSTD_isError(size)) {
-THROW(env, "java/lang/InternalError", dlsym_ZSTD_getErrorName(size));
-return (jint) 0;
+size_t size;
+if (uncompressed_direct_buf_len != 0) {
+size = dlsym_ZSTD_compressStream(stream, &output, &input);
+if (dlsym_ZSTD_isError(size)) {
+THROW(env, "java/lang/InternalError",
dlsym_ZSTD_getErrorName(size));
+return (jint) 0;
+}
}
if (finish && input.pos == input.size) {
// end the stream, flush and write the frame epilogue
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e213563c/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
--
hadoop git commit: HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 3be72b7aa -> 080e9d0f9
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed
by Jason Lowe.
(cherry picked from commit 8f97d6f2cdfccefba5457ae3d561e9ce0109da3f)
Conflicts:
dev-support/docker/Dockerfile
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/080e9d0f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/080e9d0f
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/080e9d0f
Branch: refs/heads/branch-3.1
Commit: 080e9d0f9b3ab351bb24c11fdd6a83791a519a4d
Parents: 3be72b7
Author: Akira Ajisaka
Authored: Wed Oct 24 13:49:28 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 24 13:54:30 2018 +0900
--
dev-support/docker/Dockerfile| 1 +
.../hadoop/io/compress/zstd/ZStandardDecompressor.java | 4 ++--
.../apache/hadoop/io/compress/zstd/ZStandardCompressor.c | 11 +++
.../hadoop/io/compress/zstd/ZStandardDecompressor.c | 1 +
.../zstd/TestZStandardCompressorDecompressor.java| 10 --
5 files changed, 15 insertions(+), 12 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/080e9d0f/dev-support/docker/Dockerfile
--
diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile
index e1aa00f..ba799d7 100644
--- a/dev-support/docker/Dockerfile
+++ b/dev-support/docker/Dockerfile
@@ -57,6 +57,7 @@ RUN apt-get -q update && apt-get -q install -y \
libsnappy-dev \
libssl-dev \
libtool \
+libzstd1-dev \
locales \
make \
pinentry-curses \
http://git-wip-us.apache.org/repos/asf/hadoop/blob/080e9d0f/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
index 73d73e1..bc9d29c 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
@@ -262,8 +262,8 @@ public class ZStandardDecompressor implements Decompressor {
int originalPosition = dst.position();
int n = inflateBytesDirect(
-src, src.position(), src.remaining(), dst, dst.position(),
-dst.remaining()
+src, src.position(), src.limit(), dst, dst.position(),
+dst.limit()
);
dst.position(originalPosition + n);
if (bytesInCompressedBuffer > 0) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/080e9d0f/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
index 055683a..289554b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
@@ -195,10 +195,13 @@ JNIEXPORT jint
Java_org_apache_hadoop_io_compress_zstd_ZStandardCompressor_defla
ZSTD_inBuffer input = { uncompressed_bytes, uncompressed_direct_buf_len,
uncompressed_direct_buf_off };
ZSTD_outBuffer output = { compressed_bytes, compressed_direct_buf_len, 0 };
-size_t size = dlsym_ZSTD_compressStream(stream, &output, &input);
-if (dlsym_ZSTD_isError(size)) {
-THROW(env, "java/lang/InternalError", dlsym_ZSTD_getErrorName(size));
-return (jint) 0;
+size_t size;
+if (uncompressed_direct_buf_len != 0) {
+size = dlsym_ZSTD_compressStream(stream, &output, &input);
+if (dlsym_ZSTD_isError(size)) {
+THROW(env, "java/lang/InternalError",
dlsym_ZSTD_getErrorName(size));
+return (jint) 0;
+}
}
if (finish && input.pos == input.size) {
// end the stream, flush and write the frame epilogue
http://git-wip-us.apache.org/repos/asf/hadoop/blob/080e9d0f/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
--
diff --git
a/hadoop-
hadoop git commit: HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 4a481e1dc -> d3850e8e1
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed
by Jason Lowe.
(cherry picked from commit 8f97d6f2cdfccefba5457ae3d561e9ce0109da3f)
Conflicts:
dev-support/docker/Dockerfile
(cherry picked from commit ca699774a235c3aede8da0448e38308a5be139a6)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d3850e8e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d3850e8e
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/d3850e8e
Branch: refs/heads/branch-2.9
Commit: d3850e8e15203b79fa6d20d56aaee0b69414aee6
Parents: 4a481e1
Author: Akira Ajisaka
Authored: Wed Oct 24 13:49:28 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 24 14:01:34 2018 +0900
--
.../hadoop/io/compress/zstd/ZStandardDecompressor.java | 4 ++--
.../apache/hadoop/io/compress/zstd/ZStandardCompressor.c | 11 +++
.../hadoop/io/compress/zstd/ZStandardDecompressor.c | 1 +
.../zstd/TestZStandardCompressorDecompressor.java| 10 --
4 files changed, 14 insertions(+), 12 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/d3850e8e/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
index 73d73e1..bc9d29c 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
@@ -262,8 +262,8 @@ public class ZStandardDecompressor implements Decompressor {
int originalPosition = dst.position();
int n = inflateBytesDirect(
-src, src.position(), src.remaining(), dst, dst.position(),
-dst.remaining()
+src, src.position(), src.limit(), dst, dst.position(),
+dst.limit()
);
dst.position(originalPosition + n);
if (bytesInCompressedBuffer > 0) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/d3850e8e/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
index 055683a..289554b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
@@ -195,10 +195,13 @@ JNIEXPORT jint
Java_org_apache_hadoop_io_compress_zstd_ZStandardCompressor_defla
ZSTD_inBuffer input = { uncompressed_bytes, uncompressed_direct_buf_len,
uncompressed_direct_buf_off };
ZSTD_outBuffer output = { compressed_bytes, compressed_direct_buf_len, 0 };
-size_t size = dlsym_ZSTD_compressStream(stream, &output, &input);
-if (dlsym_ZSTD_isError(size)) {
-THROW(env, "java/lang/InternalError", dlsym_ZSTD_getErrorName(size));
-return (jint) 0;
+size_t size;
+if (uncompressed_direct_buf_len != 0) {
+size = dlsym_ZSTD_compressStream(stream, &output, &input);
+if (dlsym_ZSTD_isError(size)) {
+THROW(env, "java/lang/InternalError",
dlsym_ZSTD_getErrorName(size));
+return (jint) 0;
+}
}
if (finish && input.pos == input.size) {
// end the stream, flush and write the frame epilogue
http://git-wip-us.apache.org/repos/asf/hadoop/blob/d3850e8e/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
index b97dd17..e28359b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
@@ -178,6 +178,7 @@ JNIEX
hadoop git commit: HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
Repository: hadoop
Updated Branches:
refs/heads/branch-2 dbf36dbb8 -> ca699774a
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed
by Jason Lowe.
(cherry picked from commit 8f97d6f2cdfccefba5457ae3d561e9ce0109da3f)
Conflicts:
dev-support/docker/Dockerfile
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ca699774
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ca699774
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ca699774
Branch: refs/heads/branch-2
Commit: ca699774a235c3aede8da0448e38308a5be139a6
Parents: dbf36db
Author: Akira Ajisaka
Authored: Wed Oct 24 13:49:28 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 24 14:00:34 2018 +0900
--
.../hadoop/io/compress/zstd/ZStandardDecompressor.java | 4 ++--
.../apache/hadoop/io/compress/zstd/ZStandardCompressor.c | 11 +++
.../hadoop/io/compress/zstd/ZStandardDecompressor.c | 1 +
.../zstd/TestZStandardCompressorDecompressor.java| 10 --
4 files changed, 14 insertions(+), 12 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/ca699774/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
index 73d73e1..bc9d29c 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
@@ -262,8 +262,8 @@ public class ZStandardDecompressor implements Decompressor {
int originalPosition = dst.position();
int n = inflateBytesDirect(
-src, src.position(), src.remaining(), dst, dst.position(),
-dst.remaining()
+src, src.position(), src.limit(), dst, dst.position(),
+dst.limit()
);
dst.position(originalPosition + n);
if (bytesInCompressedBuffer > 0) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/ca699774/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
index 055683a..289554b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
@@ -195,10 +195,13 @@ JNIEXPORT jint
Java_org_apache_hadoop_io_compress_zstd_ZStandardCompressor_defla
ZSTD_inBuffer input = { uncompressed_bytes, uncompressed_direct_buf_len,
uncompressed_direct_buf_off };
ZSTD_outBuffer output = { compressed_bytes, compressed_direct_buf_len, 0 };
-size_t size = dlsym_ZSTD_compressStream(stream, &output, &input);
-if (dlsym_ZSTD_isError(size)) {
-THROW(env, "java/lang/InternalError", dlsym_ZSTD_getErrorName(size));
-return (jint) 0;
+size_t size;
+if (uncompressed_direct_buf_len != 0) {
+size = dlsym_ZSTD_compressStream(stream, &output, &input);
+if (dlsym_ZSTD_isError(size)) {
+THROW(env, "java/lang/InternalError",
dlsym_ZSTD_getErrorName(size));
+return (jint) 0;
+}
}
if (finish && input.pos == input.size) {
// end the stream, flush and write the frame epilogue
http://git-wip-us.apache.org/repos/asf/hadoop/blob/ca699774/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
index b97dd17..e28359b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
@@ -178,6 +178,7 @@ JNIEXPORT jint JNICALL
Java_org_apache_hadoop_io_compress_zstd_ZStandardDecom
hadoop git commit: HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.0 a9bc3e370 -> e402791a5
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed
by Jason Lowe.
(cherry picked from commit 8f97d6f2cdfccefba5457ae3d561e9ce0109da3f)
Conflicts:
dev-support/docker/Dockerfile
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e402791a
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e402791a
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/e402791a
Branch: refs/heads/branch-3.0
Commit: e402791a51ae2dc892d1508dd5112e366b5cc79d
Parents: a9bc3e3
Author: Akira Ajisaka
Authored: Wed Oct 24 13:49:28 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 24 13:56:19 2018 +0900
--
dev-support/docker/Dockerfile| 1 +
.../hadoop/io/compress/zstd/ZStandardDecompressor.java | 4 ++--
.../apache/hadoop/io/compress/zstd/ZStandardCompressor.c | 11 +++
.../hadoop/io/compress/zstd/ZStandardDecompressor.c | 1 +
.../zstd/TestZStandardCompressorDecompressor.java| 10 --
5 files changed, 15 insertions(+), 12 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e402791a/dev-support/docker/Dockerfile
--
diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile
index e1aa00f..ba799d7 100644
--- a/dev-support/docker/Dockerfile
+++ b/dev-support/docker/Dockerfile
@@ -57,6 +57,7 @@ RUN apt-get -q update && apt-get -q install -y \
libsnappy-dev \
libssl-dev \
libtool \
+libzstd1-dev \
locales \
make \
pinentry-curses \
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e402791a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
index 73d73e1..bc9d29c 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.java
@@ -262,8 +262,8 @@ public class ZStandardDecompressor implements Decompressor {
int originalPosition = dst.position();
int n = inflateBytesDirect(
-src, src.position(), src.remaining(), dst, dst.position(),
-dst.remaining()
+src, src.position(), src.limit(), dst, dst.position(),
+dst.limit()
);
dst.position(originalPosition + n);
if (bytesInCompressedBuffer > 0) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e402791a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
index 055683a..289554b 100644
---
a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
+++
b/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardCompressor.c
@@ -195,10 +195,13 @@ JNIEXPORT jint
Java_org_apache_hadoop_io_compress_zstd_ZStandardCompressor_defla
ZSTD_inBuffer input = { uncompressed_bytes, uncompressed_direct_buf_len,
uncompressed_direct_buf_off };
ZSTD_outBuffer output = { compressed_bytes, compressed_direct_buf_len, 0 };
-size_t size = dlsym_ZSTD_compressStream(stream, &output, &input);
-if (dlsym_ZSTD_isError(size)) {
-THROW(env, "java/lang/InternalError", dlsym_ZSTD_getErrorName(size));
-return (jint) 0;
+size_t size;
+if (uncompressed_direct_buf_len != 0) {
+size = dlsym_ZSTD_compressStream(stream, &output, &input);
+if (dlsym_ZSTD_isError(size)) {
+THROW(env, "java/lang/InternalError",
dlsym_ZSTD_getErrorName(size));
+return (jint) 0;
+}
}
if (finish && input.pos == input.size) {
// end the stream, flush and write the frame epilogue
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e402791a/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/zstd/ZStandardDecompressor.c
--
diff --git
a/hadoop-
hadoop git commit: HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility. Contributed by Wei-Chiu Chuang.
Repository: hadoop
Updated Branches:
refs/heads/branch-2 a0aa61014 -> f23f339a6
HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break
compatibility.
Contributed by Wei-Chiu Chuang.
(cherry picked from commit 52cb766ad0bbea378a529fcff3cf372cf0a33cde)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f23f339a
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f23f339a
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f23f339a
Branch: refs/heads/branch-2
Commit: f23f339a6c02eb20af1d920c4c5c72ed25244459
Parents: a0aa610
Author: Steve Loughran
Authored: Mon Oct 22 11:06:56 2018 +0100
Committer: Akira Ajisaka
Committed: Tue Oct 30 09:58:59 2018 +0900
--
.../hadoop/fs/CommonConfigurationKeysPublic.java | 19 +--
1 file changed, 17 insertions(+), 2 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f23f339a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
index df4dfbe..9adb9ba 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
@@ -557,13 +557,28 @@ public class CommonConfigurationKeysPublic {
public static final String HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_KEY =
"hadoop.security.groups.shell.command.timeout";
/**
+ * @deprecated use
+ * {@link
CommonConfigurationKeysPublic#HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_KEY}
+ * instead.
+ */
+ public static final String HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_SECS =
+ HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_KEY;
+ /**
* @see
*
* core-default.xml
*/
public static final long
- HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_DEFAULT =
- 0L;
+ HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_DEFAULT =
+ 0L;
+ /**
+ * @deprecated use
+ * {@link
CommonConfigurationKeysPublic#HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_DEFAULT}
+ * instead.
+ */
+ public static final long
+ HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_SECS_DEFAULT =
+ HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_DEFAULT;
/**
* @see
*
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility. Contributed by Wei-Chiu Chuang.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 94d797753 -> f84beefb4
HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break
compatibility.
Contributed by Wei-Chiu Chuang.
(cherry picked from commit 52cb766ad0bbea378a529fcff3cf372cf0a33cde)
(cherry picked from commit f23f339a6c02eb20af1d920c4c5c72ed25244459)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f84beefb
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f84beefb
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f84beefb
Branch: refs/heads/branch-2.9
Commit: f84beefb48ec35e90e78e4bed740e7f674c06fde
Parents: 94d7977
Author: Steve Loughran
Authored: Mon Oct 22 11:06:56 2018 +0100
Committer: Akira Ajisaka
Committed: Tue Oct 30 10:00:35 2018 +0900
--
.../hadoop/fs/CommonConfigurationKeysPublic.java | 19 +--
1 file changed, 17 insertions(+), 2 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f84beefb/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
index 91604e1..df5d2a4 100644
---
a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
+++
b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
@@ -557,13 +557,28 @@ public class CommonConfigurationKeysPublic {
public static final String HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_KEY =
"hadoop.security.groups.shell.command.timeout";
/**
+ * @deprecated use
+ * {@link
CommonConfigurationKeysPublic#HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_KEY}
+ * instead.
+ */
+ public static final String HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_SECS =
+ HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_KEY;
+ /**
* @see
*
* core-default.xml
*/
public static final long
- HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_DEFAULT =
- 0L;
+ HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_DEFAULT =
+ 0L;
+ /**
+ * @deprecated use
+ * {@link
CommonConfigurationKeysPublic#HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_DEFAULT}
+ * instead.
+ */
+ public static final long
+ HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_SECS_DEFAULT =
+ HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT_DEFAULT;
/**
* @see
*
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: MAPREDUCE-7027: HadoopArchiveLogs shouldn't delete the original logs if the HAR creation fails. Contributed by Gergely Novák
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 f84beefb4 -> f79470e69
MAPREDUCE-7027: HadoopArchiveLogs shouldn't delete the original logs if the HAR
creation fails. Contributed by Gergely Novák
(cherry picked from commit 68ce193efcb595f75d7addf751559c806a5aa399)
(cherry picked from commit a0b55392d4385b623f6a8c0af17e58e2a9468be5)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f79470e6
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f79470e6
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f79470e6
Branch: refs/heads/branch-2.9
Commit: f79470e69666875cd43f171e438f7764796ce535
Parents: f84beef
Author: Xuan Gong
Authored: Fri Feb 23 14:37:26 2018 -0800
Committer: Akira Ajisaka
Committed: Tue Oct 30 10:04:48 2018 +0900
--
.../hadoop/tools/HadoopArchiveLogsRunner.java | 26 ++-
.../tools/TestHadoopArchiveLogsRunner.java | 204 +++
2 files changed, 141 insertions(+), 89 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f79470e6/hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogsRunner.java
--
diff --git
a/hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogsRunner.java
b/hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogsRunner.java
index b3c2de6..b736694 100644
---
a/hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogsRunner.java
+++
b/hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogsRunner.java
@@ -18,6 +18,7 @@
package org.apache.hadoop.tools;
+import com.google.common.annotations.VisibleForTesting;
import org.apache.commons.cli.CommandLine;
import org.apache.commons.cli.CommandLineParser;
import org.apache.commons.cli.GnuParser;
@@ -65,6 +66,9 @@ public class HadoopArchiveLogsRunner implements Tool {
private JobConf conf;
+ @VisibleForTesting
+ HadoopArchives hadoopArchives;
+
private static final FsPermission HAR_DIR_PERM =
new FsPermission(FsAction.ALL, FsAction.READ_EXECUTE, FsAction.NONE);
private static final FsPermission HAR_INNER_FILES_PERM =
@@ -72,6 +76,7 @@ public class HadoopArchiveLogsRunner implements Tool {
public HadoopArchiveLogsRunner(Configuration conf) {
setConf(conf);
+hadoopArchives = new HadoopArchives(conf);
}
public static void main(String[] args) {
@@ -132,10 +137,10 @@ public class HadoopArchiveLogsRunner implements Tool {
conf.set("mapreduce.framework.name", "local");
// Set the umask so we get 640 files and 750 dirs
conf.set("fs.permissions.umask-mode", "027");
-HadoopArchives ha = new HadoopArchives(conf);
+String harName = appId + ".har";
String[] haArgs = {
"-archiveName",
-appId + ".har",
+harName,
"-p",
remoteAppLogDir,
"*",
@@ -146,15 +151,26 @@ public class HadoopArchiveLogsRunner implements Tool {
sb.append("\n\t").append(haArg);
}
LOG.info(sb.toString());
-ha.run(haArgs);
+int exitCode = hadoopArchives.run(haArgs);
+if (exitCode != 0) {
+ LOG.warn("Failed to create archives for " + appId);
+ return -1;
+}
FileSystem fs = null;
// Move har file to correct location and delete original logs
try {
fs = FileSystem.get(conf);
- Path harDest = new Path(remoteAppLogDir, appId + ".har");
+ Path harPath = new Path(workingDir, harName);
+ if (!fs.exists(harPath) ||
+ fs.listStatus(harPath).length == 0) {
+LOG.warn("The created archive \"" + harName +
+"\" is missing or empty.");
+return -1;
+ }
+ Path harDest = new Path(remoteAppLogDir, harName);
LOG.info("Moving har to original location");
- fs.rename(new Path(workingDir, appId + ".har"), harDest);
+ fs.rename(harPath, harDest);
LOG.info("Deleting original logs");
for (FileStatus original : fs.listStatus(new Path(remoteAppLogDir),
new PathFilter() {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f79470e6/hadoop-tools/hadoop-archive-logs/src/test/java/org/apache/hadoop/tools/TestHadoopArchiveLogsRunner.java
--
diff --git
a/hadoop-tools/hadoop-archive-logs/src/test/java/org/apache/hadoop/tools/TestHadoopArchiveLogsRunner.java
b/hadoop-tools/hadoop-archive-logs/src/test/java/org/apache/hadoop/tools/TestHadoopArchiveLogsRunner.java
index fad9b97..5369338 100644
---
a/hadoop-tools/hadoop-archive-logs/src/test/java/org/apache/hadoop/tools/TestHadoopArchiveLogsRunner.java
+++
b/hadoop-tools/hadoop-archive-logs/src/test/ja
hadoop git commit: HDFS-13719. Docs around dfs.image.transfer.timeout are misleading. Contributed by Kitti Nansi.
Repository: hadoop Updated Branches: refs/heads/branch-2.9 f79470e69 -> ce602fa84 HDFS-13719. Docs around dfs.image.transfer.timeout are misleading. Contributed by Kitti Nansi. (cherry picked from commit 913417bbeab558154fbcc833af54664e7eeba97e) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ce602fa8 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ce602fa8 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ce602fa8 Branch: refs/heads/branch-2.9 Commit: ce602fa845552e2b5883214f5004e6061e6d5108 Parents: f79470e Author: Andrew Wang Authored: Mon Jul 9 15:17:26 2018 +0200 Committer: Akira Ajisaka Committed: Tue Oct 30 10:20:53 2018 +0900 -- .../hadoop-hdfs/src/main/resources/hdfs-default.xml| 13 + 1 file changed, 5 insertions(+), 8 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/ce602fa8/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml b/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml index b9c21e6..4b9cf4a 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml +++ b/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml @@ -1244,11 +1244,10 @@ dfs.image.transfer.timeout 6 -Socket timeout for image transfer in milliseconds. This timeout and the related -dfs.image.transfer.bandwidthPerSec parameter should be configured such -that normal image transfer can complete successfully. -This timeout prevents client hangs when the sender fails during -image transfer. This is socket timeout during image transfer. +Socket timeout for the HttpURLConnection instance used in the image +transfer. This is measured in milliseconds. +This timeout prevents client hangs if the connection is idle +for this configured timeout, during image transfer. @@ -1259,9 +1258,7 @@ Maximum bandwidth used for regular image transfers (instead of bootstrapping the standby namenode), in bytes per second. This can help keep normal namenode operations responsive during -checkpointing. The maximum bandwidth and timeout in -dfs.image.transfer.timeout should be set such that normal image -transfers can complete successfully. +checkpointing. A default value of 0 indicates that throttling is disabled. The maximum bandwidth used for bootstrapping standby namenode is configured with dfs.image.transfer-bootstrap-standby.bandwidthPerSec. - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15886. Fix findbugs warnings in RegistryDNS.java.
Repository: hadoop
Updated Branches:
refs/heads/trunk 277a3d8d9 -> f747f5b06
HADOOP-15886. Fix findbugs warnings in RegistryDNS.java.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f747f5b0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f747f5b0
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f747f5b0
Branch: refs/heads/trunk
Commit: f747f5b06cb0da59c7c20b9f0e46d3eec9622eed
Parents: 277a3d8
Author: Akira Ajisaka
Authored: Tue Oct 30 11:43:36 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 31 10:01:31 2018 +0900
--
.../dev-support/findbugs-exclude.xml| 33
hadoop-common-project/hadoop-registry/pom.xml | 10 ++
.../dev-support/findbugs-exclude.xml| 16 --
3 files changed, 43 insertions(+), 16 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f747f5b0/hadoop-common-project/hadoop-registry/dev-support/findbugs-exclude.xml
--
diff --git
a/hadoop-common-project/hadoop-registry/dev-support/findbugs-exclude.xml
b/hadoop-common-project/hadoop-registry/dev-support/findbugs-exclude.xml
new file mode 100644
index 000..dc7b139
--- /dev/null
+++ b/hadoop-common-project/hadoop-registry/dev-support/findbugs-exclude.xml
@@ -0,0 +1,33 @@
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f747f5b0/hadoop-common-project/hadoop-registry/pom.xml
--
diff --git a/hadoop-common-project/hadoop-registry/pom.xml
b/hadoop-common-project/hadoop-registry/pom.xml
index ef9f3ef..7ca1c9e 100644
--- a/hadoop-common-project/hadoop-registry/pom.xml
+++ b/hadoop-common-project/hadoop-registry/pom.xml
@@ -163,6 +163,16 @@
+org.codehaus.mojo
+findbugs-maven-plugin
+
+ true
+ true
+
${project.basedir}/dev-support/findbugs-exclude.xml
+ Max
+
+
+
org.apache.rat
apache-rat-plugin
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f747f5b0/hadoop-yarn-project/hadoop-yarn/dev-support/findbugs-exclude.xml
--
diff --git a/hadoop-yarn-project/hadoop-yarn/dev-support/findbugs-exclude.xml
b/hadoop-yarn-project/hadoop-yarn/dev-support/findbugs-exclude.xml
index 216c3bd..dd42129 100644
--- a/hadoop-yarn-project/hadoop-yarn/dev-support/findbugs-exclude.xml
+++ b/hadoop-yarn-project/hadoop-yarn/dev-support/findbugs-exclude.xml
@@ -639,22 +639,6 @@
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[2/2] hadoop git commit: HDFS-13942. [JDK10] Fix javadoc errors in hadoop-hdfs module. Contributed by Dinesh Chitlangia.
HDFS-13942. [JDK10] Fix javadoc errors in hadoop-hdfs module. Contributed by Dinesh Chitlangia. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fac9f91b Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/fac9f91b Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/fac9f91b Branch: refs/heads/trunk Commit: fac9f91b2944cee641049fffcafa6b65e0cf68f2 Parents: e4f22b0 Author: Akira Ajisaka Authored: Wed Oct 31 14:43:58 2018 +0900 Committer: Akira Ajisaka Committed: Wed Oct 31 14:43:58 2018 +0900 -- .../java/org/apache/hadoop/hdfs/DFSUtil.java| 12 ++-- .../hadoop/hdfs/protocol/BlockListAsLongs.java | 2 +- .../QJournalProtocolServerSideTranslatorPB.java | 2 +- .../token/block/BlockTokenSecretManager.java| 2 +- .../hadoop/hdfs/server/balancer/Balancer.java | 15 ++--- .../server/blockmanagement/BlockManager.java| 26 + .../blockmanagement/BlockPlacementPolicy.java | 1 - .../CombinedHostFileManager.java| 6 +- .../blockmanagement/CorruptReplicasMap.java | 2 +- .../blockmanagement/DatanodeAdminManager.java | 8 +-- .../server/blockmanagement/HostFileManager.java | 7 +-- .../hdfs/server/blockmanagement/HostSet.java| 8 +-- .../server/blockmanagement/SlowPeerTracker.java | 5 +- .../server/datanode/BlockPoolSliceStorage.java | 60 .../server/datanode/BlockRecoveryWorker.java| 15 +++-- .../hdfs/server/datanode/BlockScanner.java | 6 +- .../hadoop/hdfs/server/datanode/DataNode.java | 10 ++-- .../hdfs/server/datanode/DataStorage.java | 4 +- .../hdfs/server/datanode/DirectoryScanner.java | 1 - .../hdfs/server/datanode/FileIoProvider.java| 3 - .../hdfs/server/datanode/VolumeScanner.java | 4 +- .../server/datanode/checker/AbstractFuture.java | 13 ++--- .../server/datanode/fsdataset/FsDatasetSpi.java | 12 ++-- .../server/datanode/fsdataset/FsVolumeSpi.java | 13 +++-- .../datanode/metrics/OutlierDetector.java | 3 +- .../diskbalancer/DiskBalancerException.java | 1 - .../datamodel/DiskBalancerCluster.java | 11 ++-- .../datamodel/DiskBalancerDataNode.java | 10 ++-- .../diskbalancer/planner/GreedyPlanner.java | 2 +- .../hadoop/hdfs/server/namenode/AclStorage.java | 18 +++--- .../server/namenode/EncryptionZoneManager.java | 42 +- .../hdfs/server/namenode/FSDirectory.java | 8 +-- .../hdfs/server/namenode/FSNamesystem.java | 24 ++-- .../hadoop/hdfs/server/namenode/INode.java | 4 +- .../hdfs/server/namenode/INodeReference.java| 6 +- .../hdfs/server/namenode/INodesInPath.java | 4 +- .../hdfs/server/namenode/JournalManager.java| 2 +- .../hdfs/server/namenode/LeaseManager.java | 2 +- .../server/namenode/MetaRecoveryContext.java| 2 +- .../hadoop/hdfs/server/namenode/NameNode.java | 6 +- .../hdfs/server/namenode/NamenodeFsck.java | 9 ++- .../hadoop/hdfs/server/namenode/Quota.java | 5 +- .../server/namenode/ReencryptionHandler.java| 2 +- .../server/namenode/XAttrPermissionFilter.java | 4 +- .../hdfs/server/namenode/XAttrStorage.java | 8 +-- .../snapshot/AbstractINodeDiffList.java | 8 +-- .../namenode/snapshot/DiffListBySkipList.java | 9 +-- .../sps/BlockStorageMovementNeeded.java | 5 +- .../namenode/sps/DatanodeCacheManager.java | 2 +- .../sps/StoragePolicySatisfyManager.java| 14 +++-- .../startupprogress/StartupProgressView.java| 4 +- .../server/namenode/top/metrics/TopMetrics.java | 17 -- .../namenode/top/window/RollingWindow.java | 18 +++--- .../top/window/RollingWindowManager.java| 2 +- .../protocol/BlockStorageMovementCommand.java | 11 ++-- .../hdfs/server/protocol/DatanodeProtocol.java | 2 +- .../hdfs/server/protocol/NamenodeProtocol.java | 5 +- .../sps/ExternalSPSBlockMoveTaskHandler.java| 2 + .../org/apache/hadoop/hdfs/tools/DFSck.java | 13 +++-- .../offlineEditsViewer/OfflineEditsViewer.java | 4 +- .../offlineEditsViewer/OfflineEditsVisitor.java | 2 +- .../StatisticsEditsVisitor.java | 4 +- .../NameDistributionVisitor.java| 4 +- .../java/org/apache/hadoop/hdfs/util/Diff.java | 16 +++--- .../org/apache/hadoop/hdfs/util/XMLUtils.java | 4 +- 65 files changed, 310 insertions(+), 246 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/fac9f91b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java index 6dd366f..8627268
[1/2] hadoop git commit: HDFS-13942. [JDK10] Fix javadoc errors in hadoop-hdfs module. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/trunk e4f22b08e -> fac9f91b2
http://git-wip-us.apache.org/repos/asf/hadoop/blob/fac9f91b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java
index 5e708be..a195bf1 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java
@@ -47,7 +47,7 @@ public enum Quota {
/**
* Is quota violated?
- * The quota is violated if quota is set and usage > quota.
+ * The quota is violated if quota is set and usage > quota.
*/
public static boolean isViolated(final long quota, final long usage) {
return quota >= 0 && usage > quota;
@@ -55,7 +55,8 @@ public enum Quota {
/**
* Is quota violated?
- * The quota is violated if quota is set, delta > 0 and usage + delta >
quota.
+ * The quota is violated if quota is set, delta > 0 and
+ * usage + delta > quota.
*/
static boolean isViolated(final long quota, final long usage,
final long delta) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/fac9f91b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ReencryptionHandler.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ReencryptionHandler.java
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ReencryptionHandler.java
index a8acccd..2e13df5 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ReencryptionHandler.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ReencryptionHandler.java
@@ -319,7 +319,7 @@ public class ReencryptionHandler implements Runnable {
/**
* Main loop. It takes at most 1 zone per scan, and executes until the zone
* is completed.
- * {@see #reencryptEncryptionZoneInt(Long)}.
+ * {@link #reencryptEncryptionZone(long)}.
*/
@Override
public void run() {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/fac9f91b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrPermissionFilter.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrPermissionFilter.java
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrPermissionFilter.java
index e1bf027..b6f4f64 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrPermissionFilter.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrPermissionFilter.java
@@ -31,7 +31,7 @@ import com.google.common.base.Preconditions;
import static
org.apache.hadoop.hdfs.server.common.HdfsServerConstants.SECURITY_XATTR_UNREADABLE_BY_SUPERUSER;
/**
- * There are four types of extended attributes defined by the
+ * There are four types of extended attributes defined by the
* following namespaces:
*
* USER - extended user attributes: these can be assigned to files and
@@ -56,7 +56,7 @@ import static
org.apache.hadoop.hdfs.server.common.HdfsServerConstants.SECURITY_
* is called on a file or directory in the /.reserved/raw HDFS directory
* hierarchy. These attributes can only be accessed by the user who have
* read access.
- *
+ *
*/
@InterfaceAudience.Private
public class XAttrPermissionFilter {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/fac9f91b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrStorage.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrStorage.java
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrStorage.java
index 1dab69c..d856f6d 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrStorage.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/XAttrStorage.java
@@ -33,7 +33,7 @@ public class XAttrStorage {
/**
* Reads the extended attribute of an inode by name with prefix.
- *
+ *
*
* @param inode INode to read
* @param snapshotId the snapshotId of the requested path
@@ -48,11 +48,11 @@ public class XAttrStorage {
hadoop git commit: Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 e060e90ba -> dd70b1f53
Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dd70b1f5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/dd70b1f5
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/dd70b1f5
Branch: refs/heads/branch-3.1
Commit: dd70b1f53836961029767660398819a3b04eec58
Parents: e060e90
Author: Akira Ajisaka
Authored: Wed Oct 31 17:01:49 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 31 17:02:15 2018 +0900
--
.../test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java| 2 ++
1 file changed, 2 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/dd70b1f5/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
index 5cae2fc..1a046e8 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
@@ -102,6 +102,8 @@ public class TestHdfsConfigFields extends
TestConfigurationFieldsBase {
.add(DFSConfigKeys.DFS_NAMENODE_STARTUP_KEY);
configurationPropsToSkipCompare.add(DFSConfigKeys
.DFS_DATANODE_ENABLE_FILEIO_FAULT_INJECTION_KEY);
+configurationPropsToSkipCompare.add(DFSConfigKeys
+.DFS_IMAGE_EXPANDED_STRING_TABLES_KEY);
// Allocate
xmlPropsToSkipCompare = new HashSet();
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.0 20c9a12bc -> 2ae21d538
Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
(cherry picked from commit dd70b1f53836961029767660398819a3b04eec58)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2ae21d53
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2ae21d53
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/2ae21d53
Branch: refs/heads/branch-3.0
Commit: 2ae21d5387e1b85adc785de5257ae382c336e4ab
Parents: 20c9a12
Author: Akira Ajisaka
Authored: Wed Oct 31 17:01:49 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 31 17:03:47 2018 +0900
--
.../test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java| 2 ++
1 file changed, 2 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/2ae21d53/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
index 5cae2fc..1a046e8 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
@@ -102,6 +102,8 @@ public class TestHdfsConfigFields extends
TestConfigurationFieldsBase {
.add(DFSConfigKeys.DFS_NAMENODE_STARTUP_KEY);
configurationPropsToSkipCompare.add(DFSConfigKeys
.DFS_DATANODE_ENABLE_FILEIO_FAULT_INJECTION_KEY);
+configurationPropsToSkipCompare.add(DFSConfigKeys
+.DFS_IMAGE_EXPANDED_STRING_TABLES_KEY);
// Allocate
xmlPropsToSkipCompare = new HashSet();
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
Repository: hadoop
Updated Branches:
refs/heads/branch-2 f23f339a6 -> c19baf19d
Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
(cherry picked from commit dd70b1f53836961029767660398819a3b04eec58)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c19baf19
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c19baf19
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/c19baf19
Branch: refs/heads/branch-2
Commit: c19baf19dac4bca4fd0402105f8a0508c518e65a
Parents: f23f339
Author: Akira Ajisaka
Authored: Wed Oct 31 17:01:49 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 31 17:04:06 2018 +0900
--
.../test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java| 2 ++
1 file changed, 2 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c19baf19/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
index 86b570d..2d88636 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
@@ -107,6 +107,8 @@ public class TestHdfsConfigFields extends
TestConfigurationFieldsBase {
.add(DFSConfigKeys.DFS_NAMENODE_STARTUP_KEY);
configurationPropsToSkipCompare.add(DFSConfigKeys
.DFS_DATANODE_ENABLE_FILEIO_FAULT_INJECTION_KEY);
+configurationPropsToSkipCompare.add(DFSConfigKeys
+.DFS_IMAGE_EXPANDED_STRING_TABLES_KEY);
// Allocate
xmlPropsToSkipCompare = new HashSet();
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 ce602fa84 -> 9a69cc1b5
Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
(cherry picked from commit dd70b1f53836961029767660398819a3b04eec58)
(cherry picked from commit c19baf19dac4bca4fd0402105f8a0508c518e65a)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9a69cc1b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9a69cc1b
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/9a69cc1b
Branch: refs/heads/branch-2.9
Commit: 9a69cc1b584167389b37ced597cb61df2c37
Parents: ce602fa
Author: Akira Ajisaka
Authored: Wed Oct 31 17:01:49 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Oct 31 17:04:33 2018 +0900
--
.../test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java| 2 ++
1 file changed, 2 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/9a69cc1b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
index 86b570d..2d88636 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tools/TestHdfsConfigFields.java
@@ -107,6 +107,8 @@ public class TestHdfsConfigFields extends
TestConfigurationFieldsBase {
.add(DFSConfigKeys.DFS_NAMENODE_STARTUP_KEY);
configurationPropsToSkipCompare.add(DFSConfigKeys
.DFS_DATANODE_ENABLE_FILEIO_FAULT_INJECTION_KEY);
+configurationPropsToSkipCompare.add(DFSConfigKeys
+.DFS_IMAGE_EXPANDED_STRING_TABLES_KEY);
// Allocate
xmlPropsToSkipCompare = new HashSet();
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: YARN-7765. Fixed an issue that kerberos tgt not found when NM posting timeline events. Contributed by Rohith Sharma K S
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 9a69cc1b5 -> 15a777fa2
YARN-7765. Fixed an issue that kerberos tgt not found when NM posting timeline
events. Contributed by Rohith Sharma K S
(cherry picked from commit 0497e09339415ffd6b6f84beeff7e1809647662c)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/15a777fa
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/15a777fa
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/15a777fa
Branch: refs/heads/branch-2.9
Commit: 15a777fa2d30c3a5b9a8eff8f3b9219bae0bc991
Parents: 9a69cc1
Author: Jian He
Authored: Sat Jan 27 22:18:51 2018 -0800
Committer: Akira Ajisaka
Committed: Thu Nov 1 13:26:36 2018 +0900
--
.../hadoop/yarn/server/nodemanager/NodeManager.java | 11 ---
.../nodemanager/timelineservice/NMTimelinePublisher.java | 1 +
.../timelineservice/storage/HBaseTimelineWriterImpl.java | 5 +
3 files changed, 10 insertions(+), 7 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/15a777fa/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
index 2920d97..fcb5474 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
@@ -441,18 +441,15 @@ public class NodeManager extends CompositeService
addService(nodeStatusUpdater);
((NMContext) context).setNodeStatusUpdater(nodeStatusUpdater);
-super.serviceInit(conf);
-// TODO add local dirs to del
- }
-
- @Override
- protected void serviceStart() throws Exception {
+// Do secure login before calling init for added services.
try {
doSecureLogin();
} catch (IOException e) {
throw new YarnRuntimeException("Failed NodeManager login", e);
}
-super.serviceStart();
+
+super.serviceInit(conf);
+// TODO add local dirs to del
}
@Override
http://git-wip-us.apache.org/repos/asf/hadoop/blob/15a777fa/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/timelineservice/NMTimelinePublisher.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/timelineservice/NMTimelinePublisher.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/timelineservice/NMTimelinePublisher.java
index 2124c1a..52895c4 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/timelineservice/NMTimelinePublisher.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/timelineservice/NMTimelinePublisher.java
@@ -99,6 +99,7 @@ public class NMTimelinePublisher extends CompositeService {
this.nmLoginUGI = UserGroupInformation.isSecurityEnabled() ?
UserGroupInformation.getLoginUser() :
UserGroupInformation.getCurrentUser();
+LOG.info("Initialized NMTimelinePublisher UGI to " + nmLoginUGI);
super.serviceInit(conf);
}
http://git-wip-us.apache.org/repos/asf/hadoop/blob/15a777fa/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/HBaseTimelineWriterImpl.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/HBaseTimelineWriterImpl.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/HBaseTimelineWriterImpl.java
index 9e9134c..f938185 100644
---
a/hadoop-yarn-project/hadoop-yarn/hado
hadoop git commit: YARN-8404. Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down. Contributed by Rohith Sharma K S
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 15a777fa2 -> 3df916db6
YARN-8404. Timeline event publish need to be async to avoid Dispatcher thread
leak in case ATS is down. Contributed by Rohith Sharma K S
(cherry picked from commit 6307962b932e0ee69ba61f5796388c175d79195a)
(cherry picked from commit 96a6798c1ddbfc159e50f1a2049754898156dbe3)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3df916db
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3df916db
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/3df916db
Branch: refs/heads/branch-2.9
Commit: 3df916db63131e6aa6284aefb2208f9d3a72c431
Parents: 15a777f
Author: Sunil G
Authored: Wed Jun 13 16:09:16 2018 +0530
Committer: Akira Ajisaka
Committed: Thu Nov 1 13:33:36 2018 +0900
--
.../resourcemanager/metrics/TimelineServiceV1Publisher.java| 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/3df916db/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TimelineServiceV1Publisher.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TimelineServiceV1Publisher.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TimelineServiceV1Publisher.java
index e1fe512..423f538 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TimelineServiceV1Publisher.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TimelineServiceV1Publisher.java
@@ -151,9 +151,9 @@ public class TimelineServiceV1Publisher extends
AbstractSystemMetricsPublisher {
tEvent.setEventInfo(eventInfo);
entity.addEvent(tEvent);
-// sync sending of finish event to avoid possibility of saving application
-// finished state in RMStateStore save without publishing in ATS.
-putEntity(entity); // sync event so that ATS update is done without fail.
+
+getDispatcher().getEventHandler().handle(new TimelineV1PublishEvent(
+SystemMetricsEventType.PUBLISH_ENTITY, entity,
app.getApplicationId()));
}
@SuppressWarnings("unchecked")
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] Git Push Summary
Repository: hadoop Updated Branches: refs/heads/branch-2.9.2 [created] 3df916db6 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: Preparing for 2.9.3 development
Repository: hadoop Updated Branches: refs/heads/branch-2.9 3df916db6 -> 2e997e8ab Preparing for 2.9.3 development Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2e997e8a Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2e997e8a Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/2e997e8a Branch: refs/heads/branch-2.9 Commit: 2e997e8ab1a945312b817fd5c32d87d02af19630 Parents: 3df916d Author: Akira Ajisaka Authored: Thu Nov 1 13:58:52 2018 +0900 Committer: Akira Ajisaka Committed: Thu Nov 1 13:58:52 2018 +0900 -- hadoop-assemblies/pom.xml| 4 ++-- hadoop-build-tools/pom.xml | 2 +- hadoop-client/pom.xml| 4 ++-- hadoop-cloud-storage-project/hadoop-cloud-storage/pom.xml| 4 ++-- hadoop-cloud-storage-project/pom.xml | 4 ++-- hadoop-common-project/hadoop-annotations/pom.xml | 4 ++-- hadoop-common-project/hadoop-auth-examples/pom.xml | 4 ++-- hadoop-common-project/hadoop-auth/pom.xml| 4 ++-- hadoop-common-project/hadoop-common/pom.xml | 4 ++-- hadoop-common-project/hadoop-kms/pom.xml | 4 ++-- hadoop-common-project/hadoop-minikdc/pom.xml | 4 ++-- hadoop-common-project/hadoop-nfs/pom.xml | 4 ++-- hadoop-common-project/pom.xml| 4 ++-- hadoop-dist/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs-client/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml| 4 ++-- hadoop-hdfs-project/hadoop-hdfs-nfs/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs-rbf/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/pom.xml| 4 ++-- hadoop-hdfs-project/pom.xml | 4 ++-- .../hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml | 4 ++-- .../hadoop-mapreduce-client-common/pom.xml | 4 ++-- .../hadoop-mapreduce-client/hadoop-mapreduce-client-core/pom.xml | 4 ++-- .../hadoop-mapreduce-client-hs-plugins/pom.xml | 4 ++-- .../hadoop-mapreduce-client/hadoop-mapreduce-client-hs/pom.xml | 4 ++-- .../hadoop-mapreduce-client-jobclient/pom.xml| 4 ++-- .../hadoop-mapreduce-client-shuffle/pom.xml | 4 ++-- hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml | 4 ++-- hadoop-mapreduce-project/hadoop-mapreduce-examples/pom.xml | 4 ++-- hadoop-mapreduce-project/pom.xml | 4 ++-- hadoop-maven-plugins/pom.xml | 2 +- hadoop-minicluster/pom.xml | 4 ++-- hadoop-project-dist/pom.xml | 4 ++-- hadoop-project/pom.xml | 4 ++-- hadoop-tools/hadoop-aliyun/pom.xml | 2 +- hadoop-tools/hadoop-ant/pom.xml | 4 ++-- hadoop-tools/hadoop-archive-logs/pom.xml | 4 ++-- hadoop-tools/hadoop-archives/pom.xml | 4 ++-- hadoop-tools/hadoop-aws/pom.xml | 4 ++-- hadoop-tools/hadoop-azure-datalake/pom.xml | 2 +- hadoop-tools/hadoop-azure/pom.xml| 2 +- hadoop-tools/hadoop-datajoin/pom.xml | 4 ++-- hadoop-tools/hadoop-distcp/pom.xml | 4 ++-- hadoop-tools/hadoop-extras/pom.xml | 4 ++-- hadoop-tools/hadoop-gridmix/pom.xml | 4 ++-- hadoop-tools/hadoop-openstack/pom.xml| 4 ++-- hadoop-tools/hadoop-pipes/pom.xml| 4 ++-- hadoop-tools/hadoop-resourceestimator/pom.xml| 4 ++-- hadoop-tools/hadoop-rumen/pom.xml| 4 ++-- hadoop-tools/hadoop-sls/pom.xml | 4 ++-- hadoop-tools/hadoop-streaming/pom.xml| 4 ++-- hadoop-tools/hadoop-tools-dist/pom.xml | 4 ++-- hadoop-tools/pom.xml | 4 ++-- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/pom.xml | 4 ++-- .../hadoop-yarn-applications-distributedshell/pom.xml| 4 ++-- .../hadoop-yarn-applications-unmanaged-am-launcher/p
hadoop git commit: Update the version from 2.9.2-SNAPSHOT to 2.9.2
Repository: hadoop Updated Branches: refs/heads/branch-2.9.2 3df916db6 -> 5537f1db0 Update the version from 2.9.2-SNAPSHOT to 2.9.2 Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5537f1db Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/5537f1db Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/5537f1db Branch: refs/heads/branch-2.9.2 Commit: 5537f1db09782806b5d9cdf9acf4c773beefaa7e Parents: 3df916d Author: Akira Ajisaka Authored: Thu Nov 1 14:10:12 2018 +0900 Committer: Akira Ajisaka Committed: Thu Nov 1 14:10:12 2018 +0900 -- hadoop-assemblies/pom.xml| 4 ++-- hadoop-build-tools/pom.xml | 2 +- hadoop-client/pom.xml| 4 ++-- hadoop-cloud-storage-project/hadoop-cloud-storage/pom.xml| 4 ++-- hadoop-cloud-storage-project/pom.xml | 4 ++-- hadoop-common-project/hadoop-annotations/pom.xml | 4 ++-- hadoop-common-project/hadoop-auth-examples/pom.xml | 4 ++-- hadoop-common-project/hadoop-auth/pom.xml| 4 ++-- hadoop-common-project/hadoop-common/pom.xml | 4 ++-- hadoop-common-project/hadoop-kms/pom.xml | 4 ++-- hadoop-common-project/hadoop-minikdc/pom.xml | 4 ++-- hadoop-common-project/hadoop-nfs/pom.xml | 4 ++-- hadoop-common-project/pom.xml| 4 ++-- hadoop-dist/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs-client/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml| 4 ++-- hadoop-hdfs-project/hadoop-hdfs-nfs/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs-rbf/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs/pom.xml | 4 ++-- hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/pom.xml| 4 ++-- hadoop-hdfs-project/pom.xml | 4 ++-- .../hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml | 4 ++-- .../hadoop-mapreduce-client-common/pom.xml | 4 ++-- .../hadoop-mapreduce-client/hadoop-mapreduce-client-core/pom.xml | 4 ++-- .../hadoop-mapreduce-client-hs-plugins/pom.xml | 4 ++-- .../hadoop-mapreduce-client/hadoop-mapreduce-client-hs/pom.xml | 4 ++-- .../hadoop-mapreduce-client-jobclient/pom.xml| 4 ++-- .../hadoop-mapreduce-client-shuffle/pom.xml | 4 ++-- hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml | 4 ++-- hadoop-mapreduce-project/hadoop-mapreduce-examples/pom.xml | 4 ++-- hadoop-mapreduce-project/pom.xml | 4 ++-- hadoop-maven-plugins/pom.xml | 2 +- hadoop-minicluster/pom.xml | 4 ++-- hadoop-project-dist/pom.xml | 4 ++-- hadoop-project/pom.xml | 4 ++-- hadoop-tools/hadoop-aliyun/pom.xml | 2 +- hadoop-tools/hadoop-ant/pom.xml | 4 ++-- hadoop-tools/hadoop-archive-logs/pom.xml | 4 ++-- hadoop-tools/hadoop-archives/pom.xml | 4 ++-- hadoop-tools/hadoop-aws/pom.xml | 4 ++-- hadoop-tools/hadoop-azure-datalake/pom.xml | 2 +- hadoop-tools/hadoop-azure/pom.xml| 2 +- hadoop-tools/hadoop-datajoin/pom.xml | 4 ++-- hadoop-tools/hadoop-distcp/pom.xml | 4 ++-- hadoop-tools/hadoop-extras/pom.xml | 4 ++-- hadoop-tools/hadoop-gridmix/pom.xml | 4 ++-- hadoop-tools/hadoop-openstack/pom.xml| 4 ++-- hadoop-tools/hadoop-pipes/pom.xml| 4 ++-- hadoop-tools/hadoop-resourceestimator/pom.xml| 4 ++-- hadoop-tools/hadoop-rumen/pom.xml| 4 ++-- hadoop-tools/hadoop-sls/pom.xml | 4 ++-- hadoop-tools/hadoop-streaming/pom.xml| 4 ++-- hadoop-tools/hadoop-tools-dist/pom.xml | 4 ++-- hadoop-tools/pom.xml | 4 ++-- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/pom.xml | 4 ++-- .../hadoop-yarn-applications-distributedshell/pom.xml| 4 ++-- .../hadoop-yarn-applications-unm
hadoop git commit: Update index.md.vm for 2.9.2 release.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9.2 5537f1db0 -> 01f7d838c
Update index.md.vm for 2.9.2 release.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/01f7d838
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/01f7d838
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/01f7d838
Branch: refs/heads/branch-2.9.2
Commit: 01f7d838c93114cdb5e318a4dc3be8d64152f272
Parents: 5537f1d
Author: Akira Ajisaka
Authored: Thu Nov 1 14:42:21 2018 +0900
Committer: Akira Ajisaka
Committed: Thu Nov 1 14:42:32 2018 +0900
--
hadoop-project/src/site/markdown/index.md.vm | 60 +--
1 file changed, 34 insertions(+), 26 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/01f7d838/hadoop-project/src/site/markdown/index.md.vm
--
diff --git a/hadoop-project/src/site/markdown/index.md.vm
b/hadoop-project/src/site/markdown/index.md.vm
index 1cbc181..ba2b85d 100644
--- a/hadoop-project/src/site/markdown/index.md.vm
+++ b/hadoop-project/src/site/markdown/index.md.vm
@@ -15,48 +15,56 @@
Apache Hadoop ${project.version}
-Apache Hadoop ${project.version} is a minor release in the 2.x.y release
-line, building upon the previous stable release 2.4.1.
+Apache Hadoop ${project.version} is a point release in the 2.x.y release
+line, building upon the previous stable release 2.9.1.
Here is a short overview of the major features and improvements.
* Common
-* Authentication improvements when using an HTTP proxy server. This is
-useful when accessing WebHDFS via a proxy server.
-
-* A new Hadoop metrics sink that allows writing directly to Graphite.
+* Aliyun OSS Support. See the
+[user documentation](./hadoop-aliyun/tools/hadoop-aliyun/index.html)
+for more details.
-* [Specification
work](./hadoop-project-dist/hadoop-common/filesystem/index.html)
-related to the Hadoop Compatible Filesystem (HCFS) effort.
+* HADOOP Resource Estimator. See the
+[user documentation](./hadoop-resourceestimator/ResourceEstimator.html)
+for more details.
* HDFS
-* Support for POSIX-style filesystem extended attributes. See the
-[user
documentation](./hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html)
+* HDFS Router based federation. See the
+[user
documentation](./hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html)
for more details.
-* Using the OfflineImageViewer, clients can now browse an fsimage via
-the WebHDFS API.
+* YARN
-* The NFS gateway received a number of supportability improvements and
-bug fixes. The Hadoop portmapper is no longer required to run the
gateway,
-and the gateway is now able to reject connections from unprivileged
ports.
+* YARN Timeline Service v.2. See the
+[user
documentation](./hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html)
+for more details.
-* The SecondaryNameNode, JournalNode, and DataNode web UIs have been
-modernized with HTML5 and Javascript.
+* YARN Federation. See the
+[user documentation](./hadoop-yarn/hadoop-yarn-site/Federation.html)
+for more details.
-* YARN
+* Opportunistic Containers. See the
+[user
documentation](./hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html)
+for more details.
+
+* YARN Web UI v.2. See the
+[user documentation](./hadoop-yarn/hadoop-yarn-site/YarnUI2.html)
+for more details.
+
+* Capacity Scheduler
-* YARN's REST APIs now support write/modify operations. Users can submit
and
-kill applications through REST APIs.
+* Changing queue configuration via API. See the
+[user
documentation](./hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Changing_queue_configuration_via_API)
+for more details.
-* The timeline store in YARN, used for storing generic and
-application-specific information for applications, supports
authentication
-through Kerberos.
+* Update Resources and Execution Type of an
+allocated/running container. See the
+[user
documentation](./hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Updating_a_Container_Experimental_-_API_may_change_in_the_future)
+for more details.
-* The Fair Scheduler supports dynamic hierarchical user queues, user
queues
-are created dynamically at runtime under any specified parent-queue.
Getting Started
===
@@ -66,4 +74,4 @@ Hadoop. Begin with the
[Single Node Setup](./hadoop-project-dist/hadoop-comm
hadoop git commit: Minor fix in index.md.vm
Repository: hadoop Updated Branches: refs/heads/branch-2.9.2 01f7d838c -> 0a98347a6 Minor fix in index.md.vm Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0a98347a Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0a98347a Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/0a98347a Branch: refs/heads/branch-2.9.2 Commit: 0a98347a6727d5a4cd4d430339b276491fd6a06a Parents: 01f7d83 Author: Akira Ajisaka Authored: Thu Nov 1 16:07:33 2018 +0900 Committer: Akira Ajisaka Committed: Thu Nov 1 16:07:42 2018 +0900 -- hadoop-project/src/site/markdown/index.md.vm | 16 +++- 1 file changed, 7 insertions(+), 9 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/0a98347a/hadoop-project/src/site/markdown/index.md.vm -- diff --git a/hadoop-project/src/site/markdown/index.md.vm b/hadoop-project/src/site/markdown/index.md.vm index ba2b85d..2247a65 100644 --- a/hadoop-project/src/site/markdown/index.md.vm +++ b/hadoop-project/src/site/markdown/index.md.vm @@ -54,16 +54,14 @@ Here is a short overview of the major features and improvements. [user documentation](./hadoop-yarn/hadoop-yarn-site/YarnUI2.html) for more details. -* Capacity Scheduler - -* Changing queue configuration via API. See the -[user documentation](./hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Changing_queue_configuration_via_API) -for more details. +* Changing queue configuration via API (supported only on the Capacity Scheduler). See the +[user documentation](./hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Changing_queue_configuration_via_API) +for more details. -* Update Resources and Execution Type of an -allocated/running container. See the -[user documentation](./hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Updating_a_Container_Experimental_-_API_may_change_in_the_future) -for more details. +* Update Resources and Execution Type of an allocated/running container. +(supported only on the Capacity Scheduler). See the +[user documentation](./hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Updating_a_Container_Experimental_-_API_may_change_in_the_future) +for more details. Getting Started - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
Repository: hadoop Updated Branches: refs/heads/trunk 4e3df75eb -> a5e21cd6a HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a5e21cd6 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a5e21cd6 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/a5e21cd6 Branch: refs/heads/trunk Commit: a5e21cd6a450990d00eb7515d579b51d2a0bff82 Parents: 4e3df75 Author: Akira Ajisaka Authored: Mon Nov 5 15:28:21 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 15:28:21 2018 +0900 -- NOTICE.txt | 8 1 file changed, 4 insertions(+), 4 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/a5e21cd6/NOTICE.txt -- diff --git a/NOTICE.txt b/NOTICE.txt index 00fa375..d6e5488 100644 --- a/NOTICE.txt +++ b/NOTICE.txt @@ -8,10 +8,10 @@ following notices: * Copyright 2011 FuseSource Corp. http://fusesource.com The binary distribution of this product bundles binaries of -AWS SDK for Java - Bundle 1.11.134, -AWS Java SDK for AWS KMS 1.11.134, -AWS Java SDK for Amazon S3 1.11.134, -AWS Java SDK for AWS STS 1.11.134, +AWS SDK for Java - Bundle 1.11.375, +AWS Java SDK for AWS KMS 1.11.375, +AWS Java SDK for Amazon S3 1.11.375, +AWS Java SDK for AWS STS 1.11.375, JMES Path Query library 1.0, which has the following notices: * This software includes third party software subject to the following - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-3.2 a15bcf97a -> ea6b9d6c6 HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. (cherry picked from commit a5e21cd6a450990d00eb7515d579b51d2a0bff82) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ea6b9d6c Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ea6b9d6c Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ea6b9d6c Branch: refs/heads/branch-3.2 Commit: ea6b9d6c61e35c86d05017ae2cde497e63eb4a9b Parents: a15bcf9 Author: Akira Ajisaka Authored: Mon Nov 5 15:28:21 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 15:29:06 2018 +0900 -- NOTICE.txt | 8 1 file changed, 4 insertions(+), 4 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/ea6b9d6c/NOTICE.txt -- diff --git a/NOTICE.txt b/NOTICE.txt index a53f13c..c1617f7 100644 --- a/NOTICE.txt +++ b/NOTICE.txt @@ -8,10 +8,10 @@ following notices: * Copyright 2011 FuseSource Corp. http://fusesource.com The binary distribution of this product bundles binaries of -AWS SDK for Java - Bundle 1.11.134, -AWS Java SDK for AWS KMS 1.11.134, -AWS Java SDK for Amazon S3 1.11.134, -AWS Java SDK for AWS STS 1.11.134, +AWS SDK for Java - Bundle 1.11.375, +AWS Java SDK for AWS KMS 1.11.375, +AWS Java SDK for Amazon S3 1.11.375, +AWS Java SDK for AWS STS 1.11.375, JMES Path Query library 1.0, which has the following notices: * This software includes third party software subject to the following - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-3.0 68ec0fa0a -> 869b1cee6 HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. (cherry picked from commit 73d8f8761e969ed6054cec0f58ae86d13232e516) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/869b1cee Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/869b1cee Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/869b1cee Branch: refs/heads/branch-3.0 Commit: 869b1cee671ba146ade22b5cc1fc4fb0e57d Parents: 68ec0fa Author: Akira Ajisaka Authored: Mon Nov 5 15:31:53 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 15:32:23 2018 +0900 -- NOTICE.txt | 8 1 file changed, 4 insertions(+), 4 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/869b1cee/NOTICE.txt -- diff --git a/NOTICE.txt b/NOTICE.txt index 0718909..23c2dc3 100644 --- a/NOTICE.txt +++ b/NOTICE.txt @@ -8,10 +8,10 @@ following notices: * Copyright 2011 FuseSource Corp. http://fusesource.com The binary distribution of this product bundles binaries of -AWS SDK for Java - Bundle 1.11.134, -AWS Java SDK for AWS KMS 1.11.134, -AWS Java SDK for Amazon S3 1.11.134, -AWS Java SDK for AWS STS 1.11.134, +AWS SDK for Java - Bundle 1.11.271, +AWS Java SDK for AWS KMS 1.11.271, +AWS Java SDK for Amazon S3 1.11.271, +AWS Java SDK for AWS STS 1.11.271, JMES Path Query library 1.0, which has the following notices: * This software includes third party software subject to the following - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-3.1 0577c8901 -> 73d8f8761 HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/73d8f876 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/73d8f876 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/73d8f876 Branch: refs/heads/branch-3.1 Commit: 73d8f8761e969ed6054cec0f58ae86d13232e516 Parents: 0577c89 Author: Akira Ajisaka Authored: Mon Nov 5 15:31:53 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 15:31:53 2018 +0900 -- NOTICE.txt | 8 1 file changed, 4 insertions(+), 4 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/73d8f876/NOTICE.txt -- diff --git a/NOTICE.txt b/NOTICE.txt index 95a670d..ecb486f 100644 --- a/NOTICE.txt +++ b/NOTICE.txt @@ -8,10 +8,10 @@ following notices: * Copyright 2011 FuseSource Corp. http://fusesource.com The binary distribution of this product bundles binaries of -AWS SDK for Java - Bundle 1.11.134, -AWS Java SDK for AWS KMS 1.11.134, -AWS Java SDK for Amazon S3 1.11.134, -AWS Java SDK for AWS STS 1.11.134, +AWS SDK for Java - Bundle 1.11.271, +AWS Java SDK for AWS KMS 1.11.271, +AWS Java SDK for Amazon S3 1.11.271, +AWS Java SDK for AWS STS 1.11.271, JMES Path Query library 1.0, which has the following notices: * This software includes third party software subject to the following - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-2 731b90d44 -> 72ee45acf HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/72ee45ac Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/72ee45ac Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/72ee45ac Branch: refs/heads/branch-2 Commit: 72ee45acffc895649b09fa759d61ff0f58bb9b9a Parents: 731b90d Author: Akira Ajisaka Authored: Mon Nov 5 15:32:54 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 15:32:54 2018 +0900 -- NOTICE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/72ee45ac/NOTICE.txt -- diff --git a/NOTICE.txt b/NOTICE.txt index 33c12ed..6ab0214 100644 --- a/NOTICE.txt +++ b/NOTICE.txt @@ -17,7 +17,7 @@ which has the following notices: * This product includes software developed by IBM Corporation and others. The binary distribution of this product bundles binaries of -AWS Java SDK 1.10.6, +AWS Java SDK 1.11.199, which has the following notices: * This software includes third party software subject to the following copyrights: - XML parsing and utility functions from JetS3t - Copyright - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-2.9.2 0a98347a6 -> e10a1886c HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. (cherry picked from commit 72ee45acffc895649b09fa759d61ff0f58bb9b9a) (cherry picked from commit 9c64d42914e4cf328ee6a6f6c4c40182ba8279aa) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e10a1886 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e10a1886 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/e10a1886 Branch: refs/heads/branch-2.9.2 Commit: e10a1886cec354722fcebeae2b189f6710cfa61c Parents: 0a98347 Author: Akira Ajisaka Authored: Mon Nov 5 15:32:54 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 15:33:25 2018 +0900 -- NOTICE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/e10a1886/NOTICE.txt -- diff --git a/NOTICE.txt b/NOTICE.txt index 33c12ed..6ab0214 100644 --- a/NOTICE.txt +++ b/NOTICE.txt @@ -17,7 +17,7 @@ which has the following notices: * This product includes software developed by IBM Corporation and others. The binary distribution of this product bundles binaries of -AWS Java SDK 1.10.6, +AWS Java SDK 1.11.199, which has the following notices: * This software includes third party software subject to the following copyrights: - XML parsing and utility functions from JetS3t - Copyright - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-2.9 2becae83f -> 9c64d4291 HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. (cherry picked from commit 72ee45acffc895649b09fa759d61ff0f58bb9b9a) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9c64d429 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9c64d429 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/9c64d429 Branch: refs/heads/branch-2.9 Commit: 9c64d42914e4cf328ee6a6f6c4c40182ba8279aa Parents: 2becae8 Author: Akira Ajisaka Authored: Mon Nov 5 15:32:54 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 15:33:16 2018 +0900 -- NOTICE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/9c64d429/NOTICE.txt -- diff --git a/NOTICE.txt b/NOTICE.txt index 33c12ed..6ab0214 100644 --- a/NOTICE.txt +++ b/NOTICE.txt @@ -17,7 +17,7 @@ which has the following notices: * This product includes software developed by IBM Corporation and others. The binary distribution of this product bundles binaries of -AWS Java SDK 1.10.6, +AWS Java SDK 1.11.199, which has the following notices: * This software includes third party software subject to the following copyrights: - XML parsing and utility functions from JetS3t - Copyright - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/trunk a5e21cd6a -> d43cc5db0 HADOOP-15900. Update JSch versions in LICENSE.txt. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d43cc5db Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d43cc5db Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/d43cc5db Branch: refs/heads/trunk Commit: d43cc5db0ff80958ca873df1dc2fa00054e37175 Parents: a5e21cd Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 17:51:26 2018 +0900 -- LICENSE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/d43cc5db/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index 1a97528..81eb32f 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1836,7 +1836,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: -JSch 0.1.51 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-3.1 73d8f8761 -> b732ed355 HADOOP-15900. Update JSch versions in LICENSE.txt. (cherry picked from commit d43cc5db0ff80958ca873df1dc2fa00054e37175) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b732ed35 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b732ed35 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/b732ed35 Branch: refs/heads/branch-3.1 Commit: b732ed3553c8ebca75d0da2c5732fb967ac74530 Parents: 73d8f87 Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 17:52:21 2018 +0900 -- LICENSE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/b732ed35/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index 7a88148..7e05e90 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1767,7 +1767,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: -JSch 0.1.51 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-3.2 ea6b9d6c6 -> fcd221fed HADOOP-15900. Update JSch versions in LICENSE.txt. (cherry picked from commit d43cc5db0ff80958ca873df1dc2fa00054e37175) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fcd221fe Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/fcd221fe Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/fcd221fe Branch: refs/heads/branch-3.2 Commit: fcd221fed786c0f47fcc6208e0f784058128af20 Parents: ea6b9d6 Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 17:52:04 2018 +0900 -- LICENSE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/fcd221fe/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index 393ed0e..ac9ba24 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1835,7 +1835,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: -JSch 0.1.51 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-3.0 869b1cee6 -> aee665f2d HADOOP-15900. Update JSch versions in LICENSE.txt. (cherry picked from commit d43cc5db0ff80958ca873df1dc2fa00054e37175) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/aee665f2 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/aee665f2 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/aee665f2 Branch: refs/heads/branch-3.0 Commit: aee665f2db102e72a3c67733acf53cb101b5722f Parents: 869b1ce Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 17:52:36 2018 +0900 -- LICENSE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/aee665f2/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index 54ad821..c13133d 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1767,7 +1767,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: -JSch 0.1.51 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-2.9 9c64d4291 -> 1f3899fa3 HADOOP-15900. Update JSch versions in LICENSE.txt. (cherry picked from commit d43cc5db0ff80958ca873df1dc2fa00054e37175) Conflicts: LICENSE.txt (cherry picked from commit 939827daa65b61431cdb66d0ac266b902b8734c4) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1f3899fa Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1f3899fa Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/1f3899fa Branch: refs/heads/branch-2.9 Commit: 1f3899fa3b46543e49702f71ce7641463a893886 Parents: 9c64d42 Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 17:54:30 2018 +0900 -- LICENSE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/1f3899fa/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index 23c63be..5283f67 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1716,7 +1716,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: ASM Core 3.2 -JSch 0.1.51 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-2 72ee45acf -> 939827daa HADOOP-15900. Update JSch versions in LICENSE.txt. (cherry picked from commit d43cc5db0ff80958ca873df1dc2fa00054e37175) Conflicts: LICENSE.txt Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/939827da Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/939827da Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/939827da Branch: refs/heads/branch-2 Commit: 939827daa65b61431cdb66d0ac266b902b8734c4 Parents: 72ee45a Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 17:53:53 2018 +0900 -- LICENSE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/939827da/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index 23c63be..5283f67 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1716,7 +1716,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: ASM Core 3.2 -JSch 0.1.51 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-2.8 2785be987 -> 3d76d4785 HADOOP-15900. Update JSch versions in LICENSE.txt. (cherry picked from commit d43cc5db0ff80958ca873df1dc2fa00054e37175) Conflicts: LICENSE.txt (cherry picked from commit 939827daa65b61431cdb66d0ac266b902b8734c4) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3d76d478 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3d76d478 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/3d76d478 Branch: refs/heads/branch-2.8 Commit: 3d76d4785b4f2ce787f6dace7c945ede134716ba Parents: 2785be9 Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 17:54:51 2018 +0900 -- LICENSE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/3d76d478/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index 61ebbd6..a5036f6 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1566,7 +1566,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: ASM Core 3.2 -JSch 0.1.51 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-2.7 bd79bfc3a -> 29d969eff HADOOP-15900. Update JSch versions in LICENSE.txt. (cherry picked from commit d43cc5db0ff80958ca873df1dc2fa00054e37175) Conflicts: LICENSE.txt (cherry picked from commit 939827daa65b61431cdb66d0ac266b902b8734c4) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/29d969ef Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/29d969ef Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/29d969ef Branch: refs/heads/branch-2.7 Commit: 29d969eff405f0af63aa14458dad89437d61cbea Parents: bd79bfc Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 18:00:41 2018 +0900 -- LICENSE.txt | 2 +- hadoop-common-project/hadoop-common/CHANGES.txt | 15 +++ 2 files changed, 16 insertions(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/29d969ef/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index bc7ef3d..73cf666 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1536,7 +1536,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: ASM Core 3.2 -JSch 0.1.42 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 http://git-wip-us.apache.org/repos/asf/hadoop/blob/29d969ef/hadoop-common-project/hadoop-common/CHANGES.txt -- diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt index 8a11aee..b69a3cf 100644 --- a/hadoop-common-project/hadoop-common/CHANGES.txt +++ b/hadoop-common-project/hadoop-common/CHANGES.txt @@ -1,5 +1,20 @@ Hadoop Change Log +Release 2.7.8 - UNRELEASED + + INCOMPATIBLE CHANGES + + NEW FEATURES + + IMPROVEMENTS + + OPTIMIZATIONS + + BUG FIXES + +HADOOP-15900. Update JSch versions in LICENSE.txt. +Contributed by Akira Ajisaka. + Release 2.7.7 - 2018-07-18 INCOMPATIBLE CHANGES - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15900. Update JSch versions in LICENSE.txt.
Repository: hadoop Updated Branches: refs/heads/branch-2.9.2 e10a1886c -> 80971803f HADOOP-15900. Update JSch versions in LICENSE.txt. (cherry picked from commit d43cc5db0ff80958ca873df1dc2fa00054e37175) Conflicts: LICENSE.txt (cherry picked from commit 939827daa65b61431cdb66d0ac266b902b8734c4) (cherry picked from commit 1f3899fa3b46543e49702f71ce7641463a893886) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/80971803 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/80971803 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/80971803 Branch: refs/heads/branch-2.9.2 Commit: 80971803f76f09152d524392e90540d111326ef5 Parents: e10a188 Author: Akira Ajisaka Authored: Mon Nov 5 17:51:16 2018 +0900 Committer: Akira Ajisaka Committed: Mon Nov 5 18:02:47 2018 +0900 -- LICENSE.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/80971803/LICENSE.txt -- diff --git a/LICENSE.txt b/LICENSE.txt index 23c63be..5283f67 100644 --- a/LICENSE.txt +++ b/LICENSE.txt @@ -1716,7 +1716,7 @@ any resulting litigation. The binary distribution of this product bundles these dependencies under the following license: ASM Core 3.2 -JSch 0.1.51 +JSch 0.1.54 ParaNamer Core 2.3 JLine 0.9.94 leveldbjni-all 1.8 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: YARN-8858. CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. Contributed by Wangda Tan and WeiWei Yang.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.8 3d76d4785 -> 8b2363afe
YARN-8858. CapacityScheduler should respect maximum node resource when
per-queue maximum-allocation is being used. Contributed by Wangda Tan and
WeiWei Yang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8b2363af
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8b2363af
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/8b2363af
Branch: refs/heads/branch-2.8
Commit: 8b2363afed4e06512f133c56d9430dd18b815823
Parents: 3d76d47
Author: Akira Ajisaka
Authored: Tue Nov 6 13:58:30 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 6 13:58:30 2018 +0900
--
.../scheduler/AbstractYarnScheduler.java| 10
.../scheduler/capacity/CapacityScheduler.java | 12 +++-
.../capacity/TestContainerAllocation.java | 58
3 files changed, 79 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8b2363af/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java
index 46e732e..2f690b8 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java
@@ -230,6 +230,16 @@ public abstract class AbstractYarnScheduler
return getMaximumResourceCapability();
}
+ @VisibleForTesting
+ public void setForceConfiguredMaxAllocation(boolean flag) {
+maxAllocWriteLock.lock();
+try {
+ useConfiguredMaximumAllocationOnly = flag;
+} finally {
+ maxAllocWriteLock.unlock();
+}
+ }
+
protected void initMaximumResourceCapability(Resource maximumAllocation) {
maxAllocWriteLock.lock();
try {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8b2363af/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index cc9f93c..7acde84 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2056,7 +2056,17 @@ public class CapacityScheduler extends
LOG.error("queue " + queueName + " is not an leaf queue");
return getMaximumResourceCapability();
}
-return ((LeafQueue)queue).getMaximumAllocation();
+
+// queue.getMaxAllocation returns *configured* maximum allocation.
+// getMaximumResourceCapability() returns maximum allocation considers
+// per-node maximum resources. So return (component-wise) min of the two.
+
+Resource queueMaxAllocation = ((LeafQueue)queue).getMaximumAllocation();
+Resource clusterMaxAllocationConsiderNodeMax =
+getMaximumResourceCapability();
+
+return Resources.componentwiseMin(queueMaxAllocation,
+clusterMaxAllocationConsiderNodeMax);
}
private String handleMoveToPlanQueue(String targetQueueName) {
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8b2363af/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestContainerAllocation.java
--
diff --g
hadoop git commit: HADOOP-15904. [JDK 11] Javadoc build failed due to bad use of '>' in hadoop-hdfs.
Repository: hadoop
Updated Branches:
refs/heads/trunk 5d6554c72 -> 6430c9890
HADOOP-15904. [JDK 11] Javadoc build failed due to bad use of '>' in
hadoop-hdfs.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6430c989
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6430c989
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/6430c989
Branch: refs/heads/trunk
Commit: 6430c9890aae46aeb2f41512ee442adfda5189dc
Parents: 5d6554c
Author: Akira Ajisaka
Authored: Tue Nov 6 18:42:38 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 6 18:42:38 2018 +0900
--
.../hadoop/hdfs/server/diskbalancer/planner/package-info.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/6430c989/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/diskbalancer/planner/package-info.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/diskbalancer/planner/package-info.java
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/diskbalancer/planner/package-info.java
index 0ad1cd9..4df9ba3 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/diskbalancer/planner/package-info.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/diskbalancer/planner/package-info.java
@@ -29,7 +29,7 @@
*
* while(current.isBalancingNeeded(thresholdValue)) {
*
- * // Creates a plan , like move 20 GB data from v1 -> v2
+ * // Creates a plan , like move 20 GB data from v1 {@literal ->} v2
* Step step = planner.plan(current, thresholdValue);
*
* // we add that to our plan
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15902. [JDK 11] Specify the HTML version of Javadoc to 4.01. Contributed by Takanobu Asanuma.
Repository: hadoop Updated Branches: refs/heads/trunk 6430c9890 -> 78e43bccf HADOOP-15902. [JDK 11] Specify the HTML version of Javadoc to 4.01. Contributed by Takanobu Asanuma. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/78e43bcc Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/78e43bcc Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/78e43bcc Branch: refs/heads/trunk Commit: 78e43bccf655153d5fc8fc891d59c536354d8031 Parents: 6430c98 Author: Akira Ajisaka Authored: Tue Nov 6 20:44:05 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 6 20:44:05 2018 +0900 -- hadoop-project/pom.xml | 20 1 file changed, 20 insertions(+) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/78e43bcc/hadoop-project/pom.xml -- diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml index 937f21f..5d38167 100644 --- a/hadoop-project/pom.xml +++ b/hadoop-project/pom.xml @@ -2002,6 +2002,26 @@ + + + javadoc-html-version + +[11,) + + + + +org.apache.maven.plugins +maven-javadoc-plugin + + +-html4 + + + + + + - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain.
Repository: hadoop Updated Branches: refs/heads/trunk 78e43bccf -> 49412a128 HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/49412a12 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/49412a12 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/49412a12 Branch: refs/heads/trunk Commit: 49412a12898eda60cb460ebf4bb9126f3c8c1f53 Parents: 78e43bc Author: Akira Ajisaka Authored: Tue Nov 6 21:26:43 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 6 21:26:43 2018 +0900 -- hadoop-hdds/common/pom.xml | 6 ++ hadoop-ozone/s3gateway/pom.xml | 4 2 files changed, 10 insertions(+) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/49412a12/hadoop-hdds/common/pom.xml -- diff --git a/hadoop-hdds/common/pom.xml b/hadoop-hdds/common/pom.xml index 65cd1d1..0345012 100644 --- a/hadoop-hdds/common/pom.xml +++ b/hadoop-hdds/common/pom.xml @@ -37,6 +37,12 @@ http://maven.apache.org/xsd/maven-4.0.0.xsd";> + javax.annotation + javax.annotation-api + 1.2 + + + org.fusesource.leveldbjni leveldbjni-all http://git-wip-us.apache.org/repos/asf/hadoop/blob/49412a12/hadoop-ozone/s3gateway/pom.xml -- diff --git a/hadoop-ozone/s3gateway/pom.xml b/hadoop-ozone/s3gateway/pom.xml index 5bc7c62..b78796f 100644 --- a/hadoop-ozone/s3gateway/pom.xml +++ b/hadoop-ozone/s3gateway/pom.xml @@ -38,6 +38,10 @@ + javax.xml.bind + jaxb-api + + org.apache.hadoop hadoop-ozone-common compile - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain.
Repository: hadoop Updated Branches: refs/heads/ozone-0.3 4b0004488 -> f2f3d47ab HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain. (cherry picked from commit 49412a12898eda60cb460ebf4bb9126f3c8c1f53) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f2f3d47a Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f2f3d47a Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f2f3d47a Branch: refs/heads/ozone-0.3 Commit: f2f3d47ab54a3bdc326f3d7ce546e0ca5c84ae46 Parents: 4b00044 Author: Akira Ajisaka Authored: Tue Nov 6 21:26:43 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 6 21:27:23 2018 +0900 -- hadoop-hdds/common/pom.xml | 6 ++ hadoop-ozone/s3gateway/pom.xml | 4 2 files changed, 10 insertions(+) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/f2f3d47a/hadoop-hdds/common/pom.xml -- diff --git a/hadoop-hdds/common/pom.xml b/hadoop-hdds/common/pom.xml index e634746..67dca1f 100644 --- a/hadoop-hdds/common/pom.xml +++ b/hadoop-hdds/common/pom.xml @@ -37,6 +37,12 @@ http://maven.apache.org/xsd/maven-4.0.0.xsd";> + javax.annotation + javax.annotation-api + 1.2 + + + org.fusesource.leveldbjni leveldbjni-all http://git-wip-us.apache.org/repos/asf/hadoop/blob/f2f3d47a/hadoop-ozone/s3gateway/pom.xml -- diff --git a/hadoop-ozone/s3gateway/pom.xml b/hadoop-ozone/s3gateway/pom.xml index 23d41f4..1d0e5fa 100644 --- a/hadoop-ozone/s3gateway/pom.xml +++ b/hadoop-ozone/s3gateway/pom.xml @@ -38,6 +38,10 @@ + javax.xml.bind + jaxb-api + + org.apache.hadoop hadoop-ozone-common compile - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Repository: hadoop
Updated Branches:
refs/heads/trunk ba1f9d66d -> 951c98f89
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve
proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/951c98f8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/951c98f8
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/951c98f8
Branch: refs/heads/trunk
Commit: 951c98f89059d64fda8456366f680eff4a7a6785
Parents: ba1f9d6
Author: Akira Ajisaka
Authored: Wed Nov 7 11:17:35 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Nov 7 11:17:35 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 86 +---
.../TestCapacitySchedulerAsyncScheduling.java | 83 +++
2 files changed, 141 insertions(+), 28 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/951c98f8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index 5d7f1ba..e604b81 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2771,7 +2771,11 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-list.add(getSchedulerContainer(rmContainer, false));
+SchedulerContainer schedulerContainer =
+getSchedulerContainer(rmContainer, false);
+if (schedulerContainer != null) {
+ list.add(schedulerContainer);
+}
}
}
@@ -2779,10 +2783,16 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- list.add(
- getSchedulerContainer(csAssignment.getExcessReservation(), false));
+ SchedulerContainer schedulerContainer =
+ getSchedulerContainer(csAssignment.getExcessReservation(), false);
+ if (schedulerContainer != null) {
+list.add(schedulerContainer);
+ }
}
+if (list != null && list.isEmpty()) {
+ list = null;
+}
return list;
}
@@ -2867,11 +2877,15 @@ public class CapacityScheduler extends
((RMContainerImpl)rmContainer).setAllocationTags(
new HashSet<>(schedulingRequest.getAllocationTags()));
- allocated = new ContainerAllocationProposal<>(
- getSchedulerContainer(rmContainer, true),
- null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
- SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
- resource);
+ SchedulerContainer
+ schedulerContainer = getSchedulerContainer(rmContainer, true);
+ if (schedulerContainer == null) {
+allocated = null;
+ } else {
+allocated = new ContainerAllocationProposal<>(schedulerContainer,
+null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
+SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY, resource);
+ }
}
if (null != allocated) {
@@ -2901,16 +2915,27 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-allocated = new ContainerAllocationProposal<>(
-getSchedulerContainer(rmContainer, true),
-getSchedulerContainersToRelease(csAssignment),
-getSchedulerContainer(csAssignment.getFulfilledReservedContainer(),
-false), csAssignment.getType(),
-csAssignment.getRequestLocalityType(),
-csAssignment.getSchedulingMode() != null ?
-csAssignment.getSchedulingMode() :
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
-csAssignment.getResource());
+SchedulerContainer
+schedulerContainer =
hadoop git commit: YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.2 ff5a2cb5c -> 41c4e9583
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve
proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
(cherry picked from commit 951c98f89059d64fda8456366f680eff4a7a6785)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/41c4e958
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/41c4e958
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/41c4e958
Branch: refs/heads/branch-3.2
Commit: 41c4e9583ddb0e832d277a4298ad8474e267e9ff
Parents: ff5a2cb
Author: Akira Ajisaka
Authored: Wed Nov 7 11:17:35 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Nov 7 11:18:48 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 86 +---
.../TestCapacitySchedulerAsyncScheduling.java | 83 +++
2 files changed, 141 insertions(+), 28 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/41c4e958/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index 4befae7..e89fce0 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2768,7 +2768,11 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-list.add(getSchedulerContainer(rmContainer, false));
+SchedulerContainer schedulerContainer =
+getSchedulerContainer(rmContainer, false);
+if (schedulerContainer != null) {
+ list.add(schedulerContainer);
+}
}
}
@@ -2776,10 +2780,16 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- list.add(
- getSchedulerContainer(csAssignment.getExcessReservation(), false));
+ SchedulerContainer schedulerContainer =
+ getSchedulerContainer(csAssignment.getExcessReservation(), false);
+ if (schedulerContainer != null) {
+list.add(schedulerContainer);
+ }
}
+if (list != null && list.isEmpty()) {
+ list = null;
+}
return list;
}
@@ -2864,11 +2874,15 @@ public class CapacityScheduler extends
((RMContainerImpl)rmContainer).setAllocationTags(
new HashSet<>(schedulingRequest.getAllocationTags()));
- allocated = new ContainerAllocationProposal<>(
- getSchedulerContainer(rmContainer, true),
- null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
- SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
- resource);
+ SchedulerContainer
+ schedulerContainer = getSchedulerContainer(rmContainer, true);
+ if (schedulerContainer == null) {
+allocated = null;
+ } else {
+allocated = new ContainerAllocationProposal<>(schedulerContainer,
+null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
+SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY, resource);
+ }
}
if (null != allocated) {
@@ -2898,16 +2912,27 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-allocated = new ContainerAllocationProposal<>(
-getSchedulerContainer(rmContainer, true),
-getSchedulerContainersToRelease(csAssignment),
-getSchedulerContainer(csAssignment.getFulfilledReservedContainer(),
-false), csAssignment.getType(),
-csAssignment.getRequestLocalityType(),
-csAssignment.getSchedulingMode() != null ?
-csAssignment.getSchedulingMode() :
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
-csAssignme
hadoop git commit: YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 afbcb51ac -> dd8479e80
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve
proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
(cherry picked from commit 951c98f89059d64fda8456366f680eff4a7a6785)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dd8479e8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/dd8479e8
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/dd8479e8
Branch: refs/heads/branch-3.1
Commit: dd8479e80d3f0fe87a6edb099e7f617bff42106a
Parents: afbcb51
Author: Akira Ajisaka
Authored: Wed Nov 7 11:17:35 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Nov 7 11:19:11 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 86 +---
.../TestCapacitySchedulerAsyncScheduling.java | 83 +++
2 files changed, 141 insertions(+), 28 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/dd8479e8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index e0f99bd..f8ad730 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2627,7 +2627,11 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-list.add(getSchedulerContainer(rmContainer, false));
+SchedulerContainer schedulerContainer =
+getSchedulerContainer(rmContainer, false);
+if (schedulerContainer != null) {
+ list.add(schedulerContainer);
+}
}
}
@@ -2635,10 +2639,16 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- list.add(
- getSchedulerContainer(csAssignment.getExcessReservation(), false));
+ SchedulerContainer schedulerContainer =
+ getSchedulerContainer(csAssignment.getExcessReservation(), false);
+ if (schedulerContainer != null) {
+list.add(schedulerContainer);
+ }
}
+if (list != null && list.isEmpty()) {
+ list = null;
+}
return list;
}
@@ -2723,11 +2733,15 @@ public class CapacityScheduler extends
((RMContainerImpl)rmContainer).setAllocationTags(
new HashSet<>(schedulingRequest.getAllocationTags()));
- allocated = new ContainerAllocationProposal<>(
- getSchedulerContainer(rmContainer, true),
- null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
- SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
- resource);
+ SchedulerContainer
+ schedulerContainer = getSchedulerContainer(rmContainer, true);
+ if (schedulerContainer == null) {
+allocated = null;
+ } else {
+allocated = new ContainerAllocationProposal<>(schedulerContainer,
+null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
+SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY, resource);
+ }
}
if (null != allocated) {
@@ -2757,16 +2771,27 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-allocated = new ContainerAllocationProposal<>(
-getSchedulerContainer(rmContainer, true),
-getSchedulerContainersToRelease(csAssignment),
-getSchedulerContainer(csAssignment.getFulfilledReservedContainer(),
-false), csAssignment.getType(),
-csAssignment.getRequestLocalityType(),
-csAssignment.getSchedulingMode() != null ?
-csAssignment.getSchedulingMode() :
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
-csAssignme
hadoop git commit: Revert "YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang."
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 dd8479e80 -> 52af95fdc
Revert "YARN-8233. NPE in CapacityScheduler#tryCommit when handling
allocate/reserve proposal whose allocatedOrReservedContainer is null.
Contributed by Tao Yang."
This reverts commit dd8479e80d3f0fe87a6edb099e7f617bff42106a.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/52af95fd
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/52af95fd
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/52af95fd
Branch: refs/heads/branch-3.1
Commit: 52af95fdcead53c4e419d62cf24b3e90e3911ab7
Parents: dd8479e
Author: Akira Ajisaka
Authored: Wed Nov 7 11:33:31 2018 +0900
Committer: Akira Ajisaka
Committed: Wed Nov 7 11:33:31 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 86 +++-
.../TestCapacitySchedulerAsyncScheduling.java | 83 ---
2 files changed, 28 insertions(+), 141 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/52af95fd/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index f8ad730..e0f99bd 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2627,11 +2627,7 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-SchedulerContainer schedulerContainer =
-getSchedulerContainer(rmContainer, false);
-if (schedulerContainer != null) {
- list.add(schedulerContainer);
-}
+list.add(getSchedulerContainer(rmContainer, false));
}
}
@@ -2639,16 +2635,10 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- SchedulerContainer schedulerContainer =
- getSchedulerContainer(csAssignment.getExcessReservation(), false);
- if (schedulerContainer != null) {
-list.add(schedulerContainer);
- }
+ list.add(
+ getSchedulerContainer(csAssignment.getExcessReservation(), false));
}
-if (list != null && list.isEmpty()) {
- list = null;
-}
return list;
}
@@ -2733,15 +2723,11 @@ public class CapacityScheduler extends
((RMContainerImpl)rmContainer).setAllocationTags(
new HashSet<>(schedulingRequest.getAllocationTags()));
- SchedulerContainer
- schedulerContainer = getSchedulerContainer(rmContainer, true);
- if (schedulerContainer == null) {
-allocated = null;
- } else {
-allocated = new ContainerAllocationProposal<>(schedulerContainer,
-null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY, resource);
- }
+ allocated = new ContainerAllocationProposal<>(
+ getSchedulerContainer(rmContainer, true),
+ null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
+ SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
+ resource);
}
if (null != allocated) {
@@ -2771,27 +2757,16 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-SchedulerContainer
-schedulerContainer = getSchedulerContainer(rmContainer, true);
-if (schedulerContainer == null) {
- allocated = null;
- // Decrease unconfirmed resource if app is alive
- FiCaSchedulerApp app = getApplicationAttempt(
- rmContainer.getApplicationAttemptId());
- if (app != null) {
-app.decUnconfirmedRes(rmContainer.getAllocatedResource());
- }
-} else {
- allocated = new ContainerAllocationProposal<>(schedu
hadoop git commit: HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
Repository: hadoop
Updated Branches:
refs/heads/trunk 9dbb2b67c -> a736b5da1
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a736b5da
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a736b5da
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/a736b5da
Branch: refs/heads/trunk
Commit: a736b5da15084e8eb93d2f68f8eccc506ff7bea7
Parents: 9dbb2b6
Author: Akira Ajisaka
Authored: Sat Nov 10 00:24:56 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 00:24:56 2018 +0900
--
hadoop-project/pom.xml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/a736b5da/hadoop-project/pom.xml
--
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index 5d38167..c985d7b 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -127,7 +127,7 @@
-Xmx2048m
-XX:+HeapDumpOnOutOfMemoryError
-2.22.1
+3.0.0-M1
${maven-surefire-plugin.version}
${maven-surefire-plugin.version}
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.2 7440bc5a9 -> 7b62c9684
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
(cherry picked from commit a736b5da15084e8eb93d2f68f8eccc506ff7bea7)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7b62c968
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/7b62c968
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/7b62c968
Branch: refs/heads/branch-3.2
Commit: 7b62c9684d517394d1d360eb8d6dee36ff659062
Parents: 7440bc5
Author: Akira Ajisaka
Authored: Sat Nov 10 00:24:56 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 00:27:30 2018 +0900
--
hadoop-project/pom.xml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/7b62c968/hadoop-project/pom.xml
--
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index 863a93e..8cc1f87 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -127,7 +127,7 @@
-Xmx2048m
-XX:+HeapDumpOnOutOfMemoryError
-2.21.0
+3.0.0-M1
${maven-surefire-plugin.version}
${maven-surefire-plugin.version}
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.0 bbc94de47 -> ca331c805
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
(cherry picked from commit a736b5da15084e8eb93d2f68f8eccc506ff7bea7)
(cherry picked from commit 7b62c9684d517394d1d360eb8d6dee36ff659062)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ca331c80
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ca331c80
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ca331c80
Branch: refs/heads/branch-3.0
Commit: ca331c80572e4ba4b9dc18581bbf4516bc6e9c2c
Parents: bbc94de
Author: Akira Ajisaka
Authored: Sat Nov 10 00:24:56 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 00:28:46 2018 +0900
--
hadoop-project/pom.xml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/ca331c80/hadoop-project/pom.xml
--
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index 6e7b005..249ad7b 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -117,7 +117,7 @@
-Xmx2048m
-XX:+HeapDumpOnOutOfMemoryError
-2.21.0
+3.0.0-M1
${maven-surefire-plugin.version}
${maven-surefire-plugin.version}
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 01b819789 -> 3929465c2
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
(cherry picked from commit a736b5da15084e8eb93d2f68f8eccc506ff7bea7)
(cherry picked from commit 7b62c9684d517394d1d360eb8d6dee36ff659062)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3929465c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3929465c
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/3929465c
Branch: refs/heads/branch-3.1
Commit: 3929465c2e54c37a1648b50243d408f5087d46df
Parents: 01b8197
Author: Akira Ajisaka
Authored: Sat Nov 10 00:24:56 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 00:28:18 2018 +0900
--
hadoop-project/pom.xml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/3929465c/hadoop-project/pom.xml
--
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index 1230cb5..fb5270a 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -115,7 +115,7 @@
-Xmx2048m
-XX:+HeapDumpOnOutOfMemoryError
-2.21.0
+3.0.0-M1
${maven-surefire-plugin.version}
${maven-surefire-plugin.version}
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 3929465c2 -> daad07712
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve
proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/daad0771
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/daad0771
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/daad0771
Branch: refs/heads/branch-3.1
Commit: daad0771218b25b7084344b3c25ace0e58c25c0a
Parents: 3929465
Author: Akira Ajisaka
Authored: Sat Nov 10 14:37:35 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 14:37:35 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 86 +--
.../TestCapacitySchedulerAsyncScheduling.java | 89
2 files changed, 147 insertions(+), 28 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/daad0771/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index 2322b46..e0d1401 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2627,7 +2627,11 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-list.add(getSchedulerContainer(rmContainer, false));
+SchedulerContainer schedulerContainer =
+getSchedulerContainer(rmContainer, false);
+if (schedulerContainer != null) {
+ list.add(schedulerContainer);
+}
}
}
@@ -2635,10 +2639,16 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- list.add(
- getSchedulerContainer(csAssignment.getExcessReservation(), false));
+ SchedulerContainer schedulerContainer =
+ getSchedulerContainer(csAssignment.getExcessReservation(), false);
+ if (schedulerContainer != null) {
+list.add(schedulerContainer);
+ }
}
+if (list != null && list.isEmpty()) {
+ list = null;
+}
return list;
}
@@ -2723,11 +2733,15 @@ public class CapacityScheduler extends
((RMContainerImpl)rmContainer).setAllocationTags(
new HashSet<>(schedulingRequest.getAllocationTags()));
- allocated = new ContainerAllocationProposal<>(
- getSchedulerContainer(rmContainer, true),
- null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
- SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
- resource);
+ SchedulerContainer
+ schedulerContainer = getSchedulerContainer(rmContainer, true);
+ if (schedulerContainer == null) {
+allocated = null;
+ } else {
+allocated = new ContainerAllocationProposal<>(schedulerContainer,
+null, null, NodeType.NODE_LOCAL, NodeType.NODE_LOCAL,
+SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY, resource);
+ }
}
if (null != allocated) {
@@ -2757,16 +2771,27 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-allocated = new ContainerAllocationProposal<>(
-getSchedulerContainer(rmContainer, true),
-getSchedulerContainersToRelease(csAssignment),
-getSchedulerContainer(csAssignment.getFulfilledReservedContainer(),
-false), csAssignment.getType(),
-csAssignment.getRequestLocalityType(),
-csAssignment.getSchedulingMode() != null ?
-csAssignment.getSchedulingMode() :
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
-csAssignment.getResource());
+SchedulerContainer
+schedule
hadoop git commit: YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.0 ca331c805 -> 50ce9fd4e
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve
proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/50ce9fd4
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/50ce9fd4
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/50ce9fd4
Branch: refs/heads/branch-3.0
Commit: 50ce9fd4e24ce3be863452d40edadd20144c7486
Parents: ca331c8
Author: Akira Ajisaka
Authored: Sat Nov 10 18:02:57 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 18:02:57 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 72 ++-
.../TestCapacitySchedulerAsyncScheduling.java | 94
2 files changed, 143 insertions(+), 23 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/50ce9fd4/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index 2c3d69c..28b8c6b 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2448,7 +2448,11 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-list.add(getSchedulerContainer(rmContainer, false));
+SchedulerContainer schedulerContainer =
+getSchedulerContainer(rmContainer, false);
+if (schedulerContainer != null) {
+ list.add(schedulerContainer);
+}
}
}
@@ -2456,10 +2460,16 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- list.add(
- getSchedulerContainer(csAssignment.getExcessReservation(), false));
+ SchedulerContainer schedulerContainer =
+ getSchedulerContainer(csAssignment.getExcessReservation(), false);
+ if (schedulerContainer != null) {
+list.add(schedulerContainer);
+ }
}
+if (list != null && list.isEmpty()) {
+ list = null;
+}
return list;
}
@@ -2499,16 +2509,27 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-allocated = new ContainerAllocationProposal<>(
-getSchedulerContainer(rmContainer, true),
-getSchedulerContainersToRelease(csAssignment),
-getSchedulerContainer(csAssignment.getFulfilledReservedContainer(),
-false), csAssignment.getType(),
-csAssignment.getRequestLocalityType(),
-csAssignment.getSchedulingMode() != null ?
-csAssignment.getSchedulingMode() :
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
-csAssignment.getResource());
+SchedulerContainer
+schedulerContainer = getSchedulerContainer(rmContainer, true);
+if (schedulerContainer == null) {
+ allocated = null;
+ // Decrease unconfirmed resource if app is alive
+ FiCaSchedulerApp app = getApplicationAttempt(
+ rmContainer.getApplicationAttemptId());
+ if (app != null) {
+app.decUnconfirmedRes(rmContainer.getAllocatedResource());
+ }
+} else {
+ allocated = new ContainerAllocationProposal<>(schedulerContainer,
+ getSchedulerContainersToRelease(csAssignment),
+ getSchedulerContainer(
+ csAssignment.getFulfilledReservedContainer(), false),
+ csAssignment.getType(), csAssignment.getRequestLocalityType(),
+ csAssignment.getSchedulingMode() != null ?
+ csAssignment.getSchedulingMode() :
+
hadoop git commit: YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Repository: hadoop
Updated Branches:
refs/heads/branch-2 5e433e5bd -> ee1cb3b6e
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve
proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ee1cb3b6
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ee1cb3b6
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ee1cb3b6
Branch: refs/heads/branch-2
Commit: ee1cb3b6e86e26864251d8f4e9c2277fc08c73ea
Parents: 5e433e5
Author: Akira Ajisaka
Authored: Sat Nov 10 21:44:46 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 21:44:46 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 72 ++-
.../TestCapacitySchedulerAsyncScheduling.java | 94
2 files changed, 143 insertions(+), 23 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/ee1cb3b6/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index 207e059..e70e7cc 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2379,7 +2379,11 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-list.add(getSchedulerContainer(rmContainer, false));
+SchedulerContainer schedulerContainer =
+getSchedulerContainer(rmContainer, false);
+if (schedulerContainer != null) {
+ list.add(schedulerContainer);
+}
}
}
@@ -2387,10 +2391,16 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- list.add(
- getSchedulerContainer(csAssignment.getExcessReservation(), false));
+ SchedulerContainer schedulerContainer =
+ getSchedulerContainer(csAssignment.getExcessReservation(), false);
+ if (schedulerContainer != null) {
+list.add(schedulerContainer);
+ }
}
+if (list != null && list.isEmpty()) {
+ list = null;
+}
return list;
}
@@ -2430,16 +2440,27 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-allocated = new ContainerAllocationProposal<>(
-getSchedulerContainer(rmContainer, true),
-getSchedulerContainersToRelease(csAssignment),
-getSchedulerContainer(csAssignment.getFulfilledReservedContainer(),
-false), csAssignment.getType(),
-csAssignment.getRequestLocalityType(),
-csAssignment.getSchedulingMode() != null ?
-csAssignment.getSchedulingMode() :
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
-csAssignment.getResource());
+SchedulerContainer
+schedulerContainer = getSchedulerContainer(rmContainer, true);
+if (schedulerContainer == null) {
+ allocated = null;
+ // Decrease unconfirmed resource if app is alive
+ FiCaSchedulerApp app = getApplicationAttempt(
+ rmContainer.getApplicationAttemptId());
+ if (app != null) {
+app.decUnconfirmedRes(rmContainer.getAllocatedResource());
+ }
+} else {
+ allocated = new ContainerAllocationProposal<>(schedulerContainer,
+ getSchedulerContainersToRelease(csAssignment),
+ getSchedulerContainer(
+ csAssignment.getFulfilledReservedContainer(), false),
+ csAssignment.getType(), csAssignment.getRequestLocalityType(),
+ csAssignment.getSchedulingMode() != null ?
+ csAssignment.getSchedulingMode() :
+
hadoop git commit: YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 b6e1aed1a -> 7f81ebeb9
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve
proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
(cherry picked from commit ee1cb3b6e86e26864251d8f4e9c2277fc08c73ea)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7f81ebeb
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/7f81ebeb
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/7f81ebeb
Branch: refs/heads/branch-2.9
Commit: 7f81ebeb92a35e7fcda2279f42b17e7eeb79ebb4
Parents: b6e1aed
Author: Akira Ajisaka
Authored: Sat Nov 10 21:44:46 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 21:52:57 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 72 ++-
.../TestCapacitySchedulerAsyncScheduling.java | 94
2 files changed, 143 insertions(+), 23 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/7f81ebeb/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index fae9199..133eb00 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2386,7 +2386,11 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-list.add(getSchedulerContainer(rmContainer, false));
+SchedulerContainer schedulerContainer =
+getSchedulerContainer(rmContainer, false);
+if (schedulerContainer != null) {
+ list.add(schedulerContainer);
+}
}
}
@@ -2394,10 +2398,16 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- list.add(
- getSchedulerContainer(csAssignment.getExcessReservation(), false));
+ SchedulerContainer schedulerContainer =
+ getSchedulerContainer(csAssignment.getExcessReservation(), false);
+ if (schedulerContainer != null) {
+list.add(schedulerContainer);
+ }
}
+if (list != null && list.isEmpty()) {
+ list = null;
+}
return list;
}
@@ -2437,16 +2447,27 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-allocated = new ContainerAllocationProposal<>(
-getSchedulerContainer(rmContainer, true),
-getSchedulerContainersToRelease(csAssignment),
-getSchedulerContainer(csAssignment.getFulfilledReservedContainer(),
-false), csAssignment.getType(),
-csAssignment.getRequestLocalityType(),
-csAssignment.getSchedulingMode() != null ?
-csAssignment.getSchedulingMode() :
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
-csAssignment.getResource());
+SchedulerContainer
+schedulerContainer = getSchedulerContainer(rmContainer, true);
+if (schedulerContainer == null) {
+ allocated = null;
+ // Decrease unconfirmed resource if app is alive
+ FiCaSchedulerApp app = getApplicationAttempt(
+ rmContainer.getApplicationAttemptId());
+ if (app != null) {
+app.decUnconfirmedRes(rmContainer.getAllocatedResource());
+ }
+} else {
+ allocated = new ContainerAllocationProposal<>(schedulerContainer,
+ getSchedulerContainersToRelease(csAssignment),
+ getSchedulerContainer(
+ csAssignment.getFulfilledReservedContainer(), false),
+ csAssignment.getType(), csAssignment.getRequestLocalityType(),
+ csAssignment.getSchedulingMode() != null ?
hadoop git commit: YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9.2 80971803f -> fec6c8a46
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve
proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
(cherry picked from commit ee1cb3b6e86e26864251d8f4e9c2277fc08c73ea)
(cherry picked from commit 7f81ebeb92a35e7fcda2279f42b17e7eeb79ebb4)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fec6c8a4
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/fec6c8a4
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/fec6c8a4
Branch: refs/heads/branch-2.9.2
Commit: fec6c8a460ada9a9bccc929fa7704d8b3ae9bf1e
Parents: 8097180
Author: Akira Ajisaka
Authored: Sat Nov 10 21:44:46 2018 +0900
Committer: Akira Ajisaka
Committed: Sat Nov 10 21:53:41 2018 +0900
--
.../scheduler/capacity/CapacityScheduler.java | 72 ++-
.../TestCapacitySchedulerAsyncScheduling.java | 94
2 files changed, 143 insertions(+), 23 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/fec6c8a4/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
index fae9199..133eb00 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
@@ -2386,7 +2386,11 @@ public class CapacityScheduler extends
.getContainersToKill().isEmpty()) {
list = new ArrayList<>();
for (RMContainer rmContainer : csAssignment.getContainersToKill()) {
-list.add(getSchedulerContainer(rmContainer, false));
+SchedulerContainer schedulerContainer =
+getSchedulerContainer(rmContainer, false);
+if (schedulerContainer != null) {
+ list.add(schedulerContainer);
+}
}
}
@@ -2394,10 +2398,16 @@ public class CapacityScheduler extends
if (null == list) {
list = new ArrayList<>();
}
- list.add(
- getSchedulerContainer(csAssignment.getExcessReservation(), false));
+ SchedulerContainer schedulerContainer =
+ getSchedulerContainer(csAssignment.getExcessReservation(), false);
+ if (schedulerContainer != null) {
+list.add(schedulerContainer);
+ }
}
+if (list != null && list.isEmpty()) {
+ list = null;
+}
return list;
}
@@ -2437,16 +2447,27 @@ public class CapacityScheduler extends
csAssignment.getAssignmentInformation().getAllocationDetails();
if (!allocations.isEmpty()) {
RMContainer rmContainer = allocations.get(0).rmContainer;
-allocated = new ContainerAllocationProposal<>(
-getSchedulerContainer(rmContainer, true),
-getSchedulerContainersToRelease(csAssignment),
-getSchedulerContainer(csAssignment.getFulfilledReservedContainer(),
-false), csAssignment.getType(),
-csAssignment.getRequestLocalityType(),
-csAssignment.getSchedulingMode() != null ?
-csAssignment.getSchedulingMode() :
-SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY,
-csAssignment.getResource());
+SchedulerContainer
+schedulerContainer = getSchedulerContainer(rmContainer, true);
+if (schedulerContainer == null) {
+ allocated = null;
+ // Decrease unconfirmed resource if app is alive
+ FiCaSchedulerApp app = getApplicationAttempt(
+ rmContainer.getApplicationAttemptId());
+ if (app != null) {
+app.decUnconfirmedRes(rmContainer.getAllocatedResource());
+ }
+} else {
+ allocated = new ContainerAllocationProposal<>(schedulerContainer,
+ getSchedulerContainersToRelease(csAssignment),
+ getSchedulerContainer(
+ csAssignment.getFulfilledReservedContainer(), false),
+ csAssignment.getType(), csAssignment.getRequest
hadoop git commit: YARN-8772. Annotation javax.annotation.Generated has moved
Repository: hadoop
Updated Branches:
refs/heads/trunk ef5c776a4 -> 568ebecdf
YARN-8772. Annotation javax.annotation.Generated has moved
Signed-off-by: Akira Ajisaka
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/568ebecd
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/568ebecd
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/568ebecd
Branch: refs/heads/trunk
Commit: 568ebecdf49d0919db1a8d856043c10b76326c34
Parents: ef5c776
Author: Andrew Purtell
Authored: Thu Sep 13 01:27:02 2018 +
Committer: Akira Ajisaka
Committed: Fri Sep 14 15:02:52 2018 +0900
--
.../java/org/apache/hadoop/yarn/service/api/records/Artifact.java | 1 -
.../org/apache/hadoop/yarn/service/api/records/Component.java | 1 -
.../org/apache/hadoop/yarn/service/api/records/ConfigFile.java| 1 -
.../org/apache/hadoop/yarn/service/api/records/Configuration.java | 1 -
.../org/apache/hadoop/yarn/service/api/records/Container.java | 1 -
.../java/org/apache/hadoop/yarn/service/api/records/Error.java| 1 -
.../apache/hadoop/yarn/service/api/records/KerberosPrincipal.java | 2 --
.../hadoop/yarn/service/api/records/PlacementConstraint.java | 3 ---
.../apache/hadoop/yarn/service/api/records/PlacementPolicy.java | 3 ---
.../apache/hadoop/yarn/service/api/records/PlacementScope.java| 3 ---
.../org/apache/hadoop/yarn/service/api/records/PlacementType.java | 3 ---
.../apache/hadoop/yarn/service/api/records/ReadinessCheck.java| 1 -
.../java/org/apache/hadoop/yarn/service/api/records/Resource.java | 1 -
.../hadoop/yarn/service/api/records/ResourceInformation.java | 2 --
.../java/org/apache/hadoop/yarn/service/api/records/Service.java | 1 -
.../org/apache/hadoop/yarn/service/api/records/ServiceState.java | 1 -
.../org/apache/hadoop/yarn/service/api/records/ServiceStatus.java | 1 -
17 files changed, 27 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/568ebecd/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Artifact.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Artifact.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Artifact.java
index ce062cc..bba5791 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Artifact.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Artifact.java
@@ -38,7 +38,6 @@ import org.apache.hadoop.classification.InterfaceStability;
@InterfaceAudience.Public
@InterfaceStability.Unstable
@ApiModel(description = "Artifact of an service component")
-@javax.annotation.Generated(value = "class
io.swagger.codegen.languages.JavaClientCodegen", date =
"2016-06-02T08:15:05.615-07:00")
@JsonInclude(JsonInclude.Include.NON_NULL)
public class Artifact implements Serializable {
private static final long serialVersionUID = 3608929500111099035L;
http://git-wip-us.apache.org/repos/asf/hadoop/blob/568ebecd/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Component.java
--
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Component.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Component.java
index 0481123..9f64b29 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Component.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core/src/main/java/org/apache/hadoop/yarn/service/api/records/Component.java
@@ -49,7 +49,6 @@ import org.apache.hadoop.classification.InterfaceStability;
@InterfaceAudience.Public
@InterfaceStability.Unstable
@ApiModel(description = "One or more components of the service. If the service
is HBase say, then the component can be a simple role li
hadoop git commit: [JDK10] Upgrade Maven Javadoc Plugin from 3.0.0-M1 to 3.0.1.
Repository: hadoop
Updated Branches:
refs/heads/trunk 8b2f5e60f -> 281c192e7
[JDK10] Upgrade Maven Javadoc Plugin from 3.0.0-M1 to 3.0.1.
Signed-off-by: Akira Ajisaka
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/281c192e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/281c192e
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/281c192e
Branch: refs/heads/trunk
Commit: 281c192e7f917545151117fc7e067dc480b93499
Parents: 8b2f5e6
Author: Takanobu Asanuma
Authored: Tue Sep 18 09:31:47 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Sep 18 09:32:27 2018 +0900
--
hadoop-project/pom.xml | 2 +-
pom.xml| 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/281c192e/hadoop-project/pom.xml
--
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index 20a2723..3669ffb 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -1628,7 +1628,7 @@
maven-javadoc-plugin
${maven-javadoc-plugin.version}
--Xmaxwarns 1
+-Xmaxwarns 1
http://git-wip-us.apache.org/repos/asf/hadoop/blob/281c192e/pom.xml
--
diff --git a/pom.xml b/pom.xml
index 73d5cf5..5780a79 100644
--- a/pom.xml
+++ b/pom.xml
@@ -101,7 +101,7 @@ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xs
2.4
3.0.2
3.0.0-M1
-3.0.0-M1
+3.0.1
1.5
1.5
3.0.1
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.2 e6532f7eb -> 861105747
HADOOP-15923. create-release script should set max-cache-ttl as well as
default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/86110574
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/86110574
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/86110574
Branch: refs/heads/branch-3.2
Commit: 861105747bdb8c1ade3369237c10d159cce34bf1
Parents: e6532f7
Author: Akira Ajisaka
Authored: Tue Nov 13 13:40:43 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 13 13:41:42 2018 +0900
--
dev-support/bin/create-release | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/86110574/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 6ec3503..c861654 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -253,7 +253,8 @@ function startgpgagent
if [[ "${SIGN}" = true ]]; then
if [[ -n "${GPGAGENT}" && -z "${GPG_AGENT_INFO}" ]]; then
echo "starting gpg agent"
- echo "default-cache-ttl 14400" > "${LOGDIR}/gpgagent.conf"
+ echo "default-cache-ttl 36000" > "${LOGDIR}/gpgagent.conf"
+ echo "max-cache-ttl 36000" >> "${LOGDIR}/gpgagent.conf"
# shellcheck disable=2046
eval $("${GPGAGENT}" --daemon \
--options "${LOGDIR}/gpgagent.conf" \
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
Repository: hadoop
Updated Branches:
refs/heads/trunk f8713f8ad -> 703b2860a
HADOOP-15923. create-release script should set max-cache-ttl as well as
default-cache-ttl for gpg-agent.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/703b2860
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/703b2860
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/703b2860
Branch: refs/heads/trunk
Commit: 703b2860a49577629e7b3ef461d8a61292e79c88
Parents: f8713f8
Author: Akira Ajisaka
Authored: Tue Nov 13 13:40:43 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 13 13:40:43 2018 +0900
--
dev-support/bin/create-release | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/703b2860/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 6ec3503..c861654 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -253,7 +253,8 @@ function startgpgagent
if [[ "${SIGN}" = true ]]; then
if [[ -n "${GPGAGENT}" && -z "${GPG_AGENT_INFO}" ]]; then
echo "starting gpg agent"
- echo "default-cache-ttl 14400" > "${LOGDIR}/gpgagent.conf"
+ echo "default-cache-ttl 36000" > "${LOGDIR}/gpgagent.conf"
+ echo "max-cache-ttl 36000" >> "${LOGDIR}/gpgagent.conf"
# shellcheck disable=2046
eval $("${GPGAGENT}" --daemon \
--options "${LOGDIR}/gpgagent.conf" \
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 b6ef824e7 -> e67e00724
HADOOP-15923. create-release script should set max-cache-ttl as well as
default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e67e0072
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e67e0072
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/e67e0072
Branch: refs/heads/branch-3.1
Commit: e67e00724ebfc52bd6084dbf2bfbc674c2c7fa6f
Parents: b6ef824
Author: Akira Ajisaka
Authored: Tue Nov 13 13:40:43 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 13 13:42:01 2018 +0900
--
dev-support/bin/create-release | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e67e0072/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 949a46f..b0f01d7 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -253,7 +253,8 @@ function startgpgagent
if [[ "${SIGN}" = true ]]; then
if [[ -n "${GPGAGENT}" && -z "${GPG_AGENT_INFO}" ]]; then
echo "starting gpg agent"
- echo "default-cache-ttl 14400" > "${LOGDIR}/gpgagent.conf"
+ echo "default-cache-ttl 36000" > "${LOGDIR}/gpgagent.conf"
+ echo "max-cache-ttl 36000" >> "${LOGDIR}/gpgagent.conf"
# shellcheck disable=2046
eval $("${GPGAGENT}" --daemon \
--options "${LOGDIR}/gpgagent.conf" \
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.0 f514c0890 -> ff1cbb48c
HADOOP-15923. create-release script should set max-cache-ttl as well as
default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ff1cbb48
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ff1cbb48
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ff1cbb48
Branch: refs/heads/branch-3.0
Commit: ff1cbb48c8e61a0891cb4ab6e5dc4cd2a00ee20b
Parents: f514c08
Author: Akira Ajisaka
Authored: Tue Nov 13 13:40:43 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 13 13:42:19 2018 +0900
--
dev-support/bin/create-release | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/ff1cbb48/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 949a46f..b0f01d7 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -253,7 +253,8 @@ function startgpgagent
if [[ "${SIGN}" = true ]]; then
if [[ -n "${GPGAGENT}" && -z "${GPG_AGENT_INFO}" ]]; then
echo "starting gpg agent"
- echo "default-cache-ttl 14400" > "${LOGDIR}/gpgagent.conf"
+ echo "default-cache-ttl 36000" > "${LOGDIR}/gpgagent.conf"
+ echo "max-cache-ttl 36000" >> "${LOGDIR}/gpgagent.conf"
# shellcheck disable=2046
eval $("${GPGAGENT}" --daemon \
--options "${LOGDIR}/gpgagent.conf" \
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
Repository: hadoop
Updated Branches:
refs/heads/branch-2 b7ca20e16 -> a86b66534
HADOOP-15923. create-release script should set max-cache-ttl as well as
default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a86b6653
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a86b6653
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/a86b6653
Branch: refs/heads/branch-2
Commit: a86b665340696bd83b6062025282dda40eaaa9fb
Parents: b7ca20e
Author: Akira Ajisaka
Authored: Tue Nov 13 13:40:43 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 13 13:42:37 2018 +0900
--
dev-support/bin/create-release | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/a86b6653/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 39c9133..fbe3fb2 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -259,7 +259,8 @@ function startgpgagent
if [[ "${SIGN}" = true ]]; then
if [[ -n "${GPGAGENT}" && -z "${GPG_AGENT_INFO}" ]]; then
echo "starting gpg agent"
- echo "default-cache-ttl 14400" > "${LOGDIR}/gpgagent.conf"
+ echo "default-cache-ttl 36000" > "${LOGDIR}/gpgagent.conf"
+ echo "max-cache-ttl 36000" >> "${LOGDIR}/gpgagent.conf"
# shellcheck disable=2046
eval $("${GPGAGENT}" --daemon \
--options "${LOGDIR}/gpgagent.conf" \
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 7f81ebeb9 -> 5884b1c28
HADOOP-15923. create-release script should set max-cache-ttl as well as
default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
(cherry picked from commit a86b665340696bd83b6062025282dda40eaaa9fb)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5884b1c2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/5884b1c2
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/5884b1c2
Branch: refs/heads/branch-2.9
Commit: 5884b1c28f4bd9137e6eb04ab7d0ad080b55b50f
Parents: 7f81ebe
Author: Akira Ajisaka
Authored: Tue Nov 13 13:40:43 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 13 13:43:05 2018 +0900
--
dev-support/bin/create-release | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/5884b1c2/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 39c9133..fbe3fb2 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -259,7 +259,8 @@ function startgpgagent
if [[ "${SIGN}" = true ]]; then
if [[ -n "${GPGAGENT}" && -z "${GPG_AGENT_INFO}" ]]; then
echo "starting gpg agent"
- echo "default-cache-ttl 14400" > "${LOGDIR}/gpgagent.conf"
+ echo "default-cache-ttl 36000" > "${LOGDIR}/gpgagent.conf"
+ echo "max-cache-ttl 36000" >> "${LOGDIR}/gpgagent.conf"
# shellcheck disable=2046
eval $("${GPGAGENT}" --daemon \
--options "${LOGDIR}/gpgagent.conf" \
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.8 31aafb886 -> e3593c09d
HADOOP-15923. create-release script should set max-cache-ttl as well as
default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
(cherry picked from commit a86b665340696bd83b6062025282dda40eaaa9fb)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e3593c09
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e3593c09
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/e3593c09
Branch: refs/heads/branch-2.8
Commit: e3593c09d429b786fc98de516fc520f622e957be
Parents: 31aafb8
Author: Akira Ajisaka
Authored: Tue Nov 13 13:40:43 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 13 13:44:49 2018 +0900
--
dev-support/bin/create-release | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/e3593c09/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 8b138e5..09066a1 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -259,7 +259,8 @@ function startgpgagent
if [[ "${SIGN}" = true ]]; then
if [[ -n "${GPGAGENT}" && -z "${GPG_AGENT_INFO}" ]]; then
echo "starting gpg agent"
- echo "default-cache-ttl 14400" > "${LOGDIR}/gpgagent.conf"
+ echo "default-cache-ttl 36000" > "${LOGDIR}/gpgagent.conf"
+ echo "max-cache-ttl 36000" >> "${LOGDIR}/gpgagent.conf"
# shellcheck disable=2046
eval $("${GPGAGENT}" --daemon \
--options "${LOGDIR}/gpgagent.conf" \
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9.2 fec6c8a46 -> 826afbeae
HADOOP-15923. create-release script should set max-cache-ttl as well as
default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
(cherry picked from commit a86b665340696bd83b6062025282dda40eaaa9fb)
(cherry picked from commit 5884b1c28f4bd9137e6eb04ab7d0ad080b55b50f)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/826afbea
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/826afbea
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/826afbea
Branch: refs/heads/branch-2.9.2
Commit: 826afbeae31ca687bc2f8471dc841b66ed2c6704
Parents: fec6c8a
Author: Akira Ajisaka
Authored: Tue Nov 13 13:40:43 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 13 13:45:18 2018 +0900
--
dev-support/bin/create-release | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/826afbea/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 39c9133..fbe3fb2 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -259,7 +259,8 @@ function startgpgagent
if [[ "${SIGN}" = true ]]; then
if [[ -n "${GPGAGENT}" && -z "${GPG_AGENT_INFO}" ]]; then
echo "starting gpg agent"
- echo "default-cache-ttl 14400" > "${LOGDIR}/gpgagent.conf"
+ echo "default-cache-ttl 36000" > "${LOGDIR}/gpgagent.conf"
+ echo "max-cache-ttl 36000" >> "${LOGDIR}/gpgagent.conf"
# shellcheck disable=2046
eval $("${GPGAGENT}" --daemon \
--options "${LOGDIR}/gpgagent.conf" \
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] Git Push Summary
Repository: hadoop Updated Tags: refs/tags/YARN-5355-2017-05-25 [created] 193746245 refs/tags/rel/release- [created] f474b7d22 refs/tags/release-2.9.2-RC0 [created] 562ac7c57 refs/tags/release-3.2.0-RC0 [created] 534f03f20 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] Git Push Summary
Repository: hadoop Updated Tags: refs/tags/release-3.2.0-RC0 [deleted] 534f03f20 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] Git Push Summary
Repository: hadoop Updated Tags: refs/tags/YARN-5355-2017-05-25 [deleted] 193746245 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15930. Exclude MD5 checksum files from release artifact.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.2 37082a664 -> 9f3d42f10
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9f3d42f1
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9f3d42f1
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/9f3d42f1
Branch: refs/heads/branch-3.2
Commit: 9f3d42f1068dcfba99f89514950d05539b65842c
Parents: 37082a6
Author: Akira Ajisaka
Authored: Wed Nov 14 14:50:34 2018 +0900
Committer: Akira Ajisaka
Committed: Thu Nov 15 10:47:13 2018 +0900
--
dev-support/bin/create-release | 14 --
1 file changed, 14 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/9f3d42f1/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index c861654..9d0decf 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -169,11 +169,6 @@ function run()
fi
}
-function domd5()
-{
- run "${MD5SUM}" "${1}" > "${1}.md5"
-}
-
function header()
{
echo
@@ -235,11 +230,6 @@ function set_defaults
fi
fi
- MD5SUM=$(command -v md5sum)
- if [[ -z "${MD5SUM}" ]]; then
-MD5SUM=$(command -v md5)
- fi
-
NATIVE=false
OSNAME=$(uname -s)
@@ -641,9 +631,6 @@ function signartifacts
declare ret
if [[ "${SIGN}" = false ]]; then
-for i in ${ARTIFACTS_DIR}/*; do
- domd5 "${i}"
-done
echo ""
echo "Remember to sign the artifacts before staging them on the open"
echo ""
@@ -655,7 +642,6 @@ function signartifacts
for i in ${ARTIFACTS_DIR}/*; do
${GPG} --use-agent --armor --output "${i}.asc" --detach-sig "${i}"
${GPG} --print-mds "${i}" > "${i}.mds"
-domd5 "${i}"
done
if [[ "${ASFRELEASE}" = true ]]; then
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15930. Exclude MD5 checksum files from release artifact.
Repository: hadoop
Updated Branches:
refs/heads/trunk bac8807c8 -> df5e863fe
HADOOP-15930. Exclude MD5 checksum files from release artifact.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/df5e863f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/df5e863f
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/df5e863f
Branch: refs/heads/trunk
Commit: df5e863fee544c9283e28a21c2788c008d7e3e04
Parents: bac8807
Author: Akira Ajisaka
Authored: Wed Nov 14 14:50:34 2018 +0900
Committer: Akira Ajisaka
Committed: Thu Nov 15 10:45:34 2018 +0900
--
dev-support/bin/create-release | 14 --
1 file changed, 14 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/df5e863f/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index c861654..9d0decf 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -169,11 +169,6 @@ function run()
fi
}
-function domd5()
-{
- run "${MD5SUM}" "${1}" > "${1}.md5"
-}
-
function header()
{
echo
@@ -235,11 +230,6 @@ function set_defaults
fi
fi
- MD5SUM=$(command -v md5sum)
- if [[ -z "${MD5SUM}" ]]; then
-MD5SUM=$(command -v md5)
- fi
-
NATIVE=false
OSNAME=$(uname -s)
@@ -641,9 +631,6 @@ function signartifacts
declare ret
if [[ "${SIGN}" = false ]]; then
-for i in ${ARTIFACTS_DIR}/*; do
- domd5 "${i}"
-done
echo ""
echo "Remember to sign the artifacts before staging them on the open"
echo ""
@@ -655,7 +642,6 @@ function signartifacts
for i in ${ARTIFACTS_DIR}/*; do
${GPG} --use-agent --armor --output "${i}.asc" --detach-sig "${i}"
${GPG} --print-mds "${i}" > "${i}.mds"
-domd5 "${i}"
done
if [[ "${ASFRELEASE}" = true ]]; then
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15930. Exclude MD5 checksum files from release artifact.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 5d532cfc6 -> ba75aeec2
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ba75aeec
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ba75aeec
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ba75aeec
Branch: refs/heads/branch-3.1
Commit: ba75aeec284b345381a00c751a2faed9c04d21fe
Parents: 5d532cf
Author: Akira Ajisaka
Authored: Wed Nov 14 14:50:34 2018 +0900
Committer: Akira Ajisaka
Committed: Thu Nov 15 10:47:32 2018 +0900
--
dev-support/bin/create-release | 14 --
1 file changed, 14 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/ba75aeec/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index b0f01d7..8c01cba 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -169,11 +169,6 @@ function run()
fi
}
-function domd5()
-{
- run "${MD5SUM}" "${1}" > "${1}.md5"
-}
-
function header()
{
echo
@@ -235,11 +230,6 @@ function set_defaults
fi
fi
- MD5SUM=$(command -v md5sum)
- if [[ -z "${MD5SUM}" ]]; then
-MD5SUM=$(command -v md5)
- fi
-
NATIVE=false
OSNAME=$(uname -s)
@@ -641,9 +631,6 @@ function signartifacts
declare ret
if [[ "${SIGN}" = false ]]; then
-for i in ${ARTIFACTS_DIR}/*; do
- domd5 "${i}"
-done
echo ""
echo "Remember to sign the artifacts before staging them on the open"
echo ""
@@ -655,7 +642,6 @@ function signartifacts
for i in ${ARTIFACTS_DIR}/*; do
${GPG} --use-agent --armor --output "${i}.asc" --detach-sig "${i}"
${GPG} --print-mds "${i}" > "${i}.mds"
-domd5 "${i}"
done
if [[ "${ASFRELEASE}" = true ]]; then
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15930. Exclude MD5 checksum files from release artifact.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.0 64cb97fb4 -> 2db612fff
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2db612ff
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2db612ff
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/2db612ff
Branch: refs/heads/branch-3.0
Commit: 2db612fff96b7348f6549c83182dce6b3fa0b04a
Parents: 64cb97f
Author: Akira Ajisaka
Authored: Wed Nov 14 14:50:34 2018 +0900
Committer: Akira Ajisaka
Committed: Thu Nov 15 10:47:53 2018 +0900
--
dev-support/bin/create-release | 14 --
1 file changed, 14 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/2db612ff/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index b0f01d7..8c01cba 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -169,11 +169,6 @@ function run()
fi
}
-function domd5()
-{
- run "${MD5SUM}" "${1}" > "${1}.md5"
-}
-
function header()
{
echo
@@ -235,11 +230,6 @@ function set_defaults
fi
fi
- MD5SUM=$(command -v md5sum)
- if [[ -z "${MD5SUM}" ]]; then
-MD5SUM=$(command -v md5)
- fi
-
NATIVE=false
OSNAME=$(uname -s)
@@ -641,9 +631,6 @@ function signartifacts
declare ret
if [[ "${SIGN}" = false ]]; then
-for i in ${ARTIFACTS_DIR}/*; do
- domd5 "${i}"
-done
echo ""
echo "Remember to sign the artifacts before staging them on the open"
echo ""
@@ -655,7 +642,6 @@ function signartifacts
for i in ${ARTIFACTS_DIR}/*; do
${GPG} --use-agent --armor --output "${i}.asc" --detach-sig "${i}"
${GPG} --print-mds "${i}" > "${i}.mds"
-domd5 "${i}"
done
if [[ "${ASFRELEASE}" = true ]]; then
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15930. Exclude MD5 checksum files from release artifact.
Repository: hadoop
Updated Branches:
refs/heads/branch-2 3aac324a0 -> 419908608
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/41990860
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/41990860
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/41990860
Branch: refs/heads/branch-2
Commit: 4199086084245a32d5a8ec09e1571948f0765c83
Parents: 3aac324
Author: Akira Ajisaka
Authored: Wed Nov 14 14:50:34 2018 +0900
Committer: Akira Ajisaka
Committed: Thu Nov 15 10:49:37 2018 +0900
--
dev-support/bin/create-release | 14 --
1 file changed, 14 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/41990860/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index fbe3fb2..33c87cd 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -167,11 +167,6 @@ function run()
fi
}
-function domd5()
-{
- run "${MD5SUM}" "${1}" > "${1}.md5"
-}
-
## @description set JAVA_HOME properly
## @audience public
## @stabilityunstable
@@ -241,11 +236,6 @@ function set_defaults
fi
fi
- MD5SUM=$(command -v md5sum)
- if [[ -z "${MD5SUM}" ]]; then
-MD5SUM=$(command -v md5)
- fi
-
NATIVE=false
OSNAME=$(uname -s)
@@ -601,9 +591,6 @@ function signartifacts
declare i
if [[ "${SIGN}" = false ]]; then
-for i in ${ARTIFACTS_DIR}/*; do
- domd5 "${i}"
-done
echo ""
echo "Remember to sign the artifacts before staging them on the open"
echo ""
@@ -615,7 +602,6 @@ function signartifacts
for i in ${ARTIFACTS_DIR}/*; do
${GPG} --use-agent --armor --output "${i}.asc" --detach-sig "${i}"
${GPG} --print-mds "${i}" > "${i}.mds"
-domd5 "${i}"
done
if [[ "${ASFRELEASE}" = true ]]; then
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15930. Exclude MD5 checksum files from release artifact.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 ef085e088 -> 29f155907
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
(cherry picked from commit 4199086084245a32d5a8ec09e1571948f0765c83)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/29f15590
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/29f15590
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/29f15590
Branch: refs/heads/branch-2.9
Commit: 29f1559071d2f8205efdcef28b8fc9f52539c86d
Parents: ef085e0
Author: Akira Ajisaka
Authored: Wed Nov 14 14:50:34 2018 +0900
Committer: Akira Ajisaka
Committed: Thu Nov 15 10:50:00 2018 +0900
--
dev-support/bin/create-release | 14 --
1 file changed, 14 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/29f15590/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index fbe3fb2..33c87cd 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -167,11 +167,6 @@ function run()
fi
}
-function domd5()
-{
- run "${MD5SUM}" "${1}" > "${1}.md5"
-}
-
## @description set JAVA_HOME properly
## @audience public
## @stabilityunstable
@@ -241,11 +236,6 @@ function set_defaults
fi
fi
- MD5SUM=$(command -v md5sum)
- if [[ -z "${MD5SUM}" ]]; then
-MD5SUM=$(command -v md5)
- fi
-
NATIVE=false
OSNAME=$(uname -s)
@@ -601,9 +591,6 @@ function signartifacts
declare i
if [[ "${SIGN}" = false ]]; then
-for i in ${ARTIFACTS_DIR}/*; do
- domd5 "${i}"
-done
echo ""
echo "Remember to sign the artifacts before staging them on the open"
echo ""
@@ -615,7 +602,6 @@ function signartifacts
for i in ${ARTIFACTS_DIR}/*; do
${GPG} --use-agent --armor --output "${i}.asc" --detach-sig "${i}"
${GPG} --print-mds "${i}" > "${i}.mds"
-domd5 "${i}"
done
if [[ "${ASFRELEASE}" = true ]]; then
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15930. Exclude MD5 checksum files from release artifact.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.8 e3593c09d -> 77c4bc906
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
(cherry picked from commit 4199086084245a32d5a8ec09e1571948f0765c83)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/77c4bc90
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/77c4bc90
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/77c4bc90
Branch: refs/heads/branch-2.8
Commit: 77c4bc9068abc0eef5bbc3de097aceb57e31bb7e
Parents: e3593c0
Author: Akira Ajisaka
Authored: Wed Nov 14 14:50:34 2018 +0900
Committer: Akira Ajisaka
Committed: Thu Nov 15 10:50:22 2018 +0900
--
dev-support/bin/create-release | 14 --
1 file changed, 14 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/77c4bc90/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 09066a1..81b40b2 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -167,11 +167,6 @@ function run()
fi
}
-function domd5()
-{
- run "${MD5SUM}" "${1}" > "${1}.md5"
-}
-
## @description set JAVA_HOME properly
## @audience public
## @stabilityunstable
@@ -241,11 +236,6 @@ function set_defaults
fi
fi
- MD5SUM=$(command -v md5sum)
- if [[ -z "${MD5SUM}" ]]; then
-MD5SUM=$(command -v md5)
- fi
-
NATIVE=false
OSNAME=$(uname -s)
@@ -601,9 +591,6 @@ function signartifacts
declare i
if [[ "${SIGN}" = false ]]; then
-for i in ${ARTIFACTS_DIR}/*; do
- domd5 "${i}"
-done
echo ""
echo "Remember to sign the artifacts before staging them on the open"
echo ""
@@ -615,7 +602,6 @@ function signartifacts
for i in ${ARTIFACTS_DIR}/*; do
${GPG} --use-agent --armor --output "${i}.asc" --detach-sig "${i}"
${GPG} --print-mds "${i}" > "${i}.mds"
-domd5 "${i}"
done
if [[ "${ASFRELEASE}" = true ]]; then
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15926. Document upgrading the section in NOTICE.txt when upgrading the version of AWS SDK. Contributed by Dinesh Chitlangia.
Repository: hadoop Updated Branches: refs/heads/branch-3.2 9f3d42f10 -> 8c9681d7f HADOOP-15926. Document upgrading the section in NOTICE.txt when upgrading the version of AWS SDK. Contributed by Dinesh Chitlangia. (cherry picked from commit 66b1335bb3a9a6f3a3db455540c973d4a85bef73) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8c9681d7 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8c9681d7 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/8c9681d7 Branch: refs/heads/branch-3.2 Commit: 8c9681d7f08f9c7cd6bb15b45605be668fad69ef Parents: 9f3d42f Author: Akira Ajisaka Authored: Thu Nov 15 16:30:24 2018 +0900 Committer: Akira Ajisaka Committed: Thu Nov 15 16:31:05 2018 +0900 -- .../hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md| 1 + 1 file changed, 1 insertion(+) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/8c9681d7/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md -- diff --git a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md index 31d3a5f..cb07a49 100644 --- a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md +++ b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md @@ -1182,6 +1182,7 @@ as it may take a couple of SDK updates before it is ready. 1. Identify the latest AWS SDK [available for download](https://aws.amazon.com/sdk-for-java/). 1. Create a private git branch of trunk for JIRA, and in `hadoop-project/pom.xml` update the `aws-java-sdk.version` to the new SDK version. +1. Update AWS SDK versions in NOTICE.txt. 1. Do a clean build and rerun all the `hadoop-aws` tests, with and without the `-Ds3guard -Ddynamodb` options. This includes the `-Pscale` set, with a role defined for the assumed role tests. in `fs.s3a.assumed.role.arn` for testing assumed roles, - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15926. Document upgrading the section in NOTICE.txt when upgrading the version of AWS SDK. Contributed by Dinesh Chitlangia.
Repository: hadoop Updated Branches: refs/heads/trunk df5e863fe -> 66b1335bb HADOOP-15926. Document upgrading the section in NOTICE.txt when upgrading the version of AWS SDK. Contributed by Dinesh Chitlangia. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/66b1335b Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/66b1335b Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/66b1335b Branch: refs/heads/trunk Commit: 66b1335bb3a9a6f3a3db455540c973d4a85bef73 Parents: df5e863 Author: Akira Ajisaka Authored: Thu Nov 15 16:30:24 2018 +0900 Committer: Akira Ajisaka Committed: Thu Nov 15 16:30:24 2018 +0900 -- .../hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md| 1 + 1 file changed, 1 insertion(+) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/66b1335b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md -- diff --git a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md index 31d3a5f..cb07a49 100644 --- a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md +++ b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md @@ -1182,6 +1182,7 @@ as it may take a couple of SDK updates before it is ready. 1. Identify the latest AWS SDK [available for download](https://aws.amazon.com/sdk-for-java/). 1. Create a private git branch of trunk for JIRA, and in `hadoop-project/pom.xml` update the `aws-java-sdk.version` to the new SDK version. +1. Update AWS SDK versions in NOTICE.txt. 1. Do a clean build and rerun all the `hadoop-aws` tests, with and without the `-Ds3guard -Ddynamodb` options. This includes the `-Pscale` set, with a role defined for the assumed role tests. in `fs.s3a.assumed.role.arn` for testing assumed roles, - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/trunk a16aa2f60 -> af5958f7b
HADOOP-15925. The config and log of gpg-agent are removed in create-release
script. Contributed by Dinesh Chitlangia.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/af5958f7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/af5958f7
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/af5958f7
Branch: refs/heads/trunk
Commit: af5958f7b6a209d6a6622acee47a66a4a921828d
Parents: a16aa2f
Author: Akira Ajisaka
Authored: Fri Nov 16 13:16:59 2018 +0900
Committer: Akira Ajisaka
Committed: Fri Nov 16 13:16:59 2018 +0900
--
dev-support/bin/create-release | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/af5958f7/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 9d0decf..3544798 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -524,7 +524,7 @@ function makearelease
big_console_header "Cleaning the Source Tree"
# git clean to clear any remnants from previous build
- run "${GIT}" clean -xdf
+ run "${GIT}" clean -xdf -e /patchprocess
mkdir -p "${LOGDIR}"
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.2 351bfa1bc -> a69423d28
HADOOP-15925. The config and log of gpg-agent are removed in create-release
script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a69423d2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a69423d2
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/a69423d2
Branch: refs/heads/branch-3.2
Commit: a69423d28c956df66f90eaa410f940c478cc
Parents: 351bfa1
Author: Akira Ajisaka
Authored: Fri Nov 16 13:16:59 2018 +0900
Committer: Akira Ajisaka
Committed: Fri Nov 16 13:17:55 2018 +0900
--
dev-support/bin/create-release | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/a69423d2/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 9d0decf..3544798 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -524,7 +524,7 @@ function makearelease
big_console_header "Cleaning the Source Tree"
# git clean to clear any remnants from previous build
- run "${GIT}" clean -xdf
+ run "${GIT}" clean -xdf -e /patchprocess
mkdir -p "${LOGDIR}"
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 3e57adee0 -> b151b5004
HADOOP-15925. The config and log of gpg-agent are removed in create-release
script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b151b500
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b151b500
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/b151b500
Branch: refs/heads/branch-3.1
Commit: b151b500480079e1df3750a6b220cb25ebd2a34e
Parents: 3e57ade
Author: Akira Ajisaka
Authored: Fri Nov 16 13:16:59 2018 +0900
Committer: Akira Ajisaka
Committed: Fri Nov 16 13:18:17 2018 +0900
--
dev-support/bin/create-release | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/b151b500/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 8c01cba..9f3bf51 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -524,7 +524,7 @@ function makearelease
big_console_header "Cleaning the Source Tree"
# git clean to clear any remnants from previous build
- run "${GIT}" clean -xdf
+ run "${GIT}" clean -xdf -e /patchprocess
mkdir -p "${LOGDIR}"
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/branch-2 419908608 -> c39e1ee2b
HADOOP-15925. The config and log of gpg-agent are removed in create-release
script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c39e1ee2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c39e1ee2
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/c39e1ee2
Branch: refs/heads/branch-2
Commit: c39e1ee2b9a6939fbfac05aecc6932489aef164b
Parents: 4199086
Author: Akira Ajisaka
Authored: Fri Nov 16 13:16:59 2018 +0900
Committer: Akira Ajisaka
Committed: Fri Nov 16 13:18:48 2018 +0900
--
dev-support/bin/create-release | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c39e1ee2/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 33c87cd..a089e7c 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -504,7 +504,7 @@ function makearelease
big_console_header "Cleaning the Source Tree"
# git clean to clear any remnants from previous build
- run "${GIT}" clean -xdf
+ run "${GIT}" clean -xdf -e /patchprocess
mkdir -p "${LOGDIR}"
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.0 2db612fff -> 6dc6978ee
HADOOP-15925. The config and log of gpg-agent are removed in create-release
script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6dc6978e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6dc6978e
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/6dc6978e
Branch: refs/heads/branch-3.0
Commit: 6dc6978eeb72c8f69de62c1709e23befa84cea6d
Parents: 2db612f
Author: Akira Ajisaka
Authored: Fri Nov 16 13:16:59 2018 +0900
Committer: Akira Ajisaka
Committed: Fri Nov 16 13:18:32 2018 +0900
--
dev-support/bin/create-release | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/6dc6978e/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 8c01cba..9f3bf51 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -524,7 +524,7 @@ function makearelease
big_console_header "Cleaning the Source Tree"
# git clean to clear any remnants from previous build
- run "${GIT}" clean -xdf
+ run "${GIT}" clean -xdf -e /patchprocess
mkdir -p "${LOGDIR}"
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.8 77c4bc906 -> 2f6c738b8
HADOOP-15925. The config and log of gpg-agent are removed in create-release
script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
(cherry picked from commit c39e1ee2b9a6939fbfac05aecc6932489aef164b)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2f6c738b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2f6c738b
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/2f6c738b
Branch: refs/heads/branch-2.8
Commit: 2f6c738b8aacfe873bee745bf3a8b2bd4fd96475
Parents: 77c4bc9
Author: Akira Ajisaka
Authored: Fri Nov 16 13:16:59 2018 +0900
Committer: Akira Ajisaka
Committed: Fri Nov 16 13:19:33 2018 +0900
--
dev-support/bin/create-release | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/2f6c738b/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 81b40b2..be148cb 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -504,7 +504,7 @@ function makearelease
big_console_header "Cleaning the Source Tree"
# git clean to clear any remnants from previous build
- run "${GIT}" clean -xdf
+ run "${GIT}" clean -xdf -e /patchprocess
mkdir -p "${LOGDIR}"
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 29f155907 -> 2929766d2
HADOOP-15925. The config and log of gpg-agent are removed in create-release
script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
(cherry picked from commit c39e1ee2b9a6939fbfac05aecc6932489aef164b)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2929766d
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2929766d
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/2929766d
Branch: refs/heads/branch-2.9
Commit: 2929766d2c37b001f33e9d98da1684a52d236448
Parents: 29f1559
Author: Akira Ajisaka
Authored: Fri Nov 16 13:16:59 2018 +0900
Committer: Akira Ajisaka
Committed: Fri Nov 16 13:19:16 2018 +0900
--
dev-support/bin/create-release | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/2929766d/dev-support/bin/create-release
--
diff --git a/dev-support/bin/create-release b/dev-support/bin/create-release
index 33c87cd..a089e7c 100755
--- a/dev-support/bin/create-release
+++ b/dev-support/bin/create-release
@@ -504,7 +504,7 @@ function makearelease
big_console_header "Cleaning the Source Tree"
# git clean to clear any remnants from previous build
- run "${GIT}" clean -xdf
+ run "${GIT}" clean -xdf -e /patchprocess
mkdir -p "${LOGDIR}"
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] Git Push Summary
Repository: hadoop Updated Tags: refs/tags/rel/release-2.9.2 [created] 60e697c26 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: Add 2.9.2 release notes and changes documents.
Repository: hadoop Updated Branches: refs/heads/trunk 5fb14e063 -> 1a00b4e32 Add 2.9.2 release notes and changes documents. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1a00b4e3 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1a00b4e3 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/1a00b4e3 Branch: refs/heads/trunk Commit: 1a00b4e325146988375c9ce5b11016c45f059a4e Parents: 5fb14e0 Author: Akira Ajisaka Authored: Tue Nov 20 12:55:40 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 20 14:25:18 2018 +0900 -- .../markdown/release/2.9.2/CHANGELOG.2.9.2.md | 80 - .../release/2.9.2/RELEASENOTES.2.9.2.md | 12 +- .../jdiff/Apache_Hadoop_HDFS_2.9.2.xml | 312 +++ 3 files changed, 399 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/1a00b4e3/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md -- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md index e0a167d..cf5e59b 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md @@ -16,10 +16,20 @@ # See the License for the specific language governing permissions and # limitations under the License. --> -# Apache Hadoop Changelog +# "Apache Hadoop" Changelog -## Release 2.9.2 - Unreleased (as of 2018-09-02) +## Release 2.9.2 - 2018-11-19 +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | + + +### IMPORTANT ISSUES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | ### NEW FEATURES: @@ -34,23 +44,28 @@ | JIRA | Summary | Priority | Component | Reporter | Contributor | |: |: | :--- |: |: |: | | [HADOOP-14987](https://issues.apache.org/jira/browse/HADOOP-14987) | Improve KMSClientProvider log around delegation token checking | Major | . | Xiaoyu Yao | Xiaoyu Yao | +| [YARN-7274](https://issues.apache.org/jira/browse/YARN-7274) | Ability to disable elasticity at leaf queue level | Major | capacityscheduler | Scott Brokaw | Zian Chen | | [HADOOP-15394](https://issues.apache.org/jira/browse/HADOOP-15394) | Backport PowerShell NodeFencer HADOOP-14309 to branch-2 | Minor | . | Ãñigo Goiri | Ãñigo Goiri | | [HDFS-13462](https://issues.apache.org/jira/browse/HDFS-13462) | Add BIND\_HOST configuration for JournalNode's HTTP and RPC Servers | Major | hdfs, journal-node | Lukas Majercak | Lukas Majercak | | [HADOOP-14841](https://issues.apache.org/jira/browse/HADOOP-14841) | Kms client should disconnect if unable to get output stream from connection. | Major | kms | Xiao Chen | Rushabh S Shah | | [HDFS-13272](https://issues.apache.org/jira/browse/HDFS-13272) | DataNodeHttpServer to have configurable HttpServer2 threads | Major | datanode | Erik Krogen | Erik Krogen | | [HADOOP-15441](https://issues.apache.org/jira/browse/HADOOP-15441) | Log kms url and token service at debug level. | Minor | . | Wei-Chiu Chuang | Gabor Bota | -| [HDFS-13544](https://issues.apache.org/jira/browse/HDFS-13544) | Improve logging for JournalNode in federated cluster | Major | federation, hdfs | Hanisha Koneru | Hanisha Koneru | | [HADOOP-15486](https://issues.apache.org/jira/browse/HADOOP-15486) | Make NetworkTopology#netLock fair | Major | net | Nanda kumar | Nanda kumar | | [HADOOP-15449](https://issues.apache.org/jira/browse/HADOOP-15449) | Increase default timeout of ZK session to avoid frequent NameNode failover | Critical | common | Karthik Palanisamy | Karthik Palanisamy | | [HDFS-13602](https://issues.apache.org/jira/browse/HDFS-13602) | Add checkOperation(WRITE) checks in FSNamesystem | Major | ha, namenode | Erik Krogen | Chao Sun | | [HDFS-13653](https://issues.apache.org/jira/browse/HDFS-13653) | Make dfs.client.failover.random.order a per nameservice configuration | Major | federation | Ekanth Sethuramalingam | Ekanth Sethuramalingam | +| [HDFS-13686](https://issues.apache.org/jira/browse/HDFS-13686) | Add overall metrics for FSNamesystemLock | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | | [HDFS-13714](https://issues.apache.org/jira/browse/HDFS-13714) | Fix TestNameNodePrunesMissingStorages test failures on Windows | Major | hdfs, namenode, test | Lukas Majercak | Lukas Majercak | +| [HDFS-13719](https://issues.apache.org/jira/browse/HDFS-13719
hadoop git commit: Add 2.9.2 release notes and changes documents.
Repository: hadoop Updated Branches: refs/heads/branch-3.2 34387599c -> f6227367f Add 2.9.2 release notes and changes documents. (cherry picked from commit 1a00b4e325146988375c9ce5b11016c45f059a4e) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f6227367 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f6227367 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f6227367 Branch: refs/heads/branch-3.2 Commit: f6227367fbb3b6c034446f884ad3ecab672a73e1 Parents: 3438759 Author: Akira Ajisaka Authored: Tue Nov 20 12:55:40 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 20 14:25:48 2018 +0900 -- .../markdown/release/2.9.2/CHANGELOG.2.9.2.md | 80 - .../release/2.9.2/RELEASENOTES.2.9.2.md | 12 +- .../jdiff/Apache_Hadoop_HDFS_2.9.2.xml | 312 +++ 3 files changed, 399 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/f6227367/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md -- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md index e0a167d..cf5e59b 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGELOG.2.9.2.md @@ -16,10 +16,20 @@ # See the License for the specific language governing permissions and # limitations under the License. --> -# Apache Hadoop Changelog +# "Apache Hadoop" Changelog -## Release 2.9.2 - Unreleased (as of 2018-09-02) +## Release 2.9.2 - 2018-11-19 +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | + + +### IMPORTANT ISSUES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | ### NEW FEATURES: @@ -34,23 +44,28 @@ | JIRA | Summary | Priority | Component | Reporter | Contributor | |: |: | :--- |: |: |: | | [HADOOP-14987](https://issues.apache.org/jira/browse/HADOOP-14987) | Improve KMSClientProvider log around delegation token checking | Major | . | Xiaoyu Yao | Xiaoyu Yao | +| [YARN-7274](https://issues.apache.org/jira/browse/YARN-7274) | Ability to disable elasticity at leaf queue level | Major | capacityscheduler | Scott Brokaw | Zian Chen | | [HADOOP-15394](https://issues.apache.org/jira/browse/HADOOP-15394) | Backport PowerShell NodeFencer HADOOP-14309 to branch-2 | Minor | . | Ãñigo Goiri | Ãñigo Goiri | | [HDFS-13462](https://issues.apache.org/jira/browse/HDFS-13462) | Add BIND\_HOST configuration for JournalNode's HTTP and RPC Servers | Major | hdfs, journal-node | Lukas Majercak | Lukas Majercak | | [HADOOP-14841](https://issues.apache.org/jira/browse/HADOOP-14841) | Kms client should disconnect if unable to get output stream from connection. | Major | kms | Xiao Chen | Rushabh S Shah | | [HDFS-13272](https://issues.apache.org/jira/browse/HDFS-13272) | DataNodeHttpServer to have configurable HttpServer2 threads | Major | datanode | Erik Krogen | Erik Krogen | | [HADOOP-15441](https://issues.apache.org/jira/browse/HADOOP-15441) | Log kms url and token service at debug level. | Minor | . | Wei-Chiu Chuang | Gabor Bota | -| [HDFS-13544](https://issues.apache.org/jira/browse/HDFS-13544) | Improve logging for JournalNode in federated cluster | Major | federation, hdfs | Hanisha Koneru | Hanisha Koneru | | [HADOOP-15486](https://issues.apache.org/jira/browse/HADOOP-15486) | Make NetworkTopology#netLock fair | Major | net | Nanda kumar | Nanda kumar | | [HADOOP-15449](https://issues.apache.org/jira/browse/HADOOP-15449) | Increase default timeout of ZK session to avoid frequent NameNode failover | Critical | common | Karthik Palanisamy | Karthik Palanisamy | | [HDFS-13602](https://issues.apache.org/jira/browse/HDFS-13602) | Add checkOperation(WRITE) checks in FSNamesystem | Major | ha, namenode | Erik Krogen | Chao Sun | | [HDFS-13653](https://issues.apache.org/jira/browse/HDFS-13653) | Make dfs.client.failover.random.order a per nameservice configuration | Major | federation | Ekanth Sethuramalingam | Ekanth Sethuramalingam | +| [HDFS-13686](https://issues.apache.org/jira/browse/HDFS-13686) | Add overall metrics for FSNamesystemLock | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | | [HDFS-13714](https://issues.apache.org/jira/browse/HDFS-13714) | Fix TestNameNodePrunesMissingStorages test failures on Windows | Major | hdfs, namenode, test | Lukas Majercak | L
hadoop git commit: Add 2.9.2 release notes and changes documents.
Repository: hadoop Updated Branches: refs/heads/branch-2 311be8864 -> 6cae964f6 Add 2.9.2 release notes and changes documents. (cherry picked from commit 1a00b4e325146988375c9ce5b11016c45f059a4e) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6cae964f Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6cae964f Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/6cae964f Branch: refs/heads/branch-2 Commit: 6cae964f6ca9ba14799398ecb929c9798076f955 Parents: 311be88 Author: Akira Ajisaka Authored: Tue Nov 20 12:55:40 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 20 14:30:09 2018 +0900 -- .../markdown/release/2.9.2/CHANGES.2.9.2.md | 274 .../release/2.9.2/RELEASENOTES.2.9.2.md | 31 ++ .../jdiff/Apache_Hadoop_HDFS_2.9.2.xml | 312 +++ 3 files changed, 617 insertions(+) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/6cae964f/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGES.2.9.2.md -- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGES.2.9.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGES.2.9.2.md new file mode 100644 index 000..cf5e59b --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGES.2.9.2.md @@ -0,0 +1,274 @@ + + +# "Apache Hadoop" Changelog + +## Release 2.9.2 - 2018-11-19 + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | + + +### IMPORTANT ISSUES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HDFS-13283](https://issues.apache.org/jira/browse/HDFS-13283) | Percentage based Reserved Space Calculation for DataNode | Major | datanode, hdfs | Lukas Majercak | Lukas Majercak | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HADOOP-14987](https://issues.apache.org/jira/browse/HADOOP-14987) | Improve KMSClientProvider log around delegation token checking | Major | . | Xiaoyu Yao | Xiaoyu Yao | +| [YARN-7274](https://issues.apache.org/jira/browse/YARN-7274) | Ability to disable elasticity at leaf queue level | Major | capacityscheduler | Scott Brokaw | Zian Chen | +| [HADOOP-15394](https://issues.apache.org/jira/browse/HADOOP-15394) | Backport PowerShell NodeFencer HADOOP-14309 to branch-2 | Minor | . | Ãñigo Goiri | Ãñigo Goiri | +| [HDFS-13462](https://issues.apache.org/jira/browse/HDFS-13462) | Add BIND\_HOST configuration for JournalNode's HTTP and RPC Servers | Major | hdfs, journal-node | Lukas Majercak | Lukas Majercak | +| [HADOOP-14841](https://issues.apache.org/jira/browse/HADOOP-14841) | Kms client should disconnect if unable to get output stream from connection. | Major | kms | Xiao Chen | Rushabh S Shah | +| [HDFS-13272](https://issues.apache.org/jira/browse/HDFS-13272) | DataNodeHttpServer to have configurable HttpServer2 threads | Major | datanode | Erik Krogen | Erik Krogen | +| [HADOOP-15441](https://issues.apache.org/jira/browse/HADOOP-15441) | Log kms url and token service at debug level. | Minor | . | Wei-Chiu Chuang | Gabor Bota | +| [HADOOP-15486](https://issues.apache.org/jira/browse/HADOOP-15486) | Make NetworkTopology#netLock fair | Major | net | Nanda kumar | Nanda kumar | +| [HADOOP-15449](https://issues.apache.org/jira/browse/HADOOP-15449) | Increase default timeout of ZK session to avoid frequent NameNode failover | Critical | common | Karthik Palanisamy | Karthik Palanisamy | +| [HDFS-13602](https://issues.apache.org/jira/browse/HDFS-13602) | Add checkOperation(WRITE) checks in FSNamesystem | Major | ha, namenode | Erik Krogen | Chao Sun | +| [HDFS-13653](https://issues.apache.org/jira/browse/HDFS-13653) | Make dfs.client.failover.random.order a per nameservice configuration | Major | federation | Ekanth Sethuramalingam | Ekanth Sethuramalingam | +| [HDFS-13686](https://issues.apache.org/jira/browse/HDFS-13686) | Add overall metrics for FSNamesystemLock | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | +| [HDFS-13714](https://issues.apache.org/jira/browse/HDFS-13714) | Fix TestNameNodePrunesMissingStorages test failures on Windows | Major | hdfs, namenode, test | Lukas Majercak | Lukas Majercak | +| [HDFS-13719](https://issues.apache.org/jira/browse/HDFS-13719) | Docs around dfs.image.transfer.timeout are misleading | Majo
hadoop git commit: Add 2.9.2 release notes and changes documents.
Repository: hadoop Updated Branches: refs/heads/branch-2.9 a2de9e479 -> 0f78c90bd Add 2.9.2 release notes and changes documents. (cherry picked from commit 1a00b4e325146988375c9ce5b11016c45f059a4e) (cherry picked from commit 6cae964f6ca9ba14799398ecb929c9798076f955) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0f78c90b Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0f78c90b Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/0f78c90b Branch: refs/heads/branch-2.9 Commit: 0f78c90bd87b9eaad140e3b796c115804c961739 Parents: a2de9e4 Author: Akira Ajisaka Authored: Tue Nov 20 12:55:40 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 20 14:31:09 2018 +0900 -- .../markdown/release/2.9.2/CHANGES.2.9.2.md | 274 .../release/2.9.2/RELEASENOTES.2.9.2.md | 31 ++ .../jdiff/Apache_Hadoop_HDFS_2.9.2.xml | 312 +++ 3 files changed, 617 insertions(+) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/0f78c90b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGES.2.9.2.md -- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGES.2.9.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGES.2.9.2.md new file mode 100644 index 000..cf5e59b --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.2/CHANGES.2.9.2.md @@ -0,0 +1,274 @@ + + +# "Apache Hadoop" Changelog + +## Release 2.9.2 - 2018-11-19 + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | + + +### IMPORTANT ISSUES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HDFS-13283](https://issues.apache.org/jira/browse/HDFS-13283) | Percentage based Reserved Space Calculation for DataNode | Major | datanode, hdfs | Lukas Majercak | Lukas Majercak | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HADOOP-14987](https://issues.apache.org/jira/browse/HADOOP-14987) | Improve KMSClientProvider log around delegation token checking | Major | . | Xiaoyu Yao | Xiaoyu Yao | +| [YARN-7274](https://issues.apache.org/jira/browse/YARN-7274) | Ability to disable elasticity at leaf queue level | Major | capacityscheduler | Scott Brokaw | Zian Chen | +| [HADOOP-15394](https://issues.apache.org/jira/browse/HADOOP-15394) | Backport PowerShell NodeFencer HADOOP-14309 to branch-2 | Minor | . | Ãñigo Goiri | Ãñigo Goiri | +| [HDFS-13462](https://issues.apache.org/jira/browse/HDFS-13462) | Add BIND\_HOST configuration for JournalNode's HTTP and RPC Servers | Major | hdfs, journal-node | Lukas Majercak | Lukas Majercak | +| [HADOOP-14841](https://issues.apache.org/jira/browse/HADOOP-14841) | Kms client should disconnect if unable to get output stream from connection. | Major | kms | Xiao Chen | Rushabh S Shah | +| [HDFS-13272](https://issues.apache.org/jira/browse/HDFS-13272) | DataNodeHttpServer to have configurable HttpServer2 threads | Major | datanode | Erik Krogen | Erik Krogen | +| [HADOOP-15441](https://issues.apache.org/jira/browse/HADOOP-15441) | Log kms url and token service at debug level. | Minor | . | Wei-Chiu Chuang | Gabor Bota | +| [HADOOP-15486](https://issues.apache.org/jira/browse/HADOOP-15486) | Make NetworkTopology#netLock fair | Major | net | Nanda kumar | Nanda kumar | +| [HADOOP-15449](https://issues.apache.org/jira/browse/HADOOP-15449) | Increase default timeout of ZK session to avoid frequent NameNode failover | Critical | common | Karthik Palanisamy | Karthik Palanisamy | +| [HDFS-13602](https://issues.apache.org/jira/browse/HDFS-13602) | Add checkOperation(WRITE) checks in FSNamesystem | Major | ha, namenode | Erik Krogen | Chao Sun | +| [HDFS-13653](https://issues.apache.org/jira/browse/HDFS-13653) | Make dfs.client.failover.random.order a per nameservice configuration | Major | federation | Ekanth Sethuramalingam | Ekanth Sethuramalingam | +| [HDFS-13686](https://issues.apache.org/jira/browse/HDFS-13686) | Add overall metrics for FSNamesystemLock | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | +| [HDFS-13714](https://issues.apache.org/jira/browse/HDFS-13714) | Fix TestNameNodePrunesMissingStorages test failures on Windows | Major | hdfs, namenode, test | Lukas Majercak | Lukas Majercak | +| [HDFS-13719](https://issues.apache.org/jira/browse/HDF
hadoop git commit: Update jdiff.stable.api from 2.9.1 to 2.9.2.
Repository: hadoop Updated Branches: refs/heads/branch-2 6cae964f6 -> d892d82ac Update jdiff.stable.api from 2.9.1 to 2.9.2. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d892d82a Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d892d82a Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/d892d82a Branch: refs/heads/branch-2 Commit: d892d82ac0a5fc124cb596247239f9c6d5fb2cdd Parents: 6cae964 Author: Akira Ajisaka Authored: Tue Nov 20 14:32:49 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 20 14:32:49 2018 +0900 -- hadoop-project-dist/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/d892d82a/hadoop-project-dist/pom.xml -- diff --git a/hadoop-project-dist/pom.xml b/hadoop-project-dist/pom.xml index 1519651..a038cd3 100644 --- a/hadoop-project-dist/pom.xml +++ b/hadoop-project-dist/pom.xml @@ -144,7 +144,7 @@ false -2.9.1 +2.9.2 -unstable - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: Update jdiff.stable.api from 2.9.1 to 2.9.2.
Repository: hadoop Updated Branches: refs/heads/branch-2.9 0f78c90bd -> 06cc20d5d Update jdiff.stable.api from 2.9.1 to 2.9.2. (cherry picked from commit d892d82ac0a5fc124cb596247239f9c6d5fb2cdd) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/06cc20d5 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/06cc20d5 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/06cc20d5 Branch: refs/heads/branch-2.9 Commit: 06cc20d5d2314d45f12415805bf4b44635ab51f6 Parents: 0f78c90 Author: Akira Ajisaka Authored: Tue Nov 20 14:32:49 2018 +0900 Committer: Akira Ajisaka Committed: Tue Nov 20 14:33:17 2018 +0900 -- hadoop-project-dist/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/06cc20d5/hadoop-project-dist/pom.xml -- diff --git a/hadoop-project-dist/pom.xml b/hadoop-project-dist/pom.xml index e55d8ca..627cb49 100644 --- a/hadoop-project-dist/pom.xml +++ b/hadoop-project-dist/pom.xml @@ -144,7 +144,7 @@ false -2.9.1 +2.9.2 -unstable - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HADOOP-14739. Update start-build-env.sh and build instruction for docker for Mac instead of docker toolbox. Contributed by Dinesh Chitlangia.
Repository: hadoop
Updated Branches:
refs/heads/trunk 0123e5197 -> 10b5da85f
HADOOP-14739. Update start-build-env.sh and build instruction for docker for
Mac instead of docker toolbox. Contributed by Dinesh Chitlangia.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/10b5da85
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/10b5da85
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/10b5da85
Branch: refs/heads/trunk
Commit: 10b5da85fab41c68c2c223a3a8749be9719908f6
Parents: 0123e51
Author: Akira Ajisaka
Authored: Tue Nov 20 23:59:08 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 20 23:59:49 2018 +0900
--
BUILDING.txt | 10 +-
start-build-env.sh | 13 +++--
2 files changed, 8 insertions(+), 15 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/10b5da85/BUILDING.txt
--
diff --git a/BUILDING.txt b/BUILDING.txt
index d35e3af..d781c2c 100644
--- a/BUILDING.txt
+++ b/BUILDING.txt
@@ -26,19 +26,11 @@ The easiest way to get an environment with all the
appropriate tools is by means
of the provided Docker config.
This requires a recent version of docker (1.4.1 and higher are known to work).
-On Linux:
+On Linux / Mac:
Install Docker and run this command:
$ ./start-build-env.sh
-On Mac:
-First make sure Virtualbox and docker toolbox are installed.
-You can use docker toolbox as described in
http://docs.docker.com/mac/step_one/.
-$ docker-machine create --driver virtualbox \
---virtualbox-memory "4096" hadoopdev
-$ eval $(docker-machine env hadoopdev)
-$ ./start-build-env.sh
-
The prompt which is then presented is located at a mounted version of the
source tree
and all required tools for testing and building have been installed and
configured.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/10b5da85/start-build-env.sh
--
diff --git a/start-build-env.sh b/start-build-env.sh
index e3d9f2f..08cdfb0 100755
--- a/start-build-env.sh
+++ b/start-build-env.sh
@@ -21,9 +21,14 @@ cd "$(dirname "$0")" # connect to root
docker build -t hadoop-build dev-support/docker
+USER_NAME=${SUDO_USER:=$USER}
+USER_ID=$(id -u "${USER_NAME}")
+
+if [ "$(uname -s)" = "Darwin" ]; then
+ GROUP_ID=100
+fi
+
if [ "$(uname -s)" = "Linux" ]; then
- USER_NAME=${SUDO_USER:=$USER}
- USER_ID=$(id -u "${USER_NAME}")
GROUP_ID=$(id -g "${USER_NAME}")
# man docker-run
# When using SELinux, mounted directories may not be accessible
@@ -51,10 +56,6 @@ if [ "$(uname -s)" = "Linux" ]; then
done
fi
fi
-else # boot2docker uid and gid
- USER_NAME=$USER
- USER_ID=1000
- GROUP_ID=50
fi
docker build -t "hadoop-build-${USER_ID}" - <
hadoop git commit: MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin.
Repository: hadoop
Updated Branches:
refs/heads/trunk 2730ead6b -> 1aad99a71
MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1aad99a7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1aad99a7
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/1aad99a7
Branch: refs/heads/trunk
Commit: 1aad99a71813660b83628cacfed393d0b3a123cc
Parents: 2730ead
Author: Akira Ajisaka
Authored: Tue Nov 27 20:01:11 2018 +0900
Committer: Akira Ajisaka
Committed: Tue Nov 27 20:01:11 2018 +0900
--
.../java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java| 1 +
1 file changed, 1 insertion(+)
--
http://git-wip-us.apache.org/repos/asf/hadoop/blob/1aad99a7/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
--
diff --git
a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
index b07c676..02ec53e 100644
---
a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
+++
b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
@@ -94,6 +94,7 @@ public class EventWriter {
wrapper.setEvent(event.getDatum());
writer.write(wrapper, encoder);
if (this.jsonOutput) {
+ encoder.flush();
out.writeBytes("\n");
}
}
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
