Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-08 Thread Masatake Iwasaki
WARN crypto.OpensslCipher: Failed to load OpenSSL Cipher. java.lang.UnsatisfiedLinkError: Cannot find AES-CTR/SM4-CTR support, is your version of Openssl new enough? at org.apache.hadoop.crypto.OpensslCipher.initIDs(Native Method) Masatake Iwasaki On 2024/03/05 7:07, slfan1989 wrote

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

2024-03-08 Thread Masatake Iwasaki
+1 on supporting only HBase v2. Masatake Iwasaki On 2024/03/06 13:18, slfan1989 wrote: +1 Option2 I also agree with the idea of upgrading hbase 2.2 to 2.5. Shilun Fan. Hbase v1 is EOL for a while now, so option 2 probably makes sense. While you are at it you should probably update

Re: [INFO] Hadoop-3.4 Release Update

2024-01-21 Thread Masatake Iwasaki
> As I mentioned in my comment on HADOOP-18045, I think 3.4.0 should still be > included in the Fix versions, > even if it was already released in 3.3.x. If I understand correctly, this > is usually our practice. +1. We can not assume 3.4.x contains all fixes of 3.3.y since we are maintaining

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

2024-01-10 Thread Masatake Iwasaki
. In addition, the description about new features of previous release should be removed from the index.md.vm. [1] https://github.com/apache/hadoop/blob/branch-3.4.0/hadoop-project/src/site/markdown/index.md.vm Masatake Iwasaki On 2024/01/11 14:15, slfan1989 wrote: Hello all, We plan to release

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-06 Thread Masatake Iwasaki
+1 On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote: > > Dear Hadoop devs, > > Given the feedback from the discussion thread [1], I'd like to start > an official thread for the community to vote on release line 3.2 EOL. > > It will include, > a. An official announcement informs no further

Re: [DISCUSS] Make some release lines EOL

2023-12-05 Thread Masatake Iwasaki
+1 on marking 3.2 EOL. For branch-2.10, just keeping cherry-picking critical our CVEs without release sounds good. If someone really want, I can try to put 2.10.3 up. dev-support/bin/create-release looks still working with some trivial fixes. On Tue, Dec 5, 2023 at 7:45 PM Steve Loughran wrote:

[jira] [Resolved] (HADOOP-18941) Modify HBase version in BUILDING.txt

2023-10-20 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18941. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Mod

[jira] [Resolved] (HADOOP-18942) Upgrade ZooKeeper to 3.7.2

2023-10-19 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18942. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HADOOP-18867) Upgrade ZooKeeper to 3.6.4

2023-10-17 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18867. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Created] (HADOOP-18942) Upgrade ZooKeeper to 3.7.2

2023-10-17 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18942: - Summary: Upgrade ZooKeeper to 3.7.2 Key: HADOOP-18942 URL: https://issues.apache.org/jira/browse/HADOOP-18942 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-18867) Upgrade ZooKeeper to 3.6.4

2023-08-25 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18867: - Summary: Upgrade ZooKeeper to 3.6.4 Key: HADOOP-18867 URL: https://issues.apache.org/jira/browse/HADOOP-18867 Project: Hadoop Common Issue Type

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-20 Thread Masatake Iwasaki
and read files via httpfs. + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky Linux 8 (x86_64). + built HBase and Hive against Hadoop 3.3.6. + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive. + skimmed the contents of site documentation. Thanks, Masatake Iwasaki

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-19 Thread Masatake Iwasaki
[1] https://github.com/apache/hadoop/pull/3241/files#diff-b273546d6f060e617553eaa49da69039d2c655a77d42022779c2281d0f6cd08eR135 [2] https://github.com/apache/hadoop/pull/3241#issuecomment-889185103 On Mon, 19 Jun 2023 at 06:44, Masatake Iwasaki wrote: I got compilation error against ZooKeeper 3.5 due

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-18 Thread Masatake Iwasaki
code is the cause. Thanks, Masatake Iwasaki On 2023/06/18 4:57, Wei-Chiu Chuang wrote: I was going to do another RC in case something comes up. But it looks like the only thing that needs to be fixed is the Changelog. 1. HADOOP-18596 <https://issues.apache.org/jira/browse/HADOOP-18

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-19 Thread Masatake Iwasaki
and skimmed the contents. + Javadocs are contained. Thanks, Masatake Iwasaki On 2023/03/16 4:47, Steve Loughran wrote: Apache Hadoop 3.3.5 Mukund and I have put together a release candidate (RC3) for Hadoop 3.3.5. What we would like is for anyone who can to verify the tarballs, especially anyone who

[jira] [Resolved] (HADOOP-18598) maven site generation doesn't include javadocs

2023-01-31 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18598. --- Fix Version/s: 3.4.0 3.3.5 Hadoop Flags: Reviewed

[jira] [Created] (HADOOP-18609) Fix source code modification after building with docs profile

2023-01-31 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18609: - Summary: Fix source code modification after building with docs profile Key: HADOOP-18609 URL: https://issues.apache.org/jira/browse/HADOOP-18609 Project

[jira] [Created] (HADOOP-18608) Add validation to check Javadocs are included in site documentation

2023-01-31 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18608: - Summary: Add validation to check Javadocs are included in site documentation Key: HADOOP-18608 URL: https://issues.apache.org/jira/browse/HADOOP-18608

[jira] [Created] (HADOOP-18601) Fix build failure with docs profile

2023-01-20 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18601: - Summary: Fix build failure with docs profile Key: HADOOP-18601 URL: https://issues.apache.org/jira/browse/HADOOP-18601 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-02 Thread Masatake Iwasaki
elp 1] ... On 2023/01/02 22:02, Masatake Iwasaki wrote: Thanks for your great effort for the new release, Steve and Mukund. +1 while it would be nice if we can address missed Javadocs. + verified the signature and checksum. + built from source tarball on Rocky Linux 8 and OpenJDK 8 with nat

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-02 Thread Masatake Iwasaki
3.1.3 against 3.3.5 failed due to dependency change. # while building HBase 2.4.13 and Hive 3.1.3 against Hadoop 3.3.4 worked. + skimmed the site contents. - Javadocs are not contained (under r3.3.5/api). # The issue can be reproduced even if I built site docs from the source. Masatake

Re: [VOTE] Release Apache Hadoop 3.3.4

2022-07-31 Thread Masatake Iwasaki
://github.com/apache/bigtop/pull/964 * HBsae needed to fix relocation rules due to dependency on okhttp added by HDFS-16453. * built Spark 3.3.0 using the staging repository. Thanks, Masatake Iwasaki On 2022/07/30 3:47, Steve Loughran wrote: I have put together a release candidate (RC1) for Hadoop

[jira] [Resolved] (HADOOP-18376) Fix failure of instanciation of s3gatewayrequestlog appender due to lack of HttpRequestLogAppender

2022-07-28 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18376. --- Resolution: Invalid The cause was old log4j.properties in my testing environment

[jira] [Created] (HADOOP-18376) Fix failure of instanciation of s3gatewayrequestlog due to lack of HttpRequestLogAppender

2022-07-28 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18376: - Summary: Fix failure of instanciation of s3gatewayrequestlog due to lack of HttpRequestLogAppender Key: HADOOP-18376 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Created] (HADOOP-18375) Fix failure of shelltest for hadoop_add_ldlibpath

2022-07-27 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18375: - Summary: Fix failure of shelltest for hadoop_add_ldlibpath Key: HADOOP-18375 URL: https://issues.apache.org/jira/browse/HADOOP-18375 Project: Hadoop Common

[ANNOUNCE] Apache Hadoop 3.2.4 release

2022-07-21 Thread Masatake Iwasaki
nd testing reviewing the final artifacts. Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-21 Thread Masatake Iwasaki
The vote passed with the following result. Binding PMC members: +1 Chris Nauroth +1 Ayush Saxena +1 Masatake Iwasaki Non binding votes: +1 Ashutosh Gupta I'm going to publish the artifacts, site docs, maven artifacts, then announce. Thank you to all who helped to push this release out

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-20 Thread Masatake Iwasaki
Hi developers, I'm still waiting for your vote. I'm considering the intermittent test failures mentioned by Chris are not blocker. Please file a JIRA and let me know if you find a blocker issue. I will appreciate your help for the release process. Regards, Masatake Iwasaki On 2022/07/20 14

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-19 Thread Masatake Iwasaki
ails. YARN 8867 did not modified other code under hadoop-yarn-services. If it is the case, TestServiceAM can be tagged as flaky in branch-3.2. On 2022/07/20 14:21, Masatake Iwasaki wrote: Thanks for testing the RC0, Chris. The following are new test failures for me on 3.2.4: * TestAMRMProxy

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-19 Thread Masatake Iwasaki
ailures. I don't know if it's a quirk to my environment, though I'm using the start-build-env.sh Docker container, so any build dependencies should be consistent. I'd be comfortable moving ahead if others are seeing these tests pass. Chris Nauroth On Thu, Jul 14, 2022 at 7:57 AM Masatake Iwasaki w

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-14 Thread Masatake Iwasaki
/content/repositories/orgapachehadoop-1354 true true Thanks, Masatake Iwasaki On 2022/07/13 1:14, Masatake Iwasaki wrote: Hi all, Here's Hadoop 3.2.4 release candidate #0: The RC is available at:   https://home.apache.org/~iwasakims/hadoop

[VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-12 Thread Masatake Iwasaki
/repositories/orgapachehadoop-1354 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. The vote will be open for (at least) 5 days. Thanks, Masatake Iwasaki

[jira] [Resolved] (HADOOP-18100) Change scope of inner classes in InodeTree to make them accessible outside package

2022-07-12 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18100. --- Fix Version/s: 3.4.0 3.2.4 3.3.9

[jira] [Created] (HADOOP-18334) Fix create-release to address removal of GPG_AGENT_INFO in branch-3.2

2022-07-11 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18334: - Summary: Fix create-release to address removal of GPG_AGENT_INFO in branch-3.2 Key: HADOOP-18334 URL: https://issues.apache.org/jira/browse/HADOOP-18334

Re: [DISCUSS] Hadoop 3.2.4 release

2022-07-11 Thread Masatake Iwasaki
Hi committers, I created branch-3.2.4. Please set the value of "Fix versions/s" field to 3.2.5 on JIRA issue if the fix is committed to branch-3.2 and not cherry-picked to branch-3.2.4. Thanks, Masatake Iwasaki On 2022/07/11 13:21, Akira Ajisaka wrote: Thank you Masatake for

Re: [DISCUSS] Hadoop 3.2.4 release

2022-07-10 Thread Masatake Iwasaki
I'm going to cut branch-3.2.4 today. If we need more time for 3.3.4 to fix the issue around HADOOP-18033, 3.2.4 can be released first. Thanks, Masatake Iwasaki On 2022/05/10 0:02, Masatake Iwasaki wrote: Hi team, Shaded client artifacts (hadoop-client-api and hadoop-client-runtime) of Hadoop

[jira] [Resolved] (HADOOP-18309) Upgrade bundled Tomcat to 8.5.76 or higher

2022-06-23 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18309. --- Fix Version/s: 2.10.3 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HADOOP-18299) Fix unexpected contents in hadoop-client-check-test-invariants on aarch64

2022-06-18 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18299. --- Assignee: (was: Masatake Iwasaki) Resolution: Cannot Reproduce I can

[jira] [Created] (HADOOP-18299) Fix unexpected contents in hadoop-client-check-test-invariants on aarch64

2022-06-17 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18299: - Summary: Fix unexpected contents in hadoop-client-check-test-invariants on aarch64 Key: HADOOP-18299 URL: https://issues.apache.org/jira/browse/HADOOP-18299

[jira] [Created] (HADOOP-18276) Rename CHANGES to CHANGELOG in branch-2.10

2022-06-04 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18276: - Summary: Rename CHANGES to CHANGELOG in branch-2.10 Key: HADOOP-18276 URL: https://issues.apache.org/jira/browse/HADOOP-18276 Project: Hadoop Common

[ANNOUNCE] Apache Hadoop 2.10.2 release

2022-05-31 Thread Masatake Iwasaki
e building and testing reviewing the final artifacts. Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-30 Thread Masatake Iwasaki
The vote passed with the following result. Binding PMC members: +1 Chris Nauroth +1 Ayush Saxena +1 Steve Loughran +1 Masatake Iwasaki Non binding votes: +1 Viraj Jasani +1 Ashutosh Gupta I'm going to publish the artifacts, site docs, maven artifacts, then announce. Thank you to all who

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-29 Thread Masatake Iwasaki
Thanks for the help, Ayush. I committed HADOOP-16663/HADOOP-16664 and cherry-picked HADOOP-16985 to branch-2.10 (and branch-3.2). If I need to cut RC1, I will try cherry-picking them to branch-2.10.2 Masatake Iwasaki On 2022/05/28 5:23, Ayush Saxena wrote: The checksum stuff was addressed

[jira] [Created] (HADOOP-18267) Fix failure of build of hadoop-hdfs-bkjournal in branch-2.10 without ptotoc in the PATH

2022-05-29 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18267: - Summary: Fix failure of build of hadoop-hdfs-bkjournal in branch-2.10 without ptotoc in the PATH Key: HADOOP-18267 URL: https://issues.apache.org/jira/browse/HADOOP

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-27 Thread Masatake Iwasaki
2.3.6 and Spark 2.4.5 against Hadoop 2.10.2 RC0 on CentOS 7 (x86_64) by using Bigtop branch-1.5 and ran smoke-tests. https://github.com/apache/bigtop/pull/906 Masatake Iwasaki On 2022/05/25 11:40, Masatake Iwasaki wrote: Hi all, Here's Hadoop 2.10.2 release candidate #0: The RC is available

[VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-24 Thread Masatake Iwasaki
/repositories/orgapachehadoop-1350 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. The vote will be open for (at least) 5 days. Thanks, Masatake Iwasaki

[jira] [Resolved] (HADOOP-17992) Disable JIRA plugin for YETUS on Hadoop

2022-05-23 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17992. --- Resolution: Duplicate Since the commit log of [#3623|https://github.com/apache

[jira] [Reopened] (HADOOP-17992) Disable JIRA plugin for YETUS on Hadoop

2022-05-23 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reopened HADOOP-17992: --- > Disable JIRA plugin for YETUS on Had

[jira] [Created] (HADOOP-18251) Fix failure of extracting JIRA id from commit message in git_jira_fix_version_check.py

2022-05-23 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18251: - Summary: Fix failure of extracting JIRA id from commit message in git_jira_fix_version_check.py Key: HADOOP-18251 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Resolved] (HADOOP-18172) Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package

2022-05-22 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18172. --- Resolution: Fixed > Change scope of getRootFallbackLink for InodeTree to make t

Re: [DISCUSS] Hadoop 2.10.2 release

2022-05-16 Thread Masatake Iwasaki
Hi committers, I created branch-2.10.2 and bumped the version of branch-2.10 to 2.10.3-SNAPSHOT. Please set the "Fix Version/s:" of JIRA to 2.10.3 if you commit the fix to branch-2.10 without cherry-picking to branch-2.10.2. Regards, Masatake Iwasaki On 2022/05/16 23:16, Masata

Re: [DISCUSS] Hadoop 2.10.2 release

2022-05-16 Thread Masatake Iwasaki
Thanks, Akira and Xiaoqiao for positive feedback. I'm going to cut branch-2.10.2 shortly. Masatake Iwasaki On 2022/05/12 11:38, Xiaoqiao He wrote: Thanks Masatake and Akira for bringing this release up. +1 for 2.10.2 release. Sorry for the late response. Regards, - He Xiaoqiao On Mon, Mar

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

2022-05-15 Thread Masatake Iwasaki
enabled 3-nodes docker cluster and ran sample MR jobs. * built site documentation by `mvn site site:stage -Preleasedocs` and skimmed the contents. * built Spark 3.2.1 against 3.3.3 RC1 using the staging repository (after `rm -rf ~/.m2/repository/org/apache/hadoop`). Thanks, Masatake Iwasaki On 2022

[DISCUSS] Hadoop 3.2.4 release

2022-05-09 Thread Masatake Iwasaki
%20AND%20fixVersion%20%3D%203.2.4 Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.3.3

2022-05-09 Thread Masatake Iwasaki
Step #10 in "Creating the release candidate (X.Y.Z-RC)" section of the Wiki still instructs to run `mvn deploy` with `-DskipShade`. https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease#HowToRelease-Creatingthereleasecandidate(X.Y.Z-RC%3CN%3E) On 2022/05/09 23:18, Masata

Re: [VOTE] Release Apache Hadoop 3.3.3

2022-05-06 Thread Masatake Iwasaki
enabled 3-nodes docker cluster and ran sample MR jobs. * launched pseudo distributed cluster and `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code. * built site documentation by `mvn site site:stage -Preleasedocs` and skimmed the contents. Thanks, Masatake

[jira] [Resolved] (HADOOP-18088) Replace log4j 1.x with reload4j

2022-04-06 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18088. --- Hadoop Flags: Reviewed Release Note: log4j 1 was replaced with reload4j which

[jira] [Created] (HADOOP-18192) Fix multiple_bindings warning about slf4j-relad4j

2022-04-04 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18192: - Summary: Fix multiple_bindings warning about slf4j-relad4j Key: HADOOP-18192 URL: https://issues.apache.org/jira/browse/HADOOP-18192 Project: Hadoop Common

[ANNOUNCE] Apache Hadoop 3.2.3 release

2022-03-28 Thread Masatake Iwasaki
/3.2.3/CHANGELOG.3.2.3.html Best Regards, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[RESULT][VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-27 Thread Masatake Iwasaki
With 3 binding +1s and 1 non-binding +1, the vote passes. I'm going to publish the release and the announcement. Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-27 Thread Masatake Iwasaki
3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC1 on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests. https://issues.apache.org/jira/browse/BIGTOP-3606 Masatake Iwasaki On 2022/03/20 14:32, Masatake Iwasaki wrote: Hi all, Here's Hadoop 3.2.3 release candidate #1: The RC is available

[VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-19 Thread Masatake Iwasaki
/repositories/orgapachehadoop-1342 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. The vote will be open for (at least) 5 days. Thanks, Masatake Iwasaki

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-18 Thread Masatake Iwasaki
, Masatake Iwasaki On 2022/03/18 10:56, Masatake Iwasaki wrote: I found that INFO level log message is emitted on every CLI invocation. $ bin/hdfs dfs -mkdir /tmp 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-17 Thread Masatake Iwasaki
-default.xml by DFS-12920, There seems to be no quick fix though it is noisy. HDFS-14630 is the fix for this. I will backport this to branch-3.2.3 if I need to cut RC1. On 2022/03/18 0:54, Masatake Iwasaki wrote: +1 from myself. * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-17 Thread Masatake Iwasaki
che/hadoop/pull/4073>, few tests are flaky but they are passing locally. On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki mailto:iwasak...@oss.nttdata.co.jp>> wrote: Hi all, Here's Hadoop 3.2.3 release candidate #0: The RC is available at: https://home.apache.org/~iwas

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-17 Thread Masatake Iwasaki
Ejbyfeldt wrote: Hi, There is no aarch64 artifact in the release candidate. Is this something that is intended? Best, Emil Ejbyfeldt On 14/03/2022 08:14, Masatake Iwasaki wrote: Hi all, Here's Hadoop 3.2.3 release candidate #0: The RC is available at: https://home.apache.org/~iwasakims

[VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-14 Thread Masatake Iwasaki
/repositories/orgapachehadoop-1339 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr

Re: Hadoop-3.2.3 Release Update

2022-03-13 Thread Masatake Iwasaki
in Proxy User documentation. (#2780) Signed-off-by: Akira Ajisaka (cherry picked from commit c8d327a4f1a7f15d6be35051414199d1d3fdc5ef) I will create RC0 shortly after updating index.md.vm (which is the top page of site documentation). Thanks, Masatake Iwasaki On 2022/03/11 22:17

Re: Hadoop-3.2.3 Release Update

2022-03-10 Thread Masatake Iwasaki
if we need. https://issues.apache.org/jira/browse/HADOOP-18088 Thanks, Masatake Iwasaki On 2022/03/10 12:23, Xiaoqiao He wrote: Thanks Masatake for reaching out. Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers

[jira] [Resolved] (HADOOP-18158) Fix failure of create-release script due to releasedocmaker changes in branch-2.10

2022-03-09 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18158. --- Fix Version/s: 2.10.2 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Created] (HADOOP-18158) Fix failure of create-release script due to releasedocmaker changes in branch-2.10

2022-03-08 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-18158: - Summary: Fix failure of create-release script due to releasedocmaker changes in branch-2.10 Key: HADOOP-18158 URL: https://issues.apache.org/jira/browse/HADOOP-18158

[DISCUSS] Hadoop 2.10.2 release

2022-03-04 Thread Masatake Iwasaki
/browse/HADOOP-18088 Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: Hadoop-3.2.3 Release Update

2022-03-03 Thread Masatake Iwasaki
Hi Brahma, I would like to use 3.2.3 for next minor release of Bigtop. https://issues.apache.org/jira/browse/BIGTOP-3605 Let me know if there is any blocker I can help. Thanks, Masatake Iwasaki On 2022/01/12 4:41, Brahma Reddy Battula wrote: Sorry, I was looking for some CVE’s fixes.will

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC5

2022-02-25 Thread Masatake Iwasaki
enabled 3-nodes docker cluster and ran sample MR jobs. * launched pseudo distributed cluster and `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code. * built site documentation by `mvn site site:stage` and skimmed the contents. Thanks, Masatake Iwasaki On 2022/02

Re: hadoop 3.3.1 build fails

2022-02-25 Thread Masatake Iwasaki
[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.11.2:yarn (yarn install) on looks like the issue fixed by YARN-10561. https://issues.apache.org/jira/browse/YARN-10561 On 2022/02/26 5:20, Bulldog20630405 wrote: when running: # both of these build command fail (i

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-28 Thread Masatake Iwasaki
should be discussed separately. Thanks and regards, Akira On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki mailto:iwasak...@oss.nttdata.co.jp>> wrote: Thanks for putting this up, Chao Sun. I got following error on building the RC3 source tarball. It is reproducible even in the contai

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-27 Thread Masatake Iwasaki
this command. [INFO] error Found incompatible module [INFO] ---- ``` Masatake Iwasaki On 2022/01/27 4:16, Chao Sun wrote: Hi all, I've put together Hadoop 3.3.2 RC3 below: The RC is available at: http://people.apache.org/~sun

[jira] [Resolved] (HADOOP-17982) OpensslCipher initialization error should log a WARN message

2021-12-10 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17982. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-12-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-18024. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HADOOP-17965) Fix documentation build failure using JDK 7 on branch-2.10

2021-10-19 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17965. --- Fix Version/s: 2.10.2 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Resolved] (HADOOP-17964) Increase Java heap size for running Maven in Dockerfile of branch-2.10

2021-10-12 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17964. --- Fix Version/s: 2.10.2 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Created] (HADOOP-17965) Fix documentation build failure using create-release on branch-2.10

2021-10-12 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17965: - Summary: Fix documentation build failure using create-release on branch-2.10 Key: HADOOP-17965 URL: https://issues.apache.org/jira/browse/HADOOP-17965

[jira] [Created] (HADOOP-17964) Increase Java heap size for running Maven in Dockerfile of branch-2.10

2021-10-12 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17964: - Summary: Increase Java heap size for running Maven in Dockerfile of branch-2.10 Key: HADOOP-17964 URL: https://issues.apache.org/jira/browse/HADOOP-17964

Re: [DISCUSS] Add remote port information to HDFS audit log

2021-10-11 Thread Masatake Iwasaki
it is optional feature disabled by default. https://github.com/apache/hadoop/blob/rel/release-3.3.1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java#L8480-L8498 If we need to add fields, making it optional might be an option. Masatake Iwasaki

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

2021-09-28 Thread Masatake Iwasaki
s Java 10 or upper. https://issues.apache.org/jira/browse/HADOOP-15304 Thanks, Akira On Tue, Sep 28, 2021 at 10:27 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: In particular, there has been an outstanding problem with doclet support for filtering javadocs by annotation since JD

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

2021-09-27 Thread Masatake Iwasaki
In particular, there has been an outstanding problem with doclet support for filtering javadocs by annotation since JDK9 came out. Could you give me a pointer to relevant Yetus JIRA or ML thread? On 2021/09/28 1:17, Sean Busbey wrote: I think consolidating on a common library and tooling for

[jira] [Created] (HADOOP-17916) Fix compilation error of ITUseHadoopCodecs with -DskipShade

2021-09-16 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17916: - Summary: Fix compilation error of ITUseHadoopCodecs with -DskipShade Key: HADOOP-17916 URL: https://issues.apache.org/jira/browse/HADOOP-17916 Project

[jira] [Created] (HADOOP-17908) Add missing RELEASENOTES and CHANGES to upstream

2021-09-13 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17908: - Summary: Add missing RELEASENOTES and CHANGES to upstream Key: HADOOP-17908 URL: https://issues.apache.org/jira/browse/HADOOP-17908 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17870) HTTP Filesystem to qualify paths in open()/getFileStatus()

2021-09-07 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17870. --- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > H

[jira] [Created] (HADOOP-17899) Fix compilation error of TestHttpFileSystem

2021-09-07 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17899: - Summary: Fix compilation error of TestHttpFileSystem Key: HADOOP-17899 URL: https://issues.apache.org/jira/browse/HADOOP-17899 Project: Hadoop Common

[jira] [Created] (HADOOP-17897) Allow nested blocks in switch case in checkstyle settings

2021-09-07 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17897: - Summary: Allow nested blocks in switch case in checkstyle settings Key: HADOOP-17897 URL: https://issues.apache.org/jira/browse/HADOOP-17897 Project: Hadoop

[jira] [Resolved] (HADOOP-17849) Exclude spotbugs-annotations from transitive dependencies on branch-3.2

2021-08-16 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17849. --- Fix Version/s: 3.2.3 Hadoop Flags: Reviewed Resolution: Fixed

Re: Hadoop-3.2.3 Release Update

2021-08-16 Thread Masatake Iwasaki
the exclusion even for zooekeeper-3.4.13. I filed HADOOP-17849 for this. On 2021/08/16 12:02, Masatake Iwasaki wrote: Thanks for bringing this up, Akira. Let me explain some background. - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs

[jira] [Created] (HADOOP-17849) Exclude spotbugs-annotations from transitive dependencies on branch-3.2

2021-08-16 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17849: - Summary: Exclude spotbugs-annotations from transitive dependencies on branch-3.2 Key: HADOOP-17849 URL: https://issues.apache.org/jira/browse/HADOOP-17849

Re: Hadoop-3.2.3 Release Update

2021-08-15 Thread Masatake Iwasaki
Thanks for bringing this up, Akira. Let me explain some background. - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff This is for building hadoop-3.2.2 against zookeeper-3.4.14. we do not see the issue usually since

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

2021-07-14 Thread Masatake Iwasaki
- recently, JIRA became some sort of a "number generator" with insufficient description/details as the developers and the reviewers spending more time discussing in the PR. JIRA issues contain useful information in the fields. We are leveraging them in development and release process. *

[jira] [Resolved] (HADOOP-17782) mvn install -DskipTests failed about hadoop@3.3.1

2021-06-30 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17782. --- Resolution: Cannot Reproduce > mvn install -DskipTests failed about hadoop@3.

[jira] [Reopened] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem

2021-06-29 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reopened HADOOP-17719: --- > DistCp with snapshot diff should support file systems other t

[jira] [Resolved] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem

2021-06-26 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17719. --- Resolution: Duplicate > DistCp with snapshot diff should support file syst

[jira] [Created] (HADOOP-17775) Remove JavaScript package from Docker environment

2021-06-23 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17775: - Summary: Remove JavaScript package from Docker environment Key: HADOOP-17775 URL: https://issues.apache.org/jira/browse/HADOOP-17775 Project: Hadoop Common

  1   2   3   >