[jira] [Resolved] (HADOOP-11758) Add options to filter out too much granular tracing spans

2021-06-17 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-11758. --- Resolution: Won't Fix > Add options to filter out too much granular tracing sp

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-10 Thread Masatake Iwasaki
and ran TestMiniLlapCliDrivera (fixed by HDFS-15790). Masatake Iwasaki On 2021/06/01 19:29, Wei-Chiu Chuang wrote: Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-07 Thread Masatake Iwasaki
issue. [1] https://issues.apache.org/jira/browse/HDFS-15098?focusedCommentId=17112893=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17112893 Masatake Iwasaki On 2021/06/07 18:04, Masatake Iwasaki wrote: I found that the top page of site documentation (index.html

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-07 Thread Masatake Iwasaki
/) if you need to cut RC4. Thanks, Masatake Iwasaki On 2021/06/01 19:29, Wei-Chiu Chuang wrote: Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3: * Revert "MAPREDUCE

Re: [VOTE] Hadoop 3.1.x EOL

2021-06-03 Thread Masatake Iwasaki
+1 Masatake Iwasaki On 2021/06/03 15:14, Akira Ajisaka wrote: Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an official announcement

Re: Do I need a +1 to merge a backport PR?

2021-06-01 Thread Masatake Iwasaki
I think we usually merge backport without explicit +1 if the conflict is trivial, same as done on JIRA-only workflow (on which we attached patch like HADOOP-xxx-branch-3.3.001.patch for precommit check then commit it without explicit +1). If committers want review since the change is not

[jira] [Created] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem

2021-05-20 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17719: - Summary: DistCp with snapshot diff should support file systems other than DistributedFileSystem Key: HADOOP-17719 URL: https://issues.apache.org/jira/browse/HADOOP

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-19 Thread Masatake Iwasaki
for using Emacs and side-by-side diff even on 13-inch MBP. Masatake Iwasaki On 2021/05/20 11:00, Akira Ajisaka wrote: I'm +1 to allow <= 100 chars. FYI: There were some discussions long before: - https://lists.apache.org/thread.html/7813c2f8a49b1d1e7655dad180f2d915a280b2f4d562cfe981e1d

[jira] [Created] (HADOOP-17609) Make SM4 support optional for OpenSSL native code

2021-03-28 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17609: - Summary: Make SM4 support optional for OpenSSL native code Key: HADOOP-17609 URL: https://issues.apache.org/jira/browse/HADOOP-17609 Project: Hadoop Common

[jira] [Created] (HADOOP-17573) Fix compilation error of OBSFileSystem in trunk

2021-03-10 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17573: - Summary: Fix compilation error of OBSFileSystem in trunk Key: HADOOP-17573 URL: https://issues.apache.org/jira/browse/HADOOP-17573 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17552) Change ipc.client.rpc-timeout.ms from 0 to 120000 by default to avoid potential hang

2021-03-06 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17552. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Cha

[jira] [Created] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-22 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17538: - Summary: Add kms-default.xml and httpfs-default.xml to site index Key: HADOOP-17538 URL: https://issues.apache.org/jira/browse/HADOOP-17538 Project: Hadoop

[jira] [Created] (HADOOP-17515) Remove outdated contents from tracing documentation

2021-02-03 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17515: - Summary: Remove outdated contents from tracing documentation Key: HADOOP-17515 URL: https://issues.apache.org/jira/browse/HADOOP-17515 Project: Hadoop

[jira] [Created] (HADOOP-17514) Remove trace subcommand from hadoop CLI

2021-02-03 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17514: - Summary: Remove trace subcommand from hadoop CLI Key: HADOOP-17514 URL: https://issues.apache.org/jira/browse/HADOOP-17514 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17508) Simplify dependency installation instructions

2021-02-01 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17508. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HADOOP-17507) Add build instructions for installing GCC 9 and CMake 3.19

2021-01-31 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17507. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Resolved] (HADOOP-17506) Fix typo in BUILDING.txt

2021-01-31 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17506. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed >

Re: [DISCUSS] HADOOP-17464. Create hadoop-compression module

2021-01-18 Thread Masatake Iwasaki
-compression a compile scope dependency of hadoop-common first then removing it on the next major release (4.0.0)? Thanks, Masatake Iwasaki On 2021/01/12 22:58, Steve Loughran wrote: Following on from discussions in a previous PR, Liang-Chi Hsieh has created a PR to add a new hadoop-compression module

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

2021-01-07 Thread Masatake Iwasaki
by `mvn site` and skimmed the contents including top-level index.html. * checked hadoop-3.2.2-site.tar.gz * verified signature and checksums. * skimmed the contents including top-level index.html. Thanks, Masatake Iwasaki On 2021/01/03 23:39, Xiaoqiao He wrote: Hi folks, The release

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-16 Thread Masatake Iwasaki
w features and big improvements. The instruction might be a bit unclear and tend to be missed by release manager. # I missed this on 2.10.1 release.. Thanks, Masatake Iwasaki On 2020/12/10 2:00, Xiaoqiao He wrote: Hi folks, The release candidate (RC4) for Hadoop-3.2.2 is available now. There are

[jira] [Resolved] (HADOOP-17425) Bump up snappy-java to 1.1.8.2

2020-12-09 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17425. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > B

[jira] [Created] (HADOOP-17369) Bump up snappy-java to 1.1.8.1

2020-11-09 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17369: - Summary: Bump up snappy-java to 1.1.8.1 Key: HADOOP-17369 URL: https://issues.apache.org/jira/browse/HADOOP-17369 Project: Hadoop Common Issue

Re: Precommit job fails to write comments in the GitHub pull requests

2020-09-29 Thread Masatake Iwasaki
Yetus when JDK11 Javadoc issue is fixed. Regards, Masatake Iwasaki On 2020/09/29 2:55, Akira Ajisaka wrote: Apache Hadoop developers, After YETUS-994, the jenkins job updates the commit status instead of writing a comment to the pull request. It requires an OAuth token with write access

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-28 Thread Masatake Iwasaki
+1 Thanks, Masatake Iwasaki On 2020/09/25 14:59, Elek, Marton wrote: Hi all, Thank you for all the feedback and requests, As we discussed in the previous thread(s) [1], Ozone is proposed to be a separated Apache Top Level Project (TLP) The proposal with all the details, motivation

Re: [ANNOUNCE] Apache Hadoop 2.10.1 release

2020-09-22 Thread Masatake Iwasaki
and CHANGES have valid contents. Thanks, Masatake Iwasaki On 2020/09/23 5:17, Masatake Iwasaki wrote: Hi all, I am happy to announce that the Apache Hadoop 2.10.1 has been released. Apache Hadoop 2.10.1 is the second release in the Apache Hadoop 2.10 line. You can download the release from

[ANNOUNCE] Apache Hadoop 2.10.1 release

2020-09-22 Thread Masatake Iwasaki
, and changelog, are on the 2.10.1 announcement page [2]. [1] https://hadoop.apache.org/releases.html [2] https://hadoop.apache.org/release/2.10.1.html Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-21 Thread Masatake Iwasaki
The vote passed with 6 binging +1's and 2 non-binding +1's. Thanks all for pushing this. I'm going to publish the release. binding +1's: - Eric Payne - Sunil Govindan - Wei-Chiu Chuang - Vinayakumar B - Mingliang Liu - Masatake Iwasaki non-binding +1's: - Jim Brennan - Eric Badger Bests

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-20 Thread Masatake Iwasaki
will appreciate additional votes. Thanks, Masatake Iwasaki [1] https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E [2] https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109af510592ea2

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-18 Thread Masatake Iwasaki
Iwasaki On 2020/09/15 2:59, Masatake Iwasaki wrote: Hi folks, This is the first release candidate for the second release of Apache Hadoop 2.10. It contains 218 fixes/improvements since 2.10.0 [1]. The RC0 artifacts are at: http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/ RC tag is release

[jira] [Created] (HADOOP-17270) Fix testCompressorDecompressorWithExeedBufferLimit to cover the intended scenario

2020-09-17 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17270: - Summary: Fix testCompressorDecompressorWithExeedBufferLimit to cover the intended scenario Key: HADOOP-17270 URL: https://issues.apache.org/jira/browse/HADOOP-17270

[VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-14 Thread Masatake Iwasaki
. [1] https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1 Thanks, Masatake Iwasaki - To unsubscribe, e-mail

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-12 Thread Masatake Iwasaki
Only HADOOP-16918 has release-blocker label. HADOOP-16918 was resolved. I'm going to cut branch-2.10.1 and RC0 tomorrow. Thanks, Masatake Iwasaki On 2020/09/08 23:14, Masatake Iwasaki wrote: https://issues.apache.org/jira/issues/?jql=project%20in%20(HADOOP%2C%20HDFS%2C%20YARN%2C%20MAPREDUCE

[jira] [Resolved] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-12 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-16918. --- Fix Version/s: 2.10.1 Resolution: Fixed Thanks. I'm closing

[jira] [Created] (HADOOP-17254) Upgrade hbase to 1.2.6.1 on branch-2

2020-09-09 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17254: - Summary: Upgrade hbase to 1.2.6.1 on branch-2 Key: HADOOP-17254 URL: https://issues.apache.org/jira/browse/HADOOP-17254 Project: Hadoop Common

[jira] [Created] (HADOOP-17253) Upgrade zookeeper to 3.4.14 on branch-2.10

2020-09-09 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17253: - Summary: Upgrade zookeeper to 3.4.14 on branch-2.10 Key: HADOOP-17253 URL: https://issues.apache.org/jira/browse/HADOOP-17253 Project: Hadoop Common

Re: [DISCUSS] Ozone TLP proposal

2020-09-08 Thread Masatake Iwasaki
this approach. (for Submarine at that time) Since I'm willing to contribute, I added my name to the wiki. Thanks, Masatake Iwasaki On 2020/09/07 21:04, Elek, Marton wrote: Hi, The Hadoop community earlier decided to move out Ozone sub-project to a separated Apache Top Level Project (TLP

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-08 Thread Masatake Iwasaki
or applicable patches. Only HADOOP-16918 has release-blocker label. I filed HADOOP-17249 and HADOOP-17251 as sub tasks. If those can not be merged in a few days, I would like to put them off until next release and cut a release candidate. Thanks, Masatake Iwasaki On 2020/09/03 21:35, Masatake

[jira] [Created] (HADOOP-17251) Upgrade netty-all to 4.1.50.Final on branch-2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17251: - Summary: Upgrade netty-all to 4.1.50.Final on branch-2.10 Key: HADOOP-17251 URL: https://issues.apache.org/jira/browse/HADOOP-17251 Project: Hadoop Common

[jira] [Created] (HADOOP-17249) Upgrade jackson-databind to 2.10 on branch-2.10

2020-09-06 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17249: - Summary: Upgrade jackson-databind to 2.10 on branch-2.10 Key: HADOOP-17249 URL: https://issues.apache.org/jira/browse/HADOOP-17249 Project: Hadoop Common

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-03 Thread Masatake Iwasaki
/jira/browse/YARN-10177 https://issues.apache.org/jira/browse/HDFS-15422 https://issues.apache.org/jira/browse/HDFS-14277 https://issues.apache.org/jira/browse/HDFS-12548 I'm going to look into them and update 'Target Version/s:' of non-critical issues. Masatake Iwasaki On 2020/09/03 4:25, Jim

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-03 Thread Masatake Iwasaki
/jira/browse/YARN-10177 https://issues.apache.org/jira/browse/HDFS-15422 https://issues.apache.org/jira/browse/HDFS-14277 https://issues.apache.org/jira/browse/HDFS-12548 I'm going to look into them and update 'Target Version/s:' of non-critical issues. Masatake Iwasaki On 2020/09/03 4:25, Jim

[jira] [Created] (HADOOP-17240) Fix wrong command line for setting up CentOS 8

2020-09-01 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17240: - Summary: Fix wrong command line for setting up CentOS 8 Key: HADOOP-17240 URL: https://issues.apache.org/jira/browse/HADOOP-17240 Project: Hadoop Common

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-01 Thread Masatake Iwasaki
Thanks, Mingliang Liu. I volunteer to take the RM role then. I will appreciate advice from who have the experience. Masatake Iwasaki On 2020/09/01 10:38, Mingliang Liu wrote: I can see how I can help, but I can not take the RM role this time. Thanks, On Mon, Aug 31, 2020 at 12:15 PM Wei

Re: [VOTE] End of Life Hadoop 2.9

2020-09-01 Thread Masatake Iwasaki
+1 Thanks, Masatake Iwasaki On 2020/09/01 4:09, Wei-Chiu Chuang wrote: Dear fellow Hadoop developers, Given the overwhelming feedback from the discussion thread https://s.apache.org/hadoop2.9eold, I'd like to start an official vote thread for the community to vote and start the 2.9 EOL

[jira] [Resolved] (HADOOP-17095) findbugs warnings building branch-2.10

2020-08-30 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17095. --- Resolution: Fixed I'm closing this since all child issues are fixed. > findb

Re: [DISCUSS] fate of branch-2.9

2020-08-27 Thread Masatake Iwasaki
+1 on EOL of branch-2.9. Since there are a lot of backported fixes in branch-2.10 after 2.10.0 (2019 Oct 29), it would be nice to release 2.10.1. I'm happy to help release work. Masatake Iwasaki On 2020/08/28 3:25, Mingliang Liu wrote: are there any Hadoop branch-2 releases planned, ever

[jira] [Created] (HADOOP-17206) Add python2 to required package on CentOS 8 for building documentation

2020-08-14 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17206: - Summary: Add python2 to required package on CentOS 8 for building documentation Key: HADOOP-17206 URL: https://issues.apache.org/jira/browse/HADOOP-17206

[jira] [Created] (HADOOP-17202) Fix findbugs warnings in hadoop-tools on branch-2.10

2020-08-10 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17202: - Summary: Fix findbugs warnings in hadoop-tools on branch-2.10 Key: HADOOP-17202 URL: https://issues.apache.org/jira/browse/HADOOP-17202 Project: Hadoop

[jira] [Resolved] (HADOOP-17171) Please fix CVEs by removing reference to htrace-core4

2020-08-06 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17171. --- Resolution: Duplicate Closing this as duplicate of HADOOP-15566. > Please

[jira] [Created] (HADOOP-17153) Add boost installation steps to build instruction on CentOS 8

2020-07-24 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17153: - Summary: Add boost installation steps to build instruction on CentOS 8 Key: HADOOP-17153 URL: https://issues.apache.org/jira/browse/HADOOP-17153 Project

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)

2020-07-23 Thread Masatake Iwasaki
-distributed cluster with Kerberos and SSL enabled, ran basic EZ operation, ran example MR jobs. * followed the reproduction step reported in  HDFS-15313 to see if the fix works. Thanks, Masatake Iwasaki On 2020/07/21 21:50, Gabor Bota wrote: Hi folks, I have put together a release candidate (RC4

[jira] [Created] (HADOOP-17138) Fix spotbugs warnings surfaced after upgrade to 4.0.6

2020-07-17 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17138: - Summary: Fix spotbugs warnings surfaced after upgrade to 4.0.6 Key: HADOOP-17138 URL: https://issues.apache.org/jira/browse/HADOOP-17138 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC3)

2020-07-14 Thread Masatake Iwasaki
nks, Masatake Iwasaki On 2020/07/13 19:36, Gabor Bota wrote: Hi folks, I have put together a release candidate (RC3) for Hadoop 3.1.4. * The RC includes in addition to the previous ones: * fix of YARN-10347. Fix double locking in CapacityScheduler#reinitialize in branch-3.1 (ht

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

2020-07-13 Thread Masatake Iwasaki
cluster on CentOS 7 and CentOS 8. * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed on CentOS 7. Masatake Iwasaki On 2020/07/07 7:27, Brahma Reddy Battula wrote: Hi folks, This is the first release candidate for the first release of Apache Hadoop 3.3.0 line. It contains

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-09 Thread Masatake Iwasaki
Hi Gabor Bota, I committed the fix of YARN-10347 to branch-3.1. I think this should be blocker for 3.1.4. Could you cherry-pick it to branch-3.1.4 and cut a new RC? Thanks, Masatake Iwasaki On 2020/07/08 23:31, Masatake Iwasaki wrote: Thanks Steve and Prabhu for the information. The cause

[jira] [Created] (HADOOP-17120) Fix failure of docker image creation due to pip2 install error on branch-3.1

2020-07-08 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17120: - Summary: Fix failure of docker image creation due to pip2 install error on branch-3.1 Key: HADOOP-17120 URL: https://issues.apache.org/jira/browse/HADOOP-17120

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-08 Thread Masatake Iwasaki
Thanks Steve and Prabhu for the information. The cause turned out to be locking in CapacityScheduler#reinitialize. I think the method is called after transitioning to active stat if RM-HA is enabled. I filed YARN-10347 and created PR. Masatake Iwasaki On 2020/07/08 16:33, Prabhu Joseph

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-05 Thread Masatake Iwasaki
(Server.java:943)     at java.security.AccessController.doPrivileged(Native Method)     at javax.security.auth.Subject.doAs(Subject.java:422)     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2943)

[jira] [Created] (HADOOP-17073) Fix NoClassDefFoundError on 'mapred minicluster'

2020-06-16 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17073: - Summary: Fix NoClassDefFoundError on 'mapred minicluster' Key: HADOOP-17073 URL: https://issues.apache.org/jira/browse/HADOOP-17073 Project: Hadoop Common

[jira] [Created] (HADOOP-17040) Fix intermittent failure of ITestBlockingThreadPoolExecutorService

2020-05-13 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17040: - Summary: Fix intermittent failure of ITestBlockingThreadPoolExecutorService Key: HADOOP-17040 URL: https://issues.apache.org/jira/browse/HADOOP-17040

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

2020-05-12 Thread Masatake Iwasaki
Also I am trying to run the abfs tests but all tests are getting skipped even if I think I have right auth-keys.xml. I will debug this and update. hadoop-azure expects azure-auth-keys.xml instead of auth-keys.xml? I think it should be consistent with other FS modules.. Masatake Iwasaki

[jira] [Resolved] (HADOOP-17034) Fix failure of TestSnappyCompressorDecompressor on CentOS 8

2020-05-11 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17034. --- Assignee: (was: Masatake Iwasaki) Resolution: Duplicate closing

[jira] [Created] (HADOOP-17034) Fix failure of TestSnappyCompressorDecompressor on CentOS 8

2020-05-08 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17034: - Summary: Fix failure of TestSnappyCompressorDecompressor on CentOS 8 Key: HADOOP-17034 URL: https://issues.apache.org/jira/browse/HADOOP-17034 Project

[jira] [Created] (HADOOP-17025) Fix invalid metastore configuration in S3GuardTool tests

2020-05-01 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17025: - Summary: Fix invalid metastore configuration in S3GuardTool tests Key: HADOOP-17025 URL: https://issues.apache.org/jira/browse/HADOOP-17025 Project: Hadoop

[jira] [Created] (HADOOP-16972) Ignore AuthenticationFilterInitializer for KMSWebServer

2020-04-12 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-16972: - Summary: Ignore AuthenticationFilterInitializer for KMSWebServer Key: HADOOP-16972 URL: https://issues.apache.org/jira/browse/HADOOP-16972 Project: Hadoop

Re: [DISCUSS] Shade guava into hadoop-thirdparty

2020-04-06 Thread Masatake Iwasaki
+1 Masatake Iwasaki On 2020/04/06 10:32, Akira Ajisaka wrote: +1 Thanks, Akira On Sun, Apr 5, 2020 at 4:13 AM Wei-Chiu Chuang wrote: Hi Hadoop devs, I spent a good part of the past 7 months working with a dozen of colleagues to update the guava version in Cloudera's software

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

2020-03-16 Thread Masatake Iwasaki
y tarballs (it's the easiest way for new users to get started with > Hadoop), so it's fair to consider them when evaluating a release. Just providing build machine to RM would not be enough if PMC need to ensure that binary artifiacts meet these requirements. Thanks, Masatake Iwasaki On 3/17/20

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

2020-03-16 Thread Masatake Iwasaki
y tarballs (it's the easiest way for new users to get started with > Hadoop), so it's fair to consider them when evaluating a release. Just providing build machine to RM would not be enough if PMC need to ensure that binary artifiacts meet these requirements. Thanks, Masatake Iwasaki On 3/17/20

[jira] [Resolved] (HADOOP-16905) Update jackson-databind to 2.10.3 to relieve us from the endless CVE patches

2020-03-06 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-16905. --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed > Upd

Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

2020-03-04 Thread Masatake Iwasaki
Congratulations! Masatake Iwasaki On 2020/03/04 5:11, Wei-Chiu Chuang wrote: In bcc: general@ It's my pleasure to announce that Stephen O'Donnell has been elected as committer on the Apache Hadoop project recognizing his continued contributions to the project. Please join me

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

2020-02-27 Thread Masatake Iwasaki
Thanks for putting up this, Vinayakumar B. +1(non-binding). * verified the signature and checksum of the source tarball. * installed the RC0 to my local repository by `mvn install`. * Built Hadoop trunk by `mvn clean install -DskipTests -Dhadoop-thirdparty-protobuf.version=1.0.0`. Masatake

Re: [DISCUSS] Removal of old hamlet package in 3.3+ or 3.4+

2020-01-15 Thread Masatake Iwasaki
the patch of YARN-9279. Agreed. -Akira On Sun, Feb 10, 2019 at 2:00 AM Masatake Iwasaki wrote: Thanks for working on this, Akira. > The only usage I can see is Apache Slider, however, the > functionalities of Apache Slider have been merged into YARN. Do we have mailing lists other tha

Re: [DISCUSS] drop mapreduce-pipes

2020-01-08 Thread Masatake Iwasaki
I'm +1 too. Marking it as deprecated on 3.3.0 and dropping on 3.4.0 would be an option. -Pnative build failure on RHEL/CentOS 8 is on-going issue of hadoop-pipes. I will appreciate review of HADOOP-16739 if it takes some time to drop pipes. Thanks, Masatake Iwasaki On 2020/01/07 1:26

[jira] [Created] (HADOOP-16744) Fix building instruction to enable zstd

2019-12-03 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-16744: - Summary: Fix building instruction to enable zstd Key: HADOOP-16744 URL: https://issues.apache.org/jira/browse/HADOOP-16744 Project: Hadoop Common

[jira] [Created] (HADOOP-16739) Fix native build failure of hadoop-pipes on CentOS 8

2019-12-01 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-16739: - Summary: Fix native build failure of hadoop-pipes on CentOS 8 Key: HADOOP-16739 URL: https://issues.apache.org/jira/browse/HADOOP-16739 Project: Hadoop

[jira] [Created] (HADOOP-16702) Move documentation of hadoop-toc to under src directory.

2019-11-11 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-16702: - Summary: Move documentation of hadoop-toc to under src directory. Key: HADOOP-16702 URL: https://issues.apache.org/jira/browse/HADOOP-16702 Project: Hadoop

[jira] [Created] (HADOOP-16701) Fix broken links in site index

2019-11-11 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-16701: - Summary: Fix broken links in site index Key: HADOOP-16701 URL: https://issues.apache.org/jira/browse/HADOOP-16701 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16689) Fix test failure of ITestAzureBlobFileSystemCLI.testMkdirRootNonExistentContainer

2019-11-06 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-16689: - Summary: Fix test failure of ITestAzureBlobFileSystemCLI.testMkdirRootNonExistentContainer Key: HADOOP-16689 URL: https://issues.apache.org/jira/browse/HADOOP-16689

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-28 Thread Masatake Iwasaki
files in encryption zone via httpfs. * checked that file names containing '%' or '+' or ';' can be handled by webhdfs. Masatake Iwasaki On 10/23/19 06:55, Jonathan Hung wrote: Hi folks, This is the second release candidate for the first release of Apache Hadoop 2.10 line. It contains 362

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-18 Thread Masatake Iwasaki
control of patch release. Thanks, Masatake Iwasaki On 9/11/19 16:26, Rohith Sharma K S wrote: Hi folks, I have put together a release candidate (RC0) for Apache Hadoop 3.2.1. The RC is available at: http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/ The RC tag in git is release-3.2.1-RC0

Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-09-18 Thread Masatake Iwasaki
3.1 since the noisy info is not a blocker issue to me. Does that make sense? BR, Zhankun On Wed, 18 Sep 2019 at 14:23, Masatake Iwasaki wrote: Thanks for putting this up, Zhankun Tang. While I was testing the RC0 wich CLI, noisy INFO message was emitted on every data transfer operation.:: 2019

Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-09-18 Thread Masatake Iwasaki
The issue was fixed by HDFS-14759. I think the fix should be backported if we cut RC1. Since the fix version of HDFS-14759 is 3.3.0, CR0 of 3.2.1 could have same issue. Regards, Masatake Iwasaki On 9/12/19 17:04, Zhankun Tang wrote: Hi folks, Thanks to everyone's help on this release. Special

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

2019-08-21 Thread Masatake Iwasaki
+1 Thanks, Masatake Iwasaki On 8/21/19 12:02, Wangda Tan wrote: Hi all, This is a vote thread to mark any versions smaller than 2.7 (inclusive), and 3.0 EOL. This is based on discussions of [1] This discussion runs for 7 days and will conclude on Aug 28 Wed. Please feel free to share your

Re: Unassigned Hadoop jiras with patch available

2019-08-15 Thread Masatake Iwasaki
owToCommit This could be stated as a part of "Review" process.  Also adding link to your JIRA filter to the wiki and encouraging housekeeping would be nice. # I don't have permission to edit the page.. Regards, Masatake Iwasaki On 8/2/19 06:41, Wei-Chiu Chuang wrote: I assigned all jiras

Re: [DISCUSS] Hadoop 2019 Release Planning

2019-08-15 Thread Masatake Iwasaki
Hi Wangda, Thanks for bringing this up. > I think it is the time to do maintenance releases of 3.1/3.2 and do a minor > release for 3.3.0. 3.3.0 seems to have some blocker issues.   project in ("Hadoop Common", "Hadoop HDFS", "Hadoop Map/Reduce", "Hadoop YARN") AND "Target Version/s" =

[jira] [Resolved] (HADOOP-16335) ERROR: namenode can only be executed by root while executing "hdfs namenode -format"

2019-08-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-16335. --- Resolution: Invalid I think this is coufiguration issue. If you define env var

Re: Branch-2 and Tomcat

2019-07-19 Thread Masatake Iwasaki
> Since 7.0.x is live for a while, upgrading to 7.0.94 first would be easier step. Upgrading Tomcat itself seems to be small fix than I thought. I attached the patch to HADOOP-16439 for discussion. On 7/19/19 17:23, Masatake Iwasaki wrote: Thinks for working on this,  Wei-Chiu Chuang. >

[jira] [Created] (HADOOP-16439) Upgrade bundled Tomcat in branch-2

2019-07-19 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HADOOP-16439: - Summary: Upgrade bundled Tomcat in branch-2 Key: HADOOP-16439 URL: https://issues.apache.org/jira/browse/HADOOP-16439 Project: Hadoop Common Issue

Re: Branch-2 and Tomcat

2019-07-19 Thread Masatake Iwasaki
sions of Tomcat are 7.0.x, 8.5.x and 9.0.x. # http://tomcat.10.x6.nabble.com/Please-help-EOL-TOMCAT-7-and-8-5-td5073688.html Tomcat 9.0.x seems not to be good candidate because it requires Java 8 or later. Since 7.0.x is live for a while, upgrading to 7.0.94 first would be easier step. Masatake Iw

Re: [VOTE] Force "squash and merge" option for PR merge on github UI

2019-07-18 Thread Masatake Iwasaki
+1 Thanks, Masatake Iwasaki On 7/17/19 15:07, Elek, Marton wrote: Hi, Github UI (ui!) helps to merge Pull Requests to the proposed branch. There are three different ways to do it [1]: 1. Keep all the different commits from the PR branch and create one additional merge commit ("Create a

[jira] [Created] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-08 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HADOOP-16418: - Summary: Fix checkstyle and findbugs warnings in hadoop-dynamometer Key: HADOOP-16418 URL: https://issues.apache.org/jira/browse/HADOOP-16418 Project

[jira] [Created] (HADOOP-16411) Fix javadoc warnings in hadoop-dynamometer-workload

2019-07-07 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HADOOP-16411: - Summary: Fix javadoc warnings in hadoop-dynamometer-workload Key: HADOOP-16411 URL: https://issues.apache.org/jira/browse/HADOOP-16411 Project: Hadoop

[jira] [Created] (HADOOP-16099) Fix handling of path with multiple trailing slash in SwiftNativeFileSystem

2019-02-07 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HADOOP-16099: - Summary: Fix handling of path with multiple trailing slash in SwiftNativeFileSystem Key: HADOOP-16099 URL: https://issues.apache.org/jira/browse/HADOOP-16099

[jira] [Created] (HADOOP-16098) Fix javadoc warnings in hadoop-aws

2019-02-07 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HADOOP-16098: - Summary: Fix javadoc warnings in hadoop-aws Key: HADOOP-16098 URL: https://issues.apache.org/jira/browse/HADOOP-16098 Project: Hadoop Common Issue

Re: [VOTE] Moving branch-2 precommit/nightly test builds to java 8

2019-02-05 Thread Masatake Iwasaki
+1 Masatake Iwasaki On 2/4/19 18:13, Jonathan Hung wrote: Hello, Starting a vote based on the discuss thread [1] for moving branch-2 precommit/nightly test builds to openjdk8. After this change, the test phase for precommit builds [2] and branch-2 nightly build [3] will run on openjdk8

Re: [VOTE] Release Apache Hadoop 3.1.2 - RC1

2019-02-04 Thread Masatake Iwasaki
documentation and skimmed the contents. I felt HADOOP-14445 and HADOOP-15996 are relatively big change for a point release, while those looks working or disabled by default. Masatake Iwasaki On 1/28/19 22:19, Sunil G wrote: Hi Folks, On behalf of Wangda, we have an RC1 for Apache Hadoop 3.1.2

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-07-31 Thread Masatake Iwasaki
and mapreduce, * built site documentation and skimmed the contents. The binary tarball seems to be inconsistent with previous 2.7.x releases as Brahma pointed out. Bests, Masatake Iwasaki On 7/30/17 08:29, Konstantin Shvachko wrote: Hi everybody, Here is the next release of Apache Hadoop 2.7 line

[jira] [Resolved] (HADOOP-14358) NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: Native Library /usr/java/jdk/jre/lib/amd64/libhadoop.so already loaded in a

2017-04-27 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-14358. --- Resolution: Invalid Please use [user mailing list|https://hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Masatake Iwasaki
Thanks for putting this up, Junping. +1(non-binding) * verified signature and mds. * built from source on centos 7 and openjdk 8 with native profile. * built docs and skimmed the contents. * deployed 3 nodes ha cluster and run some sample jobs with caller context enabled. Masatake Iwasaki

[jira] [Resolved] (HADOOP-13839) Fix outdated tracing documentation

2017-01-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-13839. --- Resolution: Fixed Fix Version/s: 2.7.4 Target Version/s: 2.7.4 I

<    1   2   3   >