Re: Do I need a +1 to merge a backport PR?

2021-06-01 Thread Masatake Iwasaki
I think we usually merge backport without explicit +1 if the conflict is trivial, same as done on JIRA-only workflow (on which we attached patch like HADOOP-xxx-branch-3.3.001.patch for precommit check then commit it without explicit +1). If committers want review since the change is not trivial

Re: [VOTE] Hadoop 3.1.x EOL

2021-06-03 Thread Masatake Iwasaki
+1 Masatake Iwasaki On 2021/06/03 15:14, Akira Ajisaka wrote: Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an official announcement th

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-07 Thread Masatake Iwasaki
/) if you need to cut RC4. Thanks, Masatake Iwasaki On 2021/06/01 19:29, Wei-Chiu Chuang wrote: Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3: * Revert "MAPREDUCE

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-07 Thread Masatake Iwasaki
issue. [1] https://issues.apache.org/jira/browse/HDFS-15098?focusedCommentId=17112893&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17112893 Masatake Iwasaki On 2021/06/07 18:04, Masatake Iwasaki wrote: I found that the top page of site documentation (index.h

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-10 Thread Masatake Iwasaki
and ran TestMiniLlapCliDrivera (fixed by HDFS-15790). Masatake Iwasaki On 2021/06/01 19:29, Wei-Chiu Chuang wrote: Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

2021-07-14 Thread Masatake Iwasaki
- recently, JIRA became some sort of a "number generator" with insufficient description/details as the developers and the reviewers spending more time discussing in the PR. JIRA issues contain useful information in the fields. We are leveraging them in development and release process. * http

Re: Hadoop-3.2.3 Release Update

2021-08-15 Thread Masatake Iwasaki
Thanks for bringing this up, Akira. Let me explain some background. - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff This is for building hadoop-3.2.2 against zookeeper-3.4.14. we do not see the issue usually since bran

Re: Hadoop-3.2.3 Release Update

2021-08-16 Thread Masatake Iwasaki
exclusion even for zooekeeper-3.4.13. I filed HADOOP-17849 for this. On 2021/08/16 12:02, Masatake Iwasaki wrote: Thanks for bringing this up, Akira. Let me explain some background. - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

2021-09-27 Thread Masatake Iwasaki
In particular, there has been an outstanding problem with doclet support for filtering javadocs by annotation since JDK9 came out. Could you give me a pointer to relevant Yetus JIRA or ML thread? On 2021/09/28 1:17, Sean Busbey wrote: I think consolidating on a common library and tooling for

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

2021-09-28 Thread Masatake Iwasaki
nt is Java 10 or upper. https://issues.apache.org/jira/browse/HADOOP-15304 Thanks, Akira On Tue, Sep 28, 2021 at 10:27 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: In particular, there has been an outstanding problem with doclet support for filtering javadocs by annotation since

Re: [DISCUSS] Add remote port information to HDFS audit log

2021-10-11 Thread Masatake Iwasaki
is optional feature disabled by default. https://github.com/apache/hadoop/blob/rel/release-3.3.1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java#L8480-L8498 If we need to add fields, making it optional might be an option. Masatake Iwasaki On

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-27 Thread Masatake Iwasaki
tion about this command. [INFO] error Found incompatible module [INFO] -------- ``` Masatake Iwasaki On 2022/01/27 4:16, Chao Sun wrote: Hi all, I've put together Hadoop 3.3.2 RC3 below: The RC is available at: http://people.

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-28 Thread Masatake Iwasaki
e, it should be discussed separately. Thanks and regards, Akira On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki mailto:iwasak...@oss.nttdata.co.jp>> wrote: Thanks for putting this up, Chao Sun. I got following error on building the RC3 source tarball. It is reproducible even in

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC5

2022-02-25 Thread Masatake Iwasaki
enabled 3-nodes docker cluster and ran sample MR jobs. * launched pseudo distributed cluster and `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code. * built site documentation by `mvn site site:stage` and skimmed the contents. Thanks, Masatake Iwasaki On 2022/02

Re: Hadoop-3.2.3 Release Update

2022-03-03 Thread Masatake Iwasaki
Hi Brahma, I would like to use 3.2.3 for next minor release of Bigtop. https://issues.apache.org/jira/browse/BIGTOP-3605 Let me know if there is any blocker I can help. Thanks, Masatake Iwasaki On 2022/01/12 4:41, Brahma Reddy Battula wrote: Sorry, I was looking for some CVE’s fixes.will

[DISCUSS] Hadoop 2.10.2 release

2022-03-04 Thread Masatake Iwasaki
/browse/HADOOP-18088 Thanks, Masatake Iwasaki - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: Hadoop-3.2.3 Release Update

2022-03-10 Thread Masatake Iwasaki
on if we need. https://issues.apache.org/jira/browse/HADOOP-18088 Thanks, Masatake Iwasaki On 2022/03/10 12:23, Xiaoqiao He wrote: Thanks Masatake for reaching out. Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volun

Re: Hadoop-3.2.3 Release Update

2022-03-13 Thread Masatake Iwasaki
example in Proxy User documentation. (#2780) Signed-off-by: Akira Ajisaka (cherry picked from commit c8d327a4f1a7f15d6be35051414199d1d3fdc5ef) I will create RC0 shortly after updating index.md.vm (which is the top page of site documentation). Thanks, Masatake Iwasaki On 2022/0

[VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-14 Thread Masatake Iwasaki
ntent/repositories/orgapachehadoop-1339 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. Thanks, Masatake Iwasaki - To unsubscribe, e-mail: hdfs-dev-uns

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-17 Thread Masatake Iwasaki
Ejbyfeldt wrote: Hi, There is no aarch64 artifact in the release candidate. Is this something that is intended? Best, Emil Ejbyfeldt On 14/03/2022 08:14, Masatake Iwasaki wrote: Hi all, Here's Hadoop 3.2.3 release candidate #0: The RC is available at: https://home.apache.org/~iwas

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-17 Thread Masatake Iwasaki
che/hadoop/pull/4073>, few tests are flaky but they are passing locally. On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki mailto:iwasak...@oss.nttdata.co.jp>> wrote: Hi all, Here's Hadoop 3.2.3 release candidate #0: The RC is available at: https://home.apache.org/

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-17 Thread Masatake Iwasaki
-default.xml by DFS-12920, There seems to be no quick fix though it is noisy. HDFS-14630 is the fix for this. I will backport this to branch-3.2.3 if I need to cut RC1. On 2022/03/18 0:54, Masatake Iwasaki wrote: +1 from myself. * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

2022-03-18 Thread Masatake Iwasaki
hanks, Masatake Iwasaki On 2022/03/18 10:56, Masatake Iwasaki wrote: I found that INFO level log message is emitted on every CLI invocation. $ bin/hdfs dfs -mkdir /tmp 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS

[VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-19 Thread Masatake Iwasaki
ntent/repositories/orgapachehadoop-1342 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. The vote will be open for (at least) 5 days. Thanks, Masatake Iwasaki ---

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-27 Thread Masatake Iwasaki
3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC1 on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests. https://issues.apache.org/jira/browse/BIGTOP-3606 Masatake Iwasaki On 2022/03/20 14:32, Masatake Iwasaki wrote: Hi all, Here's Hadoop 3.2.3 release candidate #1: The RC is availab

[RESULT][VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-27 Thread Masatake Iwasaki
With 3 binding +1s and 1 non-binding +1, the vote passes. I'm going to publish the release and the announcement. Thanks, Masatake Iwasaki - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional com

[ANNOUNCE] Apache Hadoop 3.2.3 release

2022-03-28 Thread Masatake Iwasaki
/3.2.3/CHANGELOG.3.2.3.html Best Regards, Masatake Iwasaki - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.3.3

2022-05-06 Thread Masatake Iwasaki
enabled 3-nodes docker cluster and ran sample MR jobs. * launched pseudo distributed cluster and `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code. * built site documentation by `mvn site site:stage -Preleasedocs` and skimmed the contents. Thanks, Masatake

Re: [VOTE] Release Apache Hadoop 3.3.3

2022-05-09 Thread Masatake Iwasaki
Wiki still instructs to run `mvn deploy` with `-DskipShade`. 2 sets of artifact are deployed after creating RC based on the instruction. The latest one contains empty shaded jars. hadoop-client-api and hadoop-client-runtime of already released 3.2.3 looks having same issue... Masatake Iwasaki On

Re: [VOTE] Release Apache Hadoop 3.3.3

2022-05-09 Thread Masatake Iwasaki
Step #10 in "Creating the release candidate (X.Y.Z-RC)" section of the Wiki still instructs to run `mvn deploy` with `-DskipShade`. https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease#HowToRelease-Creatingthereleasecandidate(X.Y.Z-RC%3CN%3E) On 2022/05/09 23:18, Masata

[DISCUSS] Hadoop 3.2.4 release

2022-05-09 Thread Masatake Iwasaki
0%3D%20Resolved%20AND%20fixVersion%20%3D%203.2.4 Thanks, Masatake Iwasaki - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

2022-05-15 Thread Masatake Iwasaki
enabled 3-nodes docker cluster and ran sample MR jobs. * built site documentation by `mvn site site:stage -Preleasedocs` and skimmed the contents. * built Spark 3.2.1 against 3.3.3 RC1 using the staging repository (after `rm -rf ~/.m2/repository/org/apache/hadoop`). Thanks, Masatake Iwasaki On 2022

Re: [DISCUSS] Hadoop 2.10.2 release

2022-05-16 Thread Masatake Iwasaki
Thanks, Akira and Xiaoqiao for positive feedback. I'm going to cut branch-2.10.2 shortly. Masatake Iwasaki On 2022/05/12 11:38, Xiaoqiao He wrote: Thanks Masatake and Akira for bringing this release up. +1 for 2.10.2 release. Sorry for the late response. Regards, - He Xiaoqiao On Mon

Re: [DISCUSS] Hadoop 2.10.2 release

2022-05-16 Thread Masatake Iwasaki
Hi committers, I created branch-2.10.2 and bumped the version of branch-2.10 to 2.10.3-SNAPSHOT. Please set the "Fix Version/s:" of JIRA to 2.10.3 if you commit the fix to branch-2.10 without cherry-picking to branch-2.10.2. Regards, Masatake Iwasaki On 2022/05/16 23:16, Masata

[VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-24 Thread Masatake Iwasaki
ntent/repositories/orgapachehadoop-1350 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. The vote will be open for (at least) 5 days. Thanks, Masatake Iwasaki ---

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-27 Thread Masatake Iwasaki
2.3.6 and Spark 2.4.5 against Hadoop 2.10.2 RC0 on CentOS 7 (x86_64) by using Bigtop branch-1.5 and ran smoke-tests. https://github.com/apache/bigtop/pull/906 Masatake Iwasaki On 2022/05/25 11:40, Masatake Iwasaki wrote: Hi all, Here's Hadoop 2.10.2 release candidate #0: The RC is avai

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-29 Thread Masatake Iwasaki
Thanks for the help, Ayush. I committed HADOOP-16663/HADOOP-16664 and cherry-picked HADOOP-16985 to branch-2.10 (and branch-3.2). If I need to cut RC1, I will try cherry-picking them to branch-2.10.2 Masatake Iwasaki On 2022/05/28 5:23, Ayush Saxena wrote: The checksum stuff was addressed

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-30 Thread Masatake Iwasaki
The vote passed with the following result. Binding PMC members: +1 Chris Nauroth +1 Ayush Saxena +1 Steve Loughran +1 Masatake Iwasaki Non binding votes: +1 Viraj Jasani +1 Ashutosh Gupta I'm going to publish the artifacts, site docs, maven artifacts, then announce. Thank you to al

[ANNOUNCE] Apache Hadoop 2.10.2 release

2022-05-31 Thread Masatake Iwasaki
se building and testing reviewing the final artifacts. Masatake Iwasaki - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [DISCUSS] Hadoop 3.2.4 release

2022-07-10 Thread Masatake Iwasaki
I'm going to cut branch-3.2.4 today. If we need more time for 3.3.4 to fix the issue around HADOOP-18033, 3.2.4 can be released first. Thanks, Masatake Iwasaki On 2022/05/10 0:02, Masatake Iwasaki wrote: Hi team, Shaded client artifacts (hadoop-client-api and hadoop-client-runtime) of H

Re: [DISCUSS] Hadoop 3.2.4 release

2022-07-10 Thread Masatake Iwasaki
Hi committers, I created branch-3.2.4. Please set the value of "Fix versions/s" field to 3.2.5 on JIRA issue if the fix is committed to branch-3.2 and not cherry-picked to branch-3.2.4. Thanks, Masatake Iwasaki On 2022/07/11 13:21, Akira Ajisaka wrote: Thank you Masatake for proc

[VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-12 Thread Masatake Iwasaki
ntent/repositories/orgapachehadoop-1354 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. The vote will be open for (at least) 5 days. Thanks, Masatake Iwasaki ---

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-14 Thread Masatake Iwasaki
/content/repositories/orgapachehadoop-1354 true true Thanks, Masatake Iwasaki On 2022/07/13 1:14, Masatake Iwasaki wrote: Hi all, Here's Hadoop 3.2.4 release candidate #0: The RC is available at:   https://home.apache.org/~iwasakims/h

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-19 Thread Masatake Iwasaki
hese new test failures. I don't know if it's a quirk to my environment, though I'm using the start-build-env.sh Docker container, so any build dependencies should be consistent. I'd be comfortable moving ahead if others are seeing these tests pass. Chris Nauroth On Thu, Jul 14,

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-19 Thread Masatake Iwasaki
ails. YARN 8867 did not modified other code under hadoop-yarn-services. If it is the case, TestServiceAM can be tagged as flaky in branch-3.2. On 2022/07/20 14:21, Masatake Iwasaki wrote: Thanks for testing the RC0, Chris. The following are new test failures for me on 3.2.4: * TestAMRMProxy

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-20 Thread Masatake Iwasaki
Hi developers, I'm still waiting for your vote. I'm considering the intermittent test failures mentioned by Chris are not blocker. Please file a JIRA and let me know if you find a blocker issue. I will appreciate your help for the release process. Regards, Masatake Iwasaki On 202

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-21 Thread Masatake Iwasaki
The vote passed with the following result. Binding PMC members: +1 Chris Nauroth +1 Ayush Saxena +1 Masatake Iwasaki Non binding votes: +1 Ashutosh Gupta I'm going to publish the artifacts, site docs, maven artifacts, then announce. Thank you to all who helped to push this releas

[ANNOUNCE] Apache Hadoop 3.2.4 release

2022-07-21 Thread Masatake Iwasaki
ing and testing reviewing the final artifacts. Masatake Iwasaki - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.3.4

2022-07-31 Thread Masatake Iwasaki
://github.com/apache/bigtop/pull/964 * HBsae needed to fix relocation rules due to dependency on okhttp added by HDFS-16453. * built Spark 3.3.0 using the staging repository. Thanks, Masatake Iwasaki On 2022/07/30 3:47, Steve Loughran wrote: I have put together a release candidate (RC1) for Hadoop

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-02 Thread Masatake Iwasaki
3.1.3 against 3.3.5 failed due to dependency change. # while building HBase 2.4.13 and Hive 3.1.3 against Hadoop 3.3.4 worked. + skimmed the site contents. - Javadocs are not contained (under r3.3.5/api). # The issue can be reproduced even if I built site docs from the source. Masatake

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-02 Thread Masatake Iwasaki
-> [Help 1] ... On 2023/01/02 22:02, Masatake Iwasaki wrote: Thanks for your great effort for the new release, Steve and Mukund. +1 while it would be nice if we can address missed Javadocs. + verified the signature and checksum. + built from source tarball on Rocky Linux 8 and OpenJDK

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-19 Thread Masatake Iwasaki
skimmed the contents. + Javadocs are contained. Thanks, Masatake Iwasaki On 2023/03/16 4:47, Steve Loughran wrote: Apache Hadoop 3.3.5 Mukund and I have put together a release candidate (RC3) for Hadoop 3.3.5. What we would like is for anyone who can to verify the tarballs, especially anyone who

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-18 Thread Masatake Iwasaki
code is the cause. Thanks, Masatake Iwasaki On 2023/06/18 4:57, Wei-Chiu Chuang wrote: I was going to do another RC in case something comes up. But it looks like the only thing that needs to be fixed is the Changelog. 1. HADOOP-18596 <https://issues.apache.org/jira/browse/HADOOP-18

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-19 Thread Masatake Iwasaki
se guys operate :-) [1] https://github.com/apache/hadoop/pull/3241/files#diff-b273546d6f060e617553eaa49da69039d2c655a77d42022779c2281d0f6cd08eR135 [2] https://github.com/apache/hadoop/pull/3241#issuecomment-889185103 On Mon, 19 Jun 2023 at 06:44, Masatake Iwasaki wrote: I got compilation error again

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-20 Thread Masatake Iwasaki
and read files via httpfs. + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky Linux 8 (x86_64). + built HBase and Hive against Hadoop 3.3.6. + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive. + skimmed the contents of site documentation. Thanks, Masatake Iwasaki

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-28 Thread Masatake Iwasaki
files in encryption zone via httpfs. * checked that file names containing '%' or '+' or ';' can be handled by webhdfs. Masatake Iwasaki On 10/23/19 06:55, Jonathan Hung wrote: Hi folks, This is the second release candidate for the first release of Apache Had

Re: [DISCUSS] Removal of old hamlet package in 3.3+ or 3.4+

2020-01-15 Thread Masatake Iwasaki
g reason to hurry as I see the patch of YARN-9279. Agreed. -Akira On Sun, Feb 10, 2019 at 2:00 AM Masatake Iwasaki wrote: Thanks for working on this, Akira. > The only usage I can see is Apache Slider, however, the > functionalities of Apache Slider have been merged into YARN. Do w

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

2020-02-27 Thread Masatake Iwasaki
Thanks for putting up this, Vinayakumar B. +1(non-binding). * verified the signature and checksum of the source tarball. * installed the RC0 to my local repository by `mvn install`. * Built Hadoop trunk by `mvn clean install -DskipTests -Dhadoop-thirdparty-protobuf.version=1.0.0`. Masatake

Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

2020-03-04 Thread Masatake Iwasaki
Congratulations! Masatake Iwasaki On 2020/03/04 5:11, Wei-Chiu Chuang wrote: In bcc: general@ It's my pleasure to announce that Stephen O'Donnell has been elected as committer on the Apache Hadoop project recognizing his continued contributions to the project. Please

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

2020-03-16 Thread Masatake Iwasaki
do want to publish > binary tarballs (it's the easiest way for new users to get started with > Hadoop), so it's fair to consider them when evaluating a release. Just providing build machine to RM would not be enough if PMC need to ensure that binary artifiacts meet these requirements.

Re: [DISCUSS] Shade guava into hadoop-thirdparty

2020-04-06 Thread Masatake Iwasaki
+1 Masatake Iwasaki On 2020/04/06 10:32, Akira Ajisaka wrote: +1 Thanks, Akira On Sun, Apr 5, 2020 at 4:13 AM Wei-Chiu Chuang wrote: Hi Hadoop devs, I spent a good part of the past 7 months working with a dozen of colleagues to update the guava version in Cloudera's software

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-05 Thread Masatake Iwasaki
.java:943)     at java.security.AccessController.doPrivileged(Native Method)     at javax.security.auth.Subject.doAs(Subject.java:422)     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2943)

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-08 Thread Masatake Iwasaki
Thanks Steve and Prabhu for the information. The cause turned out to be locking in CapacityScheduler#reinitialize. I think the method is called after transitioning to active stat if RM-HA is enabled. I filed YARN-10347 and created PR. Masatake Iwasaki On 2020/07/08 16:33, Prabhu Joseph

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-08 Thread Masatake Iwasaki
Hi Gabor Bota, I committed the fix of YARN-10347 to branch-3.1. I think this should be blocker for 3.1.4. Could you cherry-pick it to branch-3.1.4 and cut a new RC? Thanks, Masatake Iwasaki On 2020/07/08 23:31, Masatake Iwasaki wrote: Thanks Steve and Prabhu for the information. The cause

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

2020-07-13 Thread Masatake Iwasaki
cluster on CentOS 7 and CentOS 8. * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed on CentOS 7. Masatake Iwasaki On 2020/07/07 7:27, Brahma Reddy Battula wrote: Hi folks, This is the first release candidate for the first release of Apache Hadoop 3.3.0 line. It contains

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC3)

2020-07-14 Thread Masatake Iwasaki
Thanks, Masatake Iwasaki On 2020/07/13 19:36, Gabor Bota wrote: Hi folks, I have put together a release candidate (RC3) for Hadoop 3.1.4. * The RC includes in addition to the previous ones: * fix of YARN-10347. Fix double locking in CapacityScheduler#reinitialize in branch-3.

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)

2020-07-23 Thread Masatake Iwasaki
-distributed cluster with Kerberos and SSL enabled, ran basic EZ operation, ran example MR jobs. * followed the reproduction step reported in  HDFS-15313 to see if the fix works. Thanks, Masatake Iwasaki On 2020/07/21 21:50, Gabor Bota wrote: Hi folks, I have put together a release candidate (RC4

Re: [DISCUSS] fate of branch-2.9

2020-08-27 Thread Masatake Iwasaki
+1 on EOL of branch-2.9. Since there are a lot of backported fixes in branch-2.10 after 2.10.0 (2019 Oct 29), it would be nice to release 2.10.1. I'm happy to help release work. Masatake Iwasaki On 2020/08/28 3:25, Mingliang Liu wrote: are there any Hadoop branch-2 releases planned,

Re: [VOTE] End of Life Hadoop 2.9

2020-08-31 Thread Masatake Iwasaki
+1 Thanks, Masatake Iwasaki On 2020/09/01 4:09, Wei-Chiu Chuang wrote: Dear fellow Hadoop developers, Given the overwhelming feedback from the discussion thread https://s.apache.org/hadoop2.9eold, I'd like to start an official vote thread for the community to vote and start the 2.

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-01 Thread Masatake Iwasaki
Thanks, Mingliang Liu. I volunteer to take the RM role then. I will appreciate advice from who have the experience. Masatake Iwasaki On 2020/09/01 10:38, Mingliang Liu wrote: I can see how I can help, but I can not take the RM role this time. Thanks, On Mon, Aug 31, 2020 at 12:15 PM Wei

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-03 Thread Masatake Iwasaki
/jira/browse/YARN-10177 https://issues.apache.org/jira/browse/HDFS-15422 https://issues.apache.org/jira/browse/HDFS-14277 https://issues.apache.org/jira/browse/HDFS-12548 I'm going to look into them and update 'Target Version/s:' of non-critical issues. Masatake Iwasaki On 2020/

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-08 Thread Masatake Iwasaki
or applicable patches. Only HADOOP-16918 has release-blocker label. I filed HADOOP-17249 and HADOOP-17251 as sub tasks. If those can not be merged in a few days, I would like to put them off until next release and cut a release candidate. Thanks, Masatake Iwasaki On 2020/09/03 21:35, Masatake

Re: [DISCUSS] Ozone TLP proposal

2020-09-08 Thread Masatake Iwasaki
this approach. (for Submarine at that time) Since I'm willing to contribute, I added my name to the wiki. Thanks, Masatake Iwasaki On 2020/09/07 21:04, Elek, Marton wrote: Hi, The Hadoop community earlier decided to move out Ozone sub-project to a separated Apache Top Level Project

Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-12 Thread Masatake Iwasaki
Only HADOOP-16918 has release-blocker label. HADOOP-16918 was resolved. I'm going to cut branch-2.10.1 and RC0 tomorrow. Thanks, Masatake Iwasaki On 2020/09/08 23:14, Masatake Iwasaki wrote: https://issues.apache.org/jira/issues/?jql=project%20in%20(HADOOP%2C%20HDFS%2C%20YARN%2C%20MAPR

[VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-14 Thread Masatake Iwasaki
. [1] https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1 Thanks, Masatake Iwasaki - To unsubscribe, e-mail

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-18 Thread Masatake Iwasaki
Iwasaki On 2020/09/15 2:59, Masatake Iwasaki wrote: Hi folks, This is the first release candidate for the second release of Apache Hadoop 2.10. It contains 218 fixes/improvements since 2.10.0 [1]. The RC0 artifacts are at: http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/ RC tag is release

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-19 Thread Masatake Iwasaki
am PDT. I will appreciate additional votes. Thanks, Masatake Iwasaki [1] https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E [2] https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109a

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-21 Thread Masatake Iwasaki
The vote passed with 6 binging +1's and 2 non-binding +1's. Thanks all for pushing this. I'm going to publish the release. binding +1's: - Eric Payne - Sunil Govindan - Wei-Chiu Chuang - Vinayakumar B - Mingliang Liu - Masatake Iwasaki non-binding +1's: - Jim Bre

[ANNOUNCE] Apache Hadoop 2.10.1 release

2020-09-22 Thread Masatake Iwasaki
changelog, are on the 2.10.1 announcement page [2]. [1] https://hadoop.apache.org/releases.html [2] https://hadoop.apache.org/release/2.10.1.html Thanks, Masatake Iwasaki - To unsubscribe, e-mail: hdfs-dev-unsubscr

Re: [ANNOUNCE] Apache Hadoop 2.10.1 release

2020-09-22 Thread Masatake Iwasaki
and CHANGES have valid contents. Thanks, Masatake Iwasaki On 2020/09/23 5:17, Masatake Iwasaki wrote: Hi all, I am happy to announce that the Apache Hadoop 2.10.1 has been released. Apache Hadoop 2.10.1 is the second release in the Apache Hadoop 2.10 line. You can download the release from the

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-28 Thread Masatake Iwasaki
+1 Thanks, Masatake Iwasaki On 2020/09/25 14:59, Elek, Marton wrote: Hi all, Thank you for all the feedback and requests, As we discussed in the previous thread(s) [1], Ozone is proposed to be a separated Apache Top Level Project (TLP) The proposal with all the details, motivation and

Re: Precommit job fails to write comments in the GitHub pull requests

2020-09-29 Thread Masatake Iwasaki
Yetus when JDK11 Javadoc issue is fixed. Regards, Masatake Iwasaki On 2020/09/29 2:55, Akira Ajisaka wrote: Apache Hadoop developers, After YETUS-994, the jenkins job updates the commit status instead of writing a comment to the pull request. It requires an OAuth token with write access to

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-16 Thread Masatake Iwasaki
w features and big improvements. The instruction might be a bit unclear and tend to be missed by release manager. # I missed this on 2.10.1 release.. Thanks, Masatake Iwasaki On 2020/12/10 2:00, Xiaoqiao He wrote: Hi folks, The release candidate (RC4) for Hadoop-3.2.2 is available now. There are

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

2021-01-07 Thread Masatake Iwasaki
by `mvn site` and skimmed the contents including top-level index.html. * checked hadoop-3.2.2-site.tar.gz * verified signature and checksums. * skimmed the contents including top-level index.html. Thanks, Masatake Iwasaki On 2021/01/03 23:39, Xiaoqiao He wrote: Hi folks, The release

Re: [DISCUSS] HADOOP-17464. Create hadoop-compression module

2021-01-18 Thread Masatake Iwasaki
adoop-compression a compile scope dependency of hadoop-common first then removing it on the next major release (4.0.0)? Thanks, Masatake Iwasaki On 2021/01/12 22:58, Steve Loughran wrote: Following on from discussions in a previous PR, Liang-Chi Hsieh has created a PR to add a new hadoop-compression m

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-19 Thread Masatake Iwasaki
cters for using Emacs and side-by-side diff even on 13-inch MBP. Masatake Iwasaki On 2021/05/20 11:00, Akira Ajisaka wrote: I'm +1 to allow <= 100 chars. FYI: There were some discussions long before: - https://lists.apache.org/thread.html/7813c2f8a49b1d1e7655dad180f2d915a280b2f4d56

Re: [DISCUSS] About the details of JDK-8 support

2015-10-06 Thread Masatake Iwasaki
2. I’d like to discuss which version we > will target this change. Can we do this in branch-2? At lease, the newest grizzly, jersey and asm seems to support java 7 too and HADOOP-11993 may work in branch-2. Masatake Iwasaki On 10/6/15 09:35, Tsuyoshi Ozawa wrote: > Hi commiters and use

Re: [VOTE] Release Apache Hadoop 2.6.2

2015-10-27 Thread Masatake Iwasaki
+1(non-binding) - verified checksums and signature of source and binary tarball - built from source tarball on CentOS 6.4 and OpenJDK 7 - built site documentation - launched 4-nodes cluster and ran example jobs Thanks, Masatake Iwasaki On 10/23/15 06:14, Sangjin Lee wrote: Hi all, I have

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Masatake Iwasaki
+1(non-binding) - verified mds and signature of source and binary tarball - started 3 node cluster and ran example jobs such as wordcount and terasort - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7 - built site documentation and skimmed the contents Thanks, Masatake Iwasaki

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Masatake Iwasaki
test of hive, pig Thanks, Masatake Iwasaki On 1/15/16 13:57, Vinod Kumar Vavilapalli wrote: Hi all, I've created an updated release candidate RC2 for Apache Hadoop 2.7.2. As discussed before, this is the next maintenance release to follow up 2.7.1. The RC is available for validati

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

2016-05-12 Thread Masatake Iwasaki
+1 Masatake On 5/12/16 13:11, Gangumalla, Uma wrote: +1 Regards, Uma On 5/10/16, 2:24 PM, "Andrew Wang" wrote: +1 On Tue, May 10, 2016 at 12:36 PM, Ravi Prakash wrote: +1. Thanks for driving this Akira On Tue, May 10, 2016 at 10:25 AM, Tsuyoshi Ozawa wrote: Before cutting 3.0.0-alp

Re: [VOTE] Merge feature branch HADOOP-12930

2016-05-14 Thread Masatake Iwasaki
hadoop_subcommand_${HADOOP_SUBCMD} ${HADOOP_SUBCMD_ARGS[$*]}" "hadoop_subcommand_${HADOOP_SUBCMD}" "${HADOOP_SUBCMD_ARGS[@]}" else hadoopcmd_case "${HADOOP_SUBCMD}" "${HADOOP_SUBCMD_ARGS[@]}" Thanks, Masatake Iwasaki On 5/15/16 02:33, Allen Wi

Re: [VOTE] Merge feature branch HADOOP-12930

2016-05-15 Thread Masatake Iwasaki
pred streaming' successfully - created etc/hadoop/shellprofile.d/test.sh and added subcommands described in UnixShellGuide.md - tested overriding built-in subcommands Masatake Iwasaki On 5/16/16 00:30, Allen Wittenauer wrote: On May 15, 2016, at 7:27 AM, Allen Wittenauer wrote: On May 14, 2

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Masatake Iwasaki
+1 (non-binding) + verified signature and mds of source and binary tarball + built from source tarball + deployed binary tarball to 3 nodes cluster and run some hadoop-mapreduce-examples jobs Thanks, Masatake Iwasaki On 4/11/15 08:44, Vinod Kumar Vavilapalli wrote: Hi all, I've crea

Re: [VOTE] Release Apache Hadoop 2.7.1 RC0

2015-07-02 Thread Masatake Iwasaki
+1 (non-binding) + verified mds of source and binary tarball + built from source tarball + deployed binary tarball to 4 nodes cluster and run some hadoop-mapreduce-examples jobs Thanks, Masatake Iwasaki On 6/29/15 17:45, Vinod Kumar Vavilapalli wrote: Hi all, I've created a re

Re: [VOTE] Release Apache Hadoop 2.6.1 RC1

2015-09-22 Thread Masatake Iwasaki
+1(non-binding) - verified mds and signature of source and binary tarball - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7 - built site documentation - started pseudo distributed cluster and ran example jobs Masatake Iwasaki On 9/17/15 11:10, Vinod Kumar Vavilapalli wrote

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Masatake Iwasaki
on docker and ran smoke-tests of hdfs, yarn and mapreduce Masatake Iwasaki On 7/23/16 11:15, Vinod Kumar Vavilapalli wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.3. As discussed before, this is the next maintenance release to follow up 2.7.2. The RC is avai

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

2016-10-07 Thread Masatake Iwasaki
+1(non-binding) * verified signature and md5. * built with -Pnative on CentOS6 and OpenJDK7. * built documentation and skimmed the contents. * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce on 3-node cluster. Thanks, Masatake Iwasaki On 10/3/16 09:12, Sangjin Lee wrote

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Masatake Iwasaki
Thanks for putting this up, Junping. +1(non-binding) * verified signature and mds. * built from source on centos 7 and openjdk 8 with native profile. * built docs and skimmed the contents. * deployed 3 nodes ha cluster and run some sample jobs with caller context enabled. Masatake Iwasaki

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-07-31 Thread Masatake Iwasaki
n and mapreduce, * built site documentation and skimmed the contents. The binary tarball seems to be inconsistent with previous 2.7.x releases as Brahma pointed out. Bests, Masatake Iwasaki On 7/30/17 08:29, Konstantin Shvachko wrote: Hi everybody, Here is the next release of Apache Hadoop 2.7 line

  1   2   >