Maintaining documentations

)? I will appreciate your advices. Regards, Masatake Iwasaki

Re: Maintaining documentations

for documentation fixes, so thanks for bringing these to our attention. I will do what I can do to improve this. Such as helping review process. Regards, Masatake Iwasaki (2014/01/22 3:22), Arpit Agarwal wrote: I will review HADOOP-10086https://issues.apache.org/jira/browse/HADOOP-10086this week

Re: Maintaining documentation

Hi JIRA and Wiki admins, I would like permission to assign JIRA issues to myself and edit Hadoop Wiki pages. I have already fixed some on HADOOP-10086 and I think there is further work. My username is iwasakims on JIRA and MasatakeIwasaki on Hadoop Wiki. Regards, Masatake Iwasaki (2014/01

Re: Maintaining documentation

I've added your username to the wiki I appreciate it Steve! (2014/01/30 17:44), Steve Loughran wrote: On 30 January 2014 01:10, Masatake Iwasaki iwasak...@oss.nttdata.co.jpwrote: Hi JIRA and Wiki admins, I would like permission to assign JIRA issues to myself and edit Hadoop Wiki pages. I

Re: Maintaining documentation

for me is using a private browsing window. Todd posited that the error is due to stale cookies after a JIRA upgrade, and this fixes it. On Thu, Jan 30, 2014 at 8:43 AM, Masatake Iwasaki iwasak...@oss.nttdata.co.jp wrote: I've added your username to the wiki I appreciate it Steve! (2014/01/30 17

Re: [VOTE] Release Apache Hadoop 2.3.0

/hadoop dir, building from the source tar ball results in no inclusion of site docs in binary tarball. Regards, Masatake Iwasaki (2014/02/11 6:49), Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

+1 (non-binding) + verified MD5 for tarball and source tarball + built from source tarball + ran example jobs such as nutchindexing, wordcount, dfsioe, hivebench, kmeans, pagerank, bayes, sort, terasort with HiBench on the cluster with 3 slave nodes. (8/6/14, 13:59), Karthik Kambatla

Re: Some information required related to Hadoop documentation developement

or anything else needs to be taken care? I think it is sufficient. Masatake Iwasaki (11/6/14, 9:51), Naganarasimha G R (Naga) wrote: Hi All, I wanted to know the following related to Hadoop Documentation 1. what and how are these *.vm files(format) used in Hadoop [Hdfs and Yarn

Re: [VOTE] Release Apache Hadoop 2.6.0

. Masatake Iwasaki (11/19/14, 7:41), Tsuyoshi OZAWA wrote: +1 if once discussion about HDFS-6833 is done(non-binding). * Verified checksum. * Deployed cluster and ran some mr examples. * Checked RM restart while running jobs. I think you have to pass along -Pdist too… afaik that is how the Jenkins

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

+1 (non-binding) + verified signature and mds of source and binary tarball + built from source tarball + deployed binary tarball to 3 nodes cluster and run some hadoop-mapreduce-examples jobs Thanks, Masatake Iwasaki On 4/11/15 08:44, Vinod Kumar Vavilapalli wrote: Hi all, I've created

Re: [VOTE] Release Apache Hadoop 2.7.1 RC0

+1 (non-binding) + verified mds of source and binary tarball + built from source tarball + deployed binary tarball to 4 nodes cluster and run some hadoop-mapreduce-examples jobs Thanks, Masatake Iwasaki On 6/29/15 17:45, Vinod Kumar Vavilapalli wrote: Hi all, I've created a release

Re: [VOTE] Release Apache Hadoop 2.6.2

+1(non-binding) - verified checksums and signature of source and binary tarball - built from source tarball on CentOS 6.4 and OpenJDK 7 - built site documentation - launched 4-nodes cluster and ran example jobs Thanks, Masatake Iwasaki On 10/23/15 06:14, Sangjin Lee wrote: Hi all, I have

Re: [DISCUSS] About the details of JDK-8 support

2. I’d like to discuss which version we > will target this change. Can we do this in branch-2? At lease, the newest grizzly, jersey and asm seems to support java 7 too and HADOOP-11993 may work in branch-2. Masatake Iwasaki On 10/6/15 09:35, Tsuyoshi Ozawa wrote: > Hi commiters and use

Re: [VOTE] Release Apache Hadoop 2.6.1 RC1

+1(non-binding) - verified mds and signature of source and binary tarball - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7 - built site documentation - started pseudo distributed cluster and ran example jobs Masatake Iwasaki On 9/17/15 11:10, Vinod Kumar Vavilapalli wrote

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

test of hive, pig Thanks, Masatake Iwasaki On 1/15/16 13:57, Vinod Kumar Vavilapalli wrote: Hi all, I've created an updated release candidate RC2 for Apache Hadoop 2.7.2. As discussed before, this is the next maintenance release to follow up 2.7.1. The RC is available for validation

Re: Replacing Commons-httpclient and bumping httpclient version

Thanks for the suggestion, Wei-Chiu Chuang. I'm +1 too to clean up dependency on commons-httpclient. Your suggestion reminded me of HADOOP-12552 which seems to depends on HADOOP-12710 and HADOOP-12711 now. I will revisit it. Masatake Iwasaki On 2/17/16 03:59, Colin P. McCabe wrote: +1

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

+1 Masatake On 5/12/16 13:11, Gangumalla, Uma wrote: +1 Regards, Uma On 5/10/16, 2:24 PM, "Andrew Wang" wrote: +1 On Tue, May 10, 2016 at 12:36 PM, Ravi Prakash wrote: +1. Thanks for driving this Akira On Tue, May 10, 2016 at 10:25 AM,

Re: [VOTE] Merge feature branch HADOOP-12930

lly - created etc/hadoop/shellprofile.d/test.sh and added subcommands described in UnixShellGuide.md - tested overriding built-in subcommands Masatake Iwasaki On 5/16/16 00:30, Allen Wittenauer wrote: On May 15, 2016, at 7:27 AM, Allen Wittenauer <a...@apache.org> wrote: On May 14, 2016, a

Re: [VOTE] Merge feature branch HADOOP-12930

hadoop_subcommand_${HADOOP_SUBCMD} ${HADOOP_SUBCMD_ARGS[$*]}" "hadoop_subcommand_${HADOOP_SUBCMD}" "${HADOOP_SUBCMD_ARGS[@]}" else hadoopcmd_case "${HADOOP_SUBCMD}" "${HADOOP_SUBCMD_ARGS[@]}" Thanks, Masatake Iwasaki On 5/15/16 02:33, All

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

on docker and ran smoke-tests of hdfs, yarn and mapreduce Masatake Iwasaki On 7/23/16 11:15, Vinod Kumar Vavilapalli wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.3. As discussed before, this is the next maintenance release to follow up 2.7.2. The RC is available

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

+1(non-binding) * verified signature and md5. * built with -Pnative on CentOS6 and OpenJDK7. * built documentation and skimmed the contents. * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce on 3-node cluster. Thanks, Masatake Iwasaki On 10/3/16 09:12, Sangjin Lee wrote

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks for putting this up, Junping. +1(non-binding) * verified signature and mds. * built from source on centos 7 and openjdk 8 with native profile. * built docs and skimmed the contents. * deployed 3 nodes ha cluster and run some sample jobs with caller context enabled. Masatake Iwasaki

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

and mapreduce, * built site documentation and skimmed the contents. The binary tarball seems to be inconsistent with previous 2.7.x releases as Brahma pointed out. Bests, Masatake Iwasaki On 7/30/17 08:29, Konstantin Shvachko wrote: Hi everybody, Here is the next release of Apache Hadoop 2.7 line

Re: [VOTE] Release Apache Hadoop 3.1.2 - RC1

documentation and skimmed the contents. I felt HADOOP-14445 and HADOOP-15996 are relatively big change for a point release, while those looks working or disabled by default. Masatake Iwasaki On 1/28/19 22:19, Sunil G wrote: Hi Folks, On behalf of Wangda, we have an RC1 for Apache Hadoop 3.1.2

Re: [VOTE] Moving branch-2 precommit/nightly test builds to java 8

+1 Masatake Iwasaki On 2/4/19 18:13, Jonathan Hung wrote: Hello, Starting a vote based on the discuss thread [1] for moving branch-2 precommit/nightly test builds to openjdk8. After this change, the test phase for precommit builds [2] and branch-2 nightly build [3] will run on openjdk8

Re: [DISCUSS] Hadoop 2019 Release Planning

Hi Wangda, Thanks for bringing this up. > I think it is the time to do maintenance releases of 3.1/3.2 and do a minor > release for 3.3.0. 3.3.0 seems to have some blocker issues.   project in ("Hadoop Common", "Hadoop HDFS", "Hadoop Map/Reduce", "Hadoop YARN") AND "Target Version/s" =

Re: Unassigned Hadoop jiras with patch available

owToCommit This could be stated as a part of "Review" process.  Also adding link to your JIRA filter to the wiki and encouraging housekeeping would be nice. # I don't have permission to edit the page.. Regards, Masatake Iwasaki On 8/2/19 06:41, Wei-Chiu Chuang wrote: I assigned all jiras

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

+1 Thanks, Masatake Iwasaki On 8/21/19 12:02, Wangda Tan wrote: Hi all, This is a vote thread to mark any versions smaller than 2.7 (inclusive), and 3.0 EOL. This is based on discussions of [1] This discussion runs for 7 days and will conclude on Aug 28 Wed. Please feel free to share your

Re: [VOTE] Release Hadoop-3.1.3-RC0

3.1 since the noisy info is not a blocker issue to me. Does that make sense? BR, Zhankun On Wed, 18 Sep 2019 at 14:23, Masatake Iwasaki wrote: Thanks for putting this up, Zhankun Tang. While I was testing the RC0 wich CLI, noisy INFO message was emitted on every data transfer operation.:: 2019

Re: [VOTE] Release Hadoop-3.1.3-RC0

The issue was fixed by HDFS-14759. I think the fix should be backported if we cut RC1. Since the fix version of HDFS-14759 is 3.3.0, CR0 of 3.2.1 could have same issue. Regards, Masatake Iwasaki On 9/12/19 17:04, Zhankun Tang wrote: Hi folks, Thanks to everyone's help on this release. Special

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

control of patch release. Thanks, Masatake Iwasaki On 9/11/19 16:26, Rohith Sharma K S wrote: Hi folks, I have put together a release candidate (RC0) for Apache Hadoop 3.2.1. The RC is available at: http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/ The RC tag in git is release-3.2.1-RC0

Re: [VOTE] Force "squash and merge" option for PR merge on github UI

+1 Thanks, Masatake Iwasaki On 7/17/19 15:07, Elek, Marton wrote: Hi, Github UI (ui!) helps to merge Pull Requests to the proposed branch. There are three different ways to do it [1]: 1. Keep all the different commits from the PR branch and create one additional merge commit ("Create a

Re: Branch-2 and Tomcat

sions of Tomcat are 7.0.x, 8.5.x and 9.0.x. # http://tomcat.10.x6.nabble.com/Please-help-EOL-TOMCAT-7-and-8-5-td5073688.html Tomcat 9.0.x seems not to be good candidate because it requires Java 8 or later. Since 7.0.x is live for a while, upgrading to 7.0.94 first would be easier step. Masatake Iw

Re: Branch-2 and Tomcat

> Since 7.0.x is live for a while, upgrading to 7.0.94 first would be easier step. Upgrading Tomcat itself seems to be small fix than I thought. I attached the patch to HADOOP-16439 for discussion. On 7/19/19 17:23, Masatake Iwasaki wrote: Thinks for working on this,  Wei-Chiu Chuang. >

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

files in encryption zone via httpfs. * checked that file names containing '%' or '+' or ';' can be handled by webhdfs. Masatake Iwasaki On 10/23/19 06:55, Jonathan Hung wrote: Hi folks, This is the second release candidate for the first release of Apache Hadoop 2.10 line. It contains 362

Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

Congratulations! Masatake Iwasaki On 2020/03/04 5:11, Wei-Chiu Chuang wrote: In bcc: general@ It's my pleasure to announce that Stephen O'Donnell has been elected as committer on the Apache Hadoop project recognizing his continued contributions to the project. Please join me

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

Thanks for putting up this, Vinayakumar B. +1(non-binding). * verified the signature and checksum of the source tarball. * installed the RC0 to my local repository by `mvn install`. * Built Hadoop trunk by `mvn clean install -DskipTests -Dhadoop-thirdparty-protobuf.version=1.0.0`. Masatake

Re: [DISCUSS] drop mapreduce-pipes

I'm +1 too. Marking it as deprecated on 3.3.0 and dropping on 3.4.0 would be an option. -Pnative build failure on RHEL/CentOS 8 is on-going issue of hadoop-pipes. I will appreciate review of HADOOP-16739 if it takes some time to drop pipes. Thanks, Masatake Iwasaki On 2020/01/07 1:26

Re: [DISCUSS] Removal of old hamlet package in 3.3+ or 3.4+

the patch of YARN-9279. Agreed. -Akira On Sun, Feb 10, 2019 at 2:00 AM Masatake Iwasaki wrote: Thanks for working on this, Akira. > The only usage I can see is Apache Slider, however, the > functionalities of Apache Slider have been merged into YARN. Do we have mailing lists other tha

Re: [DISCUSS] Shade guava into hadoop-thirdparty

+1 Masatake Iwasaki On 2020/04/06 10:32, Akira Ajisaka wrote: +1 Thanks, Akira On Sun, Apr 5, 2020 at 4:13 AM Wei-Chiu Chuang wrote: Hi Hadoop devs, I spent a good part of the past 7 months working with a dozen of colleagues to update the guava version in Cloudera's software

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

Also I am trying to run the abfs tests but all tests are getting skipped even if I think I have right auth-keys.xml. I will debug this and update. hadoop-azure expects azure-auth-keys.xml instead of auth-keys.xml? I think it should be consistent with other FS modules.. Masatake Iwasaki

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

y tarballs (it's the easiest way for new users to get started with > Hadoop), so it's fair to consider them when evaluating a release. Just providing build machine to RM would not be enough if PMC need to ensure that binary artifiacts meet these requirements. Thanks, Masatake Iwasaki On 3/17/20

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

y tarballs (it's the easiest way for new users to get started with > Hadoop), so it's fair to consider them when evaluating a release. Just providing build machine to RM would not be enough if PMC need to ensure that binary artifiacts meet these requirements. Thanks, Masatake Iwasaki On 3/17/20

Re: [DISCUSS] Hadoop 2.10.1 release

/jira/browse/YARN-10177 https://issues.apache.org/jira/browse/HDFS-15422 https://issues.apache.org/jira/browse/HDFS-14277 https://issues.apache.org/jira/browse/HDFS-12548 I'm going to look into them and update 'Target Version/s:' of non-critical issues. Masatake Iwasaki On 2020/09/03 4:25, Jim

Re: [DISCUSS] Hadoop 2.10.1 release

/jira/browse/YARN-10177 https://issues.apache.org/jira/browse/HDFS-15422 https://issues.apache.org/jira/browse/HDFS-14277 https://issues.apache.org/jira/browse/HDFS-12548 I'm going to look into them and update 'Target Version/s:' of non-critical issues. Masatake Iwasaki On 2020/09/03 4:25, Jim

Re: [VOTE] End of Life Hadoop 2.9

+1 Thanks, Masatake Iwasaki On 2020/09/01 4:09, Wei-Chiu Chuang wrote: Dear fellow Hadoop developers, Given the overwhelming feedback from the discussion thread https://s.apache.org/hadoop2.9eold, I'd like to start an official vote thread for the community to vote and start the 2.9 EOL

Re: [DISCUSS] Hadoop 2.10.1 release

Thanks, Mingliang Liu. I volunteer to take the RM role then. I will appreciate advice from who have the experience. Masatake Iwasaki On 2020/09/01 10:38, Mingliang Liu wrote: I can see how I can help, but I can not take the RM role this time. Thanks, On Mon, Aug 31, 2020 at 12:15 PM Wei

Re: [DISCUSS] Hadoop 2.10.1 release

or applicable patches. Only HADOOP-16918 has release-blocker label. I filed HADOOP-17249 and HADOOP-17251 as sub tasks. If those can not be merged in a few days, I would like to put them off until next release and cut a release candidate. Thanks, Masatake Iwasaki On 2020/09/03 21:35, Masatake

Re: [DISCUSS] Ozone TLP proposal

this approach. (for Submarine at that time) Since I'm willing to contribute, I added my name to the wiki. Thanks, Masatake Iwasaki On 2020/09/07 21:04, Elek, Marton wrote: Hi, The Hadoop community earlier decided to move out Ozone sub-project to a separated Apache Top Level Project (TLP

Re: [DISCUSS] Hadoop 2.10.1 release

Only HADOOP-16918 has release-blocker label. HADOOP-16918 was resolved. I'm going to cut branch-2.10.1 and RC0 tomorrow. Thanks, Masatake Iwasaki On 2020/09/08 23:14, Masatake Iwasaki wrote: https://issues.apache.org/jira/issues/?jql=project%20in%20(HADOOP%2C%20HDFS%2C%20YARN%2C%20MAPREDUCE

[VOTE] Release Apache Hadoop 2.10.1 (RC0)

. [1] https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1 Thanks, Masatake Iwasaki - To unsubscribe, e-mail

Re: [DISCUSS] fate of branch-2.9

+1 on EOL of branch-2.9. Since there are a lot of backported fixes in branch-2.10 after 2.10.0 (2019 Oct 29), it would be nice to release 2.10.1. I'm happy to help release work. Masatake Iwasaki On 2020/08/28 3:25, Mingliang Liu wrote: are there any Hadoop branch-2 releases planned, ever

Re: Precommit job fails to write comments in the GitHub pull requests

Yetus when JDK11 Javadoc issue is fixed. Regards, Masatake Iwasaki On 2020/09/29 2:55, Akira Ajisaka wrote: Apache Hadoop developers, After YETUS-994, the jenkins job updates the commit status instead of writing a comment to the pull request. It requires an OAuth token with write access

Re: [VOTE] Moving Ozone to a separated Apache project

+1 Thanks, Masatake Iwasaki On 2020/09/25 14:59, Elek, Marton wrote: Hi all, Thank you for all the feedback and requests, As we discussed in the previous thread(s) [1], Ozone is proposed to be a separated Apache Top Level Project (TLP) The proposal with all the details, motivation

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

The vote passed with 6 binging +1's and 2 non-binding +1's. Thanks all for pushing this. I'm going to publish the release. binding +1's: - Eric Payne - Sunil Govindan - Wei-Chiu Chuang - Vinayakumar B - Mingliang Liu - Masatake Iwasaki non-binding +1's: - Jim Brennan - Eric Badger Bests

[ANNOUNCE] Apache Hadoop 2.10.1 release

, and changelog, are on the 2.10.1 announcement page [2]. [1] https://hadoop.apache.org/releases.html [2] https://hadoop.apache.org/release/2.10.1.html Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr

Re: [ANNOUNCE] Apache Hadoop 2.10.1 release

and CHANGES have valid contents. Thanks, Masatake Iwasaki On 2020/09/23 5:17, Masatake Iwasaki wrote: Hi all, I am happy to announce that the Apache Hadoop 2.10.1 has been released. Apache Hadoop 2.10.1 is the second release in the Apache Hadoop 2.10 line. You can download the release from

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

will appreciate additional votes. Thanks, Masatake Iwasaki [1] https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E [2] https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109af510592ea2

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Iwasaki On 2020/09/15 2:59, Masatake Iwasaki wrote: Hi folks, This is the first release candidate for the second release of Apache Hadoop 2.10. It contains 218 fixes/improvements since 2.10.0 [1]. The RC0 artifacts are at: http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/ RC tag is release

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

(Server.java:943)     at java.security.AccessController.doPrivileged(Native Method)     at javax.security.auth.Subject.doAs(Subject.java:422)     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2943)

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

Thanks Steve and Prabhu for the information. The cause turned out to be locking in CapacityScheduler#reinitialize. I think the method is called after transitioning to active stat if RM-HA is enabled. I filed YARN-10347 and created PR. Masatake Iwasaki On 2020/07/08 16:33, Prabhu Joseph

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

cluster on CentOS 7 and CentOS 8. * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed on CentOS 7. Masatake Iwasaki On 2020/07/07 7:27, Brahma Reddy Battula wrote: Hi folks, This is the first release candidate for the first release of Apache Hadoop 3.3.0 line. It contains

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC3)

nks, Masatake Iwasaki On 2020/07/13 19:36, Gabor Bota wrote: Hi folks, I have put together a release candidate (RC3) for Hadoop 3.1.4. * The RC includes in addition to the previous ones: * fix of YARN-10347. Fix double locking in CapacityScheduler#reinitialize in branch-3.1 (ht

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

Hi Gabor Bota, I committed the fix of YARN-10347 to branch-3.1. I think this should be blocker for 3.1.4. Could you cherry-pick it to branch-3.1.4 and cut a new RC? Thanks, Masatake Iwasaki On 2020/07/08 23:31, Masatake Iwasaki wrote: Thanks Steve and Prabhu for the information. The cause

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)

-distributed cluster with Kerberos and SSL enabled, ran basic EZ operation, ran example MR jobs. * followed the reproduction step reported in  HDFS-15313 to see if the fix works. Thanks, Masatake Iwasaki On 2020/07/21 21:50, Gabor Bota wrote: Hi folks, I have put together a release candidate (RC4

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

by `mvn site` and skimmed the contents including top-level index.html. * checked hadoop-3.2.2-site.tar.gz * verified signature and checksums. * skimmed the contents including top-level index.html. Thanks, Masatake Iwasaki On 2021/01/03 23:39, Xiaoqiao He wrote: Hi folks, The release

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

w features and big improvements. The instruction might be a bit unclear and tend to be missed by release manager. # I missed this on 2.10.1 release.. Thanks, Masatake Iwasaki On 2020/12/10 2:00, Xiaoqiao He wrote: Hi folks, The release candidate (RC4) for Hadoop-3.2.2 is available now. There are

Re: [DISCUSS] HADOOP-17464. Create hadoop-compression module

-compression a compile scope dependency of hadoop-common first then removing it on the next major release (4.0.0)? Thanks, Masatake Iwasaki On 2021/01/12 22:58, Steve Loughran wrote: Following on from discussions in a previous PR, Liang-Chi Hsieh has created a PR to add a new hadoop-compression module

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

issue. [1] https://issues.apache.org/jira/browse/HDFS-15098?focusedCommentId=17112893=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17112893 Masatake Iwasaki On 2021/06/07 18:04, Masatake Iwasaki wrote: I found that the top page of site documentation (index.html

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

and ran TestMiniLlapCliDrivera (fixed by HDFS-15790). Masatake Iwasaki On 2021/06/01 19:29, Wei-Chiu Chuang wrote: Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3

Re: [DISCUSS] Change project style guidelines to allow line length 100

for using Emacs and side-by-side diff even on 13-inch MBP. Masatake Iwasaki On 2021/05/20 11:00, Akira Ajisaka wrote: I'm +1 to allow <= 100 chars. FYI: There were some discussions long before: - https://lists.apache.org/thread.html/7813c2f8a49b1d1e7655dad180f2d915a280b2f4d562cfe981e1d

Re: Do I need a +1 to merge a backport PR?

I think we usually merge backport without explicit +1 if the conflict is trivial, same as done on JIRA-only workflow (on which we attached patch like HADOOP-xxx-branch-3.3.001.patch for precommit check then commit it without explicit +1). If committers want review since the change is not

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

/) if you need to cut RC4. Thanks, Masatake Iwasaki On 2021/06/01 19:29, Wei-Chiu Chuang wrote: Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3: * Revert "MAPREDUCE

Re: [VOTE] Hadoop 3.1.x EOL

+1 Masatake Iwasaki On 2021/06/03 15:14, Akira Ajisaka wrote: Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an official announcement

Re: Hadoop-3.2.3 Release Update

Thanks for bringing this up, Akira. Let me explain some background. - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff This is for building hadoop-3.2.2 against zookeeper-3.4.14. we do not see the issue usually since

Re: Hadoop-3.2.3 Release Update

the exclusion even for zooekeeper-3.4.13. I filed HADOOP-17849 for this. On 2021/08/16 12:02, Masatake Iwasaki wrote: Thanks for bringing this up, Akira. Let me explain some background. - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

- recently, JIRA became some sort of a "number generator" with insufficient description/details as the developers and the reviewers spending more time discussing in the PR. JIRA issues contain useful information in the fields. We are leveraging them in development and release process. *

Re: [DISCUSS] Add remote port information to HDFS audit log

it is optional feature disabled by default. https://github.com/apache/hadoop/blob/rel/release-3.3.1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java#L8480-L8498 If we need to add fields, making it optional might be an option. Masatake Iwasaki

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

s Java 10 or upper. https://issues.apache.org/jira/browse/HADOOP-15304 Thanks, Akira On Tue, Sep 28, 2021 at 10:27 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: In particular, there has been an outstanding problem with doclet support for filtering javadocs by annotation since JD

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

In particular, there has been an outstanding problem with doclet support for filtering javadocs by annotation since JDK9 came out. Could you give me a pointer to relevant Yetus JIRA or ML thread? On 2021/09/28 1:17, Sean Busbey wrote: I think consolidating on a common library and tooling for

Re: Hadoop-3.2.3 Release Update

in Proxy User documentation. (#2780) Signed-off-by: Akira Ajisaka (cherry picked from commit c8d327a4f1a7f15d6be35051414199d1d3fdc5ef) I will create RC0 shortly after updating index.md.vm (which is the top page of site documentation). Thanks, Masatake Iwasaki On 2022/03/11 22:17

[VOTE] Release Apache Hadoop 3.2.3 - RC0

/repositories/orgapachehadoop-1339 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

Ejbyfeldt wrote: Hi, There is no aarch64 artifact in the release candidate. Is this something that is intended? Best, Emil Ejbyfeldt On 14/03/2022 08:14, Masatake Iwasaki wrote: Hi all, Here's Hadoop 3.2.3 release candidate #0: The RC is available at: https://home.apache.org/~iwasakims

Re: Hadoop-3.2.3 Release Update

if we need. https://issues.apache.org/jira/browse/HADOOP-18088 Thanks, Masatake Iwasaki On 2022/03/10 12:23, Xiaoqiao He wrote: Thanks Masatake for reaching out. Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

-default.xml by DFS-12920, There seems to be no quick fix though it is noisy. HDFS-14630 is the fix for this. I will backport this to branch-3.2.3 if I need to cut RC1. On 2022/03/18 0:54, Masatake Iwasaki wrote: +1 from myself. * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

, Masatake Iwasaki On 2022/03/18 10:56, Masatake Iwasaki wrote: I found that INFO level log message is emitted on every CLI invocation. $ bin/hdfs dfs -mkdir /tmp 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC5

enabled 3-nodes docker cluster and ran sample MR jobs. * launched pseudo distributed cluster and `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code. * built site documentation by `mvn site site:stage` and skimmed the contents. Thanks, Masatake Iwasaki On 2022/02

Re: Hadoop-3.2.3 Release Update

Hi Brahma, I would like to use 3.2.3 for next minor release of Bigtop. https://issues.apache.org/jira/browse/BIGTOP-3605 Let me know if there is any blocker I can help. Thanks, Masatake Iwasaki On 2022/01/12 4:41, Brahma Reddy Battula wrote: Sorry, I was looking for some CVE’s fixes.will

[DISCUSS] Hadoop 2.10.2 release

/browse/HADOOP-18088 Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: hadoop 3.3.1 build fails

[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.11.2:yarn (yarn install) on looks like the issue fixed by YARN-10561. https://issues.apache.org/jira/browse/YARN-10561 On 2022/02/26 5:20, Bulldog20630405 wrote: when running: # both of these build command fail (i

[VOTE] Release Apache Hadoop 3.2.3 - RC1

/repositories/orgapachehadoop-1342 You can find my public key at: https://downloads.apache.org/hadoop/common/KEYS Please evaluate the RC and vote. The vote will be open for (at least) 5 days. Thanks, Masatake Iwasaki

[RESULT][VOTE] Release Apache Hadoop 3.2.3 - RC1

With 3 binding +1s and 1 non-binding +1, the vote passes. I'm going to publish the release and the announcement. Thanks, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC1 on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests. https://issues.apache.org/jira/browse/BIGTOP-3606 Masatake Iwasaki On 2022/03/20 14:32, Masatake Iwasaki wrote: Hi all, Here's Hadoop 3.2.3 release candidate #1: The RC is available

[ANNOUNCE] Apache Hadoop 3.2.3 release

/3.2.3/CHANGELOG.3.2.3.html Best Regards, Masatake Iwasaki - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

this command. [INFO] error Found incompatible module [INFO] ---- ``` Masatake Iwasaki On 2022/01/27 4:16, Chao Sun wrote: Hi all, I've put together Hadoop 3.3.2 RC3 below: The RC is available at: http://people.apache.org/~sun

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

should be discussed separately. Thanks and regards, Akira On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki mailto:iwasak...@oss.nttdata.co.jp>> wrote: Thanks for putting this up, Chao Sun. I got following error on building the RC3 source tarball. It is reproducible even in the contai

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

che/hadoop/pull/4073>, few tests are flaky but they are passing locally. On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki mailto:iwasak...@oss.nttdata.co.jp>> wrote: Hi all, Here's Hadoop 3.2.3 release candidate #0: The RC is available at: https://home.apache.org/~iwas

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

enabled 3-nodes docker cluster and ran sample MR jobs. * built site documentation by `mvn site site:stage -Preleasedocs` and skimmed the contents. * built Spark 3.2.1 against 3.3.3 RC1 using the staging repository (after `rm -rf ~/.m2/repository/org/apache/hadoop`). Thanks, Masatake Iwasaki On 2022

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2.3.6 and Spark 2.4.5 against Hadoop 2.10.2 RC0 on CentOS 7 (x86_64) by using Bigtop branch-1.5 and ran smoke-tests. https://github.com/apache/bigtop/pull/906 Masatake Iwasaki On 2022/05/25 11:40, Masatake Iwasaki wrote: Hi all, Here's Hadoop 2.10.2 release candidate #0: The RC is available

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

The vote passed with the following result. Binding PMC members: +1 Chris Nauroth +1 Ayush Saxena +1 Steve Loughran +1 Masatake Iwasaki Non binding votes: +1 Viraj Jasani +1 Ashutosh Gupta I'm going to publish the artifacts, site docs, maven artifacts, then announce. Thank you to all who

  1   2   3   >