Re: Client Caller Context Through Router(RBF)

Thanks Ayush for bringing this up. NameNode uses clientId and callId for retry cache. - clientId: I'm +1 for adding remoteAddr in IPCConectionContext and NN should use remoteAddr for clientId. This also resolves data locality issue. - callId: Can DFSRouters share the callId and the clientId of the

Re: [DISCUSS] making Ozone a separate Apache project

+1 -Akira On Wed, May 13, 2020 at 4:53 PM Elek, Marton wrote: > > > I would like to start a discussion to make a separate Apache project for > Ozone > > > > ### HISTORY [1] > > * Apache Hadoop Ozone development started on a feature branch of > Hadoop repository (HDFS-7240) > > * In the Octo

Re: why is a hadoop dist taking so long to build

I think YARN-9606 broke the build. Reverted. Thank you, Ayush and Steve. -Akira On Fri, May 15, 2020 at 5:46 AM Ayush Saxena wrote: > Could be due to YARN-9606, got committed today itself. > https://issues.apache.org/jira/browse/YARN-9606 > The last build in the JIRA had -1 on shadedclient. > >

Re: [DISCUSS] Secure Hadoop without Kerberos

Hi Eric, thank you for starting the discussion. I'm interested in OpenID Connect (OIDC) integration. In addition to the benefits (security, cloud native), operating costs may be reduced in some companies. We have our company-wide OIDC provider and enable SSO for Hadoop Web UIs via Knox + OIDC in

Re: Hadoop QBT job always failing

+CC: common-dev Hi Gavin, The job worked as expected in #146 and it helps us to find failed tests and build errors. https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/146/ However, the job itself failed in #147 and #148 by "pipe closed after 0 cycles" https://ci-hadoop.apache.o

Re: mvnsite-hadoop-common fails on Yetus

It seems this error always occurs. Filed https://issues.apache.org/jira/browse/HADOOP-17056 I'm trying to find the root cause. Thanks, Akira On Fri, May 29, 2020 at 5:31 AM Wei-Chiu Chuang wrote: > Stephen raised a similar question today. My hunch is there's a bad Jenkins > slave machine but h

Re: [NOTICE] Removal of protobuf classes from Hadoop Token's public APIs' signature

> Please check https://issues.apache.org/jira/browse/HADOOP-17046 > This Jira proposes to keep existing ProtobuRpcEngine as-is (without shading and with protobuf-2.5.0 implementation) to support downstream implementations. Thank you, Vinay. I checked the PR and it mostly looks good. How do we proc

Re: mvnsite-hadoop-common fails on Yetus

Fixed. -Akira On Sat, May 30, 2020 at 4:54 PM Akira Ajisaka wrote: > It seems this error always occurs. > Filed https://issues.apache.org/jira/browse/HADOOP-17056 > > I'm trying to find the root cause. > > Thanks, > Akira > > On Fri, May 29, 2020 at

Re: Moving to Yetus 0.12.0

Updated Yetus version to 0.12.0 in branch-2.10 qbt job: https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-qbt-branch-2.10-java7-linux-x86/ -Akira On Tue, Apr 28, 2020 at 6:59 AM Akira Ajisaka wrote: > Hi folks, > > After upgrading the image from Ubuntu 16.04 to Ubuntu 18.04

Re: Hadoop QBT job always failing

Thanks, Akira On Fri, Jun 12, 2020 at 4:51 AM Gavin McDonald wrote: > Hi Akira, > > On Fri, May 22, 2020 at 4:44 AM Akira Ajisaka wrote: > > > +CC: common-dev > > > > Hi Gavin, > > > > The job worked as expected in #146 and it helps us to find fai

Re: [DISCUSS] Removing the archiac master branch

-0 I prefer deleting source code from master instead of deleting the branch, as I did in branch-2. https://issues.apache.org/jira/browse/HADOOP-16988 I think we are in the following infinite loop: - Ask infra to delete master. - Some committer wrongly pushes master. - We ask infra again. In the

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC1)

Hi Gabor, Thank you for your work! Kihwal reported IBR leak in standby NameNode: https://issues.apache.org/jira/browse/HDFS-15421. I think this is a blocker and this affects 3.1.4-RC1. Would you check this? Best regards, Akira On Mon, Jun 22, 2020 at 10:26 PM Gabor Bota wrote: > Hi folks, > >

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

+1 (binding) - Verified checksums and signatures. - Built from the source with CentOS 7 and OpenJDK 8. - Successfully upgraded HDFS to 3.3.0-RC0 in our development cluster (with RBF, security, and OpenJDK 11) for end-users. No issues reported. - The document looks good. - Deployed pseudo cluster a

Re: Progress

+CC: common-dev@hadoop Hi Gavin, Thank you for the reminder. I have one question. When ARM servers will be moved to ci-hadoop? Hadoop and HBase have daily jobs that run on ARM servers. I'll migrate the other Hadoop Jenkins jobs to ci-hadoop this weekend. Regards, Akira On Wed, Jul 22, 2020 at

Re: Progress

t; please help us migrate the ARM nodes. > > BR, > > On Thu, Jul 23, 2020 at 1:40 AM Gavin McDonald > wrote: > > > Hi , > > > > On Wed, Jul 22, 2020 at 7:00 PM Akira Ajisaka > wrote: > > > > > +CC: common-dev@hadoop > > > > >

GitHub OAuth token

Hi Steve, Would you register GitHub hadoop-yetus account's OAuth token to the new Jenkins servers? https://ci-hadoop.apache.org/ I'd like to migrate the hadoop-multibranch job and the token is needed. Thanks and regards, Akira

Re: GitHub OAuth token

This issue is resolved. Steve gave me the token privately and hadoop-multibranch job has been migrated using the token. -Akira On Mon, Jul 27, 2020 at 4:02 PM Akira Ajisaka wrote: > Hi Steve, > > Would you register GitHub hadoop-yetus account's OAuth token to the new > Jenkins

Re: maintainers of hadoop-multibranch please limit concurrent runs

All the ci-hadoop users, I apologize for starving the resources by my misconfiguration. Aborted all the hadoop-multibranch jobs and modified the configuration as follows: - Disabled the periodic scanning. - Set "Discover pull requests from origin/forks" to "The current pull request revision" Tha

Re: GitHub OAuth token

This is related. Removed hadoop-multibranch jobs from builds.apache.org to stop double yetus runs. -Akira On Fri, Jul 31, 2020 at 7:41 PM Steve Loughran wrote: > I'm seeing double yetus runs on each PR -this related? > > On Thu, 30 Jul 2020 at 03:14, Akira Ajisaka wrote: >

Re: [DISCUSS] fate of branch-2.9

+1 Thanks, Akira On Fri, Aug 28, 2020 at 5:51 PM lisheng.sun08 wrote: > +1 on EOL of branch-2.9. > > Thanks, > Lisheng Sun > > > > 发自我的小米手机 > 在 2020年8月27日 下午1:55，Wei-Chiu Chuang 写道： > > Bump up this thread after 6 months. > > Is anyone still interested in the 2.9 release line? Or are we good to

Re: [VOTE] End of Life Hadoop 2.9

+1 -Akira On Tue, Sep 1, 2020 at 4:09 AM Wei-Chiu Chuang wrote: > Dear fellow Hadoop developers, > > Given the overwhelming feedback from the discussion thread > https://s.apache.org/hadoop2.9eold, I'd like to start an official vote > thread for the community to vote and start the 2.9 EOL proce

Re: error in installation of hadoop 2.9.2 on windows 10 (64 bit)

(+ user ML) Hi Meghna, Please use u...@hadoop.apache.org for end-user questions and discussion. Regards, Akira On Thu, Sep 10, 2020 at 1:31 PM meghnaist wrote: > > -- Forwarded message - > From: meghnaist > Date: Wed, Sep 9, 2020, 11:59 PM > Subject: error in installation of

Re: [VOTE] Moving Ozone to a separated Apache project

+1 Thanks, Akira On Fri, Sep 25, 2020 at 3:00 PM Elek, Marton wrote: > > Hi all, > > Thank you for all the feedback and requests, > > As we discussed in the previous thread(s) [1], Ozone is proposed to be a > separated Apache Top Level Project (TLP) > > The proposal with all the details, motivat

Precommit job fails to write comments in the GitHub pull requests

Apache Hadoop developers, After YETUS-994, the jenkins job updates the commit status instead of writing a comment to the pull request. It requires an OAuth token with write access to "repo:status" but now there is no such token for Apache Hadoop. I asked the infra team to create a token: https://i

Re: Precommit job fails to write comments in the GitHub pull requests

I've got a GitHub App token from the infra team and set this to the hadoop-multibranch job. The commit statuses in GitHub pull requests will be updated by Jenkins and you'll need to check these statuses. -Akira On Tue, Sep 29, 2020 at 2:55 AM Akira Ajisaka wrote: > > Apache H

Re: Precommit job fails to write comments in the GitHub pull requests

of toolchain in order to > > avoid surprising the developers. > > We can upgrade Yetus when JDK11 Javadoc issue is fixed. > > > > Regards, > > Masatake Iwasaki > > > >> On 2020/09/29 2:55, Akira Ajisaka wrote: > >> Apache Hadoop developers, >

Re: Precommit job fails to write comments in the GitHub pull requests

> Can we point to a commit before Yetus-994 instead of master and get away with > this? I'm fine with that approach not to breaking more. Filed https://issues.apache.org/jira/browse/HADOOP-17297 Thanks, Akira On Mon, Oct 5, 2020 at 10:18 AM Akira Ajisaka wrote: > > Hi

Re: HADOOP-16649 - PR sent : what's next

Hi Thierry, Somehow the jenkins job has not been started. Kicked the job manually: https://ci-hadoop.apache.org/job/hadoop-multibranch/view/change-requests/job/PR-2385/1/ Thanks, Akira On Mon, Oct 19, 2020 at 4:25 PM Thierry ACCART wrote: > > CONFIDENTIAL & RESTRICTED > > Hi > I've sent a pull

Re: Quality Outreach - Survey

ADOOP-17177 Thanks and regards, Akira Ajisaka On Tue, Oct 20, 2020 at 12:49 AM Rory O'Donnell wrote: > > Hi Akira, > > I hope all is well! > > Thank you for all your support in maintaining the Quality of the JDK > Releases over the past years. > We want to make

Fixing flaky tests in Apache Hadoop

Hi Hadoop developers, Now there are a lot of failing unit tests and there is an issue to tackle this bad situation. https://issues.apache.org/jira/browse/HDFS-15646 Although this issue is in HDFS project, this issue is related to all the Hadoop developers. Please check the above URL, read the des

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC1

-1 - YARN resource localization is broken by HADOOP-17306 and it has been reverted. It should be reverted from 3.2.2 as well. (Thank you Jim Brennan for the report!) - Would you include HDFS-15643 in RC2? This fixes checksum error in EC with ISA-L. Thank you He Xiaoqiao for preparing the release

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

I found TestCombineFileInputFormat is failing in branch-3.2.2 and I've cherry-picked MAPREDUCE-7284 to fix the failure. Thanks, Akira On Fri, Dec 4, 2020 at 9:09 AM Chao Sun wrote: > > Thanks Xiaoqiao. I just committed the fix to branch-3.2 (and will port it > to other branches as well later). C

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

In addition, backported HDFS-13404 to fix TestRouterWebHDFSContractAppend failure. On Fri, Dec 4, 2020 at 10:43 AM Akira Ajisaka wrote: > > I found TestCombineFileInputFormat is failing in branch-3.2.2 and I've > cherry-picked MAPREDUCE-7284 to fix the failure. > > Thanks

Re: Please subscribe me to this mailing list

Please send an e-mail to common-dev-subscr...@hadoop.apache.org to subscribe to this mailing list. https://hadoop.apache.org/mailing_lists.html -Akira On Mon, Dec 7, 2020 at 5:02 PM Siddharth Ahuja wrote: > > - To unsubscribe,

[DISCUSS] Upgrading Jersey from 1.x

Hi folks, Recently I resumed the work for upgrading Jersey: - https://issues.apache.org/jira/browse/HADOOP-15984 - https://github.com/apache/hadoop/pull/763 This upgrade is important because we cannot compile and run Jersey 1.x with Java 11+. However, it is very complicated because: 1. We need t

Re: permission to the wiki

Hi Noel, Added write permission for you. Note for admin: Space tools -> Permissions -> Individual Users - Add the user and check "Pages Add." Thanks, Akira On Wed, Dec 16, 2020 at 1:28 PM Noel Hernandez Sandoval wrote: > > Hi! > > I belong to an educational institution that has an Apache Hadoo

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

o Sun > HADOOP-15775. [JDK9] Add missing javax.activation-api dependency. > Contributed by Akira Ajisaka. > HDFS-15240. Erasure Coding: dirty buffer causes reconstruction block error. > Contributed by HuangTao. > HDFS-15708. TestURLConnectionFactory fails by NoClassDefFoundError in &g

Re: [E] Yetus is failing with Java unable to create threads

In most cases, the OOM occurs when closing MiniDFSCluster. Added a detailed comment in https://issues.apache.org/jira/browse/HDFS-13579 and created a PR: https://github.com/apache/hadoop/pull/2555 -Akira On Fri, Dec 4, 2020 at 12:43 AM Ahmed Hussein wrote: > > I remember this error was there for

Re: [E] Yetus is failing with Java unable to create threads

n Thu, Dec 17, 2020 at 4:17 PM Akira Ajisaka wrote: > > In most cases, the OOM occurs when closing MiniDFSCluster. > Added a detailed comment in > https://issues.apache.org/jira/browse/HDFS-13579 and created a PR: > https://github.com/apache/hadoop/pull/2555 > > -Akira > >

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

+1 (binding) - Verified the checksums and signatures - Verified the source is the same as the RC5 tag - Built from source with CentOS 7.9 and Java 1.8.0_275 - Setup pseudo cluster and ran some FsShell commands Thanks, Akira On Sun, Jan 3, 2021 at 11:40 PM Xiaoqiao He wrote: > > Hi folks, > > Th

Easy way to run all the unit tests (apache id required)

Hi folks, I've prepared a Jenkins on-demand qbt job: https://ci-hadoop.apache.org/job/hadoop-qbt-any-java8-linux-x86_64 If you are tired of touching the source code in the modules to run all the tests (and seeing some broken Jenkins job results), please use this job instead. How to use: - Login

Re: spotbugs maven plugin

Reverted https://issues.apache.org/jira/browse/HADOOP-16870. Thanks and regards, Akira On Fri, Feb 19, 2021 at 4:56 AM Mikhail Pryakhin wrote: > > Hello community, > > I’m facing builds failure after the PR > >

Re: Seeing YETUS issue in jenkins runs

Probably this issue is due to https://issues.apache.org/jira/browse/HADOOP-16870. Reverted. -Akira On Fri, Feb 19, 2021 at 11:27 AM Sunil Govindan wrote: > > Hi All, > > We are getting the below error in recent runs. > > -1. yetus. 0m 8s. Unprocessed flag(s): --findbugs-strict-precheck > >

Re: Seeing YETUS issue in jenkins runs

t'll be maven, before long you'll be > > doing linux device drivers... > > > > > > > > On Fri, 19 Feb 2021 at 05:53, Akira Ajisaka wrote: > > > > > Probably this issue is due to > > > https://issues.apache.org/jira/browse/HADOOP-16870.

Re: Hadoop 3.1 branch broken?

In branch-3.1, JDK 9 is installed and the default java version is set to 9. In other branches, the default java version is 8. I'll backport some related JIRAs to branch-3.2. -Akira On Wed, Mar 24, 2021 at 3:27 PM Mingliang Liu wrote: > > Hi, > > From this build log >

Re: Hadoop 3.1 branch broken?

Backported HADOOP-14671, HADOOP-16754, and YARN-10036. On Wed, Mar 24, 2021 at 3:50 PM Akira Ajisaka wrote: > > In branch-3.1, JDK 9 is installed and the default java version is set > to 9. In other branches, the default java version is 8. I'll backport > some related JI

Re: Hadoop 3.1 branch broken?

021 at 4:17 PM Wei-Chiu Chuang wrote: > > JDK9 is end of support. Should we move to JDK11? > > On Wed, Mar 24, 2021 at 2:51 PM Akira Ajisaka wrote: >> >> In branch-3.1, JDK 9 is installed and the default java version is set >> to 9. In other branches, the default

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

Thanks Allen for reporting. Agreed that HDFS-10256 broke the tests. Filed HDFS-10561. Regards, Akira On 6/19/16 03:54, Allen Wittenauer wrote: On Jun 17, 2016, at 7:04 AM, Apache Jenkins Server wrote: For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/6

Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

As I commented in the jira, I'm +1 for upgrading. -Akira On 6/29/16 10:16, Tsuyoshi Ozawa wrote: No objections here? - Tsuyoshi On Mon, Jun 27, 2016 at 6:01 AM, Tsuyoshi Ozawa wrote: Hi developers, I will plan to upgrade Google Guice dependency on trunk. The change also includes asm and cg

Re: Feedback on IRC channel

I'm not using the IRC channel (#hadoop at irc.freenode.net.) I'm using slack (hadoopdev.slack.com) instead. -Akira On 7/14/16 14:48, Ravi Prakash wrote: I've never gone there either. +1 for retiring. On Wed, Jul 13, 2016 at 11:34 PM, J. Rottinghuis wrote: Uhm, there is an IRC channel?!? Jo

Re: Not being able to add HDFS contributors

Today I hit the same issue. Changing the browser to Firefox worked well for me. -Akira On 7/19/16 18:10, Zheng, Kai wrote: Thanks Andrew for the work around!! It works great ... Regards, Kai -Original Message- From: Andrew Wang [mailto:andrew.w...@cloudera.com] Sent: Wednesday, July 2

Re: [DISCUSS] 2.6.x line releases

Hi Sangjin, I'm thinking it's time for 2.6.5 release. Now there are 51 fixed issues in 2.6.5 and the number is more than 2.6.4 (47). > How long do we maintain this line? What would be a sensible EOL policy? Ideally 5 years, because most of our customers in Japan are using Hadoop cluster with

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

Hi folks, qbt for trunk+JDK8 on Linux/x86 is failing by executable '/home/jenkins/tools/maven/latest3//bin/mvn' for 'maven' does not exist. Would someone fix this? Regards, Akira On 7/21/16 00:41, Apache Jenkins Server wrote: For more details, see https://builds.apache.org/job/hadoop-qbt-

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

inting out that the leveldb changes in YARN have pretty much completely broken it out of the box on non-x86. On Jul 21, 2016, at 1:01 PM, Akira Ajisaka wrote: Hi folks, qbt for trunk+JDK8 on Linux/x86 is failing by executable '/home/jenkins/tools/maven/latest3//bin/mvn' for '

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

+1 for the source tarball. - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled and built a single node cluster - Compiled Hive 2.1.0/1.2.1 and Tez 0.8.4/0.7.1 using Hadoop 2.7.3 pom successfully - Ran some Hive on Tez queries successfully Thanks, Akira

Re: [DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

Thanks Vinod and Andrew for the summary. > Here's an attempt at encoding this policy as a set of rules for setting fix > versions (credit to Allen): > > 1) Set the fix version for all a.b.c versions, where c > 0. > 2) For each major release line, set the lowest a.b.0 version. Assuming 3.0.0-al

Re: [VOTE] Release Apache Hadoop 2.7.3 RC1

-1 (binding) HADOOP-13434 and HADOOP-11814, committed between RC0 and RC1, are not reflected in the release note. -Akira On 8/17/16 13:29, Allen Wittenauer wrote: -1 HDFS-9395 is an incompatible change: a) Why is not marked as such in the changes file? b) Why is an incompatible change in

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

Thanks Vinod for cutting another RC. +1 - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled and built a single node cluster - Compiled Hive 2.1.0/1.2.1 and Tez 0.8.4/0.7.1 using Hadoop 2.7.3 pom successfully - Ran some Hive on Tez queries successfully

Re: adding contributor roles timing out again

> How about we try to do some grouping, where we just have sub groups, > hadoop-contributors-1, hadoop-contributors-2, ... and add them as > contributors; we then edit group membership, adding a new group when the > current one gets above some chosen size limit? Agreed. Filed INFRA-12487. -Akira

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

Thanks Andrew for the great work. +1 (binding) - Downloaded source and verified checksum and signature - Compiled with -Pnative @ CentOS 7.2 and OpenJDK 8u101 - Ran some MapReduce jobs successfully - Checked Web UIs and logs - hdfs/yarn/mapred "--daemon" option works as expected Regards, Akira

Re: adding contributor roles timing out again

add people to. Same permissions as "Contributors." This applies to all of the projects using Hadoop Permissions (includes common and HDFS.) -Akira On 8/24/16 14:16, Akira Ajisaka wrote: How about we try to do some grouping, where we just have sub groups, hadoop-contributors-1, hadoop-cont

Re: About 2.6.5 and 2.7.4 release

Yes. I can help with releasing them. -Akira On 9/9/16 15:31, Tsuyoshi Ozawa wrote: Chiwan Park reported Hadoop incompatibility by the change of HADOOP-11252. Now, HADOOP-13579 is committed to branch-2.6 and branch-2.7. complement: HADOOP-13579 fixes the problem of incompatibility by HADOOP-11

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

-0 (binding) - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled successfully with both JDK6 and JDK7 - Compiled and built a single node cluster - Compiled Hive 1.2.1 and Tez 0.7.1/0.8.4 using Hadoop 2.6.5 pom successfully - Ran some Hive on Tez/MRv2 qu

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

Hi Sangjin, When using binary tarball, I'm seeing "2016-09-27T18:26Z by sjlee from branch-2.6.5" in Web UI. Can we rename it? AFAIK, hadoop releases were built by hortonmu in 2014 and was renamed to jenkins. * http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201401.mbox/%3CCAJs-t7N

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

. What I meant is that "would you change the name to 'jenkins' by using the Jenkins infra?" Regards, Akira On 10/7/16 03:04, Allen Wittenauer wrote: On Oct 5, 2016, at 10:35 PM, Akira Ajisaka wrote: Can we rename it? AFAIK, hadoop releases were built by hortonmu in 2014 and w

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

I'm sorry I was wrong. Thanks Allen for the detailed information. -Akira On 10/7/16 15:04, Allen Wittenauer wrote: On Oct 6, 2016, at 1:39 PM, Akira Ajisaka wrote: It wasn't 'renamed' to jenkins, prior releases were actually built by and on the Jenkins infrastructu

Re: [DISCUSS] HADOOP-13603 - Remove package line length checkstyle rule

This discussion was split into two separate topics. 1) Remove line length checkstyle rule for package line 2) Remove line length checkstyle rule for the entire source code 1) I'm +1 for removing the rule for package line. I can provide a trivial patch shortly in HADOOP-13603. 2) As Andrew sai

Re: Updated 2.8.0-SNAPSHOT artifact

It's almost a year since branch-2.8 has cut. I'm thinking we need to release 2.8.0 ASAP. According to the following list, there are 5 blocker and 6 critical issues. https://issues.apache.org/jira/issues/?filter=12334985 Regards, Akira On 10/18/16 10:47, Brahma Reddy Battula wrote: Hi Vinod, A

Re: Updated 2.8.0-SNAPSHOT artifact

of branch-2? On Tue, Oct 25, 2016 at 12:20 AM, Akira Ajisaka wrote: It's almost a year since branch-2.8 has cut. I'm thinking we need to release 2.8.0 ASAP. According to the following list, there are 5 blocker and 6 critical issues. https://issues.apache.org/jira/issues/?filter=1233

Re: [DISCUSS] Commit log Pattern Unification

I'm +1 for using Git "Signed-off-by" feature. Regards, Akira On 11/5/16 17:36, Brahma Reddy Battula wrote: Hi All, When we look at current git log,commit message patters are like following.. I feel, we should have unified one. Might not be very important,but it will be better have unified o

Re: [DISCUSS] Commit log Pattern Unification

In more detail, I'm +1 for requiring 'git format-patch' and commit with 'dev-support/bin/smart-apply-patch --committer', as well as Apache Yetus. That way committers can use signed-off feature and don't need to add 'contributed by ...' to commit message by hand. Thanks, Akira On 11/8/16 04:3

Re: Updated 2.8.0-SNAPSHOT artifact

Thanks, -Eric -- *From:* Karthik Kambatla *To:* Ming Ma *Cc:* Sangjin Lee ; Jason Lowe ; Akira Ajisaka ; Brahma Reddy Battula < brahmareddy.batt...@huawei.com>; Vinod Kumar Vavilapalli < vino...@apache.org>; "common-dev@hadoop.apache.org" <

Re: [Continued] [Release thread] 2.8.0 release activities

Thanks Junping and Andrew! HADOOP-2.8-JACC is not working well, so I manually kicked a job to compare 2.8 with 2.7.3. https://builds.apache.org/view/H-L/view/Hadoop/job/Hadoop-trunk-JACC/24/artifact/target/compat-check/report.html Regards, Akira On 2016/12/02 2:08, Junping Du wrote: Thanks

Re: Planning for 3.0.0-alpha2

Thanks Sangjin for finding this. > It looks like hadoop-cloud-storage-project was missed in the version set? Yes. Probably this is because hadoop-cloud-storage-project is missing in pom.xml so `mvn versions:set` did not work for the project. Filed HADOOP-14004 for fixing this. Regards, Ak

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

Hi Marton, This is intentional. source htmls were removed. https://issues.apache.org/jira/browse/HADOOP-13688 Regards, Akira On 2017/01/22 0:50, Marton Elek wrote: hadoop-3.0.0-alpha2.tar.gz is much more smaller than hadoop-3.0.0-alpha1.tar.gz. (246M vs 316M) The big difference is the genera

Re: gpg signing of commits

Thanks Steve for starting the discussion. Now I commit and cherry-pick patches with the -S option and have not faced any problems. -Akira On 2017/02/24 20:36, Steve Loughran wrote: For the next few days I'm experimenting with the -S option on signing commits, which tells git to ask gpg to s

Re: About 2.7.4 Release

Probably 2.8.0 will be released soon. https://issues.apache.org/jira/browse/HADOOP-13866?focusedCommentId=15898379&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15898379 I'm thinking 2.7.4 release process starts after 2.8.0 release, so 2.7.4 will be released in Apr

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks Junping! +1 (binding) * Verified signatures and checksums * Built Hive 2.1.0 and Tez 0.8.5 with Hadoop 2.8.0 pom * Deployed a single node cluster and ran some Hive on Tez queries successfully * The document looks good. I found a trivial issue in the doc. It does not block the release.

Automated documentation build for Apache Hadoop

Hi folks, I've created a repository to build and push Apache Hadoop document (trunk) via Travis CI. https://github.com/aajisaka/hadoop-document The document is updated daily by Travis CI cron job. https://aajisaka.github.io/hadoop-document/hadoop-project/ Hope it helps! Regards, Akira -

Re: Upgrading minimum version of Maven to 3.1 from 3.0

As I mentioned in YARN-6421. I'm +1 for upgrading to 3.1+ because the latest version of Maven 3.0.x is quite old. (4 years ago) We need to update dev-support/docker/Dockerfile to enable Maven 3.1+ for precommit Jenkins job. Regards, Akira On 2017/04/03 18:49, Sunil G wrote: Hi Folks, Recent

Re: Upgrading minimum version of Maven to 3.1 from 3.0

https://archive.apache.org/dist/maven/binaries/). btw, I assume we only plan to change maven version on trunk given new YARN UI only merge to trunk branch. Isn't it? Thanks, Junping From: Akira Ajisaka mailto:aajis...@apache.org>>

Re: Upgrading minimum version of Maven to 3.1 from 3.0

Based on the positive feedback from Junping, filed HADOOP-14285 for the update. Discussion can continue in the JIRA. Thanks, Akira On 2017/04/05 12:56, Akira Ajisaka wrote: Agreed to upgrade to 3.3+ and change the version only in trunk. -Akira On 2017/04/05 11:21, Sunil G wrote: Thanks

Re: HADOOP-14316: Switching from Findbugs to Spotbugs

HADOOP-14336 is the umbrella jira to fix the newly found warnings. https://issues.apache.org/jira/browse/HADOOP-14336 Regards, Akira On 2017/04/20 3:12, Allen Wittenauer wrote: On Apr 19, 2017, at 10:52 AM, Wei-Chiu Chuang wrote: That sounds scary. Would you mind to share the list of bugs t

Re: About 2.7.4 Release

d release script, anything else) I would be happy to do any task for new maintenance releases (or more frequent releases). Regards, Marton From: Akira Ajisaka Sent: Tuesday, March 07, 2017 7:34 AM To: Brahma Reddy Battula; Hadoop Common; yarn-...@hadoop.a

Re: About 2.7.4 Release

/25 16:21, Haohui Mai wrote: It would be great to backport HDFS-9710 to 2.7.4 as this is one of the critical fixes on scalability. Maybe we should create a jira to track this? ~Haohui On Tue, Apr 25, 2017 at 12:06 AM, Akira Ajisaka wrote: Ping I too can help with the release process. Now there are

Re: About 2.7.4 Release

11280,YARN-6024. May be we can raise one Jira to track this..? --Brahma Reddy Battula -Original Message----- From: Akira Ajisaka [mailto:aajis...@apache.org] Sent: 25 April 2017 15:36 To: Haohui Mai Cc: Brahma Reddy Battula; Andrew Wang; Sangjin Lee; Vinod Kumar Vavilapalli; Marton Elek; Had

Re: About 2.7.4 Release

issues resolved in the release. Disable mail notifications for this bulk change. Therefore, let's close them. On 2017/04/27 3:01, Allen Wittenauer wrote: On Apr 25, 2017, at 12:35 AM, Akira Ajisaka wrote: Maybe we should create a jira to track this? I think now either way (reopen or crea

Re: About 2.7.4 Release

Hi Konstantin, Thank you for volunteering as release manager! > Actually the original link works fine: https://s.apache.org/Dzg4 I couldn't see the link. Maybe is it private filter? Here is a link I generated: https://s.apache.org/ehKy This filter includes resolved issue and excludes fixversion

Re: Jenkins test failure

Hi Yongjun, Jenkins selects the latest attachment for precommit job regardless of the type of the attachment. The workaround is to attach the patch again. Regards, Akira On 2017/05/17 18:38, Yongjun Zhang wrote: Hi, I saw quite a few jenkins test failure for patches uploaded to jira, For

Re: About 2.7.4 Release

2.8 and trunk in following link.?? https://cwiki.apache.org/confluence/display/HADOOP From: Konstantin Shvachko Sent: Saturday, May 13, 2017 3:58 AM To: Akira Ajisaka Cc: Hadoop Common; Hdfs-dev; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org

Re: Reminder to always set x.0.0 and x.y.0 fix versions when backporting

Thanks Andrew for the reminder! I've checked the commit log and set 2.9.0 to the issue if the patch is committed in branch-2. -Akira On 2017/05/08 6:21, Andrew Wang wrote: Hi folks, I've noticed with the backporting efforts for 2.8.1, we're losing some x.y.0 fix versions (e.g. 2.9.0). Our f

Re: About 2.7.4 Release

://issues.apache.org/jira/browse/YARN-5988 https://issues.apache.org/jira/browse/YARN-6304 I will raise a JIRAs to back port it. @Akira , could you help to add these JIRAs into wiki? Thanks & Regards Rohith Sharma K S On 29 May 2017 at 12:19, Akira Ajisaka wrote: Created a page for 2

wiki.apache.org is no longer editable

Hi folks, https://wiki.apache.org/hadoop/ is no longer editable. If you want to edit a wiki page in wiki.apache.org, you need to migrate the page to https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Home. If you want to edit the wiki, please tell me your account for cwiki.apache.org. Th

Re: wiki.apache.org is no longer editable

asn't been migrated to cwiki yet, and the home page of our Hadoop space is a placeholder right now. On Fri, Jun 2, 2017 at 4:12 AM, Steve Loughran mailto:ste...@hortonworks.com>> wrote: > On 1 Jun 2017, at 06:15, Akira Ajisaka mailto:aajis...@apache.org>> wrote: >

Migrating logging APIs to slf4j (HADOOP-12956)

Hi folks, Now we are migrating from logging APIs (log4j, commons-logging) to slf4j for upgrading from log4j1 to log4j2. https://issues.apache.org/jira/browse/HADOOP-12956 I really appreciate if you are using slf4j APIs in the code instead of other logging APIs. Thanks and regards, Akira

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

Thanks Andrew! +1 (binding) * Verified signatures and checksums * Built from source on CentOS 7.2 with OpenJDK 1.8.0_131 with -Pnative * Deployed pseudo-distributed cluster and ran some example job * The change log and the release notes look good. Regards, Akira On 2017/06/30 11:40, Andrew Wan

Re: Requesting write access for Confluence Wiki

Done. -Akira On 2017/07/18 8:12, Aaron Fabbri wrote: Hi, I'd like to create a troubleshooting page on the Hadoop Confluence wiki for HADOOP-14467. Can someone please grant me access? Account under fab...@apache.org. - To

Re: Maven inconsistently overriding Zookeeper version

Hi Sean, Probably test scope is missing in the zookeeper dependency of hadoop-yarn-server-resource-manager test-jar. Attaching a patch to fix this. Here is a log after applying the patch: https://gist.github.com/aajisaka/057cb3d6d26c05a541f5b5de06f70ded Regards, Akira On 2017/07/19 2:26, Sean

Re: Maven inconsistently overriding Zookeeper version

Filed YARN-6859 and attached the patch there. -Akira On 2017/07/19 14:06, Akira Ajisaka wrote: Hi Sean, Probably test scope is missing in the zookeeper dependency of hadoop-yarn-server-resource-manager test-jar. Attaching a patch to fix this. Here is a log after applying the patch: https

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin for the work! I have a question: Where are the maven artifacts deployed? -Akira On 2017/07/30 8:29, Konstantin Shvachko wrote: Hi everybody, Here is the next release of Apache Hadoop 2.7 line. The previous stable release 2.7.3 was available since 25 August, 2016. Release 2.7.

<    1   2   3   4   5   6   7   8   9   10   >