Re: [VOTE] Hadoop 3.2.x EOL

2023-12-06 Thread Akira Ajisaka
+1 On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote: > Dear Hadoop devs, > > Given the feedback from the discussion thread [1], I'd like to start > an official thread for the community to vote on release line 3.2 EOL. > > It will include, > a. An official announcement informs no further

Re: [DISCUSS] YARN code maintenance

2023-07-02 Thread Akira Ajisaka
Hi Wei-Chiu, Thank you for starting the discussion. I thought the same thing about 2 years ago when I tried to upgrade the Jersey version in https://issues.apache.org/jira/browse/HADOOP-15984 and found it's really hard to upgrade it in YARN. Now I still think it makes sense to move the code to

[jira] [Resolved] (YARN-11187) Remove WhiteBox in yarn module.

2022-10-06 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11187. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thank you [~slfan1989

[jira] [Resolved] (YARN-11301) Fix NoClassDefFoundError: org/junit/platform/launcher/core/LauncherFactory after YARN-11269

2022-09-13 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11301. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk

[jira] [Resolved] (YARN-11241) Add uncleaning option for local app log file with log-aggregation enabled

2022-09-12 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11241. -- Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed Committed to trunk

[jira] [Resolved] (YARN-11287) Fix NoClassDefFoundError: org/junit/platform/launcher/core/LauncherFactory After YARN-10793

2022-08-30 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11287. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thank you [~slfan1989

[jira] [Resolved] (YARN-11254) hadoop-minikdc dependency duplicated in hadoop-yarn-server-nodemanager pom.xml

2022-08-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11254. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thank you [~clara0

[jira] [Resolved] (YARN-11257) Add junit5 dependency to hadoop-yarn-server-timeline-pluginstorage to fix few unit test failure

2022-08-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11257. -- Resolution: Duplicate This issue has been fixed by YARN-11269. Closing. > Add jun

[jira] [Resolved] (YARN-11248) Add unit test for FINISHED_CONTAINERS_PULLED_BY_AM event on DECOMMISSIONING

2022-08-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11248. -- Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed Committed to trunk

[jira] [Resolved] (YARN-10793) Upgrade Junit from 4 to 5 in hadoop-yarn-server-applicationhistoryservice

2022-08-07 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10793. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thank you [~groot] for your

Re: [DISCUSS] Hadoop 3.2.4 release

2022-07-10 Thread Akira Ajisaka
Thank you Masatake for proceeding the release process. -Akira On Mon, Jul 11, 2022 at 10:12 AM Masatake Iwasaki wrote: > I'm going to cut branch-3.2.4 today. > If we need more time for 3.3.4 to fix the issue around HADOOP-18033, > 3.2.4 can be released first. > > Thanks, > Masatake Iwasaki > >

[jira] [Resolved] (YARN-11119) Backport YARN-10538 to branch-2.10

2022-06-26 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-9. -- Fix Version/s: 2.10.3 Resolution: Fixed Committed to branch-2.10. Thank you [~groot

[jira] [Resolved] (YARN-10303) One yarn rest api example of yarn document is error

2022-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10303. -- Resolution: Fixed > One yarn rest api example of yarn document is er

[jira] [Resolved] (YARN-11128) Fix comments in TestProportionalCapacityPreemptionPolicy*

2022-05-26 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11128. -- Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed Committed to trunk

[jira] [Resolved] (YARN-11092) Upgrade jquery ui to 1.13.1

2022-05-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11092. -- Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution: Fixed

[jira] [Resolved] (YARN-11125) Backport YARN-6483 to branch-2.10

2022-05-13 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11125. -- Fix Version/s: 2.10.2 Resolution: Fixed Merged the PR into branch-2.10. Thank you

[jira] [Created] (YARN-11149) Add regression test cases for YARN-11073

2022-05-13 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-11149: Summary: Add regression test cases for YARN-11073 Key: YARN-11149 URL: https://issues.apache.org/jira/browse/YARN-11149 Project: Hadoop YARN Issue Type

[jira] [Resolved] (YARN-11073) CapacityScheduler DRF Preemption kicked in incorrectly for low-capacity queues

2022-05-13 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11073. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR into trunk. Let's add test cases

Re: [VOTE] Release Apache Hadoop 3.3.3

2022-05-07 Thread Akira Ajisaka
Hi Chao, How about using https://repository.apache.org/content/repositories/orgapachehadoop-1348/ instead of https://repository.apache.org/content/repositories/staging/ ? Akira On Sat, May 7, 2022 at 10:52 AM Ayush Saxena wrote: > Hmm, I see the artifacts ideally should have got overwritten

[jira] [Resolved] (YARN-11116) Migrate Times util from SimpleDateFormat to thread-safe DateTimeFormatter class

2022-05-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-6. -- Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution: Fixed

[jira] [Resolved] (YARN-10187) Removing hadoop-yarn-project/hadoop-yarn/README as it is no longer maintained.

2022-05-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10187. -- Fix Version/s: 3.2.4 3.3.4 Resolution: Fixed Backported to branch

[jira] [Resolved] (YARN-3224) Notify AM with containers (on decommissioning node) could be preempted after timeout.

2022-05-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-3224. - Assignee: (was: Sunil G) Resolution: Fixed Duplicate of YARN-6483. Closing > Notify

[jira] [Resolved] (YARN-11101) Fix TestYarnConfigurationFields

2022-04-06 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11101. -- Resolution: Duplicate > Fix TestYarnConfigurationFie

Re: [E] [NOTICE] Attaching patches in JIRA issue no longer works

2022-03-31 Thread Akira Ajisaka
her use JIRA with patches or GitHub Issues with PRs. I think anything in >> between splits information and makes it hard to find. >> >> Eric >> >> On Sun, Mar 27, 2022 at 1:25 PM Akira Ajisaka >> wrote: >> >>> Dear Hadoop developers, >>>

[NOTICE] Attaching patches in JIRA issue no longer works

2022-03-27 Thread Akira Ajisaka
Dear Hadoop developers, I've disabled the Precommit-(HADOOP|HDFS|MAPREDUCE|YARN)-Build jobs. If you attach a patch to a JIRA issue, the Jenkins precommit job won't run. Please use GitHub PR for code review. Background: - https://issues.apache.org/jira/browse/HADOOP-17798 -

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

2022-03-27 Thread Akira Ajisaka
pers and the reviewers spending more time discussing in the > PR. > >> > - the relation between a single Jira and Github-PR is 1-to-M. In order > >> to > >> > find related discussions, the user may > >> >need to visit every PR (that may include clo

[jira] [Created] (YARN-11102) Fix spotbugs error in hadoop-sls module

2022-03-27 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-11102: Summary: Fix spotbugs error in hadoop-sls module Key: YARN-11102 URL: https://issues.apache.org/jira/browse/YARN-11102 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-11101) Fix TestYarnConfigurationFields

2022-03-27 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-11101: Summary: Fix TestYarnConfigurationFields Key: YARN-11101 URL: https://issues.apache.org/jira/browse/YARN-11101 Project: Hadoop YARN Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-26 Thread Akira Ajisaka
+1 (binding) - Verified the signatures and the checksums - Built from source using the "start-build-env.sh" from Ubuntu laptop. - Setup pseudo cluster and ran some mapreduce jobs. - Checked the Web UIs and the daemon logs. Thanks, Akira On Sun, Mar 20, 2022 at 2:33 PM Masatake Iwasaki <

Re: [DISCUSS] Hadoop 2.10.2 release

2022-03-13 Thread Akira Ajisaka
Thank you Masatake. +1 to release 2.10.2. On Fri, Mar 4, 2022 at 6:52 PM Masatake Iwasaki wrote: > Hi team, > > There are over 170 fixed issues in branch-2.10 after the release of > 2.10.1[1]. > Given that there is still a need for 2.10.x, I would like to release 2.10.2 > after HADOOP-18088[2]

[jira] [Resolved] (YARN-11081) TestYarnConfigurationFields consistently keeps failing

2022-03-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11081. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR into trunk. Thank you [~vjasani

[jira] [Resolved] (YARN-11068) Update transitive log4j2 dependency to 2.17.1

2022-02-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11068. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR#3963 into trunk. > Upd

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-28 Thread Akira Ajisaka
anks, Akira. >> >> I confirmed that the issue is fixed in current branch-3.3 containing >> YARN-10561. >> >> On 2022/01/28 14:25, Akira Ajisaka wrote: >> > Hi Masatake, >> > >> > I faced the same error in a clean environment and >> https://

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-27 Thread Akira Ajisaka
Hi Masatake, I faced the same error in a clean environment and https://issues.apache.org/jira/browse/YARN-10561 should fix this issue. I'll rebase the patch shortly. By the way, I'm afraid there is no active maintainer in hadoop-yarn-applications-catalog module. The module is for a sample

[jira] [Resolved] (YARN-11065) Bump follow-redirects from 1.13.3 to 1.14.7 in hadoop-yarn-ui

2022-01-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11065. -- Fix Version/s: 3.4.0 Resolution: Fixed > Bump follow-redirects from 1.13.3 to 1.1

[jira] [Created] (YARN-11065) Bump follow-redirects from 1.13.3 to 1.14.7 in hadoop-yarn-ui

2022-01-20 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-11065: Summary: Bump follow-redirects from 1.13.3 to 1.14.7 in hadoop-yarn-ui Key: YARN-11065 URL: https://issues.apache.org/jira/browse/YARN-11065 Project: Hadoop YARN

[jira] [Resolved] (YARN-11055) In cgroups-operations.c some fprintf format strings don't end with "\n"

2022-01-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11055. -- Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution: Fixed

Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

2022-01-05 Thread Akira Ajisaka
(Adding builds@) Hi Lewis, Nutch is already using ci-builds.apache.org, so I think Nutch can continue using it. ci-hadoop.apache.org provides almost the same functionality as ci-builds.apache.org and there is no non-production Hadoop cluster running there. Therefore moving to ci-hadoop does not

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC0

2021-12-23 Thread Akira Ajisaka
Hi Chao, > For this, I just need to update the hadoop-project/src/site/markdown/index.md.vm and incorporate notable changes made in 3.3.1/3.3.2, is that correct? > ARM binaries There was a discussion [1] and concluded that ARM binaries are optional. The release vote is only for source code, not

[jira] [Resolved] (YARN-9967) Fix NodeManager failing to start when Hdfs Auxillary Jar is set

2021-12-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-9967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-9967. - Resolution: Duplicate Fixed by YARN-11053. Closing as duplicate. > Fix NodeManager fail

[jira] [Resolved] (YARN-11053) AuxService should not use class name as default system classes

2021-12-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11053. -- Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed Committed to trunk

[jira] [Resolved] (YARN-11051) FileNotFoundException: /tmp/hadoop-maprchin/nm-local-dir/filecache/970

2021-12-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11051. -- Resolution: Invalid Hadoop JIRA is not for end-user question. BTW, I suppose you should ask

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC0

2021-12-12 Thread Akira Ajisaka
Thank you Chao Sun for preparing the RC. I've added your public key to the Hadoop KEYS file ( https://downloads.apache.org/hadoop/common/KEYS). Thanks, Akira On Fri, Dec 10, 2021 at 11:10 AM Chao Sun wrote: > Hi all, > > Sorry for the long delay. I've prepared RC0 for Hadoop 3.3.2 below: > >

[jira] [Resolved] (YARN-9515) Non-exclusive labels do not respect user-limit-factor/max-capacity

2021-12-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-9515. - Resolution: Won't Fix > Non-exclusive labels do not respect user-limit-factor/max-capac

[jira] [Resolved] (YARN-9063) ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing

2021-12-06 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-9063. - Fix Version/s: 3.4.0 2.10.2 3.2.4 3.3.3

[jira] [Resolved] (YARN-11007) Correct words in YARN documents

2021-11-25 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-11007. -- Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution: Fixed

[jira] [Resolved] (YARN-10991) Fix to ignore the grouping "[]" for resourcesStr in parseResourcesString method

2021-11-24 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10991. -- Fix Version/s: 3.4.0 3.2.4 3.3.3

[jira] [Resolved] (YARN-10976) Fix resource leak due to Files.walk

2021-10-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10976. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Committed to trunk

Re: Hadoop-3.2.3 Release Update

2021-10-05 Thread Akira Ajisaka
Battula >>>> wrote: >>>> >>>>> Hi All, >>>>> >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this >>>>> can >>>>> be done by this week,then I will try to create the RC next if there is >>

[jira] [Resolved] (YARN-10970) Prometheussink: Standby RM should expose prom endpoint

2021-09-29 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10970. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Committed to trunk

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

2021-09-28 Thread Akira Ajisaka
Hi Masatake, The problem comes from the removal of com.sun.tools.doclets.* packages in Java 10. In Apache Hadoop, I removed the doclet support for filtering javadocs when the environment is Java 10 or upper. https://issues.apache.org/jira/browse/HADOOP-15304 Thanks, Akira On Tue, Sep 28, 2021

Re: Hadoop-3.2.3 Release Update

2021-08-15 Thread Akira Ajisaka
Thanks Brahma for cutting branch-3.2.3. In Apache Bigtop, there are some patches applied to Hadoop 3.2.2. https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop In these patches, how about backporting the following issues to branch-3.2 and branch-3.2.3? - HADOOP-14922 -

[jira] [Resolved] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2021-08-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-8992. - Fix Version/s: 3.2.3 Resolution: Fixed Backported to branch-3.2. > Fair scheduler

[jira] [Resolved] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

2021-08-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-8990. - Fix Version/s: 3.2.3 Resolution: Fixed Backported to branch-3.2. > Fix fair schedu

Re: [DISCUSS] Hadoop 3.2.3 release

2021-08-02 Thread Akira Ajisaka
t 2:05 PM Xiaoqiao He wrote: >> >> >> >>> Thanks Brahma for volunteering and driving this release plan. I just >> >>> created a dashboard for 3.2.3 release[1]. >> >>> I would like to support for this release line if need. (cc Brahma) >> >>

[DISCUSS] Hadoop 3.2.3 release

2021-07-21 Thread Akira Ajisaka
Hi all, Hadoop 3.2.2 was released half a year ago, and now, we have accumulated more than 230 commits [1]. Therefore I want to start the release work for 3.2.3. There is one blocker for 3.2.3 [2]. - https://issues.apache.org/jira/browse/HDFS-12920 Is there anyone who would volunteer to be the

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-07-21 Thread Akira Ajisaka
Based on the positive feedback, filed https://issues.apache.org/jira/browse/HADOOP-17813 to update the checkstyle rule. I don't think it requires a vote thread. Thanks and regards, Akira On Sun, Jun 13, 2021 at 1:14 AM Steve Loughran wrote: > > +1 > > if you look closely the hadoop-azure module

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

2021-07-13 Thread Akira Ajisaka
Thank you Wei-Chiu for starting the discussion, > 3. JIRA security I'm +1 to use private JIRA issues to handle vulnerabilities. > 5. Doc update +1, I build the document daily and it helps me fixing documents: https://aajisaka.github.io/hadoop-document/ It's great if the latest document is built

[jira] [Resolved] (YARN-10847) Build fails on MacOS 10.15

2021-07-06 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10847. -- Resolution: Invalid Please do not change the package name when building Apache Hadoop

[jira] [Created] (YARN-10826) [UI2] Upgrade Node.js to at least 12.x

2021-06-21 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10826: Summary: [UI2] Upgrade Node.js to at least 12.x Key: YARN-10826 URL: https://issues.apache.org/jira/browse/YARN-10826 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-10817) Avoid java.lang.NullPointerException when use yarn shell

2021-06-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10817. -- Fix Version/s: (was: 3.2.1) Resolution: Duplicate > Av

Re: [VOTE] Hadoop 3.1.x EOL

2021-06-10 Thread Akira Ajisaka
This vote has passed with 18 binding +1. I'll update the JIRA and the wiki. Thanks all for your participation. On Tue, Jun 8, 2021 at 3:03 AM Steve Loughran wrote: > > > > On Thu, 3 Jun 2021 at 07:14, Akira Ajisaka wrote: >> >> Dear Hadoop developers, >&

[jira] [Resolved] (YARN-10803) [JDK 11] TestRMFailoverProxyProvider and TestNoHaRMFailoverProxyProvider fails by ClassCastException

2021-06-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10803. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Committed to trunk

[jira] [Resolved] (YARN-10808) TestHBaseTimelineStorageUtils fails by NoClassDefFoundError

2021-06-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10808. -- Resolution: Duplicate > TestHBaseTimelineStorageUtils fails by NoClassDefFoundEr

[jira] [Created] (YARN-10808) TestHBaseTimelineStorageUtils fails by NoClassDefFoundError

2021-06-06 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10808: Summary: TestHBaseTimelineStorageUtils fails by NoClassDefFoundError Key: YARN-10808 URL: https://issues.apache.org/jira/browse/YARN-10808 Project: Hadoop YARN

[jira] [Created] (YARN-10803) [JDK 11] TestRMFailoverProxyProvider and TestNoHaRMFailoverProxyProvider fails by ClassCastException

2021-06-03 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10803: Summary: [JDK 11] TestRMFailoverProxyProvider and TestNoHaRMFailoverProxyProvider fails by ClassCastException Key: YARN-10803 URL: https://issues.apache.org/jira/browse/YARN

[VOTE] Hadoop 3.1.x EOL

2021-06-03 Thread Akira Ajisaka
Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an official announcement that no further regular Hadoop 3.1.x releases will be made after 3.1.4.

Re: [DISCUSS] which release lines should we still consider actively maintained?

2021-06-03 Thread Akira Ajisaka
gt;> > >> > >> For Hadoop 3.3 line: If no one beats me, I plan to make a 3.3.2 in 2-3 > >> months. And another one in another 2-3 months. > >> The Hadoop 3.3.1 has nearly 700 commits not in 3.3.0. It is very difficult > >> to make/validate a maint releas

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

2021-05-27 Thread Akira Ajisaka
+1 - Verified checksums and signatures - Built from source with -Psrc profile - Checked the documents - Compiled Hadoop trunk and branch-3.3 with Hadoop third-party 1.1.1. -Akira On Wed, May 26, 2021 at 5:29 PM Wei-Chiu Chuang wrote: > > Hi folks, > > I have put together a release candidate

[jira] [Created] (YARN-10788) TestCsiClient fails

2021-05-26 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10788: Summary: TestCsiClient fails Key: YARN-10788 URL: https://issues.apache.org/jira/browse/YARN-10788 Project: Hadoop YARN Issue Type: Bug Components

Re: [DISCUSS] which release lines should we still consider actively maintained?

2021-05-23 Thread Akira Ajisaka
Hi Sean, Thank you for starting the discussion. I think branch-2.10, branch-3.1, branch-3.2, branch-3.3, and trunk (3.4.x) are actively maintained. The next releases will be: - 3.4.0 - 3.3.1 (Thanks, Wei-Chiu!) - 3.2.3 - 3.1.5 - 2.10.2 > Are there folks willing to go through being release

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-19 Thread Akira Ajisaka
I'm +1 to allow <= 100 chars. FYI: There were some discussions long before: - https://lists.apache.org/thread.html/7813c2f8a49b1d1e7655dad180f2d915a280b2f4d562cfe981e1dd4e%401406489966%40%3Ccommon-dev.hadoop.apache.org%3E -

[jira] [Created] (YARN-10770) container-executor permission is wrong in SecureContainer.md

2021-05-17 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10770: Summary: container-executor permission is wrong in SecureContainer.md Key: YARN-10770 URL: https://issues.apache.org/jira/browse/YARN-10770 Project: Hadoop YARN

Re: [VOTE] hadoop-thirdparty 1.1.0-RC0

2021-05-13 Thread Akira Ajisaka
+1 - Verified checksums and signatures - Built from source with -Psrc profile - Checked the documents -Akira On Thu, May 13, 2021 at 8:55 PM Wei-Chiu Chuang wrote: > > Hello my fellow Hadoop developers, > > I am putting together the first release candidate (RC0) for > Hadoop-thirdparty 1.1.0.

[jira] [Created] (YARN-10757) jsonschema2pojo-maven-plugin version is not defined

2021-04-27 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10757: Summary: jsonschema2pojo-maven-plugin version is not defined Key: YARN-10757 URL: https://issues.apache.org/jira/browse/YARN-10757 Project: Hadoop YARN

[jira] [Resolved] (YARN-10752) Shaded guava not found when compiling with profile hbase2.0

2021-04-26 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10752. -- Fix Version/s: 3.3.1 Hadoop Flags: Reviewed Resolution: Fixed Merged the PR

[jira] [Resolved] (YARN-10694) Fix spotbugs warning in CapacitySchedulerConfiguration.java

2021-03-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10694. -- Resolution: Duplicate Closing as dup. Thank you [~zhuqi] for the information. > Fix spotb

[jira] [Created] (YARN-10694) Fix spotbugs warning in CapacitySchedulerConfiguration.java

2021-03-15 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10694: Summary: Fix spotbugs warning in CapacitySchedulerConfiguration.java Key: YARN-10694 URL: https://issues.apache.org/jira/browse/YARN-10694 Project: Hadoop YARN

[jira] [Created] (YARN-10662) [JDK 11] TestTimelineReaderWebServicesHBaseStorage fails

2021-03-01 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10662: Summary: [JDK 11] TestTimelineReaderWebServicesHBaseStorage fails Key: YARN-10662 URL: https://issues.apache.org/jira/browse/YARN-10662 Project: Hadoop YARN

[jira] [Created] (YARN-10656) Parsing error in CapacityScheduler.md

2021-02-26 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10656: Summary: Parsing error in CapacityScheduler.md Key: YARN-10656 URL: https://issues.apache.org/jira/browse/YARN-10656 Project: Hadoop YARN Issue Type: Bug

Re: Seeing YETUS issue in jenkins runs

2021-02-22 Thread Akira Ajisaka
e > > doing linux device drivers... > > > > > > > > On Fri, 19 Feb 2021 at 05:53, Akira Ajisaka wrote: > > > > > Probably this issue is due to > > > https://issues.apache.org/jira/browse/HADOOP-16870. Reverted. > > > > > > -Akir

Re: Seeing YETUS issue in jenkins runs

2021-02-18 Thread Akira Ajisaka
Probably this issue is due to https://issues.apache.org/jira/browse/HADOOP-16870. Reverted. -Akira On Fri, Feb 19, 2021 at 11:27 AM Sunil Govindan wrote: > > Hi All, > > We are getting the below error in recent runs. > > -1. yetus. 0m 8s. Unprocessed flag(s): --findbugs-strict-precheck > >

Easy way to run all the unit tests (apache id required)

2021-01-25 Thread Akira Ajisaka
Hi folks, I've prepared a Jenkins on-demand qbt job: https://ci-hadoop.apache.org/job/hadoop-qbt-any-java8-linux-x86_64 If you are tired of touching the source code in the modules to run all the tests (and seeing some broken Jenkins job results), please use this job instead. How to use: - Login

[jira] [Resolved] (YARN-10560) Upgrade node.js to 10.23.1 in Web UI v2

2021-01-05 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10560. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Committed to trunk

[jira] [Created] (YARN-10560) Upgrade node.js to 10.23.1

2021-01-05 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10560: Summary: Upgrade node.js to 10.23.1 Key: YARN-10560 URL: https://issues.apache.org/jira/browse/YARN-10560 Project: Hadoop YARN Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

2021-01-04 Thread Akira Ajisaka
+1 (binding) - Verified the checksums and signatures - Verified the source is the same as the RC5 tag - Built from source with CentOS 7.9 and Java 1.8.0_275 - Setup pseudo cluster and ran some FsShell commands Thanks, Akira On Sun, Jan 3, 2021 at 11:40 PM Xiaoqiao He wrote: > > Hi folks, > >

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-15 Thread Akira Ajisaka
o Sun > HADOOP-15775. [JDK9] Add missing javax.activation-api dependency. > Contributed by Akira Ajisaka. > HDFS-15240. Erasure Coding: dirty buffer causes reconstruction block error. > Contributed by HuangTao. > HDFS-15708. TestURLConnectionFactory fails by NoClassDefFoundError in &g

[DISCUSS] Upgrading Jersey from 1.x

2020-12-14 Thread Akira Ajisaka
Hi folks, Recently I resumed the work for upgrading Jersey: - https://issues.apache.org/jira/browse/HADOOP-15984 - https://github.com/apache/hadoop/pull/763 This upgrade is important because we cannot compile and run Jersey 1.x with Java 11+. However, it is very complicated because: 1. We need

[jira] [Resolved] (YARN-10491) Fix deprecation warnings in SLSWebApp.java

2020-12-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10491. -- Fix Version/s: 3.2.3 3.1.5 3.3.1 3.4.0

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

2020-12-03 Thread Akira Ajisaka
In addition, backported HDFS-13404 to fix TestRouterWebHDFSContractAppend failure. On Fri, Dec 4, 2020 at 10:43 AM Akira Ajisaka wrote: > > I found TestCombineFileInputFormat is failing in branch-3.2.2 and I've > cherry-picked MAPREDUCE-7284 to fix the failure. > > Thanks, >

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

2020-12-03 Thread Akira Ajisaka
I found TestCombineFileInputFormat is failing in branch-3.2.2 and I've cherry-picked MAPREDUCE-7284 to fix the failure. Thanks, Akira On Fri, Dec 4, 2020 at 9:09 AM Chao Sun wrote: > > Thanks Xiaoqiao. I just committed the fix to branch-3.2 (and will port it > to other branches as well later).

[jira] [Resolved] (YARN-10511) Update yarn.nodemanager.env-whitelist value in docs

2020-12-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10511. -- Fix Version/s: 3.2.3 3.1.5 3.3.1 3.4.0

[jira] [Resolved] (YARN-10498) Fix Yarn CapacityScheduler Markdown document

2020-11-29 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10498. -- Fix Version/s: 3.2.3 2.10.2 3.1.5

[jira] [Resolved] (YARN-10488) Several typos in package: org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair

2020-11-24 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-10488. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk

[jira] [Created] (YARN-10500) TestDelegationTokenRenewer fails intermittently

2020-11-24 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10500: Summary: TestDelegationTokenRenewer fails intermittently Key: YARN-10500 URL: https://issues.apache.org/jira/browse/YARN-10500 Project: Hadoop YARN Issue

[jira] [Created] (YARN-10499) TestRouterWebServicesREST fails

2020-11-24 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10499: Summary: TestRouterWebServicesREST fails Key: YARN-10499 URL: https://issues.apache.org/jira/browse/YARN-10499 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-10491) Fix deprecation warnings in SLSWebApp.java

2020-11-16 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10491: Summary: Fix deprecation warnings in SLSWebApp.java Key: YARN-10491 URL: https://issues.apache.org/jira/browse/YARN-10491 Project: Hadoop YARN Issue Type

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC1

2020-11-05 Thread Akira Ajisaka
-1 - YARN resource localization is broken by HADOOP-17306 and it has been reverted. It should be reverted from 3.2.2 as well. (Thank you Jim Brennan for the report!) - Would you include HDFS-15643 in RC2? This fixes checksum error in EC with ISA-L. Thank you He Xiaoqiao for preparing the release

[jira] [Created] (YARN-10474) [JDK 12] TestAsyncDispatcher fails

2020-10-27 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10474: Summary: [JDK 12] TestAsyncDispatcher fails Key: YARN-10474 URL: https://issues.apache.org/jira/browse/YARN-10474 Project: Hadoop YARN Issue Type: Bug

Fixing flaky tests in Apache Hadoop

2020-10-22 Thread Akira Ajisaka
Hi Hadoop developers, Now there are a lot of failing unit tests and there is an issue to tackle this bad situation. https://issues.apache.org/jira/browse/HDFS-15646 Although this issue is in HDFS project, this issue is related to all the Hadoop developers. Please check the above URL, read the

  1   2   3   4   5   >