Re: [VOTE] Hadoop 3.2.x EOL

2023-12-06 Thread Akira Ajisaka
+1 On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote: > Dear Hadoop devs, > > Given the feedback from the discussion thread [1], I'd like to start > an official thread for the community to vote on release line 3.2 EOL. > > It will include, > a. An official announcement informs no further regula

[jira] [Resolved] (HDFS-16878) TestLeaseRecovery2 timeouts

2022-12-29 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16878. -- Resolution: Duplicate Dup of HDFS-16853. Closing. > TestLeaseRecovery2 timeo

[jira] [Created] (HDFS-16878) TestLeaseRecovery2 timeouts

2022-12-29 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16878: Summary: TestLeaseRecovery2 timeouts Key: HDFS-16878 URL: https://issues.apache.org/jira/browse/HDFS-16878 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-16766) XML External Entity (XXE) attacks can occur while processing XML received from an untrusted source

2022-09-26 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16766. -- Fix Version/s: 3.4.0 3.3.9 3.2.5 Resolution: Fixed

[jira] [Resolved] (HDFS-16729) RBF: fix some unreasonably annotated docs

2022-08-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16729. -- Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed Committed to trunk and

Re: [DISCUSS] Hadoop 3.2.4 release

2022-07-10 Thread Akira Ajisaka
Thank you Masatake for proceeding the release process. -Akira On Mon, Jul 11, 2022 at 10:12 AM Masatake Iwasaki wrote: > I'm going to cut branch-3.2.4 today. > If we need more time for 3.3.4 to fix the issue around HADOOP-18033, > 3.2.4 can be released first. > > Thanks, > Masatake Iwasaki > >

[jira] [Resolved] (HDFS-16064) HDFS-721 causes DataNode decommissioning to get stuck indefinitely

2022-06-19 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16064. -- Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed Merged the PR into

[jira] [Created] (HDFS-16635) Fix javadoc error in Java 11

2022-06-16 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16635: Summary: Fix javadoc error in Java 11 Key: HDFS-16635 URL: https://issues.apache.org/jira/browse/HDFS-16635 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-16576) Remove unused Imports in Hadoop HDFS project

2022-06-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16576. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. > Remove unused Imports

[jira] [Resolved] (HDFS-16608) Fix the link in TestClientProtocolForPipelineRecovery

2022-06-06 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16608. -- Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed Committed to trunk and

[jira] [Resolved] (HDFS-16604) Install gtest via FetchContent_Declare in CMake

2022-05-31 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16604. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR into trunk. > Install gtest

[jira] [Resolved] (HDFS-16453) Upgrade okhttp from 2.7.5 to 4.9.3

2022-05-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16453. -- Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed Committed to trunk and

[jira] [Resolved] (HDFS-16185) Fix comment in LowRedundancyBlocks.java

2022-05-07 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16185. -- Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution: Fixed

Re: [VOTE] Release Apache Hadoop 3.3.3

2022-05-07 Thread Akira Ajisaka
Hi Chao, How about using https://repository.apache.org/content/repositories/orgapachehadoop-1348/ instead of https://repository.apache.org/content/repositories/staging/ ? Akira On Sat, May 7, 2022 at 10:52 AM Ayush Saxena wrote: > Hmm, I see the artifacts ideally should have got overwritten by

[jira] [Resolved] (HDFS-16255) RBF: Fix dead link to fedbalance document

2022-04-24 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16255. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thank you [~groot] for your

[jira] [Resolved] (HDFS-16546) Fix UT TestOfflineImageViewer#testReverseXmlWithoutSnapshotDiffSection to branch branch-3.2

2022-04-21 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16546. -- Fix Version/s: 3.2.4 Resolution: Fixed Committed to branch-3.2. Thank you [~cndaimin

[jira] [Resolved] (HDFS-16035) Remove DummyGroupMapping as it is not longer used anywhere

2022-04-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16035. -- Resolution: Fixed Thank you [~vjasani] for your report and thank you [~groot] for your

[jira] [Resolved] (HDFS-16536) TestOfflineImageViewer fails on branch-3.3

2022-04-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16536. -- Fix Version/s: 3.3.4 Resolution: Fixed Committed to branch-3.3. Thank you [~groot

[jira] [Created] (HDFS-16536) TestOfflineImageViewer fails on branch-3.3

2022-04-10 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16536: Summary: TestOfflineImageViewer fails on branch-3.3 Key: HDFS-16536 URL: https://issues.apache.org/jira/browse/HDFS-16536 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-16529) Remove unnecessary setObserverRead in TestConsistentReadsObserver

2022-04-06 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16529. -- Fix Version/s: 3.4.0 2.10.2 3.2.4

[jira] [Resolved] (HDFS-16527) Add global timeout rule for TestRouterDistCpProcedure

2022-04-05 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16527. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thank you [~tomscut] for

Re: [E] [NOTICE] Attaching patches in JIRA issue no longer works

2022-03-31 Thread Akira Ajisaka
s on both is confusing and splitting information. I would >> rather use JIRA with patches or GitHub Issues with PRs. I think anything in >> between splits information and makes it hard to find. >> >> Eric >> >> On Sun, Mar 27, 2022 at 1:25 PM Akira Ajisaka >

[NOTICE] Attaching patches in JIRA issue no longer works

2022-03-27 Thread Akira Ajisaka
Dear Hadoop developers, I've disabled the Precommit-(HADOOP|HDFS|MAPREDUCE|YARN)-Build jobs. If you attach a patch to a JIRA issue, the Jenkins precommit job won't run. Please use GitHub PR for code review. Background: - https://issues.apache.org/jira/browse/HADOOP-17798 - https://lists.apache.or

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

2022-03-27 Thread Akira Ajisaka
opers and the reviewers spending more time discussing in the > PR. > >> > - the relation between a single Jira and Github-PR is 1-to-M. In order > >> to > >> > find related discussions, the user may > >> >need to visit every PR (that may includ

[jira] [Resolved] (HDFS-16355) Improve the description of dfs.block.scanner.volume.bytes.per.second

2022-03-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16355. -- Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution: Fixed

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-26 Thread Akira Ajisaka
+1 (binding) - Verified the signatures and the checksums - Built from source using the "start-build-env.sh" from Ubuntu laptop. - Setup pseudo cluster and ran some mapreduce jobs. - Checked the Web UIs and the daemon logs. Thanks, Akira On Sun, Mar 20, 2022 at 2:33 PM Masatake Iwasaki < iwasak..

[jira] [Created] (HDFS-16523) Fix dependency error in hadoop-hdfs

2022-03-26 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16523: Summary: Fix dependency error in hadoop-hdfs Key: HDFS-16523 URL: https://issues.apache.org/jira/browse/HDFS-16523 Project: Hadoop HDFS Issue Type: Bug

Re: [DISCUSS] Hadoop 2.10.2 release

2022-03-13 Thread Akira Ajisaka
Thank you Masatake. +1 to release 2.10.2. On Fri, Mar 4, 2022 at 6:52 PM Masatake Iwasaki wrote: > Hi team, > > There are over 170 fixed issues in branch-2.10 after the release of > 2.10.1[1]. > Given that there is still a need for 2.10.x, I would like to release 2.10.2 > after HADOOP-18088[2]

[jira] [Resolved] (HDFS-16449) Fix hadoop web site release notes and changelog not available

2022-02-13 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16449. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR into trunk. > Fix hadoop web s

[jira] [Resolved] (HDFS-16443) Fix edge case where DatanodeAdminDefaultMonitor doubly enqueues a DatanodeDescriptor on exception

2022-01-30 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16443. -- Fix Version/s: 3.2.4 Resolution: Fixed Backported to branch-3.2. > Fix edge case wh

[jira] [Resolved] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-30 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16303. -- Resolution: Fixed > Losing over 100 datanodes in state decommissioning results in f

[jira] [Resolved] (HDFS-16441) The following error occurs when accessing webhdfs in Kerberos security mode:Failed to obtain user group information: java.io.IOException: Security enabled but user not a

2022-01-28 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16441. -- Resolution: Invalid Hi [~xiaoqiuqiu] - In Apache Hadoop community, JIRA is used for the

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-28 Thread Akira Ajisaka
Thanks, Akira. >> >> I confirmed that the issue is fixed in current branch-3.3 containing >> YARN-10561. >> >> On 2022/01/28 14:25, Akira Ajisaka wrote: >> > Hi Masatake, >> > >> > I faced the same error in a clean environment and >> htt

[jira] [Resolved] (HDFS-16169) Fix TestBlockTokenWithDFSStriped#testEnd2End failure

2022-01-28 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16169. -- Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed Committed to trunk and

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-27 Thread Akira Ajisaka
Hi Masatake, I faced the same error in a clean environment and https://issues.apache.org/jira/browse/YARN-10561 should fix this issue. I'll rebase the patch shortly. By the way, I'm afraid there is no active maintainer in hadoop-yarn-applications-catalog module. The module is for a sample applica

Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

2022-01-05 Thread Akira Ajisaka
(Adding builds@) Hi Lewis, Nutch is already using ci-builds.apache.org, so I think Nutch can continue using it. ci-hadoop.apache.org provides almost the same functionality as ci-builds.apache.org and there is no non-production Hadoop cluster running there. Therefore moving to ci-hadoop does not m

[jira] [Resolved] (HDFS-16409) Fix typo: testHasExeceptionsReturnsCorrectValue -> testHasExceptionsReturnsCorrectValue

2022-01-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16409. -- Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution: Fixed

[jira] [Resolved] (HDFS-16395) Remove useless NNThroughputBenchmark#dummyActionNoSynch()

2021-12-24 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16395. -- Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution: Fixed

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC0

2021-12-23 Thread Akira Ajisaka
Hi Chao, > For this, I just need to update the hadoop-project/src/site/markdown/index.md.vm and incorporate notable changes made in 3.3.1/3.3.2, is that correct? > ARM binaries There was a discussion [1] and concluded that ARM binaries are optional. The release vote is only for source code, not b

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC0

2021-12-12 Thread Akira Ajisaka
Thank you Chao Sun for preparing the RC. I've added your public key to the Hadoop KEYS file ( https://downloads.apache.org/hadoop/common/KEYS). Thanks, Akira On Fri, Dec 10, 2021 at 11:10 AM Chao Sun wrote: > Hi all, > > Sorry for the long delay. I've prepared RC0 for Hadoop 3.3.2 below: > > T

[jira] [Resolved] (HDFS-16324) Fix error log in BlockManagerSafeMode

2021-12-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16324. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR into trunk. > Fix error log

[jira] [Resolved] (HDFS-16314) Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-12-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16314. -- Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed Committed to trunk and

[jira] [Resolved] (HDFS-16171) De-flake testDecommissionStatus

2021-11-25 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16171. -- Fix Version/s: 3.2.4 Resolution: Fixed Merged PR #3720 into branch-3.2. > De-fl

[jira] [Resolved] (HDFS-16334) Correct NameNode ACL description

2021-11-21 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16334. -- Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed Committed to trunk and

[jira] [Resolved] (HDFS-16328) Correct disk balancer param desc

2021-11-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16328. -- Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution: Fixed

[jira] [Resolved] (HDFS-16330) Fix incorrect placeholder for Exception logs in DiskBalancer

2021-11-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16330. -- Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution: Fixed

[jira] [Resolved] (HDFS-16329) Fix log format for BlockManager

2021-11-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16329. -- Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution: Fixed

[jira] [Resolved] (HDFS-14240) blockReport test in NNThroughputBenchmark throws ArrayIndexOutOfBoundsException

2021-11-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-14240. -- Assignee: (was: Ranith Sardar) Resolution: Duplicate Closing as duplicate

[jira] [Resolved] (HDFS-16269) [Fix] Improve NNThroughputBenchmark#blockReport operation

2021-11-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16269. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thank you [~jianghuazhu] for

[jira] [Resolved] (HDFS-16257) [HDFS] [RBF] Guava cache performance issue in Router MountTableResolver

2021-10-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16257. -- Fix Version/s: 2.10.2 Resolution: Fixed Committed to branch-2.10. > [HDFS] [RBF] Gu

[jira] [Resolved] (HDFS-16276) RBF: Remove the useless configuration of rpc isolation in md

2021-10-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16276. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thank you [~zhuxiangyi] for

[jira] [Resolved] (HDFS-16258) HDFS-13671 breaks TestBlockManager in branch-3.2

2021-10-06 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16258. -- Resolution: Cannot Reproduce It passed in the latest qbt job. Closing. https://ci

Re: Hadoop-3.2.3 Release Update

2021-10-05 Thread Akira Ajisaka
ahma Reddy Battula >>>> wrote: >>>> >>>>> Hi All, >>>>> >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this >>>>> can >>>>> be done by this week,then I will try to create the RC next if there

[jira] [Created] (HDFS-16256) Minor fixes in HDFS Fedbalance document

2021-10-05 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16256: Summary: Minor fixes in HDFS Fedbalance document Key: HDFS-16256 URL: https://issues.apache.org/jira/browse/HDFS-16256 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-16255) Fix dead link to fedbalance document

2021-10-05 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16255: Summary: Fix dead link to fedbalance document Key: HDFS-16255 URL: https://issues.apache.org/jira/browse/HDFS-16255 Project: Hadoop HDFS Issue Type: Sub

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

2021-09-28 Thread Akira Ajisaka
Hi Masatake, The problem comes from the removal of com.sun.tools.doclets.* packages in Java 10. In Apache Hadoop, I removed the doclet support for filtering javadocs when the environment is Java 10 or upper. https://issues.apache.org/jira/browse/HADOOP-15304 Thanks, Akira On Tue, Sep 28, 2021 at

[jira] [Resolved] (HDFS-15864) TestFsDatasetImpl#testDnRestartWithHardLink fails intermittently

2021-09-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-15864. -- Resolution: Duplicate Closing as duplicate of HDFS-16213. Thank you [~touchida] for your

[jira] [Reopened] (HDFS-16219) RBF: Set default map tasks and bandwidth in RouterFederationRename

2021-09-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HDFS-16219: -- Thank you [~vjasani] for your comment. Reopened this. > RBF: Set default map tasks and bandwi

[jira] [Resolved] (HDFS-16219) RBF: Set default map tasks and bandwidth in RouterFederationRename

2021-09-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16219. -- Resolution: Duplicate Fixed as part of HDFS-16217. > RBF: Set default map tasks and bandwi

[jira] [Resolved] (HDFS-16217) RBF: Set default value of hdfs.fedbalance.procedure.scheduler.journal.uri

2021-09-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16217. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR. > RBF: Set default value

[jira] [Resolved] (HDFS-16219) RBF: Set default map tasks and bandwidth in RouterFederationRename

2021-09-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16219. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR. > RBF: Set default map tasks

[jira] [Reopened] (HDFS-16219) RBF: Set default map tasks and bandwidth in RouterFederationRename

2021-09-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HDFS-16219: -- > RBF: Set default map tasks and bandwidth in RouterFederationRen

[jira] [Resolved] (HDFS-16218) RBF: RouterFedbalance should load HDFS config

2021-09-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16218. -- Fix Version/s: 3.4.0 Resolution: Fixed Thank you! Merged into trunk. >

[jira] [Created] (HDFS-16219) RBF: Set default map tasks and bandwidth in RouterFederationRename

2021-09-09 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16219: Summary: RBF: Set default map tasks and bandwidth in RouterFederationRename Key: HDFS-16219 URL: https://issues.apache.org/jira/browse/HDFS-16219 Project: Hadoop

[jira] [Created] (HDFS-16218) RBF: RouterFedbalance should load HDFS config

2021-09-09 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16218: Summary: RBF: RouterFedbalance should load HDFS config Key: HDFS-16218 URL: https://issues.apache.org/jira/browse/HDFS-16218 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-16217) RBF: Set default value of hdfs.fedbalance.procedure.scheduler.journal.uri

2021-09-09 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16217: Summary: RBF: Set default value of hdfs.fedbalance.procedure.scheduler.journal.uri Key: HDFS-16217 URL: https://issues.apache.org/jira/browse/HDFS-16217 Project

[jira] [Created] (HDFS-16185) Fix comment in LowRedundancyBlocks.java

2021-08-24 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16185: Summary: Fix comment in LowRedundancyBlocks.java Key: HDFS-16185 URL: https://issues.apache.org/jira/browse/HDFS-16185 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-16171) De-flake testDecommissionStatus

2021-08-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16171. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. > De-fl

Re: Hadoop-3.2.3 Release Update

2021-08-15 Thread Akira Ajisaka
Thanks Brahma for cutting branch-3.2.3. In Apache Bigtop, there are some patches applied to Hadoop 3.2.2. https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop In these patches, how about backporting the following issues to branch-3.2 and branch-3.2.3? - HADOOP-14922 - HA

[jira] [Reopened] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-08-12 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HDFS-15878: -- This test still fails. > RBF: Flaky test > TestRouterWebHDFSContract

[jira] [Resolved] (HDFS-16172) TestRouterWebHDFSContractCreate fails

2021-08-12 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16172. -- Resolution: Duplicate > TestRouterWebHDFSContractCreate fa

[jira] [Created] (HDFS-16172) TestRouterWebHDFSContractCreate fails

2021-08-12 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16172: Summary: TestRouterWebHDFSContractCreate fails Key: HDFS-16172 URL: https://issues.apache.org/jira/browse/HDFS-16172 Project: Hadoop HDFS Issue Type: Test

[jira] [Resolved] (HDFS-16151) Improve the parameter comments related to ProtobufRpcEngine2#Server()

2021-08-07 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16151. -- Fix Version/s: 3.3.2 3.4.0 Hadoop Flags: Reviewed Resolution

Re: [DISCUSS] Hadoop 3.2.3 release

2021-08-02 Thread Akira Ajisaka
t 2:05 PM Xiaoqiao He wrote: >> >> >> >>> Thanks Brahma for volunteering and driving this release plan. I just >> >>> created a dashboard for 3.2.3 release[1]. >> >>> I would like to support for this release line if need. (cc Brahma) >> >>

[jira] [Created] (HDFS-16143) TestEditLogTailer#testStandbyTriggersLogRollsWhenTailInProgressEdits is flaky

2021-07-25 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16143: Summary: TestEditLogTailer#testStandbyTriggersLogRollsWhenTailInProgressEdits is flaky Key: HDFS-16143 URL: https://issues.apache.org/jira/browse/HDFS-16143 Project

[jira] [Resolved] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with Hadoop 3.x

2021-07-25 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-12920. -- Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution: Fixed

[jira] [Created] (HDFS-16142) TestObservernode#testMkdirsRaceWithObserverRead is flaky

2021-07-25 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16142: Summary: TestObservernode#testMkdirsRaceWithObserverRead is flaky Key: HDFS-16142 URL: https://issues.apache.org/jira/browse/HDFS-16142 Project: Hadoop HDFS

[jira] [Created] (HDFS-16140) TestBootstrapAliasmap fails by BindException

2021-07-24 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16140: Summary: TestBootstrapAliasmap fails by BindException Key: HDFS-16140 URL: https://issues.apache.org/jira/browse/HDFS-16140 Project: Hadoop HDFS Issue Type

Re: [DISCUSS] Hadoop 3.2.3 release

2021-07-23 Thread Akira Ajisaka
Hi Brahma, Thank you for volunteering! -Akira On Fri, Jul 23, 2021 at 5:57 PM Brahma Reddy Battula wrote: > > Hi Akira, > > Thanks for bringing this.. > > I want to drive this if nobody already plan to do this.. > > > On Thu, 22 Jul 2021 at 8:48 AM, Akira A

[DISCUSS] Hadoop 3.2.3 release

2021-07-21 Thread Akira Ajisaka
Hi all, Hadoop 3.2.2 was released half a year ago, and now, we have accumulated more than 230 commits [1]. Therefore I want to start the release work for 3.2.3. There is one blocker for 3.2.3 [2]. - https://issues.apache.org/jira/browse/HDFS-12920 Is there anyone who would volunteer to be the 3.

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-07-21 Thread Akira Ajisaka
Based on the positive feedback, filed https://issues.apache.org/jira/browse/HADOOP-17813 to update the checkstyle rule. I don't think it requires a vote thread. Thanks and regards, Akira On Sun, Jun 13, 2021 at 1:14 AM Steve Loughran wrote: > > +1 > > if you look closely the hadoop-azure module

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

2021-07-13 Thread Akira Ajisaka
Thank you Wei-Chiu for starting the discussion, > 3. JIRA security I'm +1 to use private JIRA issues to handle vulnerabilities. > 5. Doc update +1, I build the document daily and it helps me fixing documents: https://aajisaka.github.io/hadoop-document/ It's great if the latest document is built a

[jira] [Resolved] (HDFS-16109) Fix flaky some unit tests since they offen timeout

2021-07-04 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16109. -- Fix Version/s: 3.3.2 3.4.0 Hadoop Flags: Reviewed Resolution

[jira] [Resolved] (HDFS-15653) dfshealth.html#tab-overview is not working

2021-06-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-15653. -- Resolution: Not A Problem > dfshealth.html#tab-overview is not work

[jira] [Reopened] (HDFS-15653) dfshealth.html#tab-overview is not working

2021-06-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HDFS-15653: -- > dfshealth.html#tab-overview is not work

[jira] [Reopened] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2021-06-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HDFS-15272: -- > Backport HDFS-12862 to branch-3.1 > - > >

[jira] [Resolved] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2021-06-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-15272. -- Resolution: Won't Fix branch-3.1 is EoL. Closing as won't fix. > Backport

Re: [VOTE] Hadoop 3.1.x EOL

2021-06-10 Thread Akira Ajisaka
This vote has passed with 18 binding +1. I'll update the JIRA and the wiki. Thanks all for your participation. On Tue, Jun 8, 2021 at 3:03 AM Steve Loughran wrote: > > > > On Thu, 3 Jun 2021 at 07:14, Akira Ajisaka wrote: >> >> Dear Hadoop developers, >

[jira] [Created] (HDFS-16059) dfsadmin -listOpenFiles -blockingDecommission can miss some files

2021-06-09 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16059: Summary: dfsadmin -listOpenFiles -blockingDecommission can miss some files Key: HDFS-16059 URL: https://issues.apache.org/jira/browse/HDFS-16059 Project: Hadoop HDFS

[VOTE] Hadoop 3.1.x EOL

2021-06-02 Thread Akira Ajisaka
Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an official announcement that no further regular Hadoop 3.1.x releases will be made after 3.1.4. (2

Re: [DISCUSS] which release lines should we still consider actively maintained?

2021-06-02 Thread Akira Ajisaka
dea. > >> > >> > >> > >> For Hadoop 3.3 line: If no one beats me, I plan to make a 3.3.2 in 2-3 > >> months. And another one in another 2-3 months. > >> The Hadoop 3.3.1 has nearly 700 commits not in 3.3.0. It is very difficult > >> to mak

[jira] [Created] (HDFS-16050) Some dynamometer tests fail

2021-05-31 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16050: Summary: Some dynamometer tests fail Key: HDFS-16050 URL: https://issues.apache.org/jira/browse/HDFS-16050 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-16046) TestBalanceProcedureScheduler and TestDistCpProcedure timeout

2021-05-29 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16046. -- Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

2021-05-27 Thread Akira Ajisaka
+1 - Verified checksums and signatures - Built from source with -Psrc profile - Checked the documents - Compiled Hadoop trunk and branch-3.3 with Hadoop third-party 1.1.1. -Akira On Wed, May 26, 2021 at 5:29 PM Wei-Chiu Chuang wrote: > > Hi folks, > > I have put together a release candidate (RC

[jira] [Created] (HDFS-16046) TestBalanceProcedureScheduler timeouts

2021-05-27 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16046: Summary: TestBalanceProcedureScheduler timeouts Key: HDFS-16046 URL: https://issues.apache.org/jira/browse/HDFS-16046 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-16031) Possible Resource Leak in org.apache.hadoop.hdfs.server.aliasmap#InMemoryAliasMap

2021-05-25 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-16031. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk

Re: [DISCUSS] which release lines should we still consider actively maintained?

2021-05-23 Thread Akira Ajisaka
Hi Sean, Thank you for starting the discussion. I think branch-2.10, branch-3.1, branch-3.2, branch-3.3, and trunk (3.4.x) are actively maintained. The next releases will be: - 3.4.0 - 3.3.1 (Thanks, Wei-Chiu!) - 3.2.3 - 3.1.5 - 2.10.2 > Are there folks willing to go through being release manag

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-19 Thread Akira Ajisaka
I'm +1 to allow <= 100 chars. FYI: There were some discussions long before: - https://lists.apache.org/thread.html/7813c2f8a49b1d1e7655dad180f2d915a280b2f4d562cfe981e1dd4e%401406489966%40%3Ccommon-dev.hadoop.apache.org%3E - https://lists.apache.org/thread.html/3e1785cbbe14dcab9bb970fa0f534811cfe

Re: [VOTE] hadoop-thirdparty 1.1.0-RC0

2021-05-13 Thread Akira Ajisaka
+1 - Verified checksums and signatures - Built from source with -Psrc profile - Checked the documents -Akira On Thu, May 13, 2021 at 8:55 PM Wei-Chiu Chuang wrote: > > Hello my fellow Hadoop developers, > > I am putting together the first release candidate (RC0) for > Hadoop-thirdparty 1.1.0. T

[jira] [Created] (HDFS-16006) TestRouterFederationRename is flaky

2021-05-03 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16006: Summary: TestRouterFederationRename is flaky Key: HDFS-16006 URL: https://issues.apache.org/jira/browse/HDFS-16006 Project: Hadoop HDFS Issue Type: Sub-task

  1   2   3   4   5   6   >