[jira] [Resolved] (HADOOP-17647) Release Hadoop 3.3.1

[ https://issues.apache.org/jira/browse/HADOOP-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17647. -- Assignee: Wei-Chiu Chuang Resolution: Done The release was published on June

[jira] [Resolved] (HADOOP-19035) CrcUtil/CrcComposer should not throw IOException for non-IO

[ https://issues.apache.org/jira/browse/HADOOP-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19035. -- Fix Version/s: 3.5.0 Resolution: Fixed > CrcUtil/CrcComposer should not th

[jira] [Resolved] (HADOOP-18956) Zookeeper SSL/TLS support in ZKDelegationTokenSecretManager and ZKSignerSecretProvider

[ https://issues.apache.org/jira/browse/HADOOP-18956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18956. -- Fix Version/s: 3.4.0 Resolution: Fixed > Zookeeper SSL/TLS supp

Re: Checksum file for 3.3.6 release slightly wrong

Hi that's a good catch The RC1 was used for official release, and instead of using the build script to create an entirely new release tarball I simply updated the file names. Probably shouldn't do so. On Fri, Oct 6, 2023 at 6:00 AM Lars Francke wrote: > Hi, > > the checksum file for the 3.3.6

[jira] [Created] (HADOOP-18843) Guava version 32.0.1 bump to fix CVE-2023-2976 (hadoop-thirdparty PR#23)

Wei-Chiu Chuang created HADOOP-18843: Summary: Guava version 32.0.1 bump to fix CVE-2023-2976 (hadoop-thirdparty PR#23) Key: HADOOP-18843 URL: https://issues.apache.org/jira/browse/HADOOP-18843

HADOOP-18207 hadoop-logging module about to land

Hi, I am preparing to resolve HADOOP-18207 ( https://github.com/apache/hadoop/pull/5717). This change affects all modules. With this change, it will eliminate almost all the direct log4j usage. As always, landing such a big piece is tricky. I

Re: [DISCUSS][HDFS] Add rust binding for libhdfs

Inline On Sat, Jul 15, 2023 at 5:04 AM Ayush Saxena wrote: > Forwarding from dev@hadoop to relevant ML > > Original mail: > https://lists.apache.org/thread/r5rcmc7lwwvkysj0320myxltsyokp9kq > > -Ayush > > On 2023/07/15 09:18:42 Xuanwo wrote: > > Hello, everyone. > > > > I'm the maintainer of

[jira] [Resolved] (HADOOP-18766) 3.3.6 Dependency vulnerability check

[ https://issues.apache.org/jira/browse/HADOOP-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18766. -- Fix Version/s: 3.3.6 Resolution: Done > 3.3.6 Dependency vulnerability ch

[jira] [Resolved] (HADOOP-18765) Release 3.3.6

[ https://issues.apache.org/jira/browse/HADOOP-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18765. -- Fix Version/s: 3.3.6 Resolution: Done > Release 3.

[ANNOUNCE] Apache Hadoop 3.3.6 release

On behalf of the Apache Hadoop Project Management Committee, I am pleased to announce the release of Apache Hadoop 3.3.6. It contains 117 bug fixes, improvements and enhancements since 3.3.5. Users of Apache Hadoop 3.3.5 and earlier should upgrade to this release.

[jira] [Resolved] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

[ https://issues.apache.org/jira/browse/HADOOP-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18769. -- Fix Version/s: 3.3.6 Resolution: Fixed > Upgrade hadoop3 docker scri

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

> -Ayush > > > [1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769 > [2] https://github.com/apache/tez/pull/285#issuecomment-1590962978 > > On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi > wrote: > >> +1 (Non-binding). >> Thanks a lot Wei-Chiu

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

hed a pseudo distributed cluster using released binary packages, > > done some HDFS dir/file basic opeations. > > + Run grep, pi and wordcount MR tasks on the pseudo cluster. > > > > Bests, > > Sammi Chen > > > > 发件人: Wei-C

Clean up old Hadoop release tarballs

https://dist.apache.org/repos/dist/release/hadoop/common/ has Hadoop release tarballs 3.3.1 ~ 3.3.5. I plan to remove the tarballs from 3.3.1 to 3.3.4 and leave only 3.3.5 (and the upcoming 3.3.6). Shout out if you have something depending on the old release tarballs (you shouldn't) Other release

DockerHub admin for Apache Hadoop

Ayush and I have acquired the DockerHub admin privilege for the Hadoop project in order to facilitate the release of Hadoop 3.3.6. Apache Infra allows only two seats per project. So if you need something, let Ayush and I know and we will make it happen for you. If you are a Docker guru and can't

[jira] [Resolved] (HADOOP-18780) Add tags 3.3/3.3.5 to the official Hadoop docker image

[ https://issues.apache.org/jira/browse/HADOOP-18780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18780. -- Resolution: Fixed > Add tags 3.3/3.3.5 to the official Hadoop docker im

[jira] [Created] (HADOOP-18780) Add tag 3.3/3.3.5 for the official Hadoop docker image

Wei-Chiu Chuang created HADOOP-18780: Summary: Add tag 3.3/3.3.5 for the official Hadoop docker image Key: HADOOP-18780 URL: https://issues.apache.org/jira/browse/HADOOP-18780 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK > 8 > >> > with native profile enabled. > >> >+ launched pseudo distributed cluster including kms and httpfs with > >> > Kerberos and SSL enabled. > >> >+ created encryption

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

Bumping this thread to the top. If you are verifying the release, please vote on this thread. RC0 and RC1 are exactly the same. The only material difference is the Changelog. Thanks!! On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang wrote: > I am inviting anyone to try and vote on this rele

[VOTE] Release Apache Hadoop 3.3.6 RC1

I am inviting anyone to try and vote on this release candidate. Note: This is exactly the same as RC0, except the CHANGELOG. The RC is available at: https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64) https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64) Git tag:

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

ill be prepared, > right? > If true, I would like to try and vote on the next RC. > Just notice that some JIRAs are not included and need to revert some PRs to > pass HBase verification which are mentioned above. > > Best Regards, > - He Xiaoqiao > > > On Fri, Jun

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

ey for gs://fake-in-memory-test-b ucket/contract-test/testOpenFileApplyAsyncRead "fs.option.openfile.length" On Wed, Jun 14, 2023 at 5:01 PM Wei-Chiu Chuang wrote: > The hbase-filesystem tests passed after reverting HADOOP-18596 > <https://issues.apache.org/jira/b

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

It's branching off branch-3.3 On Thu, Jun 15, 2023 at 3:18 AM Steve Loughran wrote: > Which branch is -3.3.6 off? 3.3.5 or 3.3? > > I'm travelling for the next few days and unlikely to be able to test this; > will do my best > > On Wed, 14 Jun 2023 at 07:27, Wei-Chiu Chuang

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

not the end of the world. I think we can address it by adding an incompatible change flag and a release note. On Wed, Jun 14, 2023 at 3:55 PM Wei-Chiu Chuang wrote: > Cross referenced git history and jira. Changelog needs some update > > Not in the release > >1. HDFS-16858 <https:/

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

59->AbstractContractDistCpTest.distCpUpdateDeepDirectoryStructure:334->AbstractContractDistCpTest.assertCounterInRange:294->Assert.assertTrue:41->Assert.fail:88 Files Copied value 2 above maximum 1 [INFO] [ERROR] Tests run: 240, Failures: 3, Errors: 0, Skipped: 58 Ozone test in progress. Wil

[VOTE] Release Apache Hadoop 3.3.6 RC0

I am inviting anyone to try and vote on this release candidate. Note: This is built off branch-3.3.6 plus PR#5741 (aws sdk update) and PR#5740 (LICENSE file update) The RC is available at: https://home.apache.org/~weichiu/hadoop-3.3.6-RC0-amd64/ (for amd64)

Re: [DISCUSS] Hadoop 3.3.6 release planning

setSafeMode() is exposed through SafeMode interface. On Thu, Jun 8, 2023 at 11:11 AM Wei-Chiu Chuang wrote: > Thanks for comments > > Looking at jiras fixed in 3.3.6 and 3.3.9 (my bad, forgot that most > commits landing in branch-3.3 was 3.3.9), most are okay. We have about 119 >

[jira] [Resolved] (HADOOP-18761) Remove mysql-connector-java

[ https://issues.apache.org/jira/browse/HADOOP-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18761. -- Fix Version/s: 3.4.0 3.3.6 Resolution: Fixed > Rem

[jira] [Resolved] (HADOOP-18459) scan detected CVE-2021-37136 and CVE-2021-37137 in netty.io_netty_codec

[ https://issues.apache.org/jira/browse/HADOOP-18459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18459. -- Resolution: Won't Fix snakeyaml is updated in 3.3.x. netty3 is removed in trunk

[jira] [Resolved] (HADOOP-18123) Netty version 3.10.6 to be upgraded to handle CVE-2021-43797

[ https://issues.apache.org/jira/browse/HADOOP-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18123. -- Resolution: Duplicate Netty3 is removed in Hadoop 3.4 in trunk. Resolve

[jira] [Resolved] (HADOOP-13413) Update ZooKeeper version to 3.4.9

[ https://issues.apache.org/jira/browse/HADOOP-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-13413. -- Resolution: Won't Fix Stale jira; clean up. > Update ZooKeeper version to 3.

Fwd: [jira] [Created] (HADOOP-18768) Integrating Apache Hadoop into OSS-Fuzz

Are there Hadoop committers who would like to help triage bug reports from OSS-Fuzz? -- Forwarded message - From: Henry Lin (Jira) Date: Mon, Jun 12, 2023 at 9:10 AM Subject: [jira] [Created] (HADOOP-18768) Integrating Apache Hadoop into OSS-Fuzz To: Henry Lin created

[jira] [Created] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

Wei-Chiu Chuang created HADOOP-18769: Summary: Upgrade hadoop3 docker scripts to use 3.3.6 Key: HADOOP-18769 URL: https://issues.apache.org/jira/browse/HADOOP-18769 Project: Hadoop Common

[jira] [Created] (HADOOP-18766) 3.3.6 Dependency vulnerability check

Wei-Chiu Chuang created HADOOP-18766: Summary: 3.3.6 Dependency vulnerability check Key: HADOOP-18766 URL: https://issues.apache.org/jira/browse/HADOOP-18766 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18765) Release 3.3.6

Wei-Chiu Chuang created HADOOP-18765: Summary: Release 3.3.6 Key: HADOOP-18765 URL: https://issues.apache.org/jira/browse/HADOOP-18765 Project: Hadoop Common Issue Type: Task

Re: [DISCUSS] Mysql-connector-java is GPL licensed; Hadoop can't use it.

; > .. Owen > > > On Fri, Jun 9, 2023 at 1:58 AM Wei-Chiu Chuang > > wrote: > > > Hi community, > > > > While preparing for 3.3.6 RC, I realized the mysql-connector-java > > dependency added by HADOOP-18535 > > <https://issues.apache.org/jira/b

[jira] [Created] (HADOOP-18761) Revert HADOOP-18535 because mysql-connector-java is GPL

Wei-Chiu Chuang created HADOOP-18761: Summary: Revert HADOOP-18535 because mysql-connector-java is GPL Key: HADOOP-18761 URL: https://issues.apache.org/jira/browse/HADOOP-18761 Project: Hadoop

[DISCUSS] Mysql-connector-java is GPL licensed; Hadoop can't use it.

Hi community, While preparing for 3.3.6 RC, I realized the mysql-connector-java dependency added by HADOOP-18535 is GPL licensed. Source: https://github.com/mysql/mysql-connector-j/blob/release/8.0/LICENSE See legal discussion at Apache

[jira] [Created] (HADOOP-18760) 3.3.6 Release NOTICE and LICENSE file update

Wei-Chiu Chuang created HADOOP-18760: Summary: 3.3.6 Release NOTICE and LICENSE file update Key: HADOOP-18760 URL: https://issues.apache.org/jira/browse/HADOOP-18760 Project: Hadoop Common

[jira] [Resolved] (HADOOP-11219) [Umbrella] Upgrade to netty 4

[ https://issues.apache.org/jira/browse/HADOOP-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-11219. -- Fix Version/s: 3.4.0 Resolution: Fixed This is done. Would be nice

Re: [DISCUSS] Hadoop 3.3.6 release planning

gt; > Cherry-pick YARN-11482 to branch-3.3 and mark 3.3.6 as the fixed > version. > > > > > > > > so far only 8 jiras were resolved in the branch-3.3 line. > > > > > > > > > > > > If we should consider both 3.3.6 and 3.3.9 (which is from > r

Re: Call for Presentations, Community Over Code 2023

There's also a call for presentation for Community over Code Asia 2023 https://www.bagevent.com/event/cocasia-2023-EN Happening Aug 18-20. CfP due by 6/6 On Tue, May 9, 2023 at 8:39 PM Ayush Saxena wrote: > Forwarding from dev@hadoop to the dev ML which we use. > > The actual mail lies here:

[jira] [Resolved] (HADOOP-18731) Backport HADOOP-18671 to branch-3.2

[ https://issues.apache.org/jira/browse/HADOOP-18731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18731. -- Resolution: Done > Backport HADOOP-18671 to branch-

[jira] [Resolved] (HADOOP-18730) Backport HADOOP-18671 to branch-3.3

[ https://issues.apache.org/jira/browse/HADOOP-18730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18730. -- Resolution: Done > Backport HADOOP-18671 to branch-

Re: Hadoop docker

el: [1] > > -Ayush > > [1] > https://the-asf.slack.com/archives/CDSDT7A0H/p1683197830915329?thread_ts=1683191495.595649=CDSDT7A0H_ts=1683197830.915329 > > On Fri, 5 May 2023 at 22:41, Wei-Chiu Chuang wrote: > > > > Hi > > I'm just curious about the official

Hadoop docker

Hi I'm just curious about the official Hadoop docker images at DockerHub here: https://hub.docker.com/layers/apache/hadoop/3/images/sha256-1c33d429560ebc1b4fba1d61758ff5c73a2c9027572568769f56a68c4eaadbf6?context=explore Who is maintaining it? The release howto wiki does not mention the docker

[DISCUSS] Hadoop 3.3.6 release planning

Hi community, I'd like to kick off the discussion around Hadoop 3.3.6 release plan. I'm being selfish but my intent for 3.3.6 is to have the new APIs in HADOOP-18671 added so we can have HBase to adopt this new API. Other than that, perhaps

[jira] [Created] (HADOOP-18731) Backport HADOOP-18671 to branch-3.2

Wei-Chiu Chuang created HADOOP-18731: Summary: Backport HADOOP-18671 to branch-3.2 Key: HADOOP-18731 URL: https://issues.apache.org/jira/browse/HADOOP-18731 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18730) Backport HADOOP-18671 to branch-3.3

Wei-Chiu Chuang created HADOOP-18730: Summary: Backport HADOOP-18671 to branch-3.3 Key: HADOOP-18730 URL: https://issues.apache.org/jira/browse/HADOOP-18730 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-18702) Remove ozone mailing lists from Hadoop website

[ https://issues.apache.org/jira/browse/HADOOP-18702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18702. -- Resolution: Fixed > Remove ozone mailing lists from Hadoop webs

[jira] [Created] (HADOOP-18702) Remove ozone mailing list from Hadoop website

Wei-Chiu Chuang created HADOOP-18702: Summary: Remove ozone mailing list from Hadoop website Key: HADOOP-18702 URL: https://issues.apache.org/jira/browse/HADOOP-18702 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18548) Hadoop Archive tool (HAR) should acquire delegation tokens from source and destination file systems

[ https://issues.apache.org/jira/browse/HADOOP-18548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18548. -- Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~sgal] for the PR

Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

My random thoughts. Probably bad takes: There are projects experimenting with JDK17 now. JDK11 active support will end in 6 months. If it's already hard to migrate from JDK8 why not retarget JDK17. On Tue, Mar 28, 2023 at 10:30 AM Ayush Saxena wrote: > I know Jersey upgrade as a blocker. Some

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

I think moving up interfaces to FileSystem or some abstract FileSystem class has a few benefits: 1. Application can potentially be made FS-agnostic, with hasPathCapabilities() check. At least, make the code to compile. 2. We will be able to add a contract test to ensure behavior is expected. The

[jira] [Resolved] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18668. -- Fix Version/s: 3.4.0 Resolution: Fixed > Path capability probe for trunc

[jira] [Created] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

Wei-Chiu Chuang created HADOOP-18671: Summary: Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem Key: HADOOP-18671 URL: https://issues.apache.org/jira/browse/HADOOP-18671

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

of us who can build the > entire stack can do it, but that gradually adds more divergence from the > open source libraries, reduces the test coverage overall and only increases > maintenance costs over time. > > steve > > On Thu, 16 Mar 2023 at 20:56, Wei-Chiu Chuang wrote:

[DISCUSS] Move HDFS specific APIs to FileSystem abstration

Hi, Stephen and I are working on a project to make HBase to run on Ozone. HBase, born out of the Hadoop project, depends on a number of HDFS specific APIs, including recoverLease() and isInSafeMode(). The HBase community [1] strongly voiced that they don't want the project to have direct

[jira] [Resolved] (HADOOP-18648) Avoid loading kms log4j properties dynamically by KMSWebServer

[ https://issues.apache.org/jira/browse/HADOOP-18648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18648. -- Fix Version/s: 3.4.0 Resolution: Fixed > Avoid loading kms log4j propert

[jira] [Resolved] (HADOOP-18631) Migrate Async appenders to log4j properties

[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18631. -- Fix Version/s: 3.4.0 Resolution: Fixed > Migrate Async appenders to lo

[jira] [Resolved] (HADOOP-18206) Cleanup the commons-logging references in the code base

[ https://issues.apache.org/jira/browse/HADOOP-18206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18206. -- Fix Version/s: 3.4.0 Resolution: Fixed > Cleanup the commons-logg

[jira] [Resolved] (HADOOP-18620) Avoid using grizzly-http-* APIs

[ https://issues.apache.org/jira/browse/HADOOP-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18620. -- Fix Version/s: 3.4.0 Resolution: Fixed > Avoid using grizzly-http-* A

[jira] [Resolved] (HADOOP-18584) [NFS GW] Fix regression after netty4 migration

[ https://issues.apache.org/jira/browse/HADOOP-18584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18584. -- Fix Version/s: 3.4.0 Resolution: Fixed > [NFS GW] Fix regression after net

[jira] [Resolved] (HADOOP-16876) KMS delegation tokens are memory expensive

[ https://issues.apache.org/jira/browse/HADOOP-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-16876. -- Resolution: Cannot Reproduce > KMS delegation tokens are memory expens

[jira] [Created] (HADOOP-18584) [NFS GW] IdleStateHandler is not Shareable

Wei-Chiu Chuang created HADOOP-18584: Summary: [NFS GW] IdleStateHandler is not Shareable Key: HADOOP-18584 URL: https://issues.apache.org/jira/browse/HADOOP-18584 Project: Hadoop Common

[jira] [Created] (HADOOP-18548) Hadoop Archive tool (HAR) should acquire delegation tokens from source and destination file systems

Wei-Chiu Chuang created HADOOP-18548: Summary: Hadoop Archive tool (HAR) should acquire delegation tokens from source and destination file systems Key: HADOOP-18548 URL: https://issues.apache.org/jira/browse

Re: Code coverage report on github PRs

I believe most of them can be added by us using GitHub Workflow. There's a marketplace for these tools and most of them are free for open source projects. On Wed, Nov 23, 2022 at 11:43 AM Ayush Saxena wrote: > A simple Infra ticket I suppose should get it done for us, eg. >

Re: way forward for Winutils excision from `FileSystem`

> > > > * Bare Naked Local File System v0.1.0 doesn't (yet) support symlinks > or the sticky bit. > ok to not support symlinks. The symlinks of HDFS are not being maintained and I am not aware of anything relying on it. So I assume people don't need it. Sticky bit would be useful, I guess.

[jira] [Resolved] (HADOOP-18489) Cherrypick HADOOP-11245 to branch-3.2

[ https://issues.apache.org/jira/browse/HADOOP-18489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18489. -- Fix Version/s: 3.2.5 Resolution: Fixed > Cherrypick HADOOP-11245 to bra

[jira] [Created] (HADOOP-18489) Cherrypick HADOOP-11245 to branch-3.2

Wei-Chiu Chuang created HADOOP-18489: Summary: Cherrypick HADOOP-11245 to branch-3.2 Key: HADOOP-18489 URL: https://issues.apache.org/jira/browse/HADOOP-18489 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18488) Cherrypick HADOOP-11245 to branch-3.3

[ https://issues.apache.org/jira/browse/HADOOP-18488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18488. -- Fix Version/s: 3.3.9 Resolution: Fixed > Cherrypick HADOOP-11245 to bra

[jira] [Created] (HADOOP-18488) Cherrypick HADOOP-11245 to branch-3.3

Wei-Chiu Chuang created HADOOP-18488: Summary: Cherrypick HADOOP-11245 to branch-3.3 Key: HADOOP-18488 URL: https://issues.apache.org/jira/browse/HADOOP-18488 Project: Hadoop Common

[DISCUSS] Supporting partial file rewrite/compose

There were a number of discussions that happened during ApacheCon. In the spirit of the Apache Way, I am taking the conversation online, sharing with the larger community and also capturing requirements. Credits to Owen who started this discussion. There are a number of scenarios where users want

[DISCUSS] Hadoop 3.3.5 release planning

Bumping this up. Adding the [DISCUSS] text to make this message stand out of your inbox. I certainly missed this message and only realized 3.3.5 has more than just security updates. What was the issue with the ARM64 build? I was able to publish ARM64 build for 3.3.1 release without problems.

Re: Hadoop BoF at ApacheCon NA'22

t; On Sat, Sep 24, 2022 at 8:52 PM 俊平堵 wrote: > > > > > Yes. It should be a short talk and I can only present remotely for this > > > time. That would be great if you help to coordinate. :) > > > > > > Thanks, > > > > > > Junping &g

Re: Hadoop BoF at ApacheCon NA'22

/1_ha1BFeEyIkAJtl5tJ8Z4Vf5Md_0rN23RCrXkyNCY1c/edit?usp=sharing Please add more details here. On Thu, Sep 22, 2022 at 10:27 PM 俊平堵 wrote: > Thanks Wei-Chiu. I am happy to share the status of Hadoop Meetups in China > (2019-2022) if that is a suitable topic. :) > > Thanks, > > Junping > >

Hadoop BoF at ApacheCon NA'22

We've not had a physical event for a long long time and we're way overdue for one. I'm excited to announce we've reserved a room at the upcoming ApacheCon for Birds-of-Feather on October 4th from 17:50-18:30 CDT in Rhythms I. I was also told that participants can stay after that until the hotel

[jira] [Resolved] (HADOOP-18118) Fix KMS Accept Queue Size default value to 500

[ https://issues.apache.org/jira/browse/HADOOP-18118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18118. -- Fix Version/s: 3.4.0 Resolution: Fixed > Fix KMS Accept Queue Size defa

[jira] [Resolved] (HADOOP-18333) hadoop-client-runtime impact by CVE-2022-2047 CVE-2022-2048 due to shaded jetty

[ https://issues.apache.org/jira/browse/HADOOP-18333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18333. -- Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > had

Re: Assignment to JIRA tickets

What is your JIRA user id? I can help you by adding you to the contributor list where you'll be able to assign the tickets yourself. On Thu, Aug 4, 2022 at 1:43 PM Steve Vaughan wrote: > I'd like to be assignable to tickets that I open. I've been creating JIRA > tickets for issues I'm actively

[jira] [Resolved] (HADOOP-18079) Upgrade Netty to 4.1.77.Final

[ https://issues.apache.org/jira/browse/HADOOP-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18079. -- Resolution: Fixed > Upgrade Netty to 4.1.77.Fi

Re: style rules

I have seen violated that rule before and wondered if it's because final variables are essentially constants in other languages so all caps make sense? On Mon, Jul 11, 2022 at 10:35 AM Owen O'Malley wrote: > I keep stubbing my toe on the unfortunate Hadoop style rule that says final > variables

Re: Where is aarch64 tgz for 3.3.2 and 3.3.3

I think only the tarball needs to be uploaded. The Maven repository doesn't (the jars would be the same?) At least that's what I did before. On Thu, Jun 16, 2022 at 6:04 PM Ayush Saxena wrote: > > > > I'm assuming that the arm docker image can do the build, either on my > > macbook or more

[jira] [Resolved] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

[ https://issues.apache.org/jira/browse/HADOOP-18289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18289. -- Fix Version/s: 3.4.0 Resolution: Fixed Done. Thanks [~slfan1989] > Rem

[jira] [Resolved] (HADOOP-18140) Update default value of hadoop.ssl.enabled.protocols in the EncryptedShuffle doc

[ https://issues.apache.org/jira/browse/HADOOP-18140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18140. -- Resolution: Duplicate > Update default value of hadoop.ssl.enabled.protoc

[jira] [Resolved] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

[ https://issues.apache.org/jira/browse/HADOOP-18245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18245. -- Fix Version/s: 3.4.0 Resolution: Fixed The PR is merged in trunk. Thanks

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

Running builds for all platforms for each and every PR seems too excessive. How about doing all platform builds in the nightly jobs? On Fri, May 6, 2022 at 8:02 AM Steve Loughran wrote: > I'm not enthusiastic here as it not only makes the builds slower, it > reduces the #of builds we can

Re: Publishing hadoop-lzo maven package in com.hadoop namespace

Please be careful. Sorry but hadoop-lzo is GPL licensed. Internally at my employer we don't use/ship hadoop-lzo because of the licensing concerns. I suppose since the code is GPL we as an Apache project want to stay away from it? On Thu, May 5, 2022 at 11:17 AM Ayush Saxena wrote: > Didn’t

Re: [DISCUSS] Hadoop on Windows

Great! Sorry I missed the earlier discussion thread. Is there a target version for this support? I assume the milestone is still in a dev branch? On Thu, Apr 28, 2022 at 8:26 AM Gautham Banasandra wrote: > Hi Hadoop devs, > > I would like to announce that we recently reached a new milestone -

Re: Institutions running kerberized Hadoop clusters

Last time I checked (~2 years ago), there were thousands of Kerberized clusters among Cloudera customers. The largest ones had a few thousand nodes. What are you looking for? On Wed, Apr 13, 2022 at 7:22 AM Santosh Marella wrote: > Hey folks, > > Just curious if we have a list of

Fwd: [NOTICE] Dependabot Updates enabled for all projects

-- Forwarded message - From: Chris Lambertus Date: Tue, Apr 5, 2022 at 12:38 PM Subject: [NOTICE] Dependabot Updates enabled for all projects To: Hi folks, Infra is pleased to announce that GitHub’s Dependabot service has been approved for use by ASF Legal and Infra, and is

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

aarch64 support is only introduced in/after 3.3.0 On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt wrote: > Hi, > > > There is no aarch64 artifact in the release candidate. Is this something > that is intended? > > Best, > Emil Ejbyfeldt > > On 14/03/2022 08:14, Masatake Iwasaki wrote: > > Hi

[jira] [Resolved] (HADOOP-17526) Use Slf4jRequestLog for HttpRequestLog

[ https://issues.apache.org/jira/browse/HADOOP-17526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17526. -- Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~zhangduo] for the work

[ANNOUNCE] New Hadoop PMC Sun Chao

On behalf of the Apache Hadoop PMC, I am pleased to announce that Sun Chao(sunchao) has accepted the PMC's invitation to become a PMC on the project. We appreciate all of Sun's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome, Sun!

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

> > Many thanks to Viraj Jasani, Michael Stack, Masatake Iwasaki, Xiaoqiao He, > Mukund Madhav Thakur, Wei-Chiu Chuang, Steve Loughran, Akira Ajisaka and > other folks who helped for this release process. > > Best Regards, > Chao >

[jira] [Created] (HADOOP-18140) Update default value of hadoop.ssl.enabled.protocols in the EncryptedShuffle doc

Wei-Chiu Chuang created HADOOP-18140: Summary: Update default value of hadoop.ssl.enabled.protocols in the EncryptedShuffle doc Key: HADOOP-18140 URL: https://issues.apache.org/jira/browse/HADOOP-18140

[jira] [Resolved] (HADOOP-18125) Utility to identify git commit / Jira fixVersion discrepancies for RC preparation

[ https://issues.apache.org/jira/browse/HADOOP-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18125. -- Fix Version/s: 3.4.0 2.10.2 3.2.3

[jira] [Resolved] (HADOOP-18098) Basic verification for the release candidate vote

[ https://issues.apache.org/jira/browse/HADOOP-18098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18098. -- Fix Version/s: 3.4.0 Resolution: Fixed Merged into trunk. Thanks [~vjasani

[jira] [Resolved] (HADOOP-18089) Test coverage for Async profiler servlets

[ https://issues.apache.org/jira/browse/HADOOP-18089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18089. -- Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~vjasani] for the patch

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC2

I'll find time to check out the RC bits. I just feel bad that the tarball is now more than 600MB in size. On Fri, Jan 21, 2022 at 2:23 AM Steve Loughran wrote: > *+1 binding.* > > reviewed binaries, source, artifacts in the staging maven repository in > downstream builds. all good. > > *## test

  1   2   3   4   5   6   7   >