Re: Hadoop docker

Hi Wei-Chiu, We have branches for docker: Hadoop 3.x line: https://github.com/apache/hadoop/tree/docker-hadoop-3 Hadoop 2.x line: https://github.com/apache/hadoop/tree/docker-hadoop-2 We don't rely on Github Actions or so for docker, Infra takes care of publishing those images for us, using the br

Re: [jira] [Resolved] (HADOOP-18134) Setup Jenkins nightly CI for Windows 10

Just saw this mail, This sounds like a project level achievement to me considering Windows is an OS which we officially claim to support, worth making more noise :) Awesome stuft guys!!! This was on my bucket list for 2-3 days when it was in draft state, couldn’t get time since then , but it's re

[jira] [Resolved] (HADOOP-18715) Add debug log for getting details of tokenKindMap

[ https://issues.apache.org/jira/browse/HADOOP-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18715. --- Fix Version/s: 3.4.0 3.3.9 Hadoop Flags: Reviewed Resolution

[jira] [Created] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

Ayush Saxena created HADOOP-18724: - Summary: Open file fails with NumberFormatException for S3AFileSystem Key: HADOOP-18724 URL: https://issues.apache.org/jira/browse/HADOOP-18724 Project: Hadoop

[jira] [Resolved] (HADOOP-18660) Filesystem Spelling Mistake

[ https://issues.apache.org/jira/browse/HADOOP-18660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18660. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Filesys

[jira] [Resolved] (HADOOP-18712) upgrade to jetty 9.4.51 due to cve

[ https://issues.apache.org/jira/browse/HADOOP-18712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18712. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > upgrade

[jira] [Resolved] (HADOOP-18689) Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

[ https://issues.apache.org/jira/browse/HADOOP-18689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18689. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Bump jetti

[jira] [Resolved] (HADOOP-18711) upgrade nimbus jwt jar due to issues in its embedded shaded json-smart code

[ https://issues.apache.org/jira/browse/HADOOP-18711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18711. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > upgrade nim

[jira] [Resolved] (HADOOP-18710) Add RPC metrics for response time

[ https://issues.apache.org/jira/browse/HADOOP-18710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18710. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add

[jira] [Resolved] (HADOOP-18597) Simplify single node instructions for creating directories for Map Reduce

[ https://issues.apache.org/jira/browse/HADOOP-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18597. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Simpl

[jira] [Resolved] (HADOOP-18590) Publish SBOM artifacts

[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18590. --- Fix Version/s: 3.4.0 3.3.9 Hadoop Flags: Reviewed Resolution

[jira] [Created] (HADOOP-18701) Generic Build Improvements

Ayush Saxena created HADOOP-18701: - Summary: Generic Build Improvements Key: HADOOP-18701 URL: https://issues.apache.org/jira/browse/HADOOP-18701 Project: Hadoop Common Issue Type: Wish

[jira] [Created] (HADOOP-18689) Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

Ayush Saxena created HADOOP-18689: - Summary: Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project Key: HADOOP-18689 URL: https://issues.apache.org/jira/browse/HADOOP-18689 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

gt; > Steve Loughran > Chris Nauroth > Masatake Iwasaki > Ayush Saxena > Xiaoqiao He > > +1 non-binding > > Viraj Jasani > > > 0 or -1 votes: none. > > > Accordingly: the release is good! > > I will send the formal announcement out tomorrow >

A Message from the Board to PMC members

d...@hadoop.apache.org received a mail from the apache board, forwarding it to the mailing lists which we use, sharing the link here: https://www.mail-archive.com/dev@hadoop.apache.org/msg00158.html private@ in bcc -Ayush - To

Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

hts. Probably bad takes: > > There are projects experimenting with JDK17 now. > JDK11 active support will end in 6 months. If it's already hard to migrate > from JDK8 why not retarget JDK17. > > On Tue, Mar 28, 2023 at 10:30 AM Ayush Saxena wrote: > >> I know Jersey u

Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

I know Jersey upgrade as a blocker. Some folks were chasing that last year during 3.3.4 time, I don’t know where it is now, didn’t see then what’s the problem there but I remember there was some intitial PR which did it for HDFS atleast, so I never looked beyond that… I too had jdk-11 in my min

[jira] [Resolved] (HADOOP-18681) Upgrade hadoop3 docker scripts to use 3.3.5

[ https://issues.apache.org/jira/browse/HADOOP-18681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18681. --- Hadoop Flags: Reviewed Resolution: Fixed > Upgrade hadoop3 docker scripts to

[jira] [Created] (HADOOP-18682) Move hadoop docker scripts to dev-support

Ayush Saxena created HADOOP-18682: - Summary: Move hadoop docker scripts to dev-support Key: HADOOP-18682 URL: https://issues.apache.org/jira/browse/HADOOP-18682 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18681) Upgrade hadoop3 docker scripts to use 3.3.5

Ayush Saxena created HADOOP-18681: - Summary: Upgrade hadoop3 docker scripts to use 3.3.5 Key: HADOOP-18681 URL: https://issues.apache.org/jira/browse/HADOOP-18681 Project: Hadoop Common

Fwd: TAC supporting Berlin Buzzwords

Forwarded a recieved. -Ayush -- Forwarded message - From: Gavin McDonald Date: Fri, 24 Mar 2023 at 15:27 Subject: TAC supporting Berlin Buzzwords To: PMCs, Please forward to your dev and user lists. Hi All, The ASF Travel Assistance Committee is supporting taking up to six

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

d. In FileSystem, there is an > initialize(..) and its javadoc says: > >* Called after the new FileSystem instance is constructed, and before it >* is ready for use. > > However, there is no way to check if the FileSystem instance is ready. > > > These are currently

[jira] [Resolved] (HADOOP-18662) ListFiles with recursive fails with FNF

[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18662. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > ListFiles w

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

nown code such as loading a plugin, > code analysis, etc. However, it probably is not a good way to define APIs. > > > > Tsz-Wo > > > On Tuesday, March 21, 2023, 01:00:20 PM GMT+8, Ayush Saxena < > ayush...@gmail.com> wrote: > > > I am not sure what classi

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

I am not sure what classifies as a Hack and what not, I thought reflections are part of Java. Whatever solution but pulling in just the HDFS specific stuff to FileSystem just for Ozone, because Hbase guys didn’t agree and we have people in Hadoop who we can convince, I am -1 to such an approach an

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

Hbase doesn’t want to add Ozone as a dependency sounds to me like a ‘Hbase having resistance against the people proposing or against Ozone’ Anyway doesn’t ViewDistributedFileSystem not solve this Ozone problem, I remember Uma chasing that to solve these problems only? Pulling up the core HDFS A

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

+1(Binding) * Built from source (x86 & ARM) * Successful Native Build (x86 & ARM) * Verified Checksums (x86 & ARM) * Verified Signature (x86 & ARM) * Checked the output of hadoop version (x86 & ARM) * Verified the output of hadoop checknative (x86 & ARM) * Ran some basic HDFS shell commands. * Ran

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

Count me in as well. I am almost done. So, you have 3 potential votes, can be happy now :) Thanx Steve for the efforts!!! -Ayush > On 19-Mar-2023, at 2:46 AM, Chris Nauroth wrote: > > Yes, I'm in progress on verification, so you can expect to get a vote from > me. Thank you, Steve! > > Chri

[jira] [Created] (HADOOP-18662) ListFiles with recursive fails with FNF

Ayush Saxena created HADOOP-18662: - Summary: ListFiles with recursive fails with FNF Key: HADOOP-18662 URL: https://issues.apache.org/jira/browse/HADOOP-18662 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-18658) snakeyaml dependency: upgrade to v2.0

[ https://issues.apache.org/jira/browse/HADOOP-18658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18658. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > snakey

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC2)

> > I will highlight that I am completely fed up with doing this release and > really want to get it out the way -for which I depend on support from as > many other developers as possible. hmm, I can feel the pain. I tried to find if there is any config or any workaround which can dodge this HDF

Re: [VOTE] Release Apache Hadoop 3.3.5

> > And i > think we need to change the PR template to mention transitive updates in > the license bit too Not sure if that is gonna help, People might ignore that or check that in overconfidence. No harm though.. BTW Ozone has some cool stuff to handle this, it was added here: https://github.c

[jira] [Resolved] (HADOOP-18582) No need to clean tmp files in distcp direct mode

[ https://issues.apache.org/jira/browse/HADOOP-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18582. --- Hadoop Flags: Reviewed Resolution: Fixed > No need to clean tmp files in dis

Re: yetus reporting javadoc errors on @InterfaceAudience attributes

ush On Tue, 21 Feb 2023 at 21:16, Steve Vaughan wrote: > I'd be happy to take a look at the tests with a fresh set of eyes. Was > there an existing PR for Junit work? > ------ > *From:* Ayush Saxena > *Sent:* Tuesday, February 21, 2023 1:24 AM >

Re: yetus reporting javadoc errors on @InterfaceAudience attributes

toryEvents/testEventsFlushOnStop/ On Fri, 23 Dec 2022 at 08:50, Ayush Saxena wrote: > Have we stopped >> with the java8 builds? > > > Nopes, The answer is here just cross posting: > https://github.com/apache/hadoop/pull/5226#issuecomment-1354964948 > > Regarding dropping Java

[jira] [Resolved] (HADOOP-18524) Deploy Hadoop trunk version website

[ https://issues.apache.org/jira/browse/HADOOP-18524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18524. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Deploy Had

[jira] [Resolved] (HADOOP-18630) Add gh-pages in asf.yaml to deploy the current trunk doc

[ https://issues.apache.org/jira/browse/HADOOP-18630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18630. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add gh-pa

[jira] [Created] (HADOOP-18630) Add gh-pages in asf.yaml to deploy the current trunk doc

Ayush Saxena created HADOOP-18630: - Summary: Add gh-pages in asf.yaml to deploy the current trunk doc Key: HADOOP-18630 URL: https://issues.apache.org/jira/browse/HADOOP-18630 Project: Hadoop Common

Re: [DISCUSS] IPV6 Support for Hadoop

5e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C638102657689199570%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BbmMJ7TR8bs3Rm%2Bt5uWdahBFX9MK%2BxfhImxT4DYVtPs%3D&reserved=0> > ;> > > to get into the > > &

[jira] [Resolved] (HADOOP-18604) Add compile platform in the hadoop version output

[ https://issues.apache.org/jira/browse/HADOOP-18604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18604. --- Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Add comp

[jira] [Created] (HADOOP-18604) Add compile platform in the hadoop version output

Ayush Saxena created HADOOP-18604: - Summary: Add compile platform in the hadoop version output Key: HADOOP-18604 URL: https://issues.apache.org/jira/browse/HADOOP-18604 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.3.5

t > downstream projects have tests that do restarts on a MiniDFSCluster. > > Chris Nauroth > > > On Wed, Jan 4, 2023 at 4:22 PM Ayush Saxena wrote: > > > Hmm I'm looking at HADOOP-11867 related stuff but couldn't find it > >> mentioned anywhere in change

Re: Disable auto-posting comment on pull requests to JIRA?

Thanx Mingliang Liu for starting the thread. I don't have a strong opinion neither in favour nor against. You have already highlighted the other side, just pointing out a couple of more facts. Ideally we have three options that I am aware of: - The Existing stuff: have these PR comments as par

Re: [VOTE] Release Apache Hadoop 3.3.5

> > Hmm I'm looking at HADOOP-11867 related stuff but couldn't find it > mentioned anywhere in change log or release notes. Are they actually > up-to-date? I don't think there is any issue with the ReleaseNotes generation as such but with the Resolution type of this ticket, It ain't marked as Fix

[jira] [Resolved] (HADOOP-18586) Update the year to 2023

[ https://issues.apache.org/jira/browse/HADOOP-18586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18586. --- Fix Version/s: 3.4.0 2.10.3 3.2.5

[jira] [Created] (HADOOP-18586) Update the year to 2023

Ayush Saxena created HADOOP-18586: - Summary: Update the year to 2023 Key: HADOOP-18586 URL: https://issues.apache.org/jira/browse/HADOOP-18586 Project: Hadoop Common Issue Type: Task

Re: [VOTE] Release Apache Hadoop 3.3.5

Mostly or may be all of those failures are due to HADOOP-18324 , there is a Jira tracking issues with TestLeaseRecovery2 linked to that as well HDFS-16853 -Ayush On Wed, 28 Dec 2022 at 09:13, Vi

Re: yetus reporting javadoc errors on @InterfaceAudience attributes

s are now using java11. Have we stopped > with the java8 builds? > > as i am happy with that, we just need to make an explicit declaration and > wrap up of anything outstanding. > > > > On Thu, 15 Dec 2022 at 22:30, Ayush Saxena wrote: > > > Thanx Ashutosh, Let

Re: yetus reporting javadoc errors on @InterfaceAudience attributes

> > On Mon, Dec 12, 2022 at 1:59 PM Ayush Saxena wrote: > >> Try to fix in the same way it was done here and couple of similar PRs: >> https://github.com/apache/hadoop/pull/5179 >> >> There are a bunch of PRs in yarn getting the similar error fixed module >>

Re: yetus reporting javadoc errors on @InterfaceAudience attributes

Try to fix in the same way it was done here and couple of similar PRs: https://github.com/apache/hadoop/pull/5179 There are a bunch of PRs in yarn getting the similar error fixed module wise, the problem would be there in many other modules as well... The daily JDK-11 build also shows that failur

Re: exciting new content needed for the 3.3.5 index.md file

Hi Steve, I just went through the Jira's fixed in HDFS[1] Sharing some stuff which I find good enough to find a mention. 1.HDFS-13522 , HDFS-16767 & Related Jiras: Allow Observer Reads in HDFS Route

Re: [DISCUSS] JIRA Public Signup Disabled

, Mingliang Liu wrote: > Thanks Ayush for taking care of this. I think option 1 sounds good. > > > On Nov 22, 2022, at 2:51 PM, Ayush Saxena wrote: > > > > Hi Folks, > > Just driving the attention towards the recent change from Infra, which > > disables new people fr

Re: Code coverage report on github PRs

rkflow. There's a > marketplace for these tools and most of them are free for open source > projects. > > On Wed, Nov 23, 2022 at 11:43 AM Ayush Saxena wrote: > >> A simple Infra ticket I suppose should get it done for us, eg. >> https://issues.apache.org/jira/browse/INFRA-2

Re: Code coverage report on github PRs

A simple Infra ticket I suppose should get it done for us, eg. https://issues.apache.org/jira/browse/INFRA-23561 -Ayush On Thu, 24 Nov 2022 at 01:00, Iñigo Goiri wrote: > Now that we are using mostly GitHub PRs for the reviews and we have decent > integration for the builds etc there, I was won

[DISCUSS] JIRA Public Signup Disabled

Hi Folks, Just driving the attention towards the recent change from Infra, which disables new people from creating a Jira account, in order to prevent spams around JIRA. So, the new Jira account creation request needs to be routed via the PMC of the project. So, we have 2 options, which I can think

Re: [DISCUSS] Supporting partial file rewrite/compose

Hi Wei-Chiu, I think this got lost somewhere or the discussion moved somewhere else, if so please loop in me as well. Just guessing why everyone is so quiet :-) 1. Apache Iceberg or other evolvable table format. The first point that you mentioned regarding the iceberg, may be the use case that

[jira] [Created] (HADOOP-18524) Deploy Hadoop trunk version website

Ayush Saxena created HADOOP-18524: - Summary: Deploy Hadoop trunk version website Key: HADOOP-18524 URL: https://issues.apache.org/jira/browse/HADOOP-18524 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-18512) upgrade woodstox-core to 5.4.0 for security fix

[ https://issues.apache.org/jira/browse/HADOOP-18512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18512. --- Fix Version/s: 3.4.0 3.3.5 Hadoop Flags: Reviewed Resolution

[jira] [Resolved] (HADOOP-18493) update jackson-databind 2.12.7.1 due to CVE fixes

[ https://issues.apache.org/jira/browse/HADOOP-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18493. --- Fix Version/s: 3.4.0 3.3.5 Hadoop Flags: Reviewed Resolution

[jira] [Resolved] (HADOOP-18360) Update commons-csv from 1.0 to 1.9.0.

[ https://issues.apache.org/jira/browse/HADOOP-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18360. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Update comm

[jira] [Resolved] (HADOOP-16674) TestDNS.testRDNS can fail with ServiceUnavailableException

[ https://issues.apache.org/jira/browse/HADOOP-16674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-16674. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18388. --- Hadoop Flags: Reviewed Resolution: Fixed > Allow dynamic groupSearchFilter

[jira] [Resolved] (HADOOP-18441) Remove org.apache.hadoop.maven.plugin.shade.resource.ServicesResourceTransformer

[ https://issues.apache.org/jira/browse/HADOOP-18441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18441. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Rem

2022 ASF Community Survey

Apache community, your opinion matters: we want to hear your voice. If you have any questions about the survey or otherwise, please reach out to us! Kindly, Ayush Saxena On Behalf of: Katia Rojas V.P. of Diversity and Inclusion The Apache Software Foundation

[jira] [Reopened] (HADOOP-18417) Upgrade Maven Surefire plugin to 3.0.0-M7

[ https://issues.apache.org/jira/browse/HADOOP-18417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reopened HADOOP-18417: --- > Upgrade Maven Surefire plugin to 3.0.0

[jira] [Resolved] (HADOOP-18361) Update commons-net from 3.6 to 3.8.0.

[ https://issues.apache.org/jira/browse/HADOOP-18361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18361. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Update comm

[jira] [Resolved] (HADOOP-18404) Fix broken link to wiki help page in org.apache.hadoop.util.Shell

[ https://issues.apache.org/jira/browse/HADOOP-18404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18404. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix bro

[jira] [Resolved] (HADOOP-18387) Fix incorrect placeholder in hadoop-common

[ https://issues.apache.org/jira/browse/HADOOP-18387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18387. --- Hadoop Flags: Reviewed Resolution: Fixed > Fix incorrect placeholder in had

[jira] [Created] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

Ayush Saxena created HADOOP-18388: - Summary: Allow dynamic groupSearchFilter in LdapGroupsMapping Key: HADOOP-18388 URL: https://issues.apache.org/jira/browse/HADOOP-18388 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18358) Update commons-math3 from 3.1.1 to 3.6.1.

[ https://issues.apache.org/jira/browse/HADOOP-18358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18358. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Update comm

[jira] [Created] (HADOOP-18381) Fix/Improve DistCp doc

Ayush Saxena created HADOOP-18381: - Summary: Fix/Improve DistCp doc Key: HADOOP-18381 URL: https://issues.apache.org/jira/browse/HADOOP-18381 Project: Hadoop Common Issue Type: Improvement

[jira] [Resolved] (HADOOP-18354) Upgrade reload4j due to XXE vulnerability

[ https://issues.apache.org/jira/browse/HADOOP-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18354. --- Fix Version/s: 3.3.9 Hadoop Flags: Reviewed Resolution: Fixed > Upgr

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

+1(Binding) * Built from Source * Successful native build on Ubuntu 18.04 * Verified Checksums * Verified Signatures * Successful RAT check * Ran Basic HDFS shell commands * Ran basic MR example Jobs (TeraGen/TeraSort & TeraValidate) * Browsed through UI(NN, DN, RM, NM & JHS) * Skimmed through the

[jira] [Created] (HADOOP-18335) Improve Pre-Commit Time

Ayush Saxena created HADOOP-18335: - Summary: Improve Pre-Commit Time Key: HADOOP-18335 URL: https://issues.apache.org/jira/browse/HADOOP-18335 Project: Hadoop Common Issue Type: Task

Re: Where is aarch64 tgz for 3.3.2 and 3.3.3

x27;s true, how do i get its artifacts into the release? is the idea I > just upload a whole new binary .tar.gz file with a suffix to make clear its > arm, while the rest of release (source, maven artifacts etc) comes from the > main one? > > On Thu, 16 Jun 2022 at 09:56

Re: Where is aarch64 tgz for 3.3.2 and 3.3.3

Same question here: https://lists.apache.org/thread/rjn4zhdc30zrorsyr8jcsovmbl5hq6ol -Ayush Sent from my iPhone > On 16-Jun-2022, at 10:11 AM, Cheng Pan wrote: > > Hi community, > > I'm using Hadoop 3.3.1 to build cross-platform Docker images, and when > I'm trying to upgrade to 3.3.2 or 3.

[jira] [Resolved] (HADOOP-18282) Add .asf.yaml to hadoop-thirdparty

[ https://issues.apache.org/jira/browse/HADOOP-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18282. --- Fix Version/s: thirdparty-1.2.0 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Created] (HADOOP-18282) Add .asf.yaml to hadoop-thirdparty

Ayush Saxena created HADOOP-18282: - Summary: Add .asf.yaml to hadoop-thirdparty Key: HADOOP-18282 URL: https://issues.apache.org/jira/browse/HADOOP-18282 Project: Hadoop Common Issue Type

Re: [DISCUSS] Filesystem API shim library to assist applications still targeting previous hadoop releases.

Just answering the last point: > > Is there a way we could release it as an ASF Library but on a different > timetable from normal Hadoop releases? There is always incubator, but this > is such a minor project it is closer to the org.apache.hadoop.thirdparty > library in that it is something all cu

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

the help, Ayush. >> >> I committed HADOOP-16663/HADOOP-16664 and cherry-picked HADOOP-16985 to >> branch-2.10 (and branch-3.2). >> If I need to cut RC1, I will try cherry-picking them to branch-2.10.2 >> >> Masatake Iwasaki >> >> >> On 2022/05/28 5:23

[jira] [Resolved] (HADOOP-18244) Fix Hadoop-Common JavaDoc Error on branch-3.3

[ https://issues.apache.org/jira/browse/HADOOP-18244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18244. --- Fix Version/s: 3.3.4 Hadoop Flags: Reviewed Target Version/s: 3.3.4 (was

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

The checksum stuff was addressed in HADOOP-16985, so that filename stuff is sorted only post 3.3.x BTW it is a known issue: https://issues.apache.org/jira/browse/HADOOP-16494?focusedCommentId=16927236&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16927236 Must not

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

Have raised HADOOP-18241 There is a WIP PR linked to it as well https://issues.apache.org/jira/browse/HADOOP-18241 On Wed, 11 May 2022 at 01:28, Ayush Saxena wrote: > +1 for moving to Java 11 for trunk. > If nobody objects by EOW will create a jira for that > > -Ayush > &

[jira] [Created] (HADOOP-18241) Move to Java 11

Ayush Saxena created HADOOP-18241: - Summary: Move to Java 11 Key: HADOOP-18241 URL: https://issues.apache.org/jira/browse/HADOOP-18241 Project: Hadoop Common Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

+1, * Built from source. * Successful native build on Ubuntu 18.04 * Verified Checksums. (CHANGELOG.md,RELEASENOTES.md,hadoop-3.3.3-rat.txt,hadoop-3.3.3-site.tar.gz,hadoop-3.3.3-src.tar.gz,hadoop-3.3.3.tar.gz) * Verified Signature. * Successful RAT check * Ran basic HDFS shell commands. * Ran basic

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

like >> test.build.data, indirectly through utility classes like GenericTestUtils, >> or modifying shared resources within target/test-classes. I've been working >> towards cleaning up flaky tests, and I plan on submitting some patches today. >> From: Steve Loughran >&

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

I had done earlier). > > So, I'll settle down to integrating the full suite of platform > builds into the nightly builds. Could anyone please point > me to the Jenkins job for this? > > [1] = https://github.com/apache/hadoop/pull/3166 > > Thanks, > --Gautham >

Re: [VOTE] Release Apache Hadoop 3.3.3

che/hadoop > and Spark build will be able to pick them up for testing. However in > this case I don't see any 3.3.3 jars in the URL. > >> On Fri, May 6, 2022 at 6:24 PM Ayush Saxena wrote: >> >> There were two 3.3.3 staged. The earlier one was with skipShade, the

Re: [VOTE] Release Apache Hadoop 3.3.3

There were two 3.3.3 staged. The earlier one was with skipShade, the date was also april 22, I archived that. Chao can you use the one that Steve mentioned in the mail? On Sat, 7 May 2022 at 06:18, Chao Sun wrote: > Seems there are some issues with the shaded client as I was not able > to compil

Re: [VOTE] Release Apache Hadoop 3.3.3

+1, * Built from source * Successful native build on Ubuntu 18.04 * Verified Checksums (CHANGELOG.md,RELEASENOTES.md,hadoop-3.3.3-rat.txt,hadoop-3.3.3-site.tar.gz,hadoop-3.3.3-src.tar.gz,hadoop-3.3.3.tar.gz) * Successful RAT check * Ran some basic HDFS shell commands * Ran some basic YARN shell com

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

>From functional point of view it does makes sense to validate all the platforms as part of the builds, but the Pre commits builds taking time is now no longer a small things, In past one year or may be two, we have already increased it more than twice as compared to what it was before, If someone

Fwd: Publishing hadoop-lzo maven package in com.hadoop namespace

Didn’t read it full. But seems related to some code change in Hadoop Common Forwarded to common-dev Begin forwarded message: > From: Will Norris > Date: 5 May 2022 at 11:28:35 PM IST > To: gene...@hadoop.apache.org > Subject: Publishing hadoop-lzo maven package in com.hadoop namespace > > Hey

Re: [DISCUSS] cull unused modules from under hadoop-tools

;> On Fri, 1 Apr 2022 at 09:39, Vinayakumar B wrote: >> >> Can move unused ones to separate repo under hadoop, and introduce a >> separate independent release cycle in case required. >> >> Any thoughts on this? >> -Vinay >> >>> On Fri, 1 Ap

Fwd: Applications for Travel Assistance to ApacheCon NA 2022 now open

Forwarded as asked in the mail. -Ayush Begin forwarded message: > From: Gavin McDonald > Date: 4 April 2022 at 1:56:40 PM IST > To: travel-assista...@apache.org > Subject: Applications for Travel Assistance to ApacheCon NA 2022 now open > Reply-To: tac-ap...@apache.org > > Hello, Apache PMCs

Re: [DISCUSS] cull unused modules from under hadoop-tools

Distcp (I have a use case for it) Hadoop-federation-balance(RBF uses it, we will take care in case it bothers) Hadoop-Dynamometer(This I feel is being used from jira activies) So, these three we should let stay as is. Others the object store ones are active. You know which all are needed. For rest

[jira] [Created] (HADOOP-18166) Jenkins jobs intermittently failing in the end

Ayush Saxena created HADOOP-18166: - Summary: Jenkins jobs intermittently failing in the end Key: HADOOP-18166 URL: https://issues.apache.org/jira/browse/HADOOP-18166 Project: Hadoop Common

Re: [DISCUSS] Race condition in ProtobufRpcEngine2

Hey Andras, I had a quick look at HADOOP-18143, the methods in question in ProtobufRpcEngine2 are identical to the ones in ProtobufRpcEngine. So, I am not very sure how the race condition doesn't happen in ProtobufRpcEngine. I have to debug and spend some more time, considering that I have revert

[jira] [Reopened] (HADOOP-18082) Add debug log when RPC#Reader gets a Call

[ https://issues.apache.org/jira/browse/HADOOP-18082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reopened HADOOP-18082: --- > Add debug log when RPC#Reader gets a C

[jira] [Resolved] (HADOOP-18082) Add debug log when RPC#Reader gets a Call

[ https://issues.apache.org/jira/browse/HADOOP-18082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18082. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add debug

[jira] [Resolved] (HADOOP-18096) Distcp: Sync moves filtered file to home directory rather than deleting

[ https://issues.apache.org/jira/browse/HADOOP-18096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18096. --- Fix Version/s: 3.4.0 3.3.2 Hadoop Flags: Reviewed Resolution

<    1   2   3   4   >