Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

Hi Wei-Chiu, It seems the Maven staging repository is still pointing at RC0: https://repository.apache.org/content/repositories/staging/org/apache/hadoop/hadoop-client/3.3.1/, and it's probably because you need to drop the old RCs in Apache Nexus server. Could you do that? Thanks. Chao On Thu,

PLEASE - compile and post: hadoop.dll and winutils.exe for Windows 10 Pro x64 for 3.2.1 and 3.2.2

Can someone please compile and post (on github) 1. winutils.exe 2. hadoop.dll *for Windows 10 Pro x64* (AMD) for Hadoop 3.2.1 and Hadoop 3.2.2? This does not work: - *https://github.com/cdarlint/winutils * *I get:* *java.io.IOException:

Re: [VOTE] Hadoop 3.1.x EOL

+1 Akira Ajisaka 于2021年6月3日周四 下午2:15写道： > Dear Hadoop developers, > > Given the feedback from the discussion thread [1], I'd like to start > an official vote > thread for the community to vote and start the 3.1 EOL process. > > What this entails: > > (1) an official announcement that no

Re: [VOTE] Hadoop 3.1.x EOL

+1 Qi Zhu ---Original--- From: "Takanobu Asanuma"https://s.apache.org/w9ilb [2] https://www.timeanddate.com/worldclock/fixedtime.html?msg=4iso=20210610T16p1=248 Regards, Akira - To unsubscribe, e-mail:

Apache Hadoop qbt Report: branch-3.3+JDK8 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/6/ [May 28, 2021 1:53:46 AM] (Konstantin Shvachko) HDFS-16040. RpcQueueTime metric counts requeued calls as unique events. Contributed by Simbarashe Dzinamarira. [May 28, 2021 7:27:00 PM] (Steve

[jira] [Created] (HADOOP-17747) Upgrade azure-storage library from v8 to v12

Yong Zhang created HADOOP-17747: --- Summary: Upgrade azure-storage library from v8 to v12 Key: HADOOP-17747 URL: https://issues.apache.org/jira/browse/HADOOP-17747 Project: Hadoop Common Issue

Re: [VOTE] Hadoop 3.1.x EOL

+1 - Takanobu 2021年6月4日(金) 3:47 Ayush Saxena : > +1 > > -Ayush > > > On 03-Jun-2021, at 11:26 PM, hemanth boyina > wrote: > > > > +1 > > > > Thanks > > HemanthBoyina > > > >> On Thu, 3 Jun 2021, 20:33 Wanqiang Ji, wrote: > >> > >> +1 (non-binding) > >> > >> Wanqiang Ji > >> > >>> On Thu, Jun

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/179/ [Jun 1, 2021 7:26:47 AM] (noreply) HDFS-15998. Fix NullPointException In listOpenFiles (#3036) [Jun 1, 2021 1:57:22 PM] (Gergely Pollák) YARN-10797. Logging parameter issues in scheduler package.

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/319/ No changes -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc

Are you developing Hadoop on Windows 10 Pro x64?

Greetings: Are any Hadoop developers working/running on Windows 10 Pro x64 (AMD)? If so, how did you get Hadoop to work/run? --- I am told that to run on Windows 10 Pro x64, that I need to set: 1. HADOOP_HOME ( I set to C:\hadoop) 2. create %HADOOP_HOME%/bin 3. and put two files in there

Your dev contribution to running on Windows 10 Pro x64 (AMD)

Greetings: Are any Hadoop developers working/running on Windows 10 Pro x64 (AMD)? If so, how did you get Hadoop to work/run? --- I am told that to run on Windows 10 Pro x64, that I need to set: HADOOP_HOME ( I set to C:\hadoop) create %HADOOP_HOME%/bin and put two files in there hadoop.dll

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/527/ No changes -1 overall The following subsystems voted -1: blanks pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

Extend for a bit from the last RC, as it takes time to qualify. I'm busy testing, doing - packaging - CLI working with abfs and s3, both fs and cloudstore library calls - building downstream projects (so validating maven artifacts). cloudstore and spark there - building downstream of downstream

[jira] [Created] (HADOOP-17746) compatibility table in directory_markers.md doesn't render right

Steve Loughran created HADOOP-17746: --- Summary: compatibility table in directory_markers.md doesn't render right Key: HADOOP-17746 URL: https://issues.apache.org/jira/browse/HADOOP-17746 Project:

Re: [VOTE] Hadoop 3.1.x EOL

+1 -Ayush > On 03-Jun-2021, at 11:26 PM, hemanth boyina > wrote: > > +1 > > Thanks > HemanthBoyina > >> On Thu, 3 Jun 2021, 20:33 Wanqiang Ji, wrote: >> >> +1 (non-binding) >> >> Wanqiang Ji >> >>> On Thu, Jun 3, 2021 at 10:47 PM Sangjin Lee wrote: >>> >>> +1 >>> >>> On Thu, Jun 3,

[jira] [Created] (HADOOP-17745) ADLS client can throw an IOException when it should throw an InterruptedIOException

Eric Maynard created HADOOP-17745: - Summary: ADLS client can throw an IOException when it should throw an InterruptedIOException Key: HADOOP-17745 URL: https://issues.apache.org/jira/browse/HADOOP-17745

Re: FTPFileSystem can't rename files in different directory

I've seen the JIRA Can you just use -direct and so skip renames entirely? It's written for stores (S3, openstack) where renaming is so slow it kills performance, but it should work here too On Thu, 3 Jun 2021 at 12:55, Jerry Zhao wrote: > HI, > I have a confusion about the reason of

Re: [VOTE] Hadoop 3.1.x EOL

+1 Thanks HemanthBoyina On Thu, 3 Jun 2021, 20:33 Wanqiang Ji, wrote: > +1 (non-binding) > > Wanqiang Ji > > On Thu, Jun 3, 2021 at 10:47 PM Sangjin Lee wrote: > > > +1 > > > > On Thu, Jun 3, 2021 at 7:35 AM Sean Busbey > > wrote: > > > > > +1 > > > > > > > On Jun 3, 2021, at 1:14 AM, Akira

[jira] [Created] (HADOOP-17744) Path.suffix() raises an exception when the path is in the root dir

Steve Loughran created HADOOP-17744: --- Summary: Path.suffix() raises an exception when the path is in the root dir Key: HADOOP-17744 URL: https://issues.apache.org/jira/browse/HADOOP-17744 Project:

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

+1 on extending the vote. It's great to see that the S3 support in 3.3 is so much better! So far everything looks good from Spark side ( https://github.com/apache/spark/pull/30135) but I plan to test it more in the next few days. Best, Chao On Thu, Jun 3, 2021 at 9:56 AM Wei-Chiu Chuang wrote:

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

So I was thinking 5+7 days from Tuesday = next Sunday so that gives everyone a whole week to validate. On Fri, Jun 4, 2021 at 12:38 AM Sean Busbey wrote: > Sounds good to me. That would be until Thursday June 10th, right? > > As a side note it’s concerning that a double-dot maintenance release

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

Sounds good to me. That would be until Thursday June 10th, right? As a side note it’s concerning that a double-dot maintenance release is a big release, but I get that it’s the current state of the project. > On Jun 3, 2021, at 11:30 AM, Wei-Chiu Chuang wrote: > > Hello, > do we want to

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

Hello, do we want to extend the release vote? I understand a big release like this takes time to validate. I am aware a number of people are testing it: Attila tested Ozone on Hadoop 3.3.1 RC3, Stack is testing HBase, Chao tested Spark. I also learned that anecdotally Spark on S3 on Hadoop 3.3 is

[jira] [Created] (HADOOP-17743) Replace Guava Lists usage by Hadoop's own Lists in hadoop-common, hadoop-tools and cloud-storage projects

Viraj Jasani created HADOOP-17743: - Summary: Replace Guava Lists usage by Hadoop's own Lists in hadoop-common, hadoop-tools and cloud-storage projects Key: HADOOP-17743 URL:

Re: [VOTE] Hadoop 3.1.x EOL

+1 (non-binding) Wanqiang Ji On Thu, Jun 3, 2021 at 10:47 PM Sangjin Lee wrote: > +1 > > On Thu, Jun 3, 2021 at 7:35 AM Sean Busbey > wrote: > > > +1 > > > > > On Jun 3, 2021, at 1:14 AM, Akira Ajisaka wrote: > > > > > > Dear Hadoop developers, > > > > > > Given the feedback from the

Re: [VOTE] Hadoop 3.1.x EOL

+1 On Thu, Jun 3, 2021 at 7:35 AM Sean Busbey wrote: > +1 > > > On Jun 3, 2021, at 1:14 AM, Akira Ajisaka wrote: > > > > Dear Hadoop developers, > > > > Given the feedback from the discussion thread [1], I'd like to start > > an official vote > > thread for the community to vote and start the

Re: [VOTE] Hadoop 3.1.x EOL

+1 > On Jun 3, 2021, at 1:14 AM, Akira Ajisaka wrote: > > Dear Hadoop developers, > > Given the feedback from the discussion thread [1], I'd like to start > an official vote > thread for the community to vote and start the 3.1 EOL process. > > What this entails: > > (1) an official

Re: [E] [VOTE] Hadoop 3.1.x EOL

+1 On Thu, Jun 3, 2021 at 1:14 AM Akira Ajisaka wrote: > Dear Hadoop developers, > > Given the feedback from the discussion thread [1], I'd like to start > an official vote > thread for the community to vote and start the 3.1 EOL process. > > What this entails: > > (1) an official announcement

Re: [E] Re: [VOTE] Hadoop 3.1.x EOL

+1 On Thu, Jun 3, 2021 at 6:14 AM Surendra Singh Lilhore < surendralilh...@gmail.com> wrote: > +1 > > Thanks and Regards > Surendra > > > On Thu, Jun 3, 2021 at 4:31 PM tom lee wrote: > > > +1 > > > > Masatake Iwasaki 于2021年6月3日周四 下午5:43写道： > > > > > +1 > > > > > > Masatake Iwasaki > > > > > >

FTPFileSystem can't rename files in different directory

HI, I have a confusion about the reason of FTPFilesystem only support same directory rename, distCp that from other filesystem copying files to ftp filesystem can’t work well, because the distCp write temp files in a temp path, then rename files to different directory. I would like to update

Re: [VOTE] Hadoop 3.1.x EOL

+1 Thanks and Regards Surendra On Thu, Jun 3, 2021 at 4:31 PM tom lee wrote: > +1 > > Masatake Iwasaki 于2021年6月3日周四 下午5:43写道： > > > +1 > > > > Masatake Iwasaki > > > > On 2021/06/03 15:14, Akira Ajisaka wrote: > > > Dear Hadoop developers, > > > > > > Given the feedback from the discussion

[jira] [Resolved] (HADOOP-17152) Implement wrapper for guava newArrayList and newLinkedList

[ https://issues.apache.org/jira/browse/HADOOP-17152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HADOOP-17152. --- Fix Version/s: 3.4.0 Resolution: Fixed Merged the PR. Thank you for the

Re: [VOTE] Hadoop 3.1.x EOL

+1 Masatake Iwasaki On 2021/06/03 15:14, Akira Ajisaka wrote: Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an official announcement that no

?????? [VOTE] Hadoop 3.1.x EOL

+1 ---- ??: "Xiaoqiao He"

Re: [VOTE] Hadoop 3.1.x EOL

+1 On Thu, Jun 3, 2021 at 4:18 PM Bharat Viswanadham wrote: > +1 > > Thanks, > Bharat > > > On Thu, Jun 3, 2021 at 1:00 PM Viraj Jasani wrote: > > > +1 (non-binding) > > > > On Thu, 3 Jun 2021 at 12:21 PM, Wei-Chiu Chuang > > wrote: > > > > > +1 > > > > > > On Thu, Jun 3, 2021 at 2:14 PM

Re: [VOTE] Hadoop 3.1.x EOL

+1 Thanks, Bharat On Thu, Jun 3, 2021 at 1:00 PM Viraj Jasani wrote: > +1 (non-binding) > > On Thu, 3 Jun 2021 at 12:21 PM, Wei-Chiu Chuang > wrote: > > > +1 > > > > On Thu, Jun 3, 2021 at 2:14 PM Akira Ajisaka > wrote: > > > > > Dear Hadoop developers, > > > > > > Given the feedback from

Discusstion and Review for reverting HDFS-9260 FoldedTreeSet

Hi Community, HDFS-9260's performance issue has existed for years, and many companies using hadoop 3.x encounter it. Maybe it's time to revert FoldedTreeSet. Now the PR from Haibin Huang is ready, please see https://github.com/apache/hadoop/pull/3065 Does it make sense? it is a huge

Re: [VOTE] Hadoop 3.1.x EOL

+1 (non-binding) On Thu, 3 Jun 2021 at 12:21 PM, Wei-Chiu Chuang wrote: > +1 > > On Thu, Jun 3, 2021 at 2:14 PM Akira Ajisaka wrote: > > > Dear Hadoop developers, > > > > Given the feedback from the discussion thread [1], I'd like to start > > an official vote > > thread for the community to

[jira] [Reopened] (HADOOP-17742) DistCp: distcp fail when copying to ftp filesystem

[ https://issues.apache.org/jira/browse/HADOOP-17742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jerry reopened HADOOP-17742: > DistCp: distcp fail when copying to ftp filesystem > -- >

Re: [VOTE] Hadoop 3.1.x EOL

+1 On Thu, Jun 3, 2021 at 2:14 PM Akira Ajisaka wrote: > Dear Hadoop developers, > > Given the feedback from the discussion thread [1], I'd like to start > an official vote > thread for the community to vote and start the 3.1 EOL process. > > What this entails: > > (1) an official announcement

[VOTE] Hadoop 3.1.x EOL

Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an official announcement that no further regular Hadoop 3.1.x releases will be made after 3.1.4.

Re: [DISCUSS] which release lines should we still consider actively maintained?

Thank you for your comments. I'll create a vote thread to mark 3.1.x EOL. -Akira On Tue, May 25, 2021 at 12:46 AM Ayush Saxena wrote: > > +1, to mark 3.1.x EOL. > Apache Hive does depends on 3.1.0 as of now, but due to guave upgrade on > branch-3.1, the attempt to migrate to latest 3.1.x