+1
On Wed, Dec 6, 2023 at 8:39 AM Akira Ajisaka wrote:
>
> +1
>
>
>
> On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote:
>
> > Dear Hadoop devs,
> >
> > Given the feedback from the discussion thread [1], I'd like to start
> > an official thread for the community to vote on release line 3.2 EOL.
[
https://issues.apache.org/jira/browse/HADOOP-18279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-18279.
---
Resolution: Fixed
> Cancel fileMonitoringTimer even if trustManager isn't defi
Hmm I'm looking at HADOOP-11867 related stuff but couldn't find it
mentioned anywhere in change log or release notes. Are they actually
up-to-date?
On Mon, Jan 2, 2023 at 7:48 AM Masatake Iwasaki
wrote:
>
> >- building HBase 2.4.13 and Hive 3.1.3 against 3.3.5 failed due to
> > dependency
[
https://issues.apache.org/jira/browse/HADOOP-18383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-18383.
---
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Codecs with @DoNotP
I'm still trying to get a successful run from Spark side here:
https://github.com/apache/spark/pull/37281. The last CI run failed,
but most likely due to some issue not related to Hadoop.
On Thu, Aug 4, 2022 at 10:27 AM Steve Loughran
wrote:
>
> The vote passed with the following result.
>
>
[
https://issues.apache.org/jira/browse/HADOOP-18331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-18331.
---
Resolution: Duplicate
> Shouldn't relocate org/wildfly/openssl in shaded cli
Chao Sun created HADOOP-18331:
-
Summary: Shouldn't relocate org/wildfly/openssl in shaded client
Key: HADOOP-18331
URL: https://issues.apache.org/jira/browse/HADOOP-18331
Project: Hadoop Common
+1
- Compiled from source
- Verified checksums & signatures
- Launched a pseudo HDFS cluster and ran some simple commands
- Ran full Spark tests with the RC
Thanks Steve!
Chao
On Mon, May 16, 2022 at 2:19 AM Ayush Saxena wrote:
>
> +1,
> * Built from source.
> * Successful native build on
t; > >
> > > On Sat, May 7, 2022 at 10:52 AM Ayush Saxena wrote:
> > >
> > >> Hmm, I see the artifacts ideally should have got overwritten by the new
> > >> RC, but they didn’t. The reason seems like the staging path shared
> > doesn’t
> &g
?
>
> On Sat, 7 May 2022 at 06:18, Chao Sun wrote:
>>
>> Seems there are some issues with the shaded client as I was not able
>> to compile Apache Spark with the RC
>> (https://github.com/apache/spark/pull/36474). Looks like it's compiled
>> with the `-Dskip
Seems there are some issues with the shaded client as I was not able
to compile Apache Spark with the RC
(https://github.com/apache/spark/pull/36474). Looks like it's compiled
with the `-DskipShade` option and the hadoop-client-api JAR doesn't
contain any class:
➜ hadoop-client-api jar tf
Thanks all! I really appreciate all the help I received while working
on Hadoop, and looking forward to contributing more to this project!
A small correction: my given name is actually Chao. I made a mistake
when adding my full name to the apache account :).
Best,
Chao
On Tue, Mar 8, 2022 at
t; - He Xiaoqiao
>
> [1] https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>
> On Sun, Mar 6, 2022 at 10:14 AM Chao Sun wrote:
>
>> Ah I forgot to do `hugo` before committing the changes. Sorry. It should
>> be
>> good now.
>>
>> Chao
>&
Ah I forgot to do `hugo` before committing the changes. Sorry. It should be
good now.
Chao
On Sat, Mar 5, 2022 at 9:28 AM Chao Sun wrote:
> Hmm interesting. I followed the steps in that second link you posted,
> and the results looked good when I ran `hugo serve` locally: I c
cement
> about release 3.3.2. If we missed any steps to publish following
> guidelines[2]? Thanks.
>
> Best Regards,
> - He Xiaoqiao
>
> [1] https://hadoop.apache.org/
> [2] https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>
>
> On Fri, Mar 4, 2022 at 1:23
Hi All,
It gives me great pleasure to announce that the Apache Hadoop community has
voted to release Apache Hadoop 3.3.2.
This is the second stable release of Apache Hadoop 3.3 line. It contains
284 bug fixes, improvements and enhancements since 3.3.1.
Users are encouraged to read the overview
the
> contents.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/02/22 14:17, Chao Sun wrote:
> > Hi all,
> >
> > Here's Hadoop 3.3.2 release candidate #5:
> >
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC5
> > The
Hi all, I just started another voting thread for RC5. Please evaluate and
vote there. Thanks!
On Mon, Feb 21, 2022 at 10:46 AM Chao Sun wrote:
> Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
> too. I'll start a new RC with the only change being the CHANGELOG.
Hi all,
Here's Hadoop 3.3.2 release candidate #5:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC5
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC5
The Maven artifacts are staged at:
Chao Sun created HADOOP-18138:
-
Summary: UserGroupInformation shouldn't log exception
Key: HADOOP-18138
URL: https://issues.apache.org/jira/browse/HADOOP-18138
Project: Hadoop Common
Issue Type
curious if this requires new RC or you would like to update
>>> Changelog
>>> in the existing RC. Either way, once Changelog is updated, and since
>>> other
>>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>>
>>>
>>&
e other
>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>
>>
>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun wrote:
>>
>> > Thanks again Viraj!
>> >
>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-1772
7728
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
> 3.3.2:
> HADOOP-17936
> HADOOP-18066
>
>
>
> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun wro
P-17290
> HADOOP-17819
> YARN-9551
>
>
>
> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani wrote:
>
> > Thanks Chao. Yes contents are now present, I will start the testing.
> >
> >
> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun wrote:
> >
> >>
gt; On Sat, Feb 12, 2022 at 3:12 AM Chao Sun wrote:
>
>> Hi all,
>>
>> Sorry for the delay! was waiting for a few fixes that people have
>> requested
>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>
>> The RC is available at:
Hi all,
Sorry for the delay! was waiting for a few fixes that people have requested
to backport. I've just put together Hadoop 3.3.2 RC4 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
The RC tag is at:
and regards,
> > Akira
> >
> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> iwasak...@oss.nttdata.co.jp <mailto:iwasak...@oss.nttdata.co.jp>> wrote:
> >
> > Thanks for putting this up, Chao Sun.
> >
> > I got following error on building t
Hi all,
I've put together Hadoop 3.3.2 RC3 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
The Maven artifacts are staged at:
estlet:jar:2.3.0: Could not transfer artifact
> > > org.restlet.jee:org.restlet:pom:2.3.0 from/to
> maven-default-http-blocker
> > (
> > > http://0.0.0.0/): Blocked mirror for repositories: [maven-restlet (
> > > http://maven.restlet.org, default, rele
Thanks for the update Steve!
Mukund: could you please share the command to get the error above? I tried
a few approaches but couldn't reproduce it :(
Thanks again!
Best,
Chao
On Mon, Jan 24, 2022 at 7:16 AM Steve Loughran wrote:
>
> fix is in t disable auditing, which is now the default
>
luster w/ NN, 1 DN, RM, AHS, JHS, and
> 3
> > NMs
> >
> > - Validated inter- and intra-queue preemption
> >
> > - Validated exclusive node labels
> >
> > Thanks a lot Chao for your diligence and hard work on this release.
> >
> > Eric
> >
>
t; > >
> > > all happy
> > >
> > >
> > >
> > > *## binary*
> > > downloaded KEYS and imported, so adding your key to my list (also
> signed
> > > this and updated th
Hi all,
I've put together Hadoop 3.3.2 RC2 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC2/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC2
The Maven artifacts are staged at:
[
https://issues.apache.org/jira/browse/HADOOP-16223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-16223.
---
Fix Version/s: 3.3.2
(was: 3.3.3)
Hadoop Flags: Reviewed
ow how long
that will take to stabilize.
Sounds good.
Hope everyone had a good holiday break! I'll address the above issues and
create RC1 soon.
Thanks,
Chao
On Thu, Dec 30, 2021 at 6:00 AM Steve Loughran
wrote:
> On Tue, 14 Dec 2021 at 22:56, Chao Sun wrote:
>
> > Thanks all
> I'll do my best to test this; I'm a bit broken right now.
>
> I think we should mention in a release notes that is the version of a
> log4j included in this and all previous releases is not vulnerable. But
> provide a list plus links to any that have been fixed
>
> On Fri, 10 D
Hi all,
Sorry for the long delay. I've prepared RC0 for Hadoop 3.3.2 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC0/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC0
The Maven artifacts are staged at:
Hi, I just created a release branch branch-3.3.2 and updated the version of
branch-3.3 to 3.3.3-SNAPSHOT. Will try to get the RC1 ready soon.
On Thu, Oct 28, 2021 at 9:58 AM Chao Sun wrote:
> Hi, sorry for the delay! I plan to start the release process within a few
> days.
>
> On
Hi, sorry for the delay! I plan to start the release process within a few
days.
On Thu, Oct 28, 2021 at 3:25 AM Hui Fei wrote:
> Thank you, Chao!
> Do you need any help? I can assist you.
>
> Chao Sun 于2021年9月8日周三 上午1:06写道：
>
>> Hi all,
>>
>> It has been almost
[
https://issues.apache.org/jira/browse/HADOOP-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17936.
---
Fix Version/s: 3.3.2
3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
Chao Sun created HADOOP-17936:
-
Summary: Fix test failure after reverting HADOOP-16878 from
branch-3.3
Key: HADOOP-17936
URL: https://issues.apache.org/jira/browse/HADOOP-17936
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17868.
---
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Assignee: L. C. Hsieh
Resolution
[
https://issues.apache.org/jira/browse/HADOOP-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17891.
---
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Assignee: L. C. Hsieh
Resolution
t; On Tue, 7 Sep 2021 at 10:36 PM, Chao Sun wrote:
>
>> Hi all,
>>
>> It has been almost 3 months since the 3.3.1 release and branch-3.3 has
>> accumulated quite a few commits (118 atm). In particular, Spark community
>> recently found an issue which prevents one fr
[
https://issues.apache.org/jira/browse/HADOOP-17877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17877.
---
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Assignee: L. C. Hsieh
Resolution
[
https://issues.apache.org/jira/browse/HADOOP-17887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17887.
---
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Assignee: L. C. Hsieh
Resolution
Hi all,
It has been almost 3 months since the 3.3.1 release and branch-3.3 has
accumulated quite a few commits (118 atm). In particular, Spark community
recently found an issue which prevents one from using the shaded Hadoop
client together with certain compression codecs such as lz4 and snappy
[
https://issues.apache.org/jira/browse/HADOOP-17825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17825.
---
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Assignee: L. C. Hsieh
Resolution
+1 (non-binding)
- verified signature and checksum
- launched a single docker based cluster and ran some simple HDFS commands
- build Spark master with 3.3.1 RC and : 1) run full Spark test suites and
all success; 2) tested simple Spark commands against a S3 endpoint; 3)
tested Spark on YARN with
Hi Wei-Chiu,
It seems the Maven staging repository is still pointing at RC0:
https://repository.apache.org/content/repositories/staging/org/apache/hadoop/hadoop-client/3.3.1/,
and it's probably because you need to drop the old RCs in Apache Nexus
server. Could you do that? Thanks.
Chao
On Thu,
+1 on extending the vote. It's great to see that the S3 support in 3.3 is
so much better! So far everything looks good from Spark side (
https://github.com/apache/spark/pull/30135) but I plan to test it more in
the next few days.
Best,
Chao
On Thu, Jun 3, 2021 at 9:56 AM Wei-Chiu Chuang
wrote:
+1. I think this will be very helpful.
On Thu, May 20, 2021 at 3:10 PM Sangjin Lee wrote:
> +1 (binding). It's long overdue IMHO.
>
> On Thu, May 20, 2021 at 2:11 PM Gergely Pollak
> wrote:
>
> > I really like this initiative, thank you!
> > +1 for line length increase to 100 characters.
> >
>
+1 (non-binding)
- verified checksums & signatures
- started a single-node cluster in docker and did some simple tests, also
checked NN web-ui
- Did a full test run in Spark using the RC and it looks good
On Thu, Jan 7, 2021 at 3:01 AM 孙立晟 wrote:
> +1 (non-binding)
>
> - Build from source with
mat#testMissingBlocks fails
> (#2136)
> > HDFS-13404. Addendum: RBF:
> > TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail.
> > Contributed by Takanobu Asanuma.
> > HADOOP-16080. hadoop-aws does not work with hadoop-client-api (#2510).
> > Contributed
ll
>> check
>> > further. If it's in the release I was thinking of adding a warning in
>> the
>> > notes "unstable API"; stable if invoked from DFSClient
>>
>> On Fri, 11 Dec 2020 at 18:21, Chao Sun wrote:
>> >
>> > > I'm just
I'm just curious why this is included in the 3.2.2 release? HDFS-15567 is
tagged with 3.2.3 and the corresponding HDFS-14272 on server side is tagged
with 3.3.0.
> If it goes into FS/FC, what does it do for a viewfs with >1 mounted HDFS?
Should it take path, msync(path) so that viewFS knows where
[
https://issues.apache.org/jira/browse/HADOOP-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-16080.
---
Fix Version/s: 3.2.2
Hadoop Flags: Reviewed
Assignee: Chao Sun
Resolution
Thanks Xiaoqiao. I just committed the fix to branch-3.2 (and will port it
to other branches as well later). Could you cherry-pick it to branch-3.2.2
and start another RC? really appreciate it.
Best,
Chao
On Wed, Dec 2, 2020 at 7:59 PM Xiaoqiao He wrote:
> Thanks Chao Sun for your qu
Thanks Xiaoqiao for the work! Unfortunately we just discovered an issue
(HADOOP-16080) which prevents Spark from consuming this release. I'm
working on a PR for this and wondering if we can include the fix in the
release too.
Thanks again and apologies for the late notice.
Best,
Chao
On Mon,
[
https://issues.apache.org/jira/browse/HADOOP-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17399.
---
Fix Version/s: (was: 3.3.0)
3.4.0
Target Version/s: 3.3.1, 3.4.0
[
https://issues.apache.org/jira/browse/HADOOP-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17292.
---
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Using lz4-j
+1 (non-binding) from me as well:
- download the source and build it on mac successfully
- verified all md5, sha512 as well as signatures, however @Xiaoqiao I was
not able to find your public key in
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS so had to use the
other link.
- started a
[
https://issues.apache.org/jira/browse/HADOOP-17324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17324.
---
Fix Version/s: 3.4.0
Resolution: Fixed
> Don't relocate org.bouncycastle in shaded cli
[
https://issues.apache.org/jira/browse/HADOOP-17327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17327.
---
Resolution: Fixed
> NPE when starting MiniYARNCluster from hadoop-client-miniclus
Chao Sun created HADOOP-17373:
-
Summary: hadoop-client-integration-tests doesn't work when
building with skipShade
Key: HADOOP-17373
URL: https://issues.apache.org/jira/browse/HADOOP-17373
Project
Chao Sun created HADOOP-17327:
-
Summary: NPE when starting MiniYARNCluster from
hadoop-client-minicluster
Key: HADOOP-17327
URL: https://issues.apache.org/jira/browse/HADOOP-17327
Project: Hadoop Common
Chao Sun created HADOOP-17324:
-
Summary: ClassNotFoundException:
org.apache.hadoop.shaded.org.bouncycastle.operator.OperatorCreationException
Key: HADOOP-17324
URL: https://issues.apache.org/jira/browse/HADOOP-17324
Mon, Oct 12, 2020 at 8:59 PM Wu,Jianliang(vip.com) <
> > jianliang...@vipshop.com> wrote:
> >
> >> In our case, when nn has upgraded to 3.1.3 and dn’s version was still
> >> 2.6, we found hive to call getContentSummary method , the client and
> >> server wa
Hi community,
Does Hadoop 3.x provide wire compatibility between 3.x clients and 2.x
server? There is a blog post from Cloudera [1] mentioning wire
compatibility between 2.x clients and 3.x server, but not the other
direction. Curious if someone knows this. Also it'd be good to know if
someone is
[
https://issues.apache.org/jira/browse/HADOOP-17287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HADOOP-17287.
---
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Support new Insta
Chao Sun created HADOOP-17205:
-
Summary: Move personality file from Yetus to Hadoop repository
Key: HADOOP-17205
URL: https://issues.apache.org/jira/browse/HADOOP-17205
Project: Hadoop Common
Congratulations Ayush!
On Fri, Jul 24, 2020 at 6:43 AM Rahul Gupta wrote:
> Congratulations
>
> On Thu, Jul 23, 2020 at 8:02 PM HarshaKiran Reddy Boreddy <
> bharsh...@gmail.com> wrote:
>
> > Congratulations Ayush Saxena..!!!
> >
> > On Thu, Jul 23, 2020, 8:39 AM Xiaoqiao He wrote:
> >
> > >
Congrats Xiaoqiao!
On Thu, Jun 11, 2020 at 9:36 AM Ayush Saxena wrote:
> Congratulations He Xiaoqiao!!!
>
> -Ayush
>
> > On 11-Jun-2020, at 9:30 PM, Wei-Chiu Chuang wrote:
> >
> > In bcc: general@
> >
> > It's my pleasure to announce that He Xiaoqiao has been elected as a
> > committer on the
We are also very interested to learn from this experience, and I can help
on the translation too. Please let me know if help needed.
Best,
Chao
On Fri, Dec 20, 2019 at 9:38 AM Chen Liang wrote:
> Thanks again for driving the syncup Wei-Chiu! I am also super interested
> in learning about this
Chao Sun created HADOOP-16359:
-
Summary: Bundle ZSTD native in branch-2
Key: HADOOP-16359
URL: https://issues.apache.org/jira/browse/HADOOP-16359
Project: Hadoop Common
Issue Type: Improvement
+1 (no-binding)
At Uber we've deployed a subset of features covered in this JIRA in
production at multiple data centers, and it's being running great for a
while now. We are seeing huge benefits in terms of scaling our NameNode
throughput and providing better SLA guarantees for applications such
76 matches
Mail list logo
