Hi All,
I am currently preparing to release hadoop-3.4.0-RC1 and need to perform
some operations on the JIRA issues related to HADOOP, HDFS, YARN, and
MAPREDUCE. Specifically, the tasks include:
1. For JIRA issues with target version set to 3.4.0 and marked as
non-blocker, update the target
>
>
>
> On Mon, 22 Jan 2024 at 11:50 AM, slfan1989 wrote:
>
>> Thank you very much for specifying the frozen time for the
>> Branch-3.4.0. @Xiaoqiao
>> He
>>
>> If there is a need to backport any PRs to branch-3.4/branch-3.4.0, please
>> feel f
SE and NOTICE files are correct for the repository.
>> >> - [X] Source code artifacts have correct names matching the current
>> >> release.
>> >> - [X] All files have license headers if necessary.
>> >> - [X] Building is OK using `mvn clean install`
We have completed the release of hadoop-thirdparty-1.2.0 according to the
release process of how to release.
We will start preparing for hadoop-3.4.0-RC2 voting.
Looking forward to everything going smoothly!
Best Regards,
Shilun Fan.
On Wed, Feb 7, 2024 at 10:24 AM slfan1989 wrote:
>
Thank you all for your interest in this topic!
In my opinion, upgrading is very beneficial. Based on the roadmap for Spark
4.0, we can see that JDK8/JDK11 is no longer the default version.
Therefore, I believe it is important for us to fully support
JDK11/JDK17/JDK21 in Hadoop.
>From the
Loughran wrote:
>
>
> On Mon, 12 Feb 2024 at 15:32, slfan1989 wrote:
>
>>
>>
>> Note, because the arm64 binaries are built separately on a different
>> platform and JVM, their jar files may not match those of the x86
>> release -and therefore the maven ar
commands.
> compiled gcs-connector successfully using the 3.4.0 version.
>
> qq: what is the difference between RC1 and RC2? apart from some extra
> patches.
>
>
>
> On Thu, Feb 15, 2024 at 10:58 AM slfan1989 wrote:
>
>> Thank you for explaining this part!
>>
>
.
Best Regards,
Shilun Fan.
On Mon, Jan 29, 2024 at 10:33 PM slfan1989 wrote:
> Apache Hadoop 3.4.0
>
> Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop
> 3.4.0.
>
> What we would like is for anyone who can to verify the tarballs, especially
> anyone
ion stuff? that'd be wonderful! I've
> been assuming i'd have to push out a 3.4.1 release for that alone.
>
> On Sat, 10 Feb 2024 at 23:36, slfan1989 wrote:
>
>> We will end the voting for hadoop-3.4.0-RC1 and will open the voting for
>> hadoop-3.4.0-RC2 in 1-2 days.
>>
&
Hi folks,
Xiaoqiao He and I have put together a release candidate (RC2) for Hadoop
3.4.0.
What we would like is for anyone who can to verify the tarballs, especially
anyone who can try the arm64 binaries as we want to include them too.
The RC is available at:
@Ayush Saxena @Takanobu Asanuma
@Xiaoqiao
He @inigo...@apache.org @Masatake
Iwasaki @Akira Ajisaka
Could you please assist with the Hadoop-3.4.0-RC2 vote?
Best Regards,
Shilun Fan.
On Fri, Feb 16, 2024 at 7:27 AM slfan1989 wrote:
> Thank you for helping review hadoop-3.4.0-
> >
> > > +1 from me
> > >
> > > ant and maven repo to build and validate things, including making arm
> > > binaries if you work from an arm macbook.
> > > https://github.com/steveloughran/validate-hadoop-client-artifacts
> > >
> > &g
hirdparty
>> [2] https://github.com/apache/hadoop-thirdparty/pull/19
>> [3] https://github.com/apache/hadoop/pull/6370
>>
>>
>>
>> On 2024/01/04 14:26:37 slfan1989 wrote:
>> > Hey all,
>> >
>> > We are planning to release Hadoop 3.4.0 base on
Hello all,
We plan to release hadoop 3.4.0 based on hadoop trunk, which is the first
hadoop 3.4.0-RC version.
The RC is available at:
https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/ (for amd64)
https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-arm64/ (for arm64)
Maven artifacts
iption about new features of previous release
should be removed from the index.md.vm.
[1]
https://github.com/apache/hadoop/blob/branch-3.4.0/hadoop-project/src/site/markdown/index.md.vm
Masatake Iwasaki
On 2024/01/11 14:15, slfan1989 wrote:
> Hello all,
>
> We plan to release hadoop 3.4.0
> steve
> On Thu, 11 Jan 2024 at 05:15, slfan1989 wrote:
> Hello all,
>
> We plan to release hadoop 3.4.0 based on hadoop trunk, which is the first
> hadoop 3.4.0-RC version.
>
> The RC is available at:
> https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/ (
Dear Community Members,
While discussing release Hadoop 3.4.0, we have also decided to release
Hadoop Thirdparty version 1.2.0.
I'll be initiating some branch preparation work over the weekend.
Best Regards,
Shilun Fan.
-- Forwarded message -
发件人： slfan1989
Date: 2024/01/13 08
or we can prove it won't cause
> any issues. There is a comment which says a block was reported missing post
> the patch that induced it: [1]
>
> [1] https://github.com/apache/hadoop/pull/6244#issuecomment-1793981740
>
> -Ayush
>
>
> On Fri, 12 Jan 2024 at 07:37, slfan1989 wrote:
>
&
+1 on marking 3.2 EOL.
+1 just keeping cherry-picking critical our CVEs without release on
branch-2.10.
+1 The new version is released based on version 3.4.0.
I am willing to take on the work during the release of the new version and
look forward to a smooth release.
Best Regards,
Shilun Fan.
Hey all,
With Inigo's assistance, we collaborated to enhance the functionality of
YARN Federation.
Currently, YARN-5597 is ready, and I look forward to releasing a new
version that includes our modifications.
I agree to release a new version based on 3.4.0 and am willing to assist in
the tasks
+1
On Wed, Dec 6, 2023 at 9:03 AM Chao Sun wrote:
> +1
>
> On Wed, Dec 6, 2023 at 8:39 AM Akira Ajisaka wrote:
> >
> > +1
> >
> >
> >
> > On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote:
> >
> > > Dear Hadoop devs,
> > >
> > > Given the feedback from the discussion thread [1], I'd like to start
Apache Hadoop 3.4.0
Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop
3.4.0.
What we would like is for anyone who can to verify the tarballs, especially
anyone who can try the arm64 binaries as we want to include them too.
The RC is available at:
Hi folks,
Xiaoqiao He and I have put together a release candidate (RC0) for Hadoop
Thirdparty 1.2.0.
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC0
The RC tag is
https://github.com/apache/hadoop-thirdparty/releases/tag/release-1.2.0-RC0
The
> * Validated files have ASF header
>
> Not sure if having diff b/w the git tag & src tar is ok, this doesn't look
> like core code change though, can anybody check & confirm?
>
> -Ayush
>
>
> On Thu, 1 Feb 2024 at 13:39, Xiaoqiao He wrote:
>
>> Gentle pin
ilt from source with `mvn clean install`
> * Successfully compiled Hadoop trunk and branch-3.4 using the Hadoop
> thirdparty 1.2.0
>
> Anyway, since hadoop-thirdparty-1.1.1 has some high vulnerabilities,
> hadoop-thirdparty-1.2.0 would be required for Hadoop-3.4.0.
>
> Thanks,
> - T
and vote.
Best Regards,
Shilun Fan.
On Sun, Feb 4, 2024 at 4:18 PM Shuyan Zhang wrote:
> +1 (non-binding)
>
> - Verified hashes
> - LICENSE and NOTICE are included.
> - Rat check is ok. `mvn clean apache-rat:check`
> - `mvn clean install` works well
>
>
> slfan1989 于2024年
Hi folks,
Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop
Thirdparty 1.2.0.
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC1
The RC tag is
https://github.com/apache/hadoop-thirdparty/releases/tag/release-1.2.0-RC1
The
In JIRA issues where other release versions have been released,
> > remove
> > > > the 3.4.0 entry from the fix version.
> > >
> > > As I mentioned in my comment on HADOOP-18045, I think 3.4.0 should
> still
> > be
> > > included i
>
> Thanks all.
>
> Best Regards,
> - He Xiaoqiao
>
>
>
> On Mon, Jan 22, 2024 at 10:43 AM slfan1989 wrote:
>
>> Thank you for the feedback!
>>
>> I apologize for updating partial information in the Hadoop module.
>>
>> Today, I will comp
path).
>
> BTW, hadoop-thirdparty-1.2.0 will be included in release-3.4.0, hope we
> could finish this vote before 2024/02/06(UTC) if there are no concerns.
> Thanks all.
>
> Best Regards,
> - He Xiaoqiao
>
>
>
> On Mon, Jan 29, 2024 at 10:42 PM slfan1989 wrote:
>
Regards,
> - He Xiaoqiao
>
>
> On Tue, Jan 23, 2024 at 7:58 AM slfan1989 wrote:
>
>> branch-3.4/branch-3.4.0 was created from the trunk branch, including the
>> changes from branch-3.3.
>>
>> Best Regards,
>> Shilun Fan.
>>
>> On Tue,
d.properties:
> hadoop.version=3.4.0
> rc=RC0
> amd.src.dir=https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/
> http.source=https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64
> <https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/http.source=https://home.a
ogether.
> >
> > Tried the below things and everything worked for me.
> >
> > validated checksum and gpg signature.
> > compiled from source.
> > Ran AWS integration tests.
> > untar the binaries and able to access objects in S3 via hadoop fs
> commands.
> >
iao
>
> On Fri, Mar 1, 2024 at 12:19 PM slfan1989 wrote:
>
>> I expect to initiate a vote for hadoop-3.4.0-RC3 in preparation for the
>> hadoop-3.4.0 release. We have been working on this for 2 months and have
>> already released hadoop-thirdparty-1.2.0.
>>
>>
of other members.
Best Regards,
Shilun Fan.
On Fri, Mar 1, 2024 at 6:05 AM slfan1989 wrote:
> Thank you for the feedback on this issue!
>
> We have already released hadoop-thirdparty-1.2.0. I think we should not
> release hadoop-thirdparty-1.2.1 before the launch of hadoop-
.
HADOOP-19084: Pruning hadoop-common transitive dependencies.
I will use hadoop-release-support to package the arm version.
I plan to release hadoop-3.4.0-RC3 next Monday.
Best Regards,
Shilun Fan.
On Sat, Feb 24, 2024 at 11:28 AM slfan1989 wrote:
> Thank you very much for Steve's detailed t
Hi folks,
Xiaoqiao He and I have put together a release candidate (RC3) for Hadoop
3.4.0.
What we would like is for anyone who can to verify the tarballs, especially
anyone who can try the arm64 binaries as we want to include them too.
The RC is available at:
@Xiaoqiao He @Ayush Saxena @Steve
Loughran @Mukund Madhav Thakur
@Takanobu
Asanuma @Masatake Iwasaki
Can you help review and vote for hadoop-3.4.0-RC3? Thank you very much!
Best Regards,
Shilun Fan.
On Tue, Mar 5, 2024 at 6:07 AM slfan1989 wrote:
> Hi folks,
>
> Xiaoqiao He a
uff for its checknative; not expecting problems.
>
> So: i've got some stuff still ongoing, but the core changes to packaging
> are in and the rest I'm not worried about -they shouldn't block the release
> as I already validated them on RC2
>
>
>
>
>
> On Mon, 4 Mar 2024 a
gt;> >> -rw-r--r-- 1 root root 2739952 Sep 19 13:09
>> >> /usr/lib/aarch64-linux-gnu/libcrypto.so.1.1
>> >> -rw-r--r-- 1 root root 4466856 Oct 27 13:40
>> >> /usr/lib/aarch64-linux-gnu/libcrypto.so.3
>> >>
>> >> Anyone got any insights on
On behalf of the Apache Hadoop Project Management Committee, We are
pleased to announce the release of Apache Hadoop 3.4.0.
This is a release of Apache Hadoop 3.4 line.
Key changes include
* S3A: Upgrade AWS SDK to V2
* HDFS DataNode Split one FsDatasetImpl lock to volume grain locks
* YARN
-binding(+2)
Suhail, Ahmar
Dongjoon Hyun
Thank you very much for helping with the review and validation!
We have received 6 binding PMC affirmative votes. hadoop-3.4.0 will be
officially released in the next 1-2 days.
Best Regards,
Shilun Fan.
On Fri, Mar 15, 2024 at 8:32 AM slfan1989 wrote:
>
+1 Option2
I also agree with the idea of upgrading hbase 2.2 to 2.5.
Shilun Fan.
> Hbase v1 is EOL for a while now, so option 2 probably makes sense. While
> you are at it you should probably update the hbase2 version, because 2.2.x
> is also very old and EOL. 2.5.x is the currently maintained
Thank you for your hard work! This is a very meaningful improvement, and
from the design document, we can see a significant increase in HDFS
read/write throughput.
I am happy to see the progress made on HDFS-17384.
However, I still have some concerns, which roughly involve the following
aspects:
44 matches
Mail list logo
