Hi Sangjin,
Thanks a lot for your work here.
My +1 (binding).
- Downloaded both binary and src tarballs
- Verified md5 checksum and signature for both
- Build from source tarball
- Deployed 2 pseudo clusters, one with the released tarball and the other
with what I built from source, and did the
Thanks Andrew much for the work here!
+1 (binding).
- Downloaded both binary and src tarballs
- Verified md5 checksum and signature for both
- Built from source tarball
- Deployed 2 pseudo clusters, one with the released tarball and the other
with what I built from source, and did the following
Congratulations Andrew and all, a great milestone! Thanks Andrew for
driving it!
--Yongjun
On Tue, Dec 19, 2017 at 9:10 AM, Jonathan Kelly
wrote:
> Thanks, Andrew!
>
> On Mon, Dec 18, 2017 at 4:54 PM Andrew Wang
> wrote:
>
> > Thanks for the spot, I just pushed a correct tag. I can't delete th
Hi All,
>
We have released Apache Hadoop 3.0.2 in April of this year [1]. Since then,
there are quite some commits done to branch-3.0. To further improve the
quality of release, we plan to do 3.0.3 release now. The focus of 3.0.3
will be fixing blockers (3), critical bugs (17) and bug fixes (~130)
-Eric Payne
>
>
>
>
>
> On Monday, May 7, 2018, 12:09:00 AM CDT, Yongjun Zhang <
> yjzhan...@apache.org> wrote:
>
>
>
>
>
> Hi All,
>
> >
> We have released Apache Hadoop 3.0.2 in April of this year [1]. Since then,
> there are quite some
>> downstream projects can't pick it up (after the fact that HBase is one of
>> the most important projects around Hadoop).
>>
>> On Mon, May 7, 2018 at 1:19 PM, Yongjun Zhang
>> wrote:
>>
>> > Hi Eric,
>> >
>> > Thanks for the
please
> refer to CHANGES [2] and RELEASENOTES [3].
> - For download, please got to download page[4]
>
> Thank you all for contributing to the Apache Hadoop 2.9.1.
>
>
> Last, thanks Yongjun Zhang, Junping Du, Andrew Wang and Chris Douglas for
> your help and support.
>
&
in 3.0.3 release. This is a fix that
> will enable HBase to use Hadoop 3.0.x in the production line.
>
> thanks
> Vrushali
>
>
> On Tue, May 8, 2018 at 10:24 AM, Yongjun Zhang
> wrote:
>
>> Thanks Wei-Chiu and Haibo for the feedback!
>>
>> Good thing is th
> too early.
>
> Echoing Eric Payne, I think we should wait to cut the branch until we are
> actually creating the RC to vote on (i.e. on May 29 or 30 if the vote is to
> be on May 30).
>
> Eric
>
>
>
> On Wed, May 23, 2018 at 4:11 PM, Yongjun Zhang
> wrote:
>
Hi All,
I will be working on cutting the 3.0.3 branch and trying a build today.
Thanks.
--Yongjun
On Wed, May 23, 2018 at 3:31 PM, Yongjun Zhang wrote:
> Thanks Eric. Sounds good. I may try to see if I can do the branching/RC
> sooner.
>
> --Yongjun
>
>
> On Wed, Ma
HI,
I did build before cut branch and hit some issues, have not got to the
bottom, will cut branch after the build issues are resolved.
Thanks.
--Yongjun
On Sat, May 26, 2018 at 1:46 PM, Yongjun Zhang wrote:
> Hi All,
>
> I will be working on cutting the 3.0.3 branch and trying a bu
ndrew Wang,
Eddy Xu who helped when I tried to solve the build issues.
At this point, please be aware of the existence of branch-3.0, branch-3.0.3.
Best,
--Yongjun
On Sat, May 26, 2018 at 11:52 PM, Yongjun Zhang wrote:
> HI,
>
> I did build before cut branch and hit some issues, h
Sorry, forgot to mention Junping Du, who also helped me a lot. Many thanks
Junping!
Thanks.
--Yongjun
On Wed, May 30, 2018 at 11:49 AM, Yongjun Zhang
wrote:
> Hi,
>
> The build issues are all solved, and I have cut the 3.0.3 branch and close
> to get a build out. Since it'
rther. Sorry for the inconvenience.
--Yongjun
On Wed, May 30, 2018 at 11:49 AM, Yongjun Zhang
wrote:
> Hi,
>
> The build issues are all solved, and I have cut the 3.0.3 branch and close
> to get a build out. Since it's taking me a bit more time (I expect to send
> vote invitation
Greetings all,
I've created the first release candidate (RC0) for Apache Hadoop
3.0.3. This is our next maintenance release to follow up 3.0.2. It includes
about 249
important fixes and improvements, among which there are 8 blockers. See
https://issues.apache.org/jira/issues/?filter=12343997
The
ems to be private. I can't see the
>> blocker list.
>> https://issues.apache.org/jira/issues/?filter=12343997
>>
>> Meanwhile , I will be working on testing the release.
>>
>> Thanks
>> Shashi
>> On 6/1/18, 11:18 AM, "Yongjun Zhang" wr
>> https://issues.apache.org/jira/issues/?filter=12343997
>
> Even after logging in, I am not able to see any jiras.
> It says "The requested filter doesn't exist or is private."
>
> On Fri, Jun 1, 2018 at 10:41 AM, Yongjun Zhang
> wrote:
>
>> Thank
jobs work as expected
> - Verified that user weights work as expected
> - Verified that FairOrderingPolicy in a CS queue will evenly assign
> resources
> - Verified running yarn shell application runs as expected
>
>
>
>
>
>
>
> On Friday, June 1, 2018,
t; - basic sanity check of NN, RM UI
> >
> > Thanks,
> > Ajay
> >
> > On 6/2/18, 12:45 AM, "Shashikant Banerjee" <
> sbaner...@hortonworks.com>
> > wrote:
> >
> > Hi Yongjun,
> >
Hi Gabor,
I got the git tag in, it's release-3.0.3-RC0. Would you please give it a
try?
It should correspond to
commit 37fd7d752db73d984dc31e0cdfd590d252f5e075
Author: Yongjun Zhang
Date: Wed May 30 00:07:33 2018 -0700
Update version to 3.0.3 to prepare for 3.0.3 release
T
bu Asanuma
> wrote:
>
>> Sorry, I forgot to write my vote in the last message.
>>
>> +1 (non-binding)
>>
>> Regards,
>> Takanobu
>>
>> > -Original Message-
>> > From: Takanobu Asanuma [mailto:tasan...@yahoo-corp.jp]
>> >
Thank you all very much for the testing, feedback and discussion!
I was able to build outside docker, by following the steps Nanda described,
I saw the same problem; then I tried 3.0.2 released a while back, it has
the same issue.
As Allen pointed out, it seems the steps to build site are not cor
BTW, thanks Allen and Steve for discussing and suggestion about the site
build problem I hit earlier, I did the following step
mvn install -DskipTests
before doing the steps Nanda listed helped to solve the problems.
--Yongjun
On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang wrote:
> Th
Hello,
PMC votes are needed for release, can I get some help from PMCs?
Really appreciate it!
--Yongjun
On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang wrote:
> Thank you all very much for the testing, feedback and discussion!
>
> I was able to build outside docker, by following
istributed HDFS with KMS
>>- Ran basic hdfs commands with encryption
>>- Sanity checked webui and logs
>>
>>
>>
>> -Xiao
>>
>> On Fri, Jun 8, 2018 at 10:34 AM, Brahma Reddy Battula <
>> brahmareddy.batt...@hotmail.com> wrote:
>>
Verified that various queue config properties for CS are refreshable
> - Verified streaming jobs work as expected
> - Verified that user weights work as expected
> - Verified that FairOrderingPolicy in a CS queue will evenly assign
> resources
> - Verified running yarn shell applicatio
can resume the build with the
> command
> [ERROR] mvn -rf :hadoop-shim
>
> Not seeing the artifact published here as well.
> https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project
>
> On Tue, Jun 12, 2018 at 6:44 PM, Yongjun Zhang
> wrote:
>
>> Thank
today and now 2.9.1 is pushed to the mvn repo.
>>
>> You can double check it. I suspect sometimes Nexus may fail to notify
>> user when this is unexpected failures.
>>
>>
>>
>>
>>
>> Bests,
>>
>> Sammi
>>
>> *From:* Yongj
--Yongjun
On Mon, Jul 9, 2018 at 2:08 PM, Jonathan Eagles wrote:
> Thank you, Yongjun Zhang for resolving this issue for me. I have verified
> the 3.0.3 build is now working for me for tez to specify as a hadoop
> dependency.
>
> As for release procedure, can someone comment o
hadoop.apache.org/releases.html page.
>
> I just did it, FYI: https://svn.apache.org/viewvc?view=revision&revision=
> 1837967
>
> Thanks
> +Vinod
>
>
> On May 31, 2018, at 10:48 PM, Yongjun Zhang wrote:
>
> Greetings all,
>
> I've created the first re
Great work guys.
Wonder if we can elaborate what's impact of not having #2 fixed, and why #2
is not needed for the feature to complete?
2. Need to fix automatic failover with ZKFC. Currently it does not doesn't
know about ObserverNodes trying to convert them to SBNs.
Thanks.
--Yongjun
On Wed, D
insert calls back into the call queue. That's
> > completely unacceptable. A buggy or malicious client can easily cause
> > livelock in the IPC layer with handlers only looping on calls that never
> > satisfy the condition. Why is this not implemented via
> RetriableExcepti
Great idea Allen, big +1!
Thanks.
--Yongjun
On Thu, Mar 19, 2015 at 11:06 AM, Tsuyoshi Ozawa wrote:
> Hi Allen,
>
> Thank you for the great suggestion. Let's do this!
>
> Thanks,
> - Tsuyoshi
>
> On Fri, Mar 20, 2015 at 2:34 AM, Allen Wittenauer
> wrote:
> >
> > Hi folks,
> >
> > Ther
Thanks Allen a lot for organizing the Haoop Bug Bash, very happy to see
many folks by face!
Wish you all a nice weekend!
--Yongjun
On Tue, May 5, 2015 at 9:31 PM, Allen Wittenauer wrote:
>
> On May 5, 2015, at 8:10 PM, Allen Wittenauer wrote:
>
> > * We’ll be closing registrat
Thanks Vinod and Akira..
I assume we will have at least a committer review of any force-push. Say,
if the commit history already has x, y, z, now we need to force push with
x', we'd better not torget y and z, and if there is conflict putting in y
and z after x', the conflict is better reviewed.
M
good enough for handling them IMO.
>
> Thanks
> +Vinod
>
> > On Jan 14, 2016, at 8:07 PM, Yongjun Zhang wrote:
> >
> > I assume we will have at least a committer review of any force-push. Say,
> > if the commit history already has x, y, z, now we need to force pu
Hi Junping,
Thanks a lot for leading the effort on 2.6.4.
We were discussing in HDFS-9629, and have agreement on adding an additional
step in the release process to update the year in the webui footer. See
https://issues.apache.org/jira/browse/HDFS-9629?focusedCommentId=15130043&page=com.atlassi
HI,
Would like to bring this to your attention:
Per the discussion in HDFS-9629, we think it'd be helpful to add an extra
step in the release process when creating RC. The purpose of this extra
step is to update the release year in Web UI footer.
I have created https://issues.apache.org/jira/bro
Thanks Junping again for working on this release.
+1 (binding),
- Downloaded source tarball and binary tarball
- Verified signature and checksum for both source and binary tarballs
- Compiled and built a single node cluster
- Run HDFS shell commands to create files
- Run distcp job between this n
Thanks Junping and Allen.
It'd be nice to have HDFS-9629 but I'm ok with option 2, given the fact
that the issue is not critical (and will be addressed in all future
releases), and the concern Allen raised.
Best,
--Yongjun
On Wed, Feb 10, 2016 at 8:37 AM, Allen Wittenauer wrote:
>
> > On Feb
Thanks Andrew for initiating the effort!
+1 on pushing 3.x with extended alpha cycle, and continuing the more stable
2.x releases.
--Yongjun
On Thu, Feb 18, 2016 at 5:58 PM, Andrew Wang
wrote:
> Hi Kai,
>
> Sure, I'm open to it. It's a new major release, so we're allowed to make
> these kinds
That's nice, thanks Andrew and Allen.
--Yongjun
On Thu, Mar 3, 2016 at 9:11 PM, Andrew Wang
wrote:
> Hi all,
>
> With the inclusion of HADOOP-12651 going back to branch-2.8, CHANGES.txt
> and release notes are now generated by Yetus. I've gone ahead and deleted
> the manually updated CHANGES.tx
+1 (non-binding), pending the document issue Akira found out
+ downloaded src tarball and did build
+ deployed two pseudo-distributed clusters
+ ran some sample mapreduce job on one cluster
+ ran basic distcp test between the two clusters
Thanks.
--Yongjun
On Sun, Aug 10, 2014 at 9:35 PM, Akira
Thanks Arun for the info and reminder.
Hi Alejandro,
HADOOP-10895 is a blocker in the list Arun sent out and it's currently
owned by you. I wonder whether you will have time to work on. If not, would
you mind reassigning it to me and I will spend time on it?
Thanks.
--Yongjun
On Tue, Oct 14,
Hi,
I posted a patch to hadoop-10895 couple of days back. Wonder if anyone
could help doing a review?
Thanks a lot.
--Yongjun
On Sun, Oct 19, 2014 at 11:35 AM, Yongjun Zhang wrote:
> Thanks Arun for the info and reminder.
>
> Hi Alejandro,
>
> HADOOP-10895 is a blocker in the
Thanks Arun for leading the 2.6 release effort.
+1 (non-binding)
- Downloaded rc1 source and did build
- Created two single-node clusters running 2.6
- Ran sample mapreduce job
- Ran distcp between two clusters
--Yongjun
On Thu, Nov 13, 2014 at 3:08 PM, Arun C Murthy wrote:
> Folks,
>
> I've
Hi Suresh,
I did review HDFS-6833 and the patch Shinichi provided a while back. It's
not really directly related to replication factor. The problem reported
there is, DirectoryScanner tries to register with NN blocks already
scheduled to be deleted as regular blocks, due to the delay in block
remo
Hi,
Thanks for working on 2.7 release.
Currently the fallback from KerberosAuthenticator to
PseudoAuthenticator is enabled by default in a hardcoded way. HAOOP-10895
changes the default and requires applications (such as oozie) to set a
config property or call an API to enable the fallback.
Thi
Thanks Andrew for the proposal.
+1, and I will be happy to help.
--Yongjun
On Mon, Mar 2, 2015 at 3:19 PM, Andrew Wang
wrote:
> Hi devs,
>
> It's been a year and a half since 2.x went GA, and I think we're about due
> for a 3.x release.
> Notably, there are two incompatible changes I'd like
Thanks all.
There is an open issue HDFS-6962 (ACLs inheritance conflicts with
umaskmode), for which the incompatibility appears to make it not suitable
for 2.x and it's targetted 3.0, please see:
https://issues.apache.org/jira/browse/HDFS-6962?focusedCommentId=14335418&page=com.atlassian.jira.plu
Yongjun Zhang created MAPREDUCE-6572:
Summary: Improved incremental data copy of distcp for truncated
file
Key: MAPREDUCE-6572
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6572
Project
Yongjun Zhang created MAPREDUCE-5698:
Summary: Backport MAPREDUCE-1285 to branch-1
Key: MAPREDUCE-5698
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5698
Project: Hadoop Map/Reduce
Yongjun Zhang created MAPREDUCE-5710:
Summary: To backport MAPREDUCE-1305 to branch-1
Key: MAPREDUCE-5710
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5710
Project: Hadoop Map/Reduce
Yongjun Zhang created MAPREDUCE-6233:
Summary: org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort
failed in trunk
Key: MAPREDUCE-6233
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6233
Yongjun Zhang created MAPREDUCE-6262:
Summary: Factor OSType out from Shell: changes in mapreduce
Key: MAPREDUCE-6262
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6262
Project: Hadoop Map
55 matches
Mail list logo