Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-12 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/473/

No changes

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop Ozone 0.4.1-alpha

2019-10-12 Thread Anu Engineer
+1, Binding.

Verified the KEYS
Built from sources and ran tests:
   - General Ozone command line tests
   - Applications like MR and YARN.

--Anu


On Sat, Oct 12, 2019 at 10:25 AM Xiaoyu Yao 
wrote:

> +1 binding. Verified
> * Verify the signature.
> * Build from source.
> * Deploy docker compose in secure mode and verify ACL, sample MR jobs
>
> Thanks,
> Xiaoyu
>
> On Fri, Oct 11, 2019 at 5:37 PM Hanisha Koneru
> 
> wrote:
>
> > Thank you Nanda for putting up the RC.
> >
> > +1 binding.
> >
> > Verified the following:
> >   - Built from source
> >   - Deployed to 5 node cluster and ran smoke tests.
> >   - Ran sanity checks
> >
> > Thanks
> > Hanisha
> >
> > > On Oct 4, 2019, at 10:42 AM, Nanda kumar  wrote:
> > >
> > > Hi Folks,
> > >
> > > I have put together RC0 for Apache Hadoop Ozone 0.4.1-alpha.
> > >
> > > The artifacts are at:
> > > https://home.apache.org/~nanda/ozone/release/0.4.1/RC0/
> > >
> > > The maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1238/
> > >
> > > The RC tag in git is at:
> > > https://github.com/apache/hadoop/tree/ozone-0.4.1-alpha-RC0
> > >
> > > And the public key used for signing the artifacts can be found at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > This release contains 363 fixes/improvements [1].
> > > Thanks to everyone who put in the effort to make this happen.
> > >
> > > *The vote will run for 7 days, ending on October 11th at 11:59 pm IST.*
> > > Note: This release is alpha quality, it’s not recommended to use in
> > > production but we believe that it’s stable enough to try out the
> feature
> > > set and collect feedback.
> > >
> > >
> > > [1] https://s.apache.org/yfudc
> > >
> > > Thanks,
> > > Team Ozone
> >
> >
>


Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree [discussion -> lazy vote]

2019-10-12 Thread Vinod Kumar Vavilapalli
On Mon, Sep 23, 2019 at 4:02 PM Elek, Marton  wrote:

>  As the overall feedback was positive (in fact many of the answers were
> simple +1 votes) I don't think the thread should be repeated under
> [VOTE] subject. Therefore I call it for a lazy consensus.
>

Let's please not do this in the future.

These are large enough changes that we'd like to get formal votes both for
immediate visibility (VOTE threads are more in your face) as well as for
record-keeping in posterity.

Thanks
+Vinod


Re: [VOTE] Release Apache Hadoop Ozone 0.4.1-alpha

2019-10-12 Thread Xiaoyu Yao
+1 binding. Verified
* Verify the signature.
* Build from source.
* Deploy docker compose in secure mode and verify ACL, sample MR jobs

Thanks,
Xiaoyu

On Fri, Oct 11, 2019 at 5:37 PM Hanisha Koneru 
wrote:

> Thank you Nanda for putting up the RC.
>
> +1 binding.
>
> Verified the following:
>   - Built from source
>   - Deployed to 5 node cluster and ran smoke tests.
>   - Ran sanity checks
>
> Thanks
> Hanisha
>
> > On Oct 4, 2019, at 10:42 AM, Nanda kumar  wrote:
> >
> > Hi Folks,
> >
> > I have put together RC0 for Apache Hadoop Ozone 0.4.1-alpha.
> >
> > The artifacts are at:
> > https://home.apache.org/~nanda/ozone/release/0.4.1/RC0/
> >
> > The maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1238/
> >
> > The RC tag in git is at:
> > https://github.com/apache/hadoop/tree/ozone-0.4.1-alpha-RC0
> >
> > And the public key used for signing the artifacts can be found at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > This release contains 363 fixes/improvements [1].
> > Thanks to everyone who put in the effort to make this happen.
> >
> > *The vote will run for 7 days, ending on October 11th at 11:59 pm IST.*
> > Note: This release is alpha quality, it’s not recommended to use in
> > production but we believe that it’s stable enough to try out the feature
> > set and collect feedback.
> >
> >
> > [1] https://s.apache.org/yfudc
> >
> > Thanks,
> > Team Ozone
>
>


Re: VOTE PASSED - Hadoop-3.1.3-RC0 Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-10-12 Thread Vinod Kumar Vavilapalli
Zhankun et.al,

Did we close down the rest of the release process for 3.1.3?

I don't yet see this on the site, so asking.

If it's not done yet and you are running into issues, please let me know
and I can help with the corresponding release management tasks.

Thanks
+Vinod

On Tue, Sep 24, 2019 at 2:16 PM Zhankun Tang  wrote:

> Hi,
>
> Thank you all who spent time to verify and vote 3.1.3 release!
> I‘m pleased to announce that the vote for 3.1.3 RC0 passed! I'll push the
> release bits and send out an announcement for 3.1.3 soon.
>
> Summary of votes for Hadoop-3.1.3-RC0:
>
> 4 binding +1s, from Rohith Sharma K S, Sunil Govindan, Weiwei Yang, Eric
> Payne
>
> 3 non-binding +1s, from Xun Liu, Zac Zhou, Zhankun Tang
>
> 1 non-binding with +0s from Masatake Iwasaki
>
> and *no -1s*.
>
> BR,
> Zhankun
>
> On Tue, 24 Sep 2019 at 15:40, zac yuan  wrote:
>
> > Looking forward to 3.1.3 release. Thanks Zhankun for your great effort~
> >
> > +1 (non-binding)
> >
> > Zac Zhou
> >
> > Xun Liu  于2019年9月23日周一 上午11:49写道:
> >
> > > +1
> > >
> > > Thanks Zhankun for all of your hard work on this release.
> > >
> > >
> > > > On Sep 20, 2019, at 5:34 AM, epa...@apache.org wrote:
> > > >
> > > >
> > > >
> > > > +1 (binding)
> > > >
> > > > Thanks Zhankun for all of your hard work on this release.
> > > >
> > > > I downloaded and built the source and ran it on an insecure
> multi-node
> > > pseudo cluster.
> > > >
> > > > I performed various YARN manual tests, including creating custom
> > > resources, creating queue submission ACLs, and queue refreshes.
> > > >
> > > > One concern is that preemption does not seem to be working when only
> > the
> > > custom resources are over the queue capacity, but I don't think this is
> > > something introduced with this release.
> > > >
> > > > -Eric
> > > >
> > > >
> > > >
> > > > On Thursday, September 12, 2019, 3:04:44 AM CDT, Zhankun Tang <
> > > zt...@apache.org> wrote:
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > Hi folks,
> > > >
> > > > Thanks to everyone's help on this release. Special thanks to Rohith,
> > > > Wei-Chiu, Akira, Sunil, Wangda!
> > > >
> > > > I have created a release candidate (RC0) for Apache Hadoop 3.1.3.
> > > >
> > > > The RC release artifacts are available at:
> > > > http://home.apache.org/~ztang/hadoop-3.1.3-RC0/
> > > >
> > > > The maven artifacts are staged at:
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1228/
> > > >
> > > > The RC tag in git is here:
> > > > https://github.com/apache/hadoop/tree/release-3.1.3-RC0
> > > >
> > > > And my public key is at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > *This vote will run for 7 days, ending on Sept.19th at 11:59 pm PST.*
> > > >
> > > > For the testing, I have run several Spark and distributed shell jobs
> in
> > > my
> > > > pseudo cluster.
> > > >
> > > > My +1 (non-binding) to start.
> > > >
> > > > BR,
> > > > Zhankun
> > > >
> > > > On Wed, 4 Sep 2019 at 15:56, zhankun tang 
> > wrote:
> > > >
> > > >> Hi all,
> > > >>
> > > >> Thanks for everyone helping in resolving all the blockers targeting
> > > Hadoop
> > > >> 3.1.3[1]. We've cleaned all the blockers and moved out non-blockers
> > > issues
> > > >> to 3.1.4.
> > > >>
> > > >> I'll cut the branch today and call a release vote soon. Thanks!
> > > >>
> > > >>
> > > >> [1]. https://s.apache.org/5hj5i
> > > >>
> > > >> BR,
> > > >> Zhankun
> > > >>
> > > >>
> > > >> On Wed, 21 Aug 2019 at 12:38, Zhankun Tang 
> wrote:
> > > >>
> > > >>> Hi folks,
> > > >>>
> > > >>> We have Apache Hadoop 3.1.2 released on Feb 2019.
> > > >>>
> > > >>> It's been more than 6 months passed and there're
> > > >>>
> > > >>> 246 fixes[1]. 2 blocker and 4 critical Issues [2]
> > > >>>
> > > >>> (As Wei-Chiu Chuang mentioned, HDFS-13596 will be another blocker)
> > > >>>
> > > >>>
> > > >>> I propose my plan to do a maintenance release of 3.1.3 in the next
> > few
> > > >>> (one or two) weeks.
> > > >>>
> > > >>> Hadoop 3.1.3 release plan:
> > > >>>
> > > >>> Code Freezing Date: *25th August 2019 PDT*
> > > >>>
> > > >>> Release Date: *31th August 2019 PDT*
> > > >>>
> > > >>>
> > > >>> Please feel free to share your insights on this. Thanks!
> > > >>>
> > > >>>
> > > >>> [1] https://s.apache.org/zw8l5
> > > >>>
> > > >>> [2] https://s.apache.org/fjol5
> > > >>>
> > > >>>
> > > >>> BR,
> > > >>>
> > > >>> Zhankun
> > > >>>
> > > >>
> > > >
> > > > -
> > > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> > > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
> > >
> > >
> > > -
> > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
> > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
> > >
> > >
> >
>


[jira] [Created] (HDDS-2288) Delete hadoop-ozone and hadoop-hdds subprojects from apache trunk

2019-10-12 Thread Marton Elek (Jira)
Marton Elek created HDDS-2288:
-

 Summary: Delete hadoop-ozone and hadoop-hdds subprojects from 
apache trunk
 Key: HDDS-2288
 URL: https://issues.apache.org/jira/browse/HDDS-2288
 Project: Hadoop Distributed Data Store
  Issue Type: Task
Reporter: Marton Elek
Assignee: Marton Elek


As described in the HDDS-2287 ozone/hdds sources are moving to the 
apache/hadoop-ozone git repository.

All the remaining ozone/hdds files can be removed from trunk (including hdds 
profile in main pom.xml)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



[jira] [Created] (HDDS-2287) Move ozone source code to apache/hadoop-ozone from apache/hadoop

2019-10-12 Thread Marton Elek (Jira)
Marton Elek created HDDS-2287:
-

 Summary: Move ozone source code to apache/hadoop-ozone from 
apache/hadoop
 Key: HDDS-2287
 URL: https://issues.apache.org/jira/browse/HDDS-2287
 Project: Hadoop Distributed Data Store
  Issue Type: Task
Reporter: Marton Elek
Assignee: Marton Elek


As discussed and voted on the mailing lists, Apache Hadoop Ozone source code 
will be removed from the hadoop trunk and stored in a separated repository.

 

Original discussion is here:

[https://lists.apache.org/thread.html/ef01b7def94ba58f746875999e419e10645437423ab9af19b32821e7@%3Chdfs-dev.hadoop.apache.org%3E]

(It's started as a discussion but as everybody started to vote it's finished 
with a call to a lazy consensus vote)

 

Technical proposal is shared on the wiki: 
[https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split]

 

Discussed on the community meeting: 
[https://cwiki.apache.org/confluence/display/HADOOP/2019-09-30+Meeting+notes]

 

Which is shared on the mailing list to get more feedback: 
[https://lists.apache.org/thread.html/ed608c708ea302675ae5e39636ed73613f47a93c2ddfbd3c9e24dbae@%3Chdfs-dev.hadoop.apache.org%3E]

 

This issue is created to use the assigned number for any technical commits to 
make it easy to follow the root reason of the commit...



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



[jira] [Created] (HDFS-14905) Backport HDFS persistent memory read cache support to branch-3.2

2019-10-12 Thread Feilong He (Jira)
Feilong He created HDFS-14905:
-

 Summary: Backport HDFS persistent memory read cache support to 
branch-3.2
 Key: HDFS-14905
 URL: https://issues.apache.org/jira/browse/HDFS-14905
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: caching, datanode
Reporter: Feilong He
Assignee: Feilong He
 Fix For: 3.3.0






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org