Re: Why is yarn-ui downloading GBs of dependencies?

2017-09-06 Thread Miklos Szegedi
Do you have the files that were downloaded? Could it be dependencies? Thank you, Miklos On Wed, Sep 6, 2017 at 4:18 PM, Andrew Wang wrote: > Hi folks, > > I ran a test release build today with create-release, and noticed that we > spend a long time downloading

[jira] [Created] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7168: --- Summary: The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted Key: YARN-7168 URL: https://issues.apache.org/jira/browse/YARN-7168

[jira] [Created] (YARN-7167) Replace the MutableCounter type data in "QueueMetrics*" because the RM restart results in data disturbances on ganglia

2017-09-06 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-7167: - Summary: Replace the MutableCounter type data in "QueueMetrics*" because the RM restart results in data disturbances on ganglia Key: YARN-7167 URL:

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-06 Thread larry mccay
Hi Wangda - Thank you for starting this conversation! +1000 for a faster release cadence. Quicker releases make turning around security fixes so much easier. When we consider alpha features, let’s please ensure that they are not delivered in a state that has known security issues and also make

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-06 Thread Anu Engineer
Hi Wangda, We are planning to start the Ozone merge discussion by the end of this month. I am hopeful that it will be merged pretty soon after that. Please add Ozone to the list of features that are being tracked for Apache Hadoop 3.1. We would love to release Ozone as an alpha feature in

Why is yarn-ui downloading GBs of dependencies?

2017-09-06 Thread Andrew Wang
Hi folks, I ran a test release build today with create-release, and noticed that we spend a long time downloading dependencies for the yarn-ui build. The primary offender seems to be Ember: ... [INFO] bower ember#2.2.0 progress Receiving objects: 50% (38449/75444),

[jira] [Created] (YARN-7166) Container REST endpoints should report resource types

2017-09-06 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7166: -- Summary: Container REST endpoints should report resource types Key: YARN-7166 URL: https://issues.apache.org/jira/browse/YARN-7166 Project: Hadoop YARN

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-06 Thread Arun Suresh
Thanks for starting this Wangda. I would also like to add: - YARN-5972: Support Pausing/Freezing of opportunistic containers Cheers -Arun On Wed, Sep 6, 2017 at 1:49 PM, Steve Loughran wrote: > > > On 6 Sep 2017, at 19:13, Wangda Tan wrote: > > >

[jira] [Created] (YARN-7165) Miscellaneous fixes in yarn-native-services

2017-09-06 Thread Jian He (JIRA)
Jian He created YARN-7165: - Summary: Miscellaneous fixes in yarn-native-services Key: YARN-7165 URL: https://issues.apache.org/jira/browse/YARN-7165 Project: Hadoop YARN Issue Type: Sub-task

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-06 Thread Steve Loughran
> On 6 Sep 2017, at 19:13, Wangda Tan wrote: > > Hi all, > > As we discussed on [1], there were proposals from Steve / Vinod etc to have > a faster cadence of releases and to start thinking of a Hadoop 3.1 release > earlier than March 2018 as is currently proposed. > > I

[DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-06 Thread Wangda Tan
Hi all, As we discussed on [1], there were proposals from Steve / Vinod etc to have a faster cadence of releases and to start thinking of a Hadoop 3.1 release earlier than March 2018 as is currently proposed. I think this is a good idea. I'd like to start the process sooner, and establish

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-06 Thread Jian He
> Please correct me if I’m wrong, but the current summary of the branch, > post these changes, looks like: Sorry for confusion, I was actively writing the formal documentation for how to use/how it works etc. and will post soon in a few hours. > On Sep 6, 2017, at 10:15 AM, Allen

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-06 Thread Allen Wittenauer
> On Sep 5, 2017, at 6:23 PM, Jian He wrote: > >> If it doesn’t have all the bells and whistles, then it shouldn’t be on >> port 53 by default. > Sure, I’ll change the default port to not use 53 and document it. >> *how* is it getting launched on a privileged

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-09-06 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/515/ [Sep 5, 2017 9:46:07 AM] (kai.zheng) HDFS-12388. A bad error message in DFSStripedOutputStream. Contributed [Sep 5, 2017 1:16:57 PM] (stevel) HADOOP-14820 Wasb mkdirs security checks inconsistent with

[jira] [Created] (YARN-7164) TestAMRMClientOnRMRestart fails sporadically with bind address in use

2017-09-06 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7164: Summary: TestAMRMClientOnRMRestart fails sporadically with bind address in use Key: YARN-7164 URL: https://issues.apache.org/jira/browse/YARN-7164 Project: Hadoop YARN

[jira] [Created] (YARN-7163) RM crashes with OOM in secured cluster when HA is enabled

2017-09-06 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-7163: --- Summary: RM crashes with OOM in secured cluster when HA is enabled Key: YARN-7163 URL: https://issues.apache.org/jira/browse/YARN-7163 Project: Hadoop YARN