RE: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Chen, Sammi
+ 1. Thanks for the great work. Looking forward to see the SPS in the next rerelease. Bests, Sammi -Original Message- From: Uma Maheswara Rao G [mailto:hadoop@gmail.com] Sent: Wednesday, August 1, 2018 2:38 PM To: hdfs-dev@hadoop.apache.org Subject: [VOTE] Merge Storage

Re: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Jitendra Pandey
+1 On 7/31/18, 11:38 PM, "Uma Maheswara Rao G" wrote: Hi All, From the positive responses from JIRA discussion and no objections from below DISCUSS thread [1], I am converting it to voting thread. Last couple of weeks we spent time on testing the

[jira] [Resolved] (HDFS-13803) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui resolved HDFS-13803. Resolution: Invalid > RBF: Remove FSCK from Router Web UI, because fsck is not supported currently >

[jira] [Created] (HDFS-13803) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
Fei Hui created HDFS-13803: -- Summary: RBF: Remove FSCK from Router Web UI, because fsck is not supported currently Key: HDFS-13803 URL: https://issues.apache.org/jira/browse/HDFS-13803 Project: Hadoop HDFS

[jira] [Created] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
Fei Hui created HDFS-13802: -- Summary: RBF: Remove FSCK from Router Web UI, because fsck is not supported currently Key: HDFS-13802 URL: https://issues.apache.org/jira/browse/HDFS-13802 Project: Hadoop HDFS

Re: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Shashikant Banerjee
+1 (non-binding) Thanks Shashi On 8/8/18, 9:04 AM, "Mukul Kumar Singh" wrote: +1, Thanks for the great work. Thanks, Mukul On 08/08/18, 8:55 AM, "Rakesh Radhakrishnan" wrote: +1 Thanks, Rakesh On Wed, Aug 1,

Re: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Mukul Kumar Singh
+1, Thanks for the great work. Thanks, Mukul On 08/08/18, 8:55 AM, "Rakesh Radhakrishnan" wrote: +1 Thanks, Rakesh On Wed, Aug 1, 2018 at 12:08 PM, Uma Maheswara Rao G wrote: > Hi All, > > > > From the positive responses from JIRA

Re: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Rakesh Radhakrishnan
+1 Thanks, Rakesh On Wed, Aug 1, 2018 at 12:08 PM, Uma Maheswara Rao G wrote: > Hi All, > > > > From the positive responses from JIRA discussion and no objections from > below DISCUSS thread [1], I am converting it to voting thread. > > > > Last couple of weeks we spent time on testing the

[jira] [Created] (HDDS-335) Fix logging for scm events

2018-08-07 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDDS-335: --- Summary: Fix logging for scm events Key: HDDS-335 URL: https://issues.apache.org/jira/browse/HDDS-335 Project: Hadoop Distributed Data Store Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Chandni Singh
Thanks Wangda! +1 (non-binding) Tested the following: - Built from source and ran a single node cluster - Ran the example pi job - Launched yarn service sleep example - Verified upgrade of yarn service sleep Thanks, Chandni On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Suma Shivaprasad
Thanks Wangda! +1 (non-binding) Tested the following: - Built from source - Setup single node cluster - Tested Dynamic queues - Tested MR and DS with default, docker runtime - Tested Yarn Services with various restart policies Thanks Suma On Tue, Aug 7, 2018 at 2:45 PM Eric Payne

[jira] [Created] (HDDS-334) Update GettingStarted page to mention details about Ozone GenConf tool

2018-08-07 Thread Dinesh Chitlangia (JIRA)
Dinesh Chitlangia created HDDS-334: -- Summary: Update GettingStarted page to mention details about Ozone GenConf tool Key: HDDS-334 URL: https://issues.apache.org/jira/browse/HDDS-334 Project: Hadoop

[jira] [Created] (HDDS-333) Create an Ozone Logo

2018-08-07 Thread Anu Engineer (JIRA)
Anu Engineer created HDDS-333: - Summary: Create an Ozone Logo Key: HDDS-333 URL: https://issues.apache.org/jira/browse/HDDS-333 Project: Hadoop Distributed Data Store Issue Type: Improvement

[jira] [Created] (HDDS-332) Remove the ability to configure ozone.handler.type

2018-08-07 Thread Dinesh Chitlangia (JIRA)
Dinesh Chitlangia created HDDS-332: -- Summary: Remove the ability to configure ozone.handler.type Key: HDDS-332 URL: https://issues.apache.org/jira/browse/HDDS-332 Project: Hadoop Distributed Data

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-08-07 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-trunk-win/551/ [Aug 6, 2018 4:37:59 PM] (eyang) YARN-8624. Updated verbiage around entry point support. [Aug 7, 2018 1:32:51 AM] (yqlin) HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao [Aug 7, 2018

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Eric Payne
Thanks Wangda for creating this release. +1 (binding) Tested: - Built from source - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with hierarchical queue structure (CS) - Refreshed queue (CS) properties - Intra-queue preemption (CS) - inter-queue preemption (CS) - User weights (CS)

[jira] [Resolved] (HDDS-331) Fix docker-compose for ozone-perf

2018-08-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-331. - Resolution: Not A Bug Need to run the init.sh script to copy the jar. Problem is fixed after that.  > Fix

[jira] [Created] (HDFS-13801) Fix docker-compose for ozone-perf

2018-08-07 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-13801: - Summary: Fix docker-compose for ozone-perf Key: HDFS-13801 URL: https://issues.apache.org/jira/browse/HDFS-13801 Project: Hadoop HDFS Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Wangda Tan
Thanks everyone for voting! With 4 binding votes, 10 non-binding votes and no veto. The vote passed, I'm going to work on staging the release. Best, Wangda On Tue, Aug 7, 2018 at 12:33 PM Nandakumar Vadivelu < nvadiv...@hortonworks.com> wrote: > Thanks for all the hard work Wangda! > +1 > > *

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Nandakumar Vadivelu
Thanks for all the hard work Wangda! +1 * Verified pgp signatures * Verified MD5 checksums * Verified both source and binary releases * Installed pseudo distributed cluster * Verified hdfs filesystem commands * Verified hdfs admin commands * Verified hdfs snapshot commands * Basic sanity check on

[jira] [Created] (HDFS-13800) Improve the error message when contacting an IPC port via a browser

2018-08-07 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-13800: --- Summary: Improve the error message when contacting an IPC port via a browser Key: HDFS-13800 URL: https://issues.apache.org/jira/browse/HDFS-13800 Project:

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Gabor Bota
Thanks for the work Wangda Tan! +1 (non-binding) checked out git tag release-3.1.1-RC0 hadoop-aws integration (mvn verify) test run was successful on eu-west-1 built from source on Mac OS X 10.13.6, java version 8.0.181-oracle deployed on a 3 node cluster verified pi job (yarn), teragen,

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Shane Kumpf
+1 (binding) - Thanks for putting this together Wangda. - Built from source - Deployed a single node cluster on CentOS 7.4 - Basic dfs command checkout - Ran dshell, MR pi, and MR sleep with the default and docker runtimes - Validated the ability to disable the docker runtime - Validated the

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Craig . Condit
+1 (non-binding). Built from tag, spun up single-node cluster, ran basic DFS commands, various MR / YARN jobs with and without Docker. Craig Condit On 2018/08/02 18:43:50, Wangda Tan mailto:w...@gmail.com>> wrote: > Hi folks,> > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Ajay Kumar
+1 (non-binding) Thanks for working on this Wangda!! - built from source on mac, jdk1.8.0_111 - deployed on a 3 node non-secure cluster - tested basic hdfs cli functionality (put,get, delete,ls etc) - executed sample MR jobs (wordcount, TestDFSIO read/write) - Basic sanity

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Kitti Nánási
Thanks Wangda for working on this! +1 (non-binding) - checked out git tag release-3.1.1-RC0 - built from source on Mac OS X 10.13.4, java version 8.0.172-zulu - deployed on a 3 node cluster - ran terasort, teragen, teravalidate with success - executed basic hdfs and dfsadmin commands - executed

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Brahma Reddy Battula
+1 ,(binding). Wangda Tan thanks for driving this. --Built with source. --Installed the HA cluster --Ran basic hdfs operations through shell/API --Ran Sample jobs like pi, wordcount --Browsed UI. On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan wrote: > Hi folks, > > I've created RC0 for Apache

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Eric Badger
+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs On Tue, Aug 7, 2018 at 8:46 AM, Shashikant Banerjee < sbaner...@hortonworks.com> wrote: > +1(non-binding) > > * checked out git tag

Re: 回复:[VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Nandakumar Vadivelu
+1 for the merge. Thanks for the work Uma et al. -Nanda On 8/7/18, 7:35 PM, "Vinayakumar B" wrote: +1 Great work guys. -Vinay On Tue, 7 Aug 2018, 7:20 pm Anu Engineer, wrote: > +1, Sorry for the late vote. Thanks for the perseverance and seeing this >

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-08-07 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/861/ [Aug 6, 2018 4:37:59 PM] (eyang) YARN-8624. Updated verbiage around entry point support. [Aug 7, 2018 1:32:51 AM] (yqlin) HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao

Re: 回复:[VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Vinayakumar B
+1 Great work guys. -Vinay On Tue, 7 Aug 2018, 7:20 pm Anu Engineer, wrote: > +1, Sorry for the late vote. Thanks for the perseverance and seeing this > thru. > > --Anu > > > On 8/7/18, 1:04 AM, "郑锴(铁杰)" wrote: > > +1 for the work to be in. Thanks Uma and folks for the hard taking! > >

Re: 回复:[VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Anu Engineer
+1, Sorry for the late vote. Thanks for the perseverance and seeing this thru. --Anu On 8/7/18, 1:04 AM, "郑锴(铁杰)" wrote: +1 for the work to be in. Thanks Uma and folks for the hard taking! When it's in, I'd suggest we use a more general name for the new daemon service. It'd be

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Shashikant Banerjee
+1(non-binding) * checked out git tag release-3.1.1-RC0 * built from source * deployed on a single node cluster * executed basic dfs commands * executed some snapshot commands Thank you very much the work Wangda. Thanks Shashi On 8/7/18, 6:43 PM, "Elek, Marton" wrote: +1

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Elek, Marton
+1 (non-binding) 1. Built from the source package. 2. Checked the signature 3. Started docker based pseudo cluster and smoketested some basic functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word count job) Thank you very much the work Wangda. Marton On 08/02/2018 08:43 PM,

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Zsolt Venczel
Thanks for your efforts Wangda! +1 (non-binding) * checked out git tag release-3.1.1-RC0 * built from source on Ubuntu 16.04, java 8u161-oracle * deployed on a 4 node cluster * executed snapshot commands: create, diff, checked file presence in .snapshot directory * execute map-reduce examples:

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Sunil G
Thanks Wangda for the initiative. +1 for this RC. I have tested this RC built from source file. - Also ran few MR apps and verified both new YARN UI and old RM UI. - Tested Application priority and timeout - Inter Queue and Intra Queue Preemption cases were also verified - Tested

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Rohith Sharma K S
+1 (binding) - Built from source and deployed 2 node RM HA non-secure cluster - ATSv2 enabled for profile hbase.profile=2.0. Enabled both ats 1.5 and 2.0. - Ran sample MR and DS applications - Verified for RM HA, Work preserving restart, NM work preserving restart. - Verified jobs for application

回复:[VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread 郑锴(铁杰)
+1 for the work to be in. Thanks Uma and folks for the hard taking! When it's in, I'd suggest we use a more general name for the new daemon service. It'd be good to evolve and support more self-running admin functionalities incubated first there before doing it directly in NameNode. Regards,

[jira] [Resolved] (HDFS-13074) Ozone File System

2018-08-07 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton resolved HDFS-13074. - Resolution: Fixed Resolving as all of the sub jiras are resolved. > Ozone File System >

RE: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread Brahma Reddy Battula
+1, Great work Guys. Brahma Reddy Battula -Original Message- From: Uma Maheswara Rao G [mailto:hadoop@gmail.com] Sent: 01 August 2018 12:08 To: hdfs-dev@hadoop.apache.org Subject: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk Hi All,

RE: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-08-07 Thread surendra lilhore
+1, looking forward to seeing SPS in coming releases. Regards, Surendra -Original Message- From: Uma Maheswara Rao G [mailto:hadoop@gmail.com] Sent: 01 August 2018 14:38 To: hdfs-dev@hadoop.apache.org Subject: [VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch