Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-06-06 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-trunk-win/490/

[Jun 5, 2018 1:58:24 PM] (rohithsharmaks) YARN-8396. Click on an individual 
container continuously spins and
[Jun 5, 2018 3:34:44 PM] (xyao) HDDS-148. Remove ContainerReportManager and 
ContainerReportManagerImpl.
[Jun 5, 2018 5:31:42 PM] (aengineer) HDDS-129. Support for ReportManager in 
Datanode. Contributed by Nanda
[Jun 5, 2018 6:51:29 PM] (cliang) HDFS-13547. Add ingress port based sasl 
resolver. Contributed by Chen
[Jun 5, 2018 7:24:57 PM] (inigoiri) MAPREDUCE-7103. Fix 
TestHistoryViewerPrinter on windows due to a
[Jun 6, 2018 4:18:31 AM] (xiao) HADOOP-15217. FsUrlConnection does not handle 
paths with spaces.
[Jun 6, 2018 4:25:08 AM] (xiao) HDFS-13511. Provide specialized exception when 
block length cannot be
[Jun 6, 2018 8:04:55 AM] (sunilg) HADOOP-15514. NoClassDefFoundError for 
TimelineCollectorManager when




-1 overall


The following subsystems voted -1:
compile mvninstall pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h 00m 00s)
unit


Specific tests:

Failed junit tests :

   hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec 
   hadoop.fs.contract.rawlocal.TestRawlocalContractAppend 
   hadoop.fs.TestFsShellCopy 
   hadoop.fs.TestFsShellList 
   hadoop.fs.TestLocalFileSystem 
   hadoop.ha.TestZKFailoverController 
   hadoop.http.TestHttpServer 
   hadoop.http.TestHttpServerLogs 
   hadoop.io.compress.TestCodec 
   hadoop.io.nativeio.TestNativeIO 
   hadoop.ipc.TestSocketFactory 
   hadoop.metrics2.impl.TestStatsDMetrics 
   hadoop.security.TestSecurityUtil 
   hadoop.security.TestShellBasedUnixGroupsMapping 
   hadoop.security.token.TestDtUtilShell 
   hadoop.util.TestDiskCheckerWithDiskIo 
   hadoop.util.TestNativeCodeLoader 
   hadoop.hdfs.qjournal.server.TestJournalNode 
   hadoop.hdfs.qjournal.server.TestJournalNodeSync 
   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl 
   hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage 
   hadoop.hdfs.server.datanode.TestBlockScanner 
   hadoop.hdfs.server.datanode.TestDataNodeFaultInjector 
   hadoop.hdfs.server.datanode.TestDataNodeUUID 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.server.datanode.TestDirectoryScanner 
   hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand 
   hadoop.hdfs.server.diskbalancer.TestDiskBalancer 
   hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC 
   hadoop.hdfs.server.mover.TestMover 
   hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA 
   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics 
   hadoop.hdfs.server.namenode.TestEditLogRace 
   hadoop.hdfs.server.namenode.TestReencryptionWithKMS 
   hadoop.hdfs.server.namenode.TestStartup 
   hadoop.hdfs.TestDatanodeRegistration 
   hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs 
   hadoop.hdfs.TestDFSShell 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy 
   hadoop.hdfs.TestDFSUpgradeFromImage 
   hadoop.hdfs.TestFetchImage 
   hadoop.hdfs.TestHDFSFileSystemContract 
   hadoop.hdfs.TestLeaseRecovery2 
   hadoop.hdfs.TestLocalDFS 
   hadoop.hdfs.TestPread 
   hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy 
   hadoop.hdfs.TestSecureEncryptionZoneWithKMS 
   hadoop.hdfs.TestTrashWithSecureEncryptionZones 
   hadoop.hdfs.tools.TestDFSAdmin 
   hadoop.hdfs.tools.TestDFSAdminWithHA 
   hadoop.hdfs.web.TestWebHDFS 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.hdfs.web.TestWebHdfsUrl 
   hadoop.fs.http.server.TestHttpFSServerWebServer 
   
hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch 
   
hadoop.yarn.server.nodemanager.containermanager.linux.privileged.TestPrivilegedOperationExecutor
 
   
hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestCGroupElasticMemoryController
 
   
hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestCGroupsHandlerImpl
 
   
hadoop.yarn.server.nodemanager.containermanager.linux.runtime.TestDockerContainerRuntime
 
   
hadoop.yarn.server.nodemanager.containermanager.linux.runtime.TestJavaSandboxLinuxContainerRuntime
 
   
hadoop.yarn.server.nodemanager.containermanager.logaggregation.TestAppLogAggregatorImpl
 
   hadoop.yarn.server.nodemanager.containermanager.TestAuxServices 
   hadoop.yarn.server.nodemanager.containermanager.TestContainerManager 
   hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService 
   

[jira] [Created] (HDFS-13659) Add more test coverage for contentSummary for snapshottable path

2018-06-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-13659:
--

 Summary: Add more test coverage for contentSummary for 
snapshottable path 
 Key: HDFS-13659
 URL: https://issues.apache.org/jira/browse/HDFS-13659
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: namenode
Affects Versions: 2.8.0
Reporter: Wei-Chiu Chuang
Assignee: Wei-Chiu Chuang


HDFS-9063 corrected the behavior of contentSummary for snapshots. This jira 
proposes adding more tests to cover more scenarios:
# create a file, create snapshot, and then update the file
# after snapshot is created, delete a file



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



[jira] [Created] (HDDS-156) Implement HDDSVolume to manage volume state

2018-06-06 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-156:
---

 Summary: Implement HDDSVolume to manage volume state
 Key: HDDS-156
 URL: https://issues.apache.org/jira/browse/HDDS-156
 Project: Hadoop Distributed Data Store
  Issue Type: Sub-task
Reporter: Hanisha Koneru
Assignee: Hanisha Koneru
 Fix For: 0.2.1


This Jira proposes the following:
 # Impletement HDDSVolume to encompass VolumeInfo along with other HDDS 
specific fields.
 # Read Version file while instantiating HDDSVolumes.
 # Write volume level Version file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



FINAL REMINDER: Apache EU Roadshow 2018 in Berlin next week!

2018-06-06 Thread sharan

Hello Apache Supporters and Enthusiasts

This is a final reminder that our Apache EU Roadshow will be held in 
Berlin next week on 13th and 14th June 2018. We will have 28 different 
sessions running over 2 days that cover some great topics. So if you are 
interested in Microservices, Internet of Things (IoT), Cloud, Apache 
Tomcat or Apache Http Server then we have something for you.


https://foss-backstage.de/sessions/apache-roadshow

We will be co-located with FOSS Backstage, so if you are interested in 
topics such as incubator, the Apache Way, open source governance, legal, 
trademarks or simply open source communities then there will be 
something there for you too.  You can attend any of talks, presentations 
and workshops from the Apache EU Roadshow or FOSS Backstage.


You can find details of the combined Apache EU Roadshow and FOSS 
Backstage conference schedule below:


https://foss-backstage.de/schedule?day=2018-06-13

Ticket prices go up on 8th June 2018 and we have a last minute discount 
code that anyone can use before the deadline:


15% discount code: ASF15_discount
valid until June 7, 23:55 CET

You can register at the following link:

https://foss-backstage.de/tickets

Our Apache booth and lounge will be open from 11th - 14th June for 
meetups, hacking or to simply relax between sessions. And we will be 
posting regular updates on social media throughout next week so please 
follow us on Twitter @ApacheCon


Thank you for your continued support and we look forward to seeing you 
in Berlin!


Thanks
Sharan Foga, VP Apache Community Development

http://apachecon.com/

PLEASE NOTE: You are receiving this message because you are subscribed 
to a user@ or dev@ list of one or more Apache Software Foundation projects.




-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-06 Thread Yongjun Zhang
Thank you all so much for the testing and vote!

Nanda reported the following problem:

The following links in site documentation are broken
- Changelog and Release Notes
- Unix Shell API
- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml

Site documentation was generated using the below steps
*- mvn site:site*
*- mkdir -p /tmp/site && mvn site:stage -DstagingDirectory=/tmp/site*
*- Browse to file:///tmp/site/hadoop-project/index.html.*

Thanks,
Nanda


My build in docker was fine, and when I tested out the build outside
docker, I tested the RC binary tarbal and regular build with source
tarball, but missed out the site:site build.

I tried the steps Nanda did, and I'm even hitting an issue at the "mvn
site:site" which Nanda did not hit.

What I'm seeing is:

[INFO] 

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-site-plugin:3.6:site
(default-cli) on project hadoop-main: failed to get report for
org.apache.maven.plugins:maven-javadoc-plugin: Failed to execute goal on
project hadoop-hdfs: Could not resolve dependencies for project
org.apache.hadoop:hadoop-hdfs:jar:3.0.3: *Failure to find
org.apache.hadoop:hadoop-hdfs-client:jar:3.0.3
in https://s3-us-west-2.amazonaws.com/dynamodb-local/release
* was cached in
the local repository, resolution will not be reattempted until the update
interval of dynamodb-local-oregon has elapsed or updates are forced ->
[Help 1]
[ERROR]


I wonder if anyone else hit this problem. I was able to build 3.0.2 with
the same env. The build is looking for 3.0.3 artifacts in
*https://s3-us-west-2.amazonaws.com/dynamodb-local/release
, *which I'm
sure is the right thing, because 3.0.3 is not yet released. Or probably I
missed something in my env for this, which I have to investigate.

If anyone can follow Nanda's steps do see different outcome, that would be
interesting. Very much appreciated.

Thanks again!

--Yongjun

On Wed, Jun 6, 2018 at 12:59 AM, Kitti Nánási  wrote:

> Thanks Yongjun for working on this!
>
> +1 (non-binding)
>
> - checked out git tag release-3.0.3-RC0
> - built from source on Mac OS X 10.13.4, java version 1.8.0_171
> - deployed on a 3 node cluster
> - ran terasort, teragen, teravalidate with success
> - executed basic hdfs commands
> - created snapshots and produced snapshot diffs
>
> Thanks,
> Kitti Nanasi
>
>
> On Wed, Jun 6, 2018 at 8:06 AM, Takanobu Asanuma 
> wrote:
>
>> Sorry, I forgot to write my vote in the last message.
>>
>> +1 (non-binding)
>>
>> Regards,
>> Takanobu
>>
>> > -Original Message-
>> > From: Takanobu Asanuma [mailto:tasan...@yahoo-corp.jp]
>> > Sent: Wednesday, June 06, 2018 10:22 AM
>> > To: Gabor Bota 
>> > Cc: Yongjun Zhang ; nvadiv...@hortonworks.com;
>> > sbaner...@hortonworks.com; Hadoop Common 
>> ;
>> > Hdfs-dev ; mapreduce-...@hadoop.apache.org;
>> > yarn-...@hadoop.apache.org
>> > Subject: RE: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
>> >
>> > Thanks for driving this release, Yongjun!
>> >
>> > - Verified checksums
>> > - Succeeded native package build on CentOS 7
>> > - Started a cluster with 1 master and 5 slaves
>> > - Verified Web UI (NN, RM, JobHistory, Timeline)
>> > - Verified Teragen/Terasort jobs
>> > - Verified some operations for erasure coding
>> >
>> > Regards,
>> > Takanobu
>> >
>> > > -Original Message-
>> > > From: Gabor Bota [mailto:gabor.b...@cloudera.com]
>> > > Sent: Tuesday, June 05, 2018 9:18 PM
>> > > To: nvadiv...@hortonworks.com
>> > > Cc: Yongjun Zhang ; sbaner...@hortonworks.com;
>> > > Hadoop Common ; Hdfs-dev
>> > > ; mapreduce-...@hadoop.apache.org;
>> > > yarn-...@hadoop.apache.org
>> > > Subject: Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
>> > >
>> > > Thanks for the work Yongjun!
>> > >
>> > > +1 (non-binding)
>> > >
>> > >- checked out git tag release-3.0.3-RC0. Thanks for adding this
>> > Yongjun,
>> > >it worked.
>> > >- S3A integration (mvn verify) test run were successful on
>> eu-west-1
>> > >besides of one test issue reported in HADOOP-14927.
>> > >- built from source on Mac OS X 10.13.4, java version
>> 8.0.171-oracle
>> > >- deployed on a 3 node cluster (HDFS HA, Non-HA YARN)
>> > >- verified pi job (yarn), teragen, terasort and teravalidate
>> > >
>> > > Regards,
>> > > Gabor Bota
>> > >
>> > > On Mon, Jun 4, 2018 at 7:38 PM Nandakumar Vadivelu <
>> > > nvadiv...@hortonworks.com> wrote:
>> > >
>> > > > Thanks Yongjun for all the hard work on this release.
>> > > >
>> > > > - Verified signatures and checksums
>> > > > - Tested both the binary and also built from source on a pseudo
>> > > > distributed cluster
>> > > > - Verified filesystem shell commands
>> > > > - Verified admin commands
>> > > > - Tested snapshot feature
>> > > > - Sanity check of NN and DN UI
>> > > > - Verified site 

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-06-06 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/

[Jun 5, 2018 4:13:47 AM] (xiao) HADOOP-15507. Add MapReduce counters about EC 
bytes read.
[Jun 5, 2018 8:53:24 AM] (aajisaka) HDFS-13545. "guarded" is misspelled as 
"gaurded" in
[Jun 5, 2018 1:58:24 PM] (rohithsharmaks) YARN-8396. Click on an individual 
container continuously spins and
[Jun 5, 2018 3:34:44 PM] (xyao) HDDS-148. Remove ContainerReportManager and 
ContainerReportManagerImpl.
[Jun 5, 2018 5:31:42 PM] (aengineer) HDDS-129. Support for ReportManager in 
Datanode. Contributed by Nanda
[Jun 5, 2018 6:51:29 PM] (cliang) HDFS-13547. Add ingress port based sasl 
resolver. Contributed by Chen
[Jun 5, 2018 7:24:57 PM] (inigoiri) MAPREDUCE-7103. Fix 
TestHistoryViewerPrinter on windows due to a




-1 overall


The following subsystems voted -1:
asflicense findbugs pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   
module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
 
   Inconsistent synchronization of 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService.reloadListener;
 locked 75% of time Unsynchronized access at 
AllocationFileLoaderService.java:75% of time Unsynchronized access at 
AllocationFileLoaderService.java:[line 117] 

Failed junit tests :

   hadoop.hdfs.client.impl.TestBlockReaderLocal 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRestart 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity 
   hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun 
   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageSchema 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain 
   
hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/diff-compile-javac-root.txt
  [336K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/diff-checkstyle-root.txt
  [17M]

   pathlen:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/diff-patch-pylint.txt
  [24K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/whitespace-eol.txt
  [9.4M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/whitespace-tabs.txt
  [1.1M]

   xml:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/xml.txt
  [4.0K]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-warnings.html
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/branch-findbugs-hadoop-hdds_client.txt
  [56K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt
  [56K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/branch-findbugs-hadoop-hdds_tools.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/branch-findbugs-hadoop-ozone_client.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/branch-findbugs-hadoop-ozone_common.txt
  [24K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/803/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt
  [4.0K]
   

[jira] [Created] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

2018-06-06 Thread Kitti Nanasi (JIRA)
Kitti Nanasi created HDFS-13658:
---

 Summary: fsck, dfsadmin -report, and NN WebUI should report number 
of blocks that have 1 replica
 Key: HDFS-13658
 URL: https://issues.apache.org/jira/browse/HDFS-13658
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: hdfs
Affects Versions: 3.1.0
Reporter: Kitti Nanasi
Assignee: Kitti Nanasi


fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 
replica. We have had many cases opened in which a customer has lost a disk or a 
DN losing files/blocks due to the fact that they had blocks with only 1 
replica. We need to make the customer better aware of this situation and that 
they should take action.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-06 Thread Kitti Nánási
Thanks Yongjun for working on this!

+1 (non-binding)

- checked out git tag release-3.0.3-RC0
- built from source on Mac OS X 10.13.4, java version 1.8.0_171
- deployed on a 3 node cluster
- ran terasort, teragen, teravalidate with success
- executed basic hdfs commands
- created snapshots and produced snapshot diffs

Thanks,
Kitti Nanasi


On Wed, Jun 6, 2018 at 8:06 AM, Takanobu Asanuma 
wrote:

> Sorry, I forgot to write my vote in the last message.
>
> +1 (non-binding)
>
> Regards,
> Takanobu
>
> > -Original Message-
> > From: Takanobu Asanuma [mailto:tasan...@yahoo-corp.jp]
> > Sent: Wednesday, June 06, 2018 10:22 AM
> > To: Gabor Bota 
> > Cc: Yongjun Zhang ; nvadiv...@hortonworks.com;
> > sbaner...@hortonworks.com; Hadoop Common ;
> > Hdfs-dev ; mapreduce-...@hadoop.apache.org;
> > yarn-...@hadoop.apache.org
> > Subject: RE: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
> >
> > Thanks for driving this release, Yongjun!
> >
> > - Verified checksums
> > - Succeeded native package build on CentOS 7
> > - Started a cluster with 1 master and 5 slaves
> > - Verified Web UI (NN, RM, JobHistory, Timeline)
> > - Verified Teragen/Terasort jobs
> > - Verified some operations for erasure coding
> >
> > Regards,
> > Takanobu
> >
> > > -Original Message-
> > > From: Gabor Bota [mailto:gabor.b...@cloudera.com]
> > > Sent: Tuesday, June 05, 2018 9:18 PM
> > > To: nvadiv...@hortonworks.com
> > > Cc: Yongjun Zhang ; sbaner...@hortonworks.com;
> > > Hadoop Common ; Hdfs-dev
> > > ; mapreduce-...@hadoop.apache.org;
> > > yarn-...@hadoop.apache.org
> > > Subject: Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
> > >
> > > Thanks for the work Yongjun!
> > >
> > > +1 (non-binding)
> > >
> > >- checked out git tag release-3.0.3-RC0. Thanks for adding this
> > Yongjun,
> > >it worked.
> > >- S3A integration (mvn verify) test run were successful on eu-west-1
> > >besides of one test issue reported in HADOOP-14927.
> > >- built from source on Mac OS X 10.13.4, java version 8.0.171-oracle
> > >- deployed on a 3 node cluster (HDFS HA, Non-HA YARN)
> > >- verified pi job (yarn), teragen, terasort and teravalidate
> > >
> > > Regards,
> > > Gabor Bota
> > >
> > > On Mon, Jun 4, 2018 at 7:38 PM Nandakumar Vadivelu <
> > > nvadiv...@hortonworks.com> wrote:
> > >
> > > > Thanks Yongjun for all the hard work on this release.
> > > >
> > > > - Verified signatures and checksums
> > > > - Tested both the binary and also built from source on a pseudo
> > > > distributed cluster
> > > > - Verified filesystem shell commands
> > > > - Verified admin commands
> > > > - Tested snapshot feature
> > > > - Sanity check of NN and DN UI
> > > > - Verified site documentation
> > > >
> > > > The following links in site documentation are broken
> > > > - Changelog and Release Notes
> > > > - Unix Shell API
> > > > - core-default.xml
> > > > - hdfs-default.xml
> > > > - hdfs-rbf-default.xml
> > > > - mapred-default.xml
> > > > - yarn-default.xml
> > > >
> > > > Site documentation was generated using the below steps
> > > > - mvn site:site
> > > > - mkdir -p /tmp/site && mvn site:stage -DstagingDirectory=/tmp/site
> > > > - Browse to file:///tmp/site/hadoop-project/index.html.
> > > >
> > > > Thanks,
> > > > Nanda
> > > >
> > > > On 6/3/18, 8:55 AM, "Yongjun Zhang"  wrote:
> > > >
> > > > Hi Gabor,
> > > >
> > > > I got the git tag in, it's release-3.0.3-RC0. Would you please
> > > > give it a
> > > > try?
> > > >
> > > > It should correspond to
> > > >
> > > > commit 37fd7d752db73d984dc31e0cdfd590d252f5e075
> > > > Author: Yongjun Zhang 
> > > > Date:   Wed May 30 00:07:33 2018 -0700
> > > >
> > > > Update version to 3.0.3 to prepare for 3.0.3 release
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > --Yongjun
> > > >
> > > > On Fri, Jun 1, 2018 at 4:17 AM, Gabor Bota
> > > > 
> > > > wrote:
> > > >
> > > > > Hi Yongjun,
> > > > >
> > > > > Thank you for working on this release. Is there a git tag in
> > > > the upstream
> > > > > repo which can be checked out? I'd like to build the release
> > > > from source.
> > > > >
> > > > > Regards,
> > > > > Gabor
> > > > >
> > > > > On Fri, Jun 1, 2018 at 7:57 AM Shashikant Banerjee <
> > > > > sbaner...@hortonworks.com> wrote:
> > > > >
> > > > >> Looks like the link with the filter seems to be private. I
> > > > can't see the
> > > > >> blocker list.
> > > > >> https://issues.apache.org/jira/issues/?filter=12343997
> > > > >>
> > > > >> Meanwhile , I will be working on testing the release.
> > > > >>
> > > > >> Thanks
> > > > >> Shashi
> > > > >> On 6/1/18, 11:18 AM, "Yongjun Zhang" 
> > wrote:
> > > > >>
> > > > >> Greetings all,
> > > > >>
> > > > >> I've created the first release candidate (RC0) for Apache
> > > Hadoop
> > > > >> 3.0.3. This is our next maintenance release to follow up
> > 3.0.2.
> > > > It
> > 

RE: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-06 Thread Takanobu Asanuma
Sorry, I forgot to write my vote in the last message.

+1 (non-binding)

Regards,
Takanobu

> -Original Message-
> From: Takanobu Asanuma [mailto:tasan...@yahoo-corp.jp]
> Sent: Wednesday, June 06, 2018 10:22 AM
> To: Gabor Bota 
> Cc: Yongjun Zhang ; nvadiv...@hortonworks.com;
> sbaner...@hortonworks.com; Hadoop Common ;
> Hdfs-dev ; mapreduce-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org
> Subject: RE: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
> 
> Thanks for driving this release, Yongjun!
> 
> - Verified checksums
> - Succeeded native package build on CentOS 7
> - Started a cluster with 1 master and 5 slaves
> - Verified Web UI (NN, RM, JobHistory, Timeline)
> - Verified Teragen/Terasort jobs
> - Verified some operations for erasure coding
> 
> Regards,
> Takanobu
> 
> > -Original Message-
> > From: Gabor Bota [mailto:gabor.b...@cloudera.com]
> > Sent: Tuesday, June 05, 2018 9:18 PM
> > To: nvadiv...@hortonworks.com
> > Cc: Yongjun Zhang ; sbaner...@hortonworks.com;
> > Hadoop Common ; Hdfs-dev
> > ; mapreduce-...@hadoop.apache.org;
> > yarn-...@hadoop.apache.org
> > Subject: Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
> >
> > Thanks for the work Yongjun!
> >
> > +1 (non-binding)
> >
> >- checked out git tag release-3.0.3-RC0. Thanks for adding this
> Yongjun,
> >it worked.
> >- S3A integration (mvn verify) test run were successful on eu-west-1
> >besides of one test issue reported in HADOOP-14927.
> >- built from source on Mac OS X 10.13.4, java version 8.0.171-oracle
> >- deployed on a 3 node cluster (HDFS HA, Non-HA YARN)
> >- verified pi job (yarn), teragen, terasort and teravalidate
> >
> > Regards,
> > Gabor Bota
> >
> > On Mon, Jun 4, 2018 at 7:38 PM Nandakumar Vadivelu <
> > nvadiv...@hortonworks.com> wrote:
> >
> > > Thanks Yongjun for all the hard work on this release.
> > >
> > > - Verified signatures and checksums
> > > - Tested both the binary and also built from source on a pseudo
> > > distributed cluster
> > > - Verified filesystem shell commands
> > > - Verified admin commands
> > > - Tested snapshot feature
> > > - Sanity check of NN and DN UI
> > > - Verified site documentation
> > >
> > > The following links in site documentation are broken
> > > - Changelog and Release Notes
> > > - Unix Shell API
> > > - core-default.xml
> > > - hdfs-default.xml
> > > - hdfs-rbf-default.xml
> > > - mapred-default.xml
> > > - yarn-default.xml
> > >
> > > Site documentation was generated using the below steps
> > > - mvn site:site
> > > - mkdir -p /tmp/site && mvn site:stage -DstagingDirectory=/tmp/site
> > > - Browse to file:///tmp/site/hadoop-project/index.html.
> > >
> > > Thanks,
> > > Nanda
> > >
> > > On 6/3/18, 8:55 AM, "Yongjun Zhang"  wrote:
> > >
> > > Hi Gabor,
> > >
> > > I got the git tag in, it's release-3.0.3-RC0. Would you please
> > > give it a
> > > try?
> > >
> > > It should correspond to
> > >
> > > commit 37fd7d752db73d984dc31e0cdfd590d252f5e075
> > > Author: Yongjun Zhang 
> > > Date:   Wed May 30 00:07:33 2018 -0700
> > >
> > > Update version to 3.0.3 to prepare for 3.0.3 release
> > >
> > >
> > > Thanks,
> > >
> > > --Yongjun
> > >
> > > On Fri, Jun 1, 2018 at 4:17 AM, Gabor Bota
> > > 
> > > wrote:
> > >
> > > > Hi Yongjun,
> > > >
> > > > Thank you for working on this release. Is there a git tag in
> > > the upstream
> > > > repo which can be checked out? I'd like to build the release
> > > from source.
> > > >
> > > > Regards,
> > > > Gabor
> > > >
> > > > On Fri, Jun 1, 2018 at 7:57 AM Shashikant Banerjee <
> > > > sbaner...@hortonworks.com> wrote:
> > > >
> > > >> Looks like the link with the filter seems to be private. I
> > > can't see the
> > > >> blocker list.
> > > >> https://issues.apache.org/jira/issues/?filter=12343997
> > > >>
> > > >> Meanwhile , I will be working on testing the release.
> > > >>
> > > >> Thanks
> > > >> Shashi
> > > >> On 6/1/18, 11:18 AM, "Yongjun Zhang" 
> wrote:
> > > >>
> > > >> Greetings all,
> > > >>
> > > >> I've created the first release candidate (RC0) for Apache
> > Hadoop
> > > >> 3.0.3. This is our next maintenance release to follow up
> 3.0.2.
> > > It
> > > >> includes
> > > >> about 249
> > > >> important fixes and improvements, among which there are 8
> > > blockers.
> > > >> See
> > > >> https://issues.apache.org/jira/issues/?filter=12343997
> > > >>
> > > >> The RC artifacts are available at:
> > > >> https://dist.apache.org/repos/dist/dev/hadoop/3.0.3-RC0/
> > > >>
> > > >> The maven artifacts are available via
> > > >> https://repository.apache.org/content/repositories/
> > > >> orgapachehadoop-1126
> > > >>
> > > >> Please try the release and vote; the vote will run for the
> > > usual 5
> > > >> working
> > > >>