date:20180413

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-04-13 Thread Apache Jenkins Server

For more details, see https://builds.apache.org/job/hadoop-trunk-win/436/

[Apr 12, 2018 1:38:30 PM] (haibochen) YARN-7931. [atsv2 read acls] Include 
domain table creation as part of
[Apr 12, 2018 2:42:31 PM] (msingh) HDFS-13426. Fix javadoc in 
FsDatasetAsyncDiskService#removeVolume.
[Apr 12, 2018 3:42:19 PM] (inigoiri) Revert "HDFS-13386. RBF: Wrong date 
information in list file(-ls)
[Apr 12, 2018 4:04:23 PM] (ericp) YARN-8120. JVM can crash with SIGSEGV when 
exiting due to custom leveldb
[Apr 12, 2018 4:12:46 PM] (jlowe) MAPREDUCE-7069. Add ability to specify user 
environment variables
[Apr 12, 2018 4:28:23 PM] (inigoiri) Revert "HDFS-13388. 
RequestHedgingProxyProvider calls multiple
[Apr 12, 2018 4:30:11 PM] (inigoiri) HDFS-13386. RBF: Wrong date information in 
list file(-ls) result.
[Apr 12, 2018 5:53:57 PM] (ericp) YARN-8147. 
TestClientRMService#testGetApplications sporadically fails.
[Apr 12, 2018 7:38:00 PM] (billie) YARN-7936. Add default service AM Xmx. 
Contributed by Jian He
[Apr 13, 2018 4:23:51 AM] (aajisaka) HDFS-13436. Fix javadoc of 
package-info.java
[Apr 13, 2018 4:51:20 AM] (Bharat) HADOOP-15379. Make IrqHandler.bind() public. 
Contributed by Ajay Kumar
[Apr 13, 2018 5:06:47 AM] (wwei) YARN-8154. Fix missing titles in 
PlacementConstraints document.
[Apr 13, 2018 5:17:37 AM] (wwei) YARN-8153. Guaranteed containers always stay 
in SCHEDULED on NM after
[Apr 13, 2018 6:27:51 AM] (shv) HADOOP-14970. MiniHadoopClusterManager doesn't 
respect lack of format
[Apr 13, 2018 9:55:45 AM] (yqlin) HDFS-13418. NetworkTopology should be 
configurable when enable




-1 overall


The following subsystems voted -1:
compile mvninstall unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h 00m 00s)
unit


Specific tests:

Failed junit tests :

   hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec 
   hadoop.fs.contract.rawlocal.TestRawlocalContractAppend 
   hadoop.fs.TestFileUtil 
   hadoop.fs.TestFsShellCopy 
   hadoop.fs.TestFsShellList 
   hadoop.fs.TestLocalFileSystem 
   hadoop.fs.TestRawLocalFileSystemContract 
   hadoop.fs.TestTrash 
   hadoop.fs.viewfs.TestViewFileSystemWithAuthorityLocalFileSystem 
   hadoop.http.TestHttpServer 
   hadoop.http.TestHttpServerLogs 
   hadoop.io.nativeio.TestNativeIO 
   hadoop.ipc.TestSocketFactory 
   hadoop.metrics2.impl.TestStatsDMetrics 
   hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal 
   hadoop.security.TestSecurityUtil 
   hadoop.security.TestShellBasedUnixGroupsMapping 
   hadoop.security.token.TestDtUtilShell 
   hadoop.util.TestNativeCodeLoader 
   hadoop.util.TestNodeHealthScriptRunner 
   hadoop.fs.TestResolveHdfsSymlink 
   hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy 
   hadoop.hdfs.crypto.TestHdfsCryptoStreams 
   hadoop.hdfs.qjournal.client.TestQuorumJournalManager 
   hadoop.hdfs.qjournal.server.TestJournalNode 
   hadoop.hdfs.qjournal.server.TestJournalNodeSync 
   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages 
   hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy 
   
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement 
   
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica 
   hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage 
   hadoop.hdfs.server.datanode.TestBlockRecovery 
   hadoop.hdfs.server.datanode.TestBlockScanner 
   hadoop.hdfs.server.datanode.TestBPOfferService 
   hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics 
   hadoop.hdfs.server.datanode.TestDataNodeFaultInjector 
   hadoop.hdfs.server.datanode.TestDataNodeMetrics 
   hadoop.hdfs.server.datanode.TestDataNodeUUID 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.server.datanode.TestDirectoryScanner 
   hadoop.hdfs.server.datanode.TestHSync 
   hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame 
   hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand 
   hadoop.hdfs.server.diskbalancer.TestDiskBalancer 
   hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC 
   hadoop.hdfs.server.mover.TestMover

RE: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

2018-04-13 Thread Brahma Reddy Battula

Konstantin thanks for driving this.

+1 (binding)


--Built from the source
--Installed HA cluster
-Verified the basic shell commands
-Ran sample jobs like pi,wordcount
-Browsed the UI's



-Original Message-
From: Konstantin Shvachko [mailto:shv.had...@gmail.com] 
Sent: 10 April 2018 07:14
To: Hadoop Common ; hdfs-dev 
; mapreduce-...@hadoop.apache.org; 
yarn-dev@hadoop.apache.org
Subject: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

Hi everybody,

This is the next dot release of Apache Hadoop 2.7 line. The previous one 2.7.5 
was released on December 14, 2017.
Release 2.7.6 includes critical bug fixes and optimizations. See more details 
in Release Note:
http://home.apache.org/~shv/hadoop-2.7.6-RC0/releasenotes.html

The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.6-RC0/

Please give it a try and vote on this thread. The vote will run for 5 days 
ending 04/16/2018.

My up to date public key is available from:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS

Thanks,
--Konstantin

Re: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

2018-04-13 Thread Zhe Zhang

+1 (binding)

- Downloaded source
- Verified checksum
- Built and started local cluster
- Checked YARN UI
- Performed basic HDFS operations

On Fri, Apr 13, 2018 at 1:40 PM Chen Liang  wrote:

> Thanks for working on this Konstantin!
>
> +1 (non-binding)
>
> - verified checksum
> - built from source
> - started a single node HDFS cluster
> - performed basic operations of ls/mkdir/put/get
> - checked web UI
> - ran the MR job pi
>
> Regards,
> Chen
>
>
> > On Apr 9, 2018, at 4:14 PM, Konstantin Shvachko 
> wrote:
> >
> > Hi everybody,
> >
> > This is the next dot release of Apache Hadoop 2.7 line. The previous one
> 2.7.5
> > was released on December 14, 2017.
> > Release 2.7.6 includes critical bug fixes and optimizations. See more
> > details in Release Note:
> > http://home.apache.org/~shv/hadoop-2.7.6-RC0/releasenotes.html
> >
> > The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.6-RC0/
> >
> > Please give it a try and vote on this thread. The vote will run for 5
> days
> > ending 04/16/2018.
> >
> > My up to date public key is available from:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Thanks,
> > --Konstantin
>
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
> --
Zhe Zhang
Apache Hadoop Committer
http://zhe-thoughts.github.io/about/ | @oldcap

[jira] [Created] (YARN-8162) Method DirectoryCollection#verifyDirUsingMkdir isn't needed anymore

2018-04-13 Thread Yufei Gu (JIRA)

Yufei Gu created YARN-8162:
--

 Summary: Method DirectoryCollection#verifyDirUsingMkdir isn't 
needed anymore
 Key: YARN-8162
 URL: https://issues.apache.org/jira/browse/YARN-8162
 Project: Hadoop YARN
  Issue Type: Bug
  Components: nodemanager
Affects Versions: 3.1.0
Reporter: Yufei Gu
Assignee: Yufei Gu


First of all, DirectoryCollection#verifyDirUsingMkdir doesn't do what it claims 
to do, it creates a file but its Java doc says it create a dir. What's more, it 
is no longer needed after HADOOP-13738 (DiskChecker should perform some disk 
IO). It duplicates what HADOOP-13738 does. We should remove it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8161) ServiceState FLEX should be removed

2018-04-13 Thread Gour Saha (JIRA)

Gour Saha created YARN-8161:
---

 Summary: ServiceState FLEX should be removed
 Key: YARN-8161
 URL: https://issues.apache.org/jira/browse/YARN-8161
 Project: Hadoop YARN
  Issue Type: Sub-task
  Components: yarn-native-services
Affects Versions: 3.1.0
Reporter: Gour Saha


ServiceState FLEX is not required to trigger flex up/down of containers and 
should be removed



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8160) Yarn Service Upgrade: Support upgrade of docker containers

2018-04-13 Thread Chandni Singh (JIRA)

Chandni Singh created YARN-8160:
---

 Summary: Yarn Service Upgrade: Support upgrade of docker 
containers 
 Key: YARN-8160
 URL: https://issues.apache.org/jira/browse/YARN-8160
 Project: Hadoop YARN
  Issue Type: Sub-task
Reporter: Chandni Singh
Assignee: Chandni Singh


Ability to upgrade dockerized  yarn native services.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)

2018-04-13 Thread Konstantin Shvachko

Hi Lei,

Did you have any luck with deploy?
Could you please post your findings on
https://issues.apache.org/jira/browse/HADOOP-15205

Thanks,
--Konstantin

On Tue, Apr 10, 2018 at 12:10 PM, Lei Xu  wrote:

> Ajay, thanks for spotting this.
>
> I am working on fix the deploy.
>
> On Tue, Apr 10, 2018 at 8:32 AM, Ajay Kumar 
> wrote:
> > Thanks Lie for working on this.
> >
> >- Downloaded src tarball and verified checksums
> >- Built from src on mac with java 1.8.0_111
> >- Built a pseudo distributed hdfs cluster
> >- Run test mr jobs (pi, dfsio,wordcount
> >- Verified basic hdfs operations
> >- Basic validation for webui
> >
> > ** I checked maven artifacts and it seems source jars are not there
> (checked hadoop-hdfs , hadoop-client). Not sure if they are required for
> release.
> >
> >
> > On 4/9/18, 4:19 PM, "Xiao Chen"  wrote:
> >
> > Thanks Eddy for the effort!
> >
> > +1 (binding)
> >
> >- Downloaded src tarball and verified checksums
> >- Built from src
> >- Started a pseudo distributed hdfs cluster
> >- Verified basic hdfs operations work
> >- Sanity checked logs / webui
> >
> > Best,
> > -Xiao
> >
> >
> > On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne  invalid>
> > wrote:
> >
> > > Thanks a lot for working to produce this release.
> > >
> > > +1 (binding)
> > > Tested the following:
> > > - built from source and installed on 6-node pseudo-cluster
> > > - tested Capacity Scheduler FairOrderingPolicy and
> FifoOrderingPolicy to
> > > determine that capacity was assigned as expected in each case
> > > - tested user weights with FifoOrderingPolicy to ensure that
> weights were
> > > assigned to users as expected.
> > >
> > > Eric Payne
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu 
> wrote:
> > >
> > >
> > >
> > >
> > >
> > > Hi, All
> > >
> > > I've created release candidate RC-0 for Apache Hadoop 3.0.2.
> > >
> > > Please note: this is an amendment for Apache Hadoop 3.0.1 release
> to
> > > fix shaded jars in apache maven repository. The codebase of 3.0.2
> > > release is the same as 3.0.1.  New bug fixes will be included in
> > > Apache Hadoop 3.0.3 instead.
> > >
> > > The release page is:
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> Hadoop+3.0+Release
> > >
> > > New RC is available at: http://home.apache.org/~lei/
> hadoop-3.0.2-RC0/
> > >
> > > The git tag is release-3.0.2-RC0, and the latest commit is
> > > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee
> > >
> > > The maven artifacts are available at
> > > https://repository.apache.org/content/repositories/
> orgapachehadoop-1096/
> > >
> > > Please try the release, especially, *verify the maven artifacts*,
> and vote.
> > >
> > > The vote will run 5 days, ending 4/11/2018.
> > >
> > > Thanks for everyone who helped to spot the error and proposed
> fixes!
> > >
> > > 
> -
> > > To unsubscribe, e-mail: mapreduce-dev-unsubscribe@
> hadoop.apache.org
> > > For additional commands, e-mail: mapreduce-dev-help@hadoop.
> apache.org
> > >
> > >
> > > 
> -
> > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> > >
> > >
> >
> >
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-04-13 Thread Apache Jenkins Server

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/

[Apr 12, 2018 8:19:35 AM] (aajisaka) HADOOP-15350. [JDK10] Update maven plugin 
tools to fix compile error in
[Apr 12, 2018 8:47:37 AM] (aajisaka) HDFS-7101. Potential null dereference in 
DFSck#doWork(). Contributed by
[Apr 12, 2018 1:38:30 PM] (haibochen) YARN-7931. [atsv2 read acls] Include 
domain table creation as part of
[Apr 12, 2018 2:42:31 PM] (msingh) HDFS-13426. Fix javadoc in 
FsDatasetAsyncDiskService#removeVolume.
[Apr 12, 2018 3:42:19 PM] (inigoiri) Revert "HDFS-13386. RBF: Wrong date 
information in list file(-ls)
[Apr 12, 2018 4:04:23 PM] (ericp) YARN-8120. JVM can crash with SIGSEGV when 
exiting due to custom leveldb
[Apr 12, 2018 4:12:46 PM] (jlowe) MAPREDUCE-7069. Add ability to specify user 
environment variables
[Apr 12, 2018 4:28:23 PM] (inigoiri) Revert "HDFS-13388. 
RequestHedgingProxyProvider calls multiple
[Apr 12, 2018 4:30:11 PM] (inigoiri) HDFS-13386. RBF: Wrong date information in 
list file(-ls) result.
[Apr 12, 2018 5:53:57 PM] (ericp) YARN-8147. 
TestClientRMService#testGetApplications sporadically fails.
[Apr 12, 2018 7:38:00 PM] (billie) YARN-7936. Add default service AM Xmx. 
Contributed by Jian He




-1 overall


The following subsystems voted -1:
unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.hdfs.server.datanode.TestDataNodeUUID 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy 
   hadoop.hdfs.TestEncryptionZonesWithKMS 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy 
   hadoop.hdfs.server.namenode.TestNamenodeCapacityReport 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.yarn.server.TestDiskFailures 
   hadoop.yarn.sls.TestSLSStreamAMSynth 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/diff-compile-javac-root.txt
  [288K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/diff-checkstyle-root.txt
  [17M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/diff-patch-pylint.txt
  [24K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/diff-patch-shelldocs.txt
  [12K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/whitespace-eol.txt
  [9.4M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/whitespace-tabs.txt
  [1.1M]

   xml:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/xml.txt
  [4.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/diff-javadoc-javadoc-root.txt
  [760K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [432K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [84K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/750/artifact/out/patch-unit-hadoop-tools_hadoop-sls.txt
  [12K]

Powered by Apache Yetus 0.8.0-SNAPSHOT   http://yetus.apache.org

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

RE: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

Re: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

[jira] [Created] (YARN-8162) Method DirectoryCollection#verifyDirUsingMkdir isn't needed anymore

[jira] [Created] (YARN-8161) ServiceState FLEX should be removed

[jira] [Created] (YARN-8160) Yarn Service Upgrade: Support upgrade of docker containers

Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

8 matches

Site Navigation

Mail list logo

Footer information