Jenkins build is back to normal : Hadoop-Common-trunk #2485

[Apache Jenkins Server]

See 

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1191

[Apache Jenkins Server]

See 

Precommit changed to Yetus 0.2.0 release, src version to follow soon

[Allen Wittenauer]

FYI,  Apache Yetus 0.2.0 passed vote this morning.  In accordance with ASF 
rules, I’m setting the precommit scripts to use that version rather than Yetus 
master.  As soon as it is officially announced and available on ASF dist 
servers worldwide, I’ll be filing the necessary jira to update the version in 
the source tree to match… and for the first time in quite a while, precommit 
and in-tree version will match. :)

Thanks.

[jira] [Created] (HADOOP-12903) Add IPC Server support for suppressing exceptions by type, suppress 'server too busy' messages

[Arpit Agarwal (JIRA)]

Arpit Agarwal created HADOOP-12903:
--

 Summary: Add IPC Server support for suppressing exceptions by 
type, suppress 'server too busy' messages
 Key: HADOOP-12903
 URL: https://issues.apache.org/jira/browse/HADOOP-12903
 Project: Hadoop Common
  Issue Type: Bug
  Components: ipc
Affects Versions: 2.7.2
Reporter: Arpit Agarwal
Assignee: Arpit Agarwal


HADOOP-10597 added support for RPC congestion control by sending retriable 
'server too busy' exceptions to clients. 

However every backoff results in a log message. We've seen these log messages 
slow down the NameNode.
{code}
2016-03-07 15:02:23,272 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for 
port 8020: readAndProcess from client 127.0.0.1 threw exception 
[org.apache.hadoop.ipc.RetriableException: Server is too busy.]
{code}

We already have a metric that tracks the number of backoff events. This log 
message adds nothing useful.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1190

[Apache Jenkins Server]

See 

Changes:

[wang] HADOOP-12901. Add warning log when KMSClientProvider cannot create a

--
[...truncated 3842 lines...]
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
hadoop-minikdc ---
[INFO] Compiling 2 source files to 

[INFO] 
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-minikdc ---
[INFO] Surefire report directory: 


---
 T E S T S
---

---
 T E S T S
---
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.174 sec - in 
org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.minikdc.TestMiniKdc
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.445 sec - in 
org.apache.hadoop.minikdc.TestMiniKdc

Results :

Tests run: 6, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-minikdc 
---
[INFO] 
[INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ 
hadoop-minikdc ---
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-minikdc ---
[INFO] 
Loading source files for package org.apache.hadoop.minikdc...
Constructing Javadoc information...
Standard Doclet version 1.8.0
Building tree for all the packages and classes...
Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Building index for all the packages and classes...
Generating 

Generating 

Generating 

Building index for all classes...
Generating 

Build failed in Jenkins: Hadoop-Common-trunk #2484

[Apache Jenkins Server]

See 

Changes:

[wang] HADOOP-12901. Add warning log when KMSClientProvider cannot create a

--
[...truncated 5108 lines...]

Running org.apache.hadoop.security.TestUGILoginFromKeytab
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.449 sec - in 
org.apache.hadoop.security.TestUGILoginFromKeytab
Running org.apache.hadoop.security.TestUserGroupInformation
Tests run: 35, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.799 sec - in 
org.apache.hadoop.security.TestUserGroupInformation
Running org.apache.hadoop.security.TestUGIWithExternalKdc
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.082 sec - in 
org.apache.hadoop.security.TestUGIWithExternalKdc
Running org.apache.hadoop.security.http.TestRestCsrfPreventionFilter
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.444 sec - in 
org.apache.hadoop.security.http.TestRestCsrfPreventionFilter
Running org.apache.hadoop.security.http.TestCrossOriginFilter
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.482 sec - in 
org.apache.hadoop.security.http.TestCrossOriginFilter
Running org.apache.hadoop.security.TestProxyUserFromEnv
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.862 sec - in 
org.apache.hadoop.security.TestProxyUserFromEnv
Running org.apache.hadoop.security.authorize.TestProxyUsers
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.326 sec - in 
org.apache.hadoop.security.authorize.TestProxyUsers
Running org.apache.hadoop.security.authorize.TestProxyServers
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.568 sec - in 
org.apache.hadoop.security.authorize.TestProxyServers
Running org.apache.hadoop.security.authorize.TestServiceAuthorization
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.558 sec - in 
org.apache.hadoop.security.authorize.TestServiceAuthorization
Running org.apache.hadoop.security.authorize.TestAccessControlList
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.923 sec - in 
org.apache.hadoop.security.authorize.TestAccessControlList
Running org.apache.hadoop.security.alias.TestCredShell
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.215 sec - in 
org.apache.hadoop.security.alias.TestCredShell
Running org.apache.hadoop.security.alias.TestCredentialProviderFactory
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.288 sec - in 
org.apache.hadoop.security.alias.TestCredentialProviderFactory
Running org.apache.hadoop.security.alias.TestCredentialProvider
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.231 sec - in 
org.apache.hadoop.security.alias.TestCredentialProvider
Running org.apache.hadoop.security.TestAuthenticationFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.807 sec - in 
org.apache.hadoop.security.TestAuthenticationFilter
Running org.apache.hadoop.security.TestLdapGroupsMapping
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.745 sec - in 
org.apache.hadoop.security.TestLdapGroupsMapping
Running org.apache.hadoop.security.token.TestToken
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.522 sec - in 
org.apache.hadoop.security.token.TestToken
Running org.apache.hadoop.security.token.delegation.TestDelegationToken
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.464 sec - 
in org.apache.hadoop.security.token.delegation.TestDelegationToken
Running 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenAuthenticationHandlerWithMocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.036 sec - in 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenAuthenticationHandlerWithMocks
Running 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenManager
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.191 sec - in 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenManager
Running org.apache.hadoop.security.token.delegation.web.TestWebDelegationToken
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.783 sec - 
in org.apache.hadoop.security.token.delegation.web.TestWebDelegationToken
Running 
org.apache.hadoop.security.token.delegation.TestZKDelegationTokenSecretManager
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.006 sec - in 
org.apache.hadoop.security.token.delegation.TestZKDelegationTokenSecretManager
Running org.apache.hadoop.security.TestShellBasedUnixGroupsMapping
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.392 sec - in 
org.apache.hadoop.security.TestShellBasedUnixGroupsMapping
Running org.apache.hadoop.security.TestShellBasedIdMapping
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.637 sec - in 
org.apache.hadoop.security.TestShellBasedIdMapping
Running 

[jira] [Created] (HADOOP-12902) JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter

[Robert Kanter (JIRA)]

Robert Kanter created HADOOP-12902:
--

 Summary: JavaDocs for SignerSecretProvider are out-of-date in 
AuthenticationFilter
 Key: HADOOP-12902
 URL: https://issues.apache.org/jira/browse/HADOOP-12902
 Project: Hadoop Common
  Issue Type: Bug
  Components: documentation
Affects Versions: 2.7.0
Reporter: Robert Kanter


The Javadocs in {{AuthenticationFilter}} say:
{noformat}
 * Out of the box it provides 3 signer secret provider implementations:
 * "string", "random", and "zookeeper"
{noformat}
However, the "string" implementation is no longer available because 
HADOOP-11748 moved it to be a test-only artifact.  This also doesn't mention 
anything about the file-backed secret provider ({{FileSignerSecretProvider}}).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is back to normal : Hadoop-Common-trunk #2483

[Apache Jenkins Server]

See 

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1189

[Apache Jenkins Server]

See 

Changes:

[arp] HDFS-9906. Remove spammy log spew when a datanode is restarted.

--
[...truncated 9458 lines...]
[WARNING] 
:62:
 warning: no @param for xid
[WARNING] public XDR dump(XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:62:
 warning: no @param for client
[WARNING] public XDR dump(XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:62:
 warning: no @return
[WARNING] public XDR dump(XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:65:
 warning: no @param for xdr
[WARNING] public XDR umnt(XDR xdr, XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:65:
 warning: no @param for out
[WARNING] public XDR umnt(XDR xdr, XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:65:
 warning: no @param for xid
[WARNING] public XDR umnt(XDR xdr, XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:65:
 warning: no @param for client
[WARNING] public XDR umnt(XDR xdr, XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:65:
 warning: no @return
[WARNING] public XDR umnt(XDR xdr, XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:68:
 warning: no @param for out
[WARNING] public XDR umntall(XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:68:
 warning: no @param for xid
[WARNING] public XDR umntall(XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:68:
 warning: no @param for client
[WARNING] public XDR umntall(XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:68:
 warning: no @return
[WARNING] public XDR umntall(XDR out, int xid, InetAddress client);
[WARNING] ^
[WARNING] 
:47:
 warning: no @param for value
[WARNING] public static MNTPROC fromValue(int value) {
[WARNING] ^
[WARNING] 
:40:
 warning: no @param for status
[WARNING] public static XDR writeMNTResponse(int status, XDR xdr, int xid,
[WARNING] ^
[WARNING] 
:40:
 warning: no @param for xdr
[WARNING] public static XDR writeMNTResponse(int status, XDR xdr, int xid,
[WARNING] ^
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-assembly-plugin:2.4:single (dist) @ hadoop-nfs ---
[INFO] Reading assembly descriptor: 
../../hadoop-assemblies/src/main/resources/assemblies/hadoop-nfs-dist.xml
[WARNING] The following patterns were never triggered in this artifact 
exclusion filter:
o  'org.apache.hadoop:hadoop-common'
o  'org.apache.hadoop:hadoop-hdfs'
o  'org.hsqldb:hsqldb'

[INFO] Copying files to 

Build failed in Jenkins: Hadoop-Common-trunk #2482

[Apache Jenkins Server]

See 

Changes:

[vinodkv] YARN-4762. Fixed CgroupHandler's creation and usage to avoid

--
[...truncated 5119 lines...]
Running org.apache.hadoop.ha.TestZKFailoverController
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.242 sec - 
in org.apache.hadoop.ha.TestZKFailoverController
Running org.apache.hadoop.ha.TestZKFailoverControllerStress
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 94.421 sec - in 
org.apache.hadoop.ha.TestZKFailoverControllerStress
Running org.apache.hadoop.ha.TestHealthMonitorWithDedicatedHealthAddress
Exception: java.lang.RuntimeException thrown from the UncaughtExceptionHandler 
in thread "Health Monitor for DummyHAService #3"
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.371 sec - in 
org.apache.hadoop.ha.TestHealthMonitorWithDedicatedHealthAddress
Running org.apache.hadoop.ha.TestHAAdmin
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.617 sec - in 
org.apache.hadoop.ha.TestHAAdmin
Running org.apache.hadoop.ha.TestNodeFencer
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.888 sec - in 
org.apache.hadoop.ha.TestNodeFencer
Running org.apache.hadoop.ha.TestHealthMonitor
Exception: java.lang.RuntimeException thrown from the UncaughtExceptionHandler 
in thread "Health Monitor for DummyHAService #3"
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.474 sec - in 
org.apache.hadoop.ha.TestHealthMonitor
Running org.apache.hadoop.ha.TestActiveStandbyElector
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.032 sec - in 
org.apache.hadoop.ha.TestActiveStandbyElector
Running org.apache.hadoop.ha.TestSshFenceByTcpPort
Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.71 sec - in 
org.apache.hadoop.ha.TestSshFenceByTcpPort
Running org.apache.hadoop.ha.TestActiveStandbyElectorRealZK
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.746 sec - in 
org.apache.hadoop.ha.TestActiveStandbyElectorRealZK
Running org.apache.hadoop.net.unix.TestDomainSocket
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.929 sec - in 
org.apache.hadoop.net.unix.TestDomainSocket
Running org.apache.hadoop.net.unix.TestDomainSocketWatcher
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.622 sec - in 
org.apache.hadoop.net.unix.TestDomainSocketWatcher
Running org.apache.hadoop.net.TestScriptBasedMappingWithDependency
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.834 sec - in 
org.apache.hadoop.net.TestScriptBasedMappingWithDependency
Running org.apache.hadoop.net.TestSocketIOWithTimeout
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.405 sec - in 
org.apache.hadoop.net.TestSocketIOWithTimeout
Running org.apache.hadoop.net.TestSwitchMapping
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.418 sec - in 
org.apache.hadoop.net.TestSwitchMapping
Running org.apache.hadoop.net.TestDNS
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.344 sec - in 
org.apache.hadoop.net.TestDNS
Running org.apache.hadoop.net.TestTableMapping
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.653 sec - in 
org.apache.hadoop.net.TestTableMapping
Running org.apache.hadoop.net.TestNetworkTopologyWithNodeGroup
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.207 sec - in 
org.apache.hadoop.net.TestNetworkTopologyWithNodeGroup
Running org.apache.hadoop.net.TestClusterTopology
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.252 sec - in 
org.apache.hadoop.net.TestClusterTopology
Running org.apache.hadoop.net.TestNetUtils
Tests run: 40, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.761 sec - in 
org.apache.hadoop.net.TestNetUtils
Running org.apache.hadoop.net.TestScriptBasedMapping
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.659 sec - in 
org.apache.hadoop.net.TestScriptBasedMapping
Running org.apache.hadoop.net.TestStaticMapping
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.76 sec - in 
org.apache.hadoop.net.TestStaticMapping
Running org.apache.hadoop.log.TestLogLevel
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.869 sec - in 
org.apache.hadoop.log.TestLogLevel
Running org.apache.hadoop.log.TestLog4Json
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.423 sec - in 
org.apache.hadoop.log.TestLog4Json
Running org.apache.hadoop.tracing.TestTraceUtils
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.601 sec - in 
org.apache.hadoop.tracing.TestTraceUtils
Running org.apache.hadoop.ipc.TestRetryCache
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.508 sec - in 
org.apache.hadoop.ipc.TestRetryCache
Running org.apache.hadoop.ipc.TestRPC
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.456 sec - 
in 

[jira] [Created] (HADOOP-12901) Add warning log when KMSClientProvider cannot create a connection to the KMS server

[Xiao Chen (JIRA)]

Xiao Chen created HADOOP-12901:
--

 Summary: Add warning log when KMSClientProvider cannot create a 
connection to the KMS server
 Key: HADOOP-12901
 URL: https://issues.apache.org/jira/browse/HADOOP-12901
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Xiao Chen
Assignee: Xiao Chen
Priority: Minor


Currently when failed to connect, one can only see logs at debug level with a 
vague {{SocketTimeoutException}}. (Luckily in the env I saw this, HADOOP-10015 
was not present, so the last WARN log was printed.)
{noformat}
2015-12-17 12:28:01,410 DEBUG org.apache.hadoop.security.UserGroupInformation: 
PrivilegedAction as:hdfs (auth:SIMPLE) 
from:org.apache.hadoop.crypto.key.kms.KMSClientProvider.createConnection(KMSClientProvider.java:477)
 
2015-12-17 12:28:01,469 WARN org.apache.hadoop.security.UserGroupInformation: 
PriviledgedActionException as:hdfs (auth:SIMPLE) 
cause:java.net.SocketTimeoutException: connect timed out 
{noformat}
The issue was then fixed by opening up the KMS server port.

This jira is to propose we add specific loggings in this case, to help user 
easily identify the problem.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12900) distcp -delete should show a counter of files deleted

[John Zhuge (JIRA)]

John Zhuge created HADOOP-12900:
---

 Summary: distcp -delete should show a counter of files deleted
 Key: HADOOP-12900
 URL: https://issues.apache.org/jira/browse/HADOOP-12900
 Project: Hadoop Common
  Issue Type: Bug
  Components: tools/distcp
Affects Versions: 2.6.0
Reporter: John Zhuge
Assignee: John Zhuge
Priority: Minor


Command {{hadoop distcp -delete -update src dst}} does not show any counter 
information about the files deleted.

Probably needs a new counter section "DistCp Copy Committer Counters" since the 
CopyCommitter deletes the missing files. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12899) External dist-layout-stitching script does not work correctly on Windows.

[Chris Nauroth (JIRA)]

Chris Nauroth created HADOOP-12899:
--

 Summary: External dist-layout-stitching script does not work 
correctly on Windows.
 Key: HADOOP-12899
 URL: https://issues.apache.org/jira/browse/HADOOP-12899
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
 Environment: Windows
Reporter: Chris Nauroth
Assignee: Chris Nauroth
Priority: Blocker


In HADOOP-12850, we pulled the dist-layout-stitching script out of 
hadoop-dist/pom.xml and into an external script.  It appears this change is not 
working correctly on Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is back to normal : Hadoop-Common-trunk #2481

[Apache Jenkins Server]

See 

Build failed in Jenkins: Hadoop-Common-trunk #2480

[Apache Jenkins Server]

See 

Changes:

[jlowe] YARN-4744. Too many signal to container failure in case of LCE.

[jlowe] YARN-4760. proxy redirect to history server uses wrong URL. Contributed

--
[...truncated 3630 lines...]
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop Main  SUCCESS [  3.451 s]
[INFO] Apache Hadoop Build Tools . SUCCESS [  1.292 s]
[INFO] Apache Hadoop Project POM . SUCCESS [  1.333 s]
[INFO] Apache Hadoop Annotations . SUCCESS [  4.300 s]
[INFO] Apache Hadoop Project Dist POM  SUCCESS [  0.704 s]
[INFO] Apache Hadoop Assemblies .. SUCCESS [  0.301 s]
[INFO] Apache Hadoop Maven Plugins ... SUCCESS [  5.343 s]
[INFO] Apache Hadoop MiniKDC . SUCCESS [  2.410 s]
[INFO] Apache Hadoop Auth  SUCCESS [  4.097 s]
[INFO] Apache Hadoop Auth Examples ... SUCCESS [  2.867 s]
[INFO] Apache Hadoop Common .. SUCCESS [ 29.848 s]
[INFO] Apache Hadoop NFS . SUCCESS [  1.286 s]
[INFO] Apache Hadoop KMS . SUCCESS [  4.752 s]
[INFO] Apache Hadoop Common Project .. SUCCESS [  0.058 s]
[INFO] Apache Hadoop HDFS Client . SUCCESS [ 12.312 s]
[INFO] Apache Hadoop HDFS  SUCCESS [ 17.552 s]
[INFO] Apache Hadoop HDFS Native Client .. SUCCESS [  0.548 s]
[INFO] Apache Hadoop HttpFS .. SUCCESS [ 16.737 s]
[INFO] Apache Hadoop HDFS BookKeeper Journal . SUCCESS [  1.089 s]
[INFO] Apache Hadoop HDFS-NFS  SUCCESS [  0.707 s]
[INFO] Apache Hadoop HDFS Project  SUCCESS [  0.055 s]
[INFO] Apache Hadoop YARN  SUCCESS [  0.050 s]
[INFO] Apache Hadoop YARN API  SUCCESS [  6.220 s]
[INFO] Apache Hadoop YARN Common . SUCCESS [  5.330 s]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.110 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [  1.510 s]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [  2.494 s]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [  0.615 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [  1.146 s]
[INFO] Apache Hadoop YARN ResourceManager  SUCCESS [  5.372 s]
[INFO] Apache Hadoop YARN Server Tests ... SUCCESS [  0.826 s]
[INFO] Apache Hadoop YARN Client . SUCCESS [  1.115 s]
[INFO] Apache Hadoop YARN SharedCacheManager . SUCCESS [  0.529 s]
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SUCCESS [  0.904 s]
[INFO] Apache Hadoop YARN Applications ... SUCCESS [  0.060 s]
[INFO] Apache Hadoop YARN DistributedShell ... SUCCESS [  0.415 s]
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SUCCESS [  0.334 s]
[INFO] Apache Hadoop YARN Site ... SUCCESS [  0.083 s]
[INFO] Apache Hadoop YARN Registry ... SUCCESS [  0.811 s]
[INFO] Apache Hadoop YARN Project  SUCCESS [  0.103 s]
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  0.115 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [  3.411 s]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [  1.824 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  0.457 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [  1.915 s]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [  0.794 s]
[INFO] Apache Hadoop MapReduce JobClient . SUCCESS [  2.544 s]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SUCCESS [  0.306 s]
[INFO] Apache Hadoop MapReduce NativeTask  SUCCESS [  0.533 s]
[INFO] Apache Hadoop MapReduce Examples .. SUCCESS [  1.175 s]
[INFO] Apache Hadoop MapReduce ... SUCCESS [  0.109 s]
[INFO] Apache Hadoop MapReduce Streaming . SUCCESS [  0.675 s]
[INFO] Apache Hadoop Distributed Copy  SUCCESS [  1.564 s]
[INFO] Apache Hadoop Archives  SUCCESS [  0.422 s]
[INFO] Apache Hadoop Archive Logs  SUCCESS [  0.391 s]
[INFO] Apache Hadoop Rumen ... SUCCESS [  0.682 s]
[INFO] Apache Hadoop Gridmix . SUCCESS [  0.684 s]
[INFO] Apache Hadoop Data Join ... SUCCESS [  0.380 

[jira] [Created] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

[Steve Loughran (JIRA)]

Steve Loughran created HADOOP-12897:
---

 Summary: KerberosAuthenticator.authenticate to include URL on IO 
failures
 Key: HADOOP-12897
 URL: https://issues.apache.org/jira/browse/HADOOP-12897
 Project: Hadoop Common
  Issue Type: Improvement
  Components: security
Affects Versions: 2.8.0
Reporter: Steve Loughran


If {{KerberosAuthenticator.authenticate}} can't connect to the endpoint, you 
get a stack trace, but without the URL it is trying to talk to.

That is: it doesn't have any equivalent of the {{NetUtils.wrapException}} 
handler —which can't be called here as its not in the {{hadoop-auth}} module



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12896) kdiag to add a --DEFAULTREALM option

[Steve Loughran (JIRA)]

Steve Loughran created HADOOP-12896:
---

 Summary: kdiag to add a --DEFAULTREALM option 
 Key: HADOOP-12896
 URL: https://issues.apache.org/jira/browse/HADOOP-12896
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: security
Affects Versions: 2.8.0
Reporter: Steve Loughran
Priority: Minor
 Fix For: 2.9.0


* kdiag to add a --DEFAULTREALM option to say not having a default realm is an 
error.
* if this flag is unset, when dumping the credential cache, if there is any 
entry without a realm, *and there is no default realm*, diagnostics to fail 
with an error. Hadoop will fail in this situation; kdiag should detect and 
report




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)