[
https://issues.apache.org/jira/browse/HDFS-16747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584733#comment-17584733
]
Samrat Deb commented on HDFS-16747:
-----------------------------------
Hi [[email protected]] !
i was running all these test in cluster, encountered errors .
The branch is synced with `trunk` in remote
Here is some stack trace of it
{code:java}
2022-08-25 14:55:34,561 WARN Server - Log4j
[/Users/dbsamrat/code/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/testValidHttpFSAccess-5/conf/httpfs-log4j.properties]
configuration file not found, using default configuration from classpath
2022-08-25 14:55:34,561 INFO Server -
++++++++++++++++++++++++++++++++++++++++++++++++++++++
2022-08-25 14:55:34,561 INFO Server - Server [httpfs] starting
2022-08-25 14:55:34,561 INFO Server - Built information:
2022-08-25 14:55:34,561 INFO Server - Version : 3.4.0-SNAPSHOT
2022-08-25 14:55:34,561 INFO Server - Source Repository : REPO NOT AVAIL
2022-08-25 14:55:34,561 INFO Server - Source Revision : REVISION NOT
AVAIL
2022-08-25 14:55:34,561 INFO Server - Built by : dbsamrat
2022-08-25 14:55:34,561 INFO Server - Built timestamp :
2022-08-25T09:03:19+0000
2022-08-25 14:55:34,561 INFO Server - Runtime information:
2022-08-25 14:55:34,561 INFO Server - Home dir:
/Users/dbsamrat/code/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/testValidHttpFSAccess-5
2022-08-25 14:55:34,561 INFO Server - Config dir:
/Users/dbsamrat/code/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/testValidHttpFSAccess-5/conf
2022-08-25 14:55:34,561 INFO Server - Log dir:
/Users/dbsamrat/code/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/testValidHttpFSAccess-5/log
2022-08-25 14:55:34,561 INFO Server - Temp dir:
/Users/dbsamrat/code/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/testValidHttpFSAccess-5/temp
2022-08-25 14:55:34,563 INFO FileSystemAccessService - Using FileSystemAccess
JARs version [3.4.0-SNAPSHOT]
2022-08-25 14:55:34,567 INFO FileSystemAccessService - Using FileSystemAccess
simple/pseudo authentication, principal [dbsamrat]
2022-08-25 14:55:34,572 INFO Server - Services initialized
2022-08-25 14:55:34,572 INFO Server - Server [httpfs] started!, status [NORMAL]
2022-08-25 14:55:34,572 INFO HttpFSServerWebApp - Connects to Namenode
[file:///]
2022-08-25 14:55:34,572 INFO HttpFSServerWebApp - Initializing
HttpFSServerMetrics
2022-08-25 14:55:34,577 INFO MetricsSystemImpl - HttpFSServer metrics system
started (again)
2022-08-25 14:55:34,577 INFO JvmPauseMonitor - Starting JVM pause monitor
2022-08-25 14:55:34,579 WARN HttpServer2 - Overwriting configuration for
key='signature.secret.file' with
value='${httpfs.config.dir}/httpfs-signature.secret' previous
value='/Users/dbsamrat/code/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/testValidHttpFSAccess-5/conf/secret'
2022-08-25 14:55:34,579 WARN HttpServer2 - Overwriting configuration for
key='type' with value='simple' previous value='kerberos'
Aug 25, 2022 2:55:34 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.hadoop.fs.http.server
org.apache.hadoop.lib.wsrs
Aug 25, 2022 2:55:34 PM com.sun.jersey.api.core.ScanningResourceConfig
logClasses
INFO: Root resource classes found:
class org.apache.hadoop.fs.http.server.HttpFSServer
Aug 25, 2022 2:55:34 PM com.sun.jersey.api.core.ScanningResourceConfig
logClasses
INFO: Provider classes found:
class org.apache.hadoop.lib.wsrs.JSONProvider
class org.apache.hadoop.fs.http.server.HttpFSExceptionProvider
class org.apache.hadoop.lib.wsrs.JSONMapProvider
class org.apache.hadoop.fs.http.server.HttpFSParametersProvider
Aug 25, 2022 2:55:34 PM
com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20
PM'
2022-08-25 14:55:34,689 WARN WebAppContext - Failed startup of context
o.e.j.w.WebAppContext@743c6ce4{/webhdfs,file:///Users/dbsamrat/code/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-classes/webapp/,UNAVAILABLE}{/Users/dbsamrat/code/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-classes/webapp}
java.lang.RuntimeException: Could not read HttpFS signature secret file:
${httpfs.config.dir}/httpfs-signature.secret
at
org.apache.hadoop.fs.http.server.HttpFSAuthenticationFilter.getConfiguration(HttpFSAuthenticationFilter.java:105)
at
org.apache.hadoop.security.authentication.server.AuthenticationFilter.init(AuthenticationFilter.java:160)
at
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.init(DelegationTokenAuthenticationFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:140)
at
org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750)
at
java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
at
java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742)
at
java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647)
at
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:774)
at
org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
at
org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1449)
at
org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1414)
at
org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
at
org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.server.Server.start(Server.java:423)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.Server.doStart(Server.java:387)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at
org.apache.hadoop.fs.http.server.TestHttpFSWithKerberos.createHttpFSServer(TestHttpFSWithKerberos.java:109)
at
org.apache.hadoop.fs.http.server.TestHttpFSWithKerberos.testValidHttpFSAccess(TestHttpFSWithKerberos.java:118)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at
org.apache.hadoop.test.TestHdfsHelper$HdfsStatement.evaluate(TestHdfsHelper.java:95)
at org.apache.hadoop.test.TestDirHelper$1.evaluate(TestDirHelper.java:106)
at
org.apache.hadoop.test.TestExceptionHelper$1.evaluate(TestExceptionHelper.java:42)
at
org.apache.hadoop.test.TestJettyHelper$1.evaluate(TestJettyHelper.java:74)
at org.apache.hadoop.test.TestDirHelper$1.evaluate(TestDirHelper.java:106)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
2022-08-25 14:55:34,694 INFO AbstractConnector - Started
ServerConnector@dc7b462{HTTP/1.1, (http/1.1)}{localhost:49439}
2022-08-25 14:55:34,694 INFO Server - Started @7471ms
Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt
true ticketCache is null isInitiator true KeyTab is
/Users/dbsamrat/dbsamrat.keytab refreshKrb5Config is true principal is
client@LOCALHOST tryFirstPass is false useFirstPass is false storePass is false
clearPass is false
Refreshing Kerberos configuration
Acquire TGT from Cache
Principal is client@LOCALHOST
null credentials from Ticket Cache
Key for the principal client@LOCALHOST not available in
/Users/dbsamrat/dbsamrat.keytab
[Krb5LoginModule] authentication failed
Unable to obtain password from user
[Krb5LoginModule]: Entering logout
[Krb5LoginModule]: logged out Subject
2022-08-25 14:55:34,730 INFO AbstractConnector - Stopped
ServerConnector@dc7b462{HTTP/1.1, (http/1.1)}{localhost:49439}
2022-08-25 14:55:34,731 INFO session - node0 Stopped scavenging
2022-08-25 14:55:34,731 INFO Server - Services destroyed
2022-08-25 14:55:34,731 INFO Server - Server [httpfs] shutdown!
2022-08-25 14:55:34,731 INFO Server -
======================================================
javax.security.auth.login.LoginException: Unable to obtain password from user
at
com.sun.security.auth.module.Krb5LoginModule.promptForPass(Krb5LoginModule.java:903)
at
com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:766)
at
com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:618)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at javax.security.auth.login.LoginContext.invoke(LoginContext.java:755)
at javax.security.auth.login.LoginContext.access$000(LoginContext.java:195)
at javax.security.auth.login.LoginContext$4.run(LoginContext.java:682)
at javax.security.auth.login.LoginContext$4.run(LoginContext.java:680)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
at javax.security.auth.login.LoginContext.login(LoginContext.java:587)
at org.apache.hadoop.test.KerberosTestUtils.doAs(KerberosTestUtils.java:113)
at
org.apache.hadoop.test.KerberosTestUtils.doAsClient(KerberosTestUtils.java:131)
at
org.apache.hadoop.fs.http.server.TestHttpFSWithKerberos.testValidHttpFSAccess(TestHttpFSWithKerberos.java:120)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at
org.apache.hadoop.test.TestHdfsHelper$HdfsStatement.evaluate(TestHdfsHelper.java:95)
at org.apache.hadoop.test.TestDirHelper$1.evaluate(TestDirHelper.java:106)
at
org.apache.hadoop.test.TestExceptionHelper$1.evaluate(TestExceptionHelper.java:42)
at
org.apache.hadoop.test.TestJettyHelper$1.evaluate(TestJettyHelper.java:74)
at org.apache.hadoop.test.TestDirHelper$1.evaluate(TestDirHelper.java:106)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
{code}
> List of unit test failing in 3.3.3
> ----------------------------------
>
> Key: HDFS-16747
> URL: https://issues.apache.org/jira/browse/HDFS-16747
> Project: Hadoop HDFS
> Issue Type: Test
> Affects Versions: 3.3.3
> Reporter: Samrat Deb
> Assignee: Samrat Deb
> Priority: Major
>
> Effected Test class
> * org.apache.hadoop.fs.http.server.TestHttpFSWithKerberos
> * org.apache.hadoop.hdfs.TestMultipleNNPortQOP
> * org.apache.hadoop.hdfs.TestBlockTokenWrappingQOP
> *
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
