HI All
I am trying to write the data to hdfs through kafka spout, I have the
topology created but the data is not been acked. So when I saw the nimbus
log it gives me a transport plugin error which is causing to fail, i tried
adding the .storm dir and added the client_jass and storm.yaml with
following properties but still i have the same error, Can someone please
help me with this issue.
Thank you I appreciate your help.
$ cd .storm
[.storm]$ ls
client_jaas.conf storm.yaml
[.storm]$ cat client_jaas.conf
StormClient {
com.sun.security.auth.module.Krb5LoginModule required doNotPrompt=true
useTicketCache=true
renewTicket=true
serviceName="nimbus";
};
[.storm]$ cat storm.yaml
...
java.security.auth.login.config: ".storm/client_jaas.conf”
storm.thrift.transport :
"backtype.storm.security.auth.kerberos.KerberosSaslTransportPlugin”
...
2015-05-14 11:42:10 b.s.s.a.k.KerberosSaslTransportPlugin [ERROR] Storm
server failed to open transport to interact with a client during session
initiation: java.lang.RuntimeException:
org.apache.thrift7.transport.TTransportException
java.lang.RuntimeException: org.apache.thrift7.transport.TTransportException
at
org.apache.thrift7.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:218)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
backtype.storm.security.auth.kerberos.KerberosSaslTransportPlugin$TUGIAssumingTransportFactory$1.run(KerberosSaslTransportPlugin.java:192)
[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
backtype.storm.security.auth.kerberos.KerberosSaslTransportPlugin$TUGIAssumingTransportFactory$1.run(KerberosSaslTransportPlugin.java:189)
[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at java.security.AccessController.doPrivileged(Native Method) [na:1.7.0_67]
at javax.security.auth.Subject.doAs(Subject.java:415) [na:1.7.0_67]
at
backtype.storm.security.auth.kerberos.KerberosSaslTransportPlugin$TUGIAssumingTransportFactory.getTransport(KerberosSaslTransportPlugin.java:188)
[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:170)
[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_67]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_67]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_67]
Caused by: org.apache.thrift7.transport.TTransportException: null
at
org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:124)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslTransport.open(TSaslTransport.java:253)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslServerTransport.open(TSaslServerTransport.java:40)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:215)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
... 9 common frames omitted
2015-05-14 11:42:10 b.s.s.a.k.KerberosSaslTransportPlugin [ERROR] Storm
server failed to open transport to interact with a client during session
initiation: java.lang.RuntimeException:
org.apache.thrift7.transport.TTransportException
java.lang.RuntimeException: org.apache.thrift7.transport.TTransportException
at
org.apache.thrift7.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:218)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
backtype.storm.security.auth.kerberos.KerberosSaslTransportPlugin$TUGIAssumingTransportFactory$1.run(KerberosSaslTransportPlugin.java:192)
[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
backtype.storm.security.auth.kerberos.KerberosSaslTransportPlugin$TUGIAssumingTransportFactory$1.run(KerberosSaslTransportPlugin.java:189)
[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at java.security.AccessController.doPrivileged(Native Method) [na:1.7.0_67]
at javax.security.auth.Subject.doAs(Subject.java:415) [na:1.7.0_67]
at
backtype.storm.security.auth.kerberos.KerberosSaslTransportPlugin$TUGIAssumingTransportFactory.getTransport(KerberosSaslTransportPlugin.java:188)
[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:171)
[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_67]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_67]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_67]
Caused by: org.apache.thrift7.transport.TTransportException: null
at
org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:124)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslTransport.open(TSaslTransport.java:253)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslServerTransport.open(TSaslServerTransport.java:40)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
at
org.apache.thrift7.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:215)
~[storm-core-0.9.3.2.2.2.0-2538.jar:0.9.3.2.2.2.0-2538]
... 9 common frames omitted
2015-05-14 11:42:10 o.a.t.s.TThreadPoolServer [ERROR] Error occurred during
processing of message.