[
https://issues.apache.org/jira/browse/GIRAPH-211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431409#comment-13431409
]
Eugene Koontz commented on GIRAPH-211:
--------------------------------------
Here's some output showing client and server SASL communication based on the
above test:
{code}
[ec2-user@ip-10-176-255-76 giraph]$ cat
/tmp/logs/application_1344445498302_0016/container_1344445498302_0016_01_000002/syslog
| grep -i giraph | grep -i sasl
2012-08-08 20:58:52,806 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.NettyClient: creating saslNettyClient now.
2012-08-08 20:58:52,816 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.NettyClient: creating saslNettyClient now.
2012-08-08 20:58:52,929 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslNettyClient: Creating SASL DIGEST-MD5 client to
authenticate to service at job_1344445498302_0016
2012-08-08 20:58:52,931 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslNettyClient: Creating SASL DIGEST-MD5 client to
authenticate to service at job_1344445498302_0016
2012-08-08 20:58:52,943 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.NettyClient: storing saslNettyClient at key: [id:
0x7e8905bd, /10.176.255.76:48238 =>
ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30000]
2012-08-08 20:58:52,943 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.NettyClient: created:
org.apache.giraph.comm.SaslNettyClient@2aa937cd
2012-08-08 20:58:52,943 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.NettyClient: sending request:
org.apache.giraph.comm.SaslTokenMessage@4b8e899c to remote server:
ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30000
2012-08-08 20:58:52,943 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.RequestEncoder: encoding object:
org.apache.giraph.comm.SaslTokenMessage@4b8e899c
2012-08-08 20:58:52,947 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: write() called on token of length: 0
2012-08-08 20:58:52,947 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: write() finished writing token.
2012-08-08 20:58:52,947 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.RequestEncoder: encode: Encoding a message of type class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,954 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.NettyClient: storing saslNettyClient at key: [id:
0x04df8b14, /10.176.255.76:60743 =>
ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30001]
2012-08-08 20:58:52,954 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.NettyClient: created:
org.apache.giraph.comm.SaslNettyClient@23faa614
2012-08-08 20:58:52,954 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.NettyClient: sending request:
org.apache.giraph.comm.SaslTokenMessage@1cad7d80 to remote server:
ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30001
2012-08-08 20:58:52,954 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.RequestEncoder: encoding object:
org.apache.giraph.comm.SaslTokenMessage@1cad7d80
2012-08-08 20:58:52,954 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: write() called on token of length: 0
2012-08-08 20:58:52,954 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: write() finished writing token.
2012-08-08 20:58:52,954 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.RequestEncoder: encode: Encoding a message of type class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,959 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestDecoder: decode: Got a request of type SASL_TOKEN
from remote:/10.176.255.76:48238
2012-08-08 20:58:52,959 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type: SASL_TOKEN
2012-08-08 20:58:52,959 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: reading fields from DataInput:
org.jboss.netty.buffer.ChannelBufferInputStream@2b8ca663
2012-08-08 20:58:52,959 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: token size is: 0
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: now reading token.
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: read SASL token of length: 0
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestDecoder: decoded an object of type: class
org.apache.giraph.comm.SaslTokenMessage:org.apache.giraph.comm.SaslTokenMessage@1effc3eb
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestServerHandler: Got class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestServerHandler: calling doRequest on class: class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: looking for saslNettyServer on
server:/10.176.255.76:30000 for client /10.176.255.76:48238
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: creating SaslNettyServer with secret
manager:
org.apache.hadoop.mapreduce.security.token.JobTokenSecretManager@658782a7
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: creating saslNettyServer: secret
manager is:
org.apache.hadoop.mapreduce.security.token.JobTokenSecretManager@658782a7
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: checked read-availability; now creating
sasl server.
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: create...
2012-08-08 20:58:52,960 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: creating callback handler..
2012-08-08 20:58:52,961 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: creating SaslDigestCallback handler
with secret manager:
org.apache.hadoop.mapreduce.security.token.JobTokenSecretManager@658782a7
2012-08-08 20:58:52,961 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: created callback handler:
org.apache.giraph.comm.SaslNettyServer$SaslDigestCallbackHandler@1bb0889a
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: create was successful.
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: client's token's length is: 0
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: checking completeness of SASL
(pre-response):false
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: responding to input token of length: 0
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: response token length: 108
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: checking completeness of SASL
(post-response):false
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: server's token's length is: 108
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: Responding to client:
/10.176.255.76:48238
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: RESPONSE ENCODER IS ENCODING A
MESSAGE:org.apache.giraph.comm.SaslTokenMessage@1effc3eb
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: encoding object:
org.apache.giraph.comm.SaslTokenMessage@1effc3eb
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: encode: Encoding a message of type
class org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,967 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: write() called on token of length: 108
2012-08-08 20:58:52,968 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: write() finished writing token.
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: decode: Got a response of type
SASL_TOKEN from
server:ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30000
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type: SASL_TOKEN
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: writableRequestClass: class
org.apache.giraph.comm.SaslTokenMessage found for type:SASL_TOKEN
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: reading fields of server
response:org.apache.giraph.comm.SaslTokenMessage@48c5186e
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: reading fields from DataInput:
org.jboss.netty.buffer.ChannelBufferInputStream@3c70315
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: token size is: 108
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: now reading token.
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: read SASL token of length: 108
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: finished reading fields of server
response:org.apache.giraph.comm.SaslTokenMessage@48c5186e
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseClientHandler: message received:
org.apache.giraph.comm.SaslTokenMessage@48c5186e
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslNettyClient: SASL client callback: setting username:
FmpvYl8xMzQ0NDQ1NDk4MzAyXzAwMTY=
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslNettyClient: SASL client callback: setting
userPassword
2012-08-08 20:58:52,968 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslNettyClient: SASL client callback: setting realm:
default
2012-08-08 20:58:52,969 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: creating SASL message with size: 274
2012-08-08 20:58:52,969 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.NettyClient: sending request:
org.apache.giraph.comm.SaslTokenMessage@7e9b59a2 to remote server:
ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30000
2012-08-08 20:58:52,969 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.RequestEncoder: encoding object:
org.apache.giraph.comm.SaslTokenMessage@7e9b59a2
2012-08-08 20:58:52,969 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: write() called on token of length: 274
2012-08-08 20:58:52,969 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: write() finished writing token.
2012-08-08 20:58:52,969 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.RequestEncoder: encode: Encoding a message of type class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,969 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseClientHandler: due to reception of:
org.apache.giraph.comm.SaslTokenMessage@48c5186e
2012-08-08 20:58:52,970 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: Finished writing token to client.
2012-08-08 20:58:52,970 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestServerHandler: done with doRequest() for class:
class org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestDecoder: decode: Got a request of type SASL_TOKEN
from remote:/10.176.255.76:48238
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type: SASL_TOKEN
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: reading fields from DataInput:
org.jboss.netty.buffer.ChannelBufferInputStream@919db9e
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: token size is: 274
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: now reading token.
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: read SASL token of length: 274
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestDecoder: decoded an object of type: class
org.apache.giraph.comm.SaslTokenMessage:org.apache.giraph.comm.SaslTokenMessage@a166bd
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestServerHandler: Got class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestServerHandler: calling doRequest on class: class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: looking for saslNettyServer on
server:/10.176.255.76:30000 for client /10.176.255.76:48238
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: client's token's length is: 274
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: checking completeness of SASL
(pre-response):false
2012-08-08 20:58:52,971 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: responding to input token of length: 274
2012-08-08 20:58:52,981 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: SASL server DIGEST-MD5 callback:
setting password for client: job_1344445498302_0016 (auth:SIMPLE)
2012-08-08 20:58:52,981 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: SASL server DIGEST-MD5 callback:
setting canonicalized client ID: job_1344445498302_0016
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslNettyServer: response token length: 40
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: checking completeness of SASL
(post-response):true
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: server's token's length is: 40
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: Responding to client:
/10.176.255.76:48238
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: RESPONSE ENCODER IS ENCODING A
MESSAGE:org.apache.giraph.comm.SaslTokenMessage@a166bd
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: encoding object:
org.apache.giraph.comm.SaslTokenMessage@a166bd
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: encode: Encoding a message of type
class org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: write() called on token of length: 40
2012-08-08 20:58:52,982 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: write() finished writing token.
2012-08-08 20:58:52,982 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: decode: Got a response of type
SASL_TOKEN from
server:ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30000
2012-08-08 20:58:52,982 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type: SASL_TOKEN
2012-08-08 20:58:52,983 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: writableRequestClass: class
org.apache.giraph.comm.SaslTokenMessage found for type:SASL_TOKEN
2012-08-08 20:58:52,983 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: reading fields of server
response:org.apache.giraph.comm.SaslTokenMessage@4b6c06dd
2012-08-08 20:58:52,983 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: reading fields from DataInput:
org.jboss.netty.buffer.ChannelBufferInputStream@2136bdda
2012-08-08 20:58:52,983 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: token size is: 40
2012-08-08 20:58:52,983 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: now reading token.
2012-08-08 20:58:52,983 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: read SASL token of length: 40
2012-08-08 20:58:52,983 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: finished reading fields of server
response:org.apache.giraph.comm.SaslTokenMessage@4b6c06dd
2012-08-08 20:58:52,983 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseClientHandler: message received:
org.apache.giraph.comm.SaslTokenMessage@4b6c06dd
2012-08-08 20:58:52,987 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: Finished writing token to client.
2012-08-08 20:58:52,987 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: writing out complete token now.
2012-08-08 20:58:52,987 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: RESPONSE ENCODER IS ENCODING A
MESSAGE:org.apache.giraph.comm.SaslComplete@36511e0a
2012-08-08 20:58:52,987 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: encoding object:
org.apache.giraph.comm.SaslComplete@36511e0a
2012-08-08 20:58:52,987 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.ResponseEncoder: encode: Encoding a message of type
class org.apache.giraph.comm.SaslComplete
2012-08-08 20:58:52,987 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslComplete: writing one byte (write).
2012-08-08 20:58:52,987 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.SaslTokenMessage: wrote out complete token now.
2012-08-08 20:58:52,987 DEBUG [New I/O server worker #1-1]
org.apache.giraph.comm.RequestServerHandler: done with doRequest() for class:
class org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,009 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestDecoder: decode: Got a request of type SASL_TOKEN
from remote:/10.176.255.76:48239
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type: SASL_TOKEN
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: reading fields from DataInput:
org.jboss.netty.buffer.ChannelBufferInputStream@595780d9
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: token size is: 0
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: now reading token.
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: read SASL token of length: 0
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestDecoder: decoded an object of type: class
org.apache.giraph.comm.SaslTokenMessage:org.apache.giraph.comm.SaslTokenMessage@7fcc5461
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestServerHandler: Got class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestServerHandler: calling doRequest on class: class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: looking for saslNettyServer on
server:/10.176.255.76:30000 for client /10.176.255.76:48239
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: creating SaslNettyServer with secret
manager:
org.apache.hadoop.mapreduce.security.token.JobTokenSecretManager@658782a7
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: creating saslNettyServer: secret
manager is:
org.apache.hadoop.mapreduce.security.token.JobTokenSecretManager@658782a7
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: checked read-availability; now creating
sasl server.
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: create...
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: creating callback handler..
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: creating SaslDigestCallback handler
with secret manager:
org.apache.hadoop.mapreduce.security.token.JobTokenSecretManager@658782a7
2012-08-08 20:58:53,010 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: created callback handler:
org.apache.giraph.comm.SaslNettyServer$SaslDigestCallbackHandler@2ecc5436
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: create was successful.
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: client's token's length is: 0
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: checking completeness of SASL
(pre-response):false
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: responding to input token of length: 0
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: response token length: 108
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: checking completeness of SASL
(post-response):false
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: server's token's length is: 108
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: Responding to client:
/10.176.255.76:48239
2012-08-08 20:58:53,011 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: RESPONSE ENCODER IS ENCODING A
MESSAGE:org.apache.giraph.comm.SaslTokenMessage@7fcc5461
2012-08-08 20:58:53,012 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: encoding object:
org.apache.giraph.comm.SaslTokenMessage@7fcc5461
2012-08-08 20:58:53,012 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: encode: Encoding a message of type
class org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,012 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: write() called on token of length: 108
2012-08-08 20:58:53,012 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: write() finished writing token.
2012-08-08 20:58:53,012 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: Finished writing token to client.
2012-08-08 20:58:53,012 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestServerHandler: done with doRequest() for class:
class org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestDecoder: decode: Got a request of type SASL_TOKEN
from remote:/10.176.255.76:48239
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type: SASL_TOKEN
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: reading fields from DataInput:
org.jboss.netty.buffer.ChannelBufferInputStream@24bb6086
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: token size is: 274
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: now reading token.
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: read SASL token of length: 274
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestDecoder: decoded an object of type: class
org.apache.giraph.comm.SaslTokenMessage:org.apache.giraph.comm.SaslTokenMessage@9be1041
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestServerHandler: Got class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestServerHandler: calling doRequest on class: class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: looking for saslNettyServer on
server:/10.176.255.76:30000 for client /10.176.255.76:48239
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: client's token's length is: 274
2012-08-08 20:58:53,018 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: checking completeness of SASL
(pre-response):false
2012-08-08 20:58:53,019 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: responding to input token of length: 274
2012-08-08 20:58:53,019 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: SASL server DIGEST-MD5 callback:
setting password for client: job_1344445498302_0016 (auth:SIMPLE)
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: decode: Got a response of type
SASL_TOKEN from
server:ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30001
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type: SASL_TOKEN
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: writableRequestClass: class
org.apache.giraph.comm.SaslTokenMessage found for type:SASL_TOKEN
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: reading fields of server
response:org.apache.giraph.comm.SaslTokenMessage@1d1d2066
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: reading fields from DataInput:
org.jboss.netty.buffer.ChannelBufferInputStream@633a1778
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: token size is: 108
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: now reading token.
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: read SASL token of length: 108
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: finished reading fields of server
response:org.apache.giraph.comm.SaslTokenMessage@1d1d2066
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseClientHandler: message received:
org.apache.giraph.comm.SaslTokenMessage@1d1d2066
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslNettyClient: SASL client callback: setting username:
FmpvYl8xMzQ0NDQ1NDk4MzAyXzAwMTY=
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslNettyClient: SASL client callback: setting
userPassword
2012-08-08 20:58:53,020 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslNettyClient: SASL client callback: setting realm:
default
2012-08-08 20:58:53,021 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: creating SASL message with size: 274
2012-08-08 20:58:53,021 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.NettyClient: sending request:
org.apache.giraph.comm.SaslTokenMessage@7adafa2c to remote server:
ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30001
2012-08-08 20:58:53,021 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.RequestEncoder: encoding object:
org.apache.giraph.comm.SaslTokenMessage@7adafa2c
2012-08-08 20:58:53,021 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: write() called on token of length: 274
2012-08-08 20:58:53,021 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: write() finished writing token.
2012-08-08 20:58:53,021 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.RequestEncoder: encode: Encoding a message of type class
org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,021 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseClientHandler: due to reception of:
org.apache.giraph.comm.SaslTokenMessage@1d1d2066
2012-08-08 20:58:53,021 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: SASL server DIGEST-MD5 callback:
setting canonicalized client ID: job_1344445498302_0016
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslNettyServer: response token length: 40
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: checking completeness of SASL
(post-response):true
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: server's token's length is: 40
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: Responding to client:
/10.176.255.76:48239
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: RESPONSE ENCODER IS ENCODING A
MESSAGE:org.apache.giraph.comm.SaslTokenMessage@9be1041
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: encoding object:
org.apache.giraph.comm.SaslTokenMessage@9be1041
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: encode: Encoding a message of type
class org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: write() called on token of length: 40
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: write() finished writing token.
2012-08-08 20:58:53,022 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: Finished writing token to client.
2012-08-08 20:58:53,023 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: writing out complete token now.
2012-08-08 20:58:53,023 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: RESPONSE ENCODER IS ENCODING A
MESSAGE:org.apache.giraph.comm.SaslComplete@3e5e9db7
2012-08-08 20:58:53,023 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: encoding object:
org.apache.giraph.comm.SaslComplete@3e5e9db7
2012-08-08 20:58:53,023 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.ResponseEncoder: encode: Encoding a message of type
class org.apache.giraph.comm.SaslComplete
2012-08-08 20:58:53,023 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: decode: Got a response of type
SASL_COMPLETE from
server:ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30000
2012-08-08 20:58:53,023 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type:
SASL_COMPLETE
2012-08-08 20:58:53,023 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: writableRequestClass: class
org.apache.giraph.comm.SaslComplete found for type:SASL_COMPLETE
2012-08-08 20:58:53,023 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: reading fields of server
response:org.apache.giraph.comm.SaslComplete@75fc25e5
2012-08-08 20:58:53,023 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.SaslComplete: read fields (none)
2012-08-08 20:58:53,024 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseDecoder: finished reading fields of server
response:org.apache.giraph.comm.SaslComplete@75fc25e5
2012-08-08 20:58:53,024 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseClientHandler: message received:
org.apache.giraph.comm.SaslComplete@75fc25e5
2012-08-08 20:58:53,024 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseClientHandler: SASL Authentication complete with
server: ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30000.
2012-08-08 20:58:53,024 DEBUG [New I/O client worker #1-1]
org.apache.giraph.comm.ResponseClientHandler: due to reception of:
org.apache.giraph.comm.SaslComplete@75fc25e5
2012-08-08 20:58:53,023 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslComplete: writing one byte (write).
2012-08-08 20:58:53,024 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: wrote out complete token now.
2012-08-08 20:58:53,024 DEBUG [New I/O server worker #1-2]
org.apache.giraph.comm.RequestServerHandler: done with doRequest() for class:
class org.apache.giraph.comm.SaslTokenMessage
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: decode: Got a response of type
SASL_TOKEN from
server:ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30001
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type: SASL_TOKEN
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: writableRequestClass: class
org.apache.giraph.comm.SaslTokenMessage found for type:SASL_TOKEN
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: reading fields of server
response:org.apache.giraph.comm.SaslTokenMessage@3fe88b35
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: reading fields from DataInput:
org.jboss.netty.buffer.ChannelBufferInputStream@3c0b655a
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: token size is: 40
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: now reading token.
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslTokenMessage: read SASL token of length: 40
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: finished reading fields of server
response:org.apache.giraph.comm.SaslTokenMessage@3fe88b35
2012-08-08 20:58:53,031 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseClientHandler: message received:
org.apache.giraph.comm.SaslTokenMessage@3fe88b35
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: decode: Got a response of type
SASL_COMPLETE from
server:ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30001
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.RequestRegistry: getClass() looking for type:
SASL_COMPLETE
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: writableRequestClass: class
org.apache.giraph.comm.SaslComplete found for type:SASL_COMPLETE
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: reading fields of server
response:org.apache.giraph.comm.SaslComplete@156a9424
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.SaslComplete: read fields (none)
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseDecoder: finished reading fields of server
response:org.apache.giraph.comm.SaslComplete@156a9424
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseClientHandler: message received:
org.apache.giraph.comm.SaslComplete@156a9424
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseClientHandler: SASL Authentication complete with
server: ip-10-176-255-76.us-west-1.compute.internal/10.176.255.76:30001.
2012-08-08 20:58:53,071 DEBUG [New I/O client worker #1-2]
org.apache.giraph.comm.ResponseClientHandler: due to reception of:
org.apache.giraph.comm.SaslComplete@156a9424
{code}
> Add secure authentication to Netty IPC
> --------------------------------------
>
> Key: GIRAPH-211
> URL: https://issues.apache.org/jira/browse/GIRAPH-211
> Project: Giraph
> Issue Type: Improvement
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.2.0
>
> Attachments: GIRAPH-211-proposal.txt, GIRAPH-211.patch
>
>
> Gianmarco De Francisci Morales asked on the user list:
> bq. I am getting the exception in the subject when running my giraph program
> bq. on a cluster with Kerberos authentication.
> This leads to the idea of having Kerberos authentication supported within
> GIRAPH. Hopefully it would use our fast GIRAPH-37 IPC, but could also
> interoperate with Hadoop security.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
