In the process of setting up a hadoop build (2.6), we're seeing a bunch of
unit test failures all of which are related with mini-kdc. They come from
many different projects (hadoop-kms, hadoop-hdfs,
hadoop-yarn-server-resourcemanager, etc.), but the commonality is mini-kdc.
All the failed unit tests shows the following exception on the mini-kdc
side of things:
2015-06-03 01:01:19,288 ERROR KerberosProtocolHandler - /127.0.0.1:55603
EXCEPTION
org.apache.mina.filter.codec.ProtocolDecoderException:
java.lang.NullPointerException: message (Hexdump: 00 00 02 45 6C 82 02 41
30 82 02 3D A1 03 02 01 05 A2 03 02 01 0C A3 82 01 C4 30 82 01 C0 30 82 01
BC A1 03 02 01 01 A2 82 01 B3 04 82 01 AF 6E 82 01 AB 30 82 01 A7 A0 03 02
01 05 A1 03 02 01 0E A2 07 03 05 00 00 00 00 00 A3 81 F6 61 81 F3 30 81 F0
A0 03 02 01 05 A1 0D 1B 0B 45 58 41 4D 50 4C 45 2E 43 4F 4D A2 20 30 1E A0
03 02 01 02 A1 17 30 15 1B 06 6B 72 62 74 67 74 1B 0B 45 58 41 4D 50 4C 45
2E 43 4F 4D A3 81 B7 30 81 B4 A0 03 02 01 11 A2 81 AC 04 81 A9 7A F6 28 B6
36 3F 53 D1 4B B5 1F E8 8B 80 DE 37 B1 9C 56 12 89 4A BB 88 98 11 C4 71 7F
D0 93 58 67 3D A0 CD 64 7D 0C 22 50 78 62 AD E4 30 51 D9 DD EB 01 38 37 5C
6E F0 E1 DB 96 18 86 C2 D6 30 CB C2 54 48 14 F1 D0 2A 84 1F 92 23 C1 06 D5
2E 19 7A 83 AA 1B AE 05 F6 37 53 3F 17 2C 6F 46 B6 24 B2 B5 C8 8E A3 AD 33
0E B6 9F 96 44 CE 9A 88 F4 83 1D DB 5F B0 1A 57 AB 36 E9 CB 21 F3 42 3D 5C
81 61 2E 0B C9 82 F6 DF E3 0D A6 6C CA B8 3D FC AB A9 AF 80 36 C7 77 61 3B
B1 47 9F 20 D4 C0 ED 4D 3C 0E 93 E4 71 8D 46 A4 81 98 30 81 95 A0 03 02 01
11 A2 81 8D 04 81 8A FA 9E 75 35 B4 71 82 F8 7E 53 45 E8 5C 1F DE 8D CB 43
B2 68 E6 8E B9 9D 88 BA 58 77 84 11 2F DD D7 D7 E5 8D 09 D6 FB AA 82 25 6E
F6 C0 A1 A8 BB 8D D1 2C 35 11 6C 88 6C CB 1B 41 54 98 80 21 FE 6F 65 DD 7B
D7 F3 C4 98 A2 26 AC 08 51 B9 51 24 EA 1E 95 C0 82 50 4F 16 3E 28 CB EB C0
A6 51 84 E6 E5 2D 58 1C C9 C8 1B A8 C6 30 02 75 2A C5 CF 78 A0 AF 90 98 41
25 7E 55 93 FC 7F 52 63 89 5E EE BE BB BF D7 E6 92 5E 2A 6F A4 69 30 67 A0
07 03 05 00 00 00 00 00 A2 0D 1B 0B 45 58 41 4D 50 4C 45 2E 43 4F 4D A3 1C
30 1A A0 03 02 01 00 A1 13 30 11 1B 04 48 54 54 50 1B 09 6C 6F 63 61 6C 68
6F 73 74 A5 11 18 0F 31 39 37 30 30 31 30 31 30 30 30 30 30 30 5A A7 06 02
04 01 55 19 DD A8 14 30 12 02 01 12)
at
org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:234)
at
org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:434)
at
org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1200(DefaultIoFilterChain.java:48)
at
org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:802)
at
org.apache.mina.core.filterchain.IoFilterAdapter.messageReceived(IoFilterAdapter.java:120)
at
org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:434)
at
org.apache.mina.core.filterchain.DefaultIoFilterChain.fireMessageReceived(DefaultIoFilterChain.java:426)
at
org.apache.mina.core.polling.AbstractPollingIoProcessor.read(AbstractPollingIoProcessor.java:604)
at
org.apache.mina.core.polling.AbstractPollingIoProcessor.process(AbstractPollingIoProcessor.java:564)
at
org.apache.mina.core.polling.AbstractPollingIoProcessor.process(AbstractPollingIoProcessor.java:553)
at
org.apache.mina.core.polling.AbstractPollingIoProcessor.access$400(AbstractPollingIoProcessor.java:57)
at
org.apache.mina.core.polling.AbstractPollingIoProcessor$Processor.run(AbstractPollingIoProcessor.java:892)
at
org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:65)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException: message
at
org.apache.mina.filter.codec.AbstractProtocolDecoderOutput.write(AbstractProtocolDecoderOutput.java:44)
at
org.apache.directory.server.kerberos.protocol.codec.MinaKerberosDecoder.decode(MinaKerberosDecoder.java:65)
at
org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:224)
... 15 more
The machines on which these unit tests are failing are CentOS 6 machines.
What's interesting is that these unit tests pass fine on some other
machines (Mac OS, ubuntu, etc.). I checked for any kerberos-related set-up
on the problematic machines, but did not spot anything obvious.
Has anyone encountered this before?
Thanks,
Sangjin
