koert kuipers created SPARK-29027: ------------------------------------- Summary: KafkaDelegationTokenSuite fails Key: SPARK-29027 URL: https://issues.apache.org/jira/browse/SPARK-29027 Project: Spark Issue Type: Bug Components: Structured Streaming Affects Versions: 3.0.0 Environment: {code} commit 6378d4bc06cd1bb1a209bd5fb63d10ef52d75eb4 Author: Sean Owen <sean.o...@databricks.com> Date: Mon Sep 9 10:19:40 2019 -0500 {code}
Ubuntu 16.04 with OpenJDK 1.8 (1.8.0_222-8u222-b10-1ubuntu1~16.04.1-b10) Reporter: koert kuipers i am seeing consistent failure of KafkaDelegationTokenSuite on master {code} JsonUtilsSuite: - parsing partitions - parsing partitionOffsets KafkaDelegationTokenSuite: javax.security.sasl.SaslException: Failure to initialize security context [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)] at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:125) at com.sun.security.sasl.gsskerb.FactoryImpl.createSaslServer(FactoryImpl.java:85) at javax.security.sasl.Sasl.createSaslServer(Sasl.java:524) at org.apache.zookeeper.server.ZooKeeperSaslServer$1.run(ZooKeeperSaslServer.java:118) at org.apache.zookeeper.server.ZooKeeperSaslServer$1.run(ZooKeeperSaslServer.java:114) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.zookeeper.server.ZooKeeperSaslServer.createSaslServer(ZooKeeperSaslServer.java:114) at org.apache.zookeeper.server.ZooKeeperSaslServer.<init>(ZooKeeperSaslServer.java:48) at org.apache.zookeeper.server.NIOServerCnxn.<init>(NIOServerCnxn.java:100) at org.apache.zookeeper.server.NIOServerCnxnFactory.createConnection(NIOServerCnxnFactory.java:156) at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:197) at java.lang.Thread.run(Thread.java:748) Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails) at sun.security.jgss.krb5.Krb5AcceptCredential.getInstance(Krb5AcceptCredential.java:87) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:127) at sun.security.jgss.GSSManagerImpl.getCredentialElement(GSSManagerImpl.java:193) at sun.security.jgss.GSSCredentialImpl.add(GSSCredentialImpl.java:427) at sun.security.jgss.GSSCredentialImpl.<init>(GSSCredentialImpl.java:62) at sun.security.jgss.GSSManagerImpl.createCredential(GSSManagerImpl.java:154) at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:108) ... 12 more org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite *** ABORTED *** org.I0Itec.zkclient.exception.ZkAuthFailedException: Authentication failure at org.I0Itec.zkclient.ZkClient.waitForKeeperState(ZkClient.java:947) at org.I0Itec.zkclient.ZkClient.waitUntilConnected(ZkClient.java:924) at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1231) at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:157) at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:131) at kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:93) at kafka.utils.ZkUtils$.apply(ZkUtils.scala:75) at org.apache.spark.sql.kafka010.KafkaTestUtils.setupEmbeddedZookeeper(KafkaTestUtils.scala:202) at org.apache.spark.sql.kafka010.KafkaTestUtils.setup(KafkaTestUtils.scala:243) at org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite.beforeAll(KafkaDelegationTokenSuite.scala:49) ... KafkaSourceOffsetSuite: - comparison {"t":{"0":1}} <=> {"t":{"0":2}} - comparison {"t":{"1":0,"0":1}} <=> {"t":{"1":1,"0":2}} - comparison {"t":{"0":1},"T":{"0":0}} <=> {"t":{"0":2},"T":{"0":1}} - comparison {"t":{"0":1}} <=> {"t":{"1":1,"0":2}} - comparison {"t":{"0":1}} <=> {"t":{"1":3,"0":2}} - basic serialization - deserialization - OffsetSeqLog serialization - deserialization - read Spark 2.1.0 offset format {code} {code} [INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT: [INFO] [INFO] Spark Project Parent POM ........................... SUCCESS [ 4.178 s] [INFO] Spark Project Tags ................................. SUCCESS [ 9.373 s] [INFO] Spark Project Sketch ............................... SUCCESS [ 24.586 s] [INFO] Spark Project Local DB ............................. SUCCESS [ 5.456 s] [INFO] Spark Project Networking ........................... SUCCESS [ 49.819 s] [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 6.096 s] [INFO] Spark Project Unsafe ............................... SUCCESS [ 14.714 s] [INFO] Spark Project Launcher ............................. SUCCESS [ 5.277 s] [INFO] Spark Project Core ................................. SUCCESS [32:58 min] [INFO] Spark Project ML Local Library ..................... SUCCESS [ 41.076 s] [INFO] Spark Project GraphX ............................... SUCCESS [01:51 min] [INFO] Spark Project Streaming ............................ SUCCESS [06:43 min] [INFO] Spark Project Catalyst ............................. SUCCESS [15:04 min] [INFO] Spark Project SQL .................................. SUCCESS [ 01:32 h] [INFO] Spark Project ML Library ........................... SUCCESS [26:48 min] [INFO] Spark Project Tools ................................ SUCCESS [ 7.830 s] [INFO] Spark Project Hive ................................. SUCCESS [ 01:00 h] [INFO] Spark Project Graph API ............................ SUCCESS [ 3.378 s] [INFO] Spark Project Cypher ............................... SUCCESS [ 3.672 s] [INFO] Spark Project Graph ................................ SUCCESS [ 3.615 s] [INFO] Spark Project REPL ................................. SUCCESS [02:11 min] [INFO] Spark Project Assembly ............................. SUCCESS [ 3.058 s] [INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 24.208 s] [INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:46 min] [INFO] Kafka 0.10+ Source for Structured Streaming ........ FAILURE [06:15 min] [INFO] Spark Project Examples ............................. SKIPPED [INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [ 2.467 s] [INFO] Spark Avro ......................................... SUCCESS [01:47 min] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 04:11 h [INFO] Finished at: 2019-09-08T02:49:07-04:00 [INFO] ------------------------------------------------------------------------ {code} -- This message was sent by Atlassian Jira (v8.3.2#803003) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org