Thanks Steve! I tried both 1.5.3 and 1.6.0 from git-clone-build. 1.5.3 is still broken. 1.6.0 does work! This one is probably the one. https://issues.apache.org/jira/browse/SPARK-11821
-Neal From: Steve Loughran <ste...@hortonworks.com<mailto:ste...@hortonworks.com>> Date: Tuesday, December 8, 2015 at 4:09 AM To: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: Re: HiveContext creation failed with Kerberos On 8 Dec 2015, at 06:52, Neal Yin <neal....@workday.com<mailto:neal....@workday.com>> wrote: 15/12/08 04:12:28 ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] lots of causes for that, its one of the two classic "kerberos doesn't like you" error messages https://steveloughran.gitbooks.io/kerberos_and_hadoop/content/sections/errors.html in your case it sounds like 1 or more of these issues https://issues.apache.org/jira/browse/SPARK-10181 https://issues.apache.org/jira/browse/SPARK-11821 https://issues.apache.org/jira/browse/SPARK-11265 All of which are fixed in 1.5.3. Which doesn't help you with the CDH 1.5.2 release, unless they backported things -Steve