[jira] [Resolved] (SPARK-27139) NettyBlockTransferService does not abide by spark.blockManager.port config option

[ https://issues.apache.org/jira/browse/SPARK-27139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved SPARK-27139. Resolution: Invalid And proper casing does the trick > NettyBlockTransferService does

[jira] [Updated] (SPARK-27139) NettyBlockTransferService does not abide by spark.blockManager.port config option

[ https://issues.apache.org/jira/browse/SPARK-27139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-27139: --- Description: This is a regression from a fix in SPARK-4837 The NettyBlockTransferService

[jira] [Created] (SPARK-27139) NettyBlockTransferService does not abide by spark.blockManager.port config option

Bolke de Bruin created SPARK-27139: -- Summary: NettyBlockTransferService does not abide by spark.blockManager.port config option Key: SPARK-27139 URL: https://issues.apache.org/jira/browse/SPARK-27139

[jira] [Created] (SPARK-22717) Postgres is assumed to cascade truncate table by default which is not true

Bolke de Bruin created SPARK-22717: -- Summary: Postgres is assumed to cascade truncate table by default which is not true Key: SPARK-22717 URL: https://issues.apache.org/jira/browse/SPARK-22717

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006296#comment-15006296 ] Bolke de Bruin commented on SPARK-10181: [~yhuai] thanks for the fix which works (sorry for the

[jira] [Comment Edited] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976990#comment-14976990 ] Bolke de Bruin edited comment on SPARK-10181 at 10/27/15 7:16 PM: -- I

[jira] [Closed] (SPARK-9887) After recent hive patches PySpark fails with IllegalArgumentException: Wrong FS: hdfs:

[ https://issues.apache.org/jira/browse/SPARK-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin closed SPARK-9887. - Was duplicate. > After recent hive patches PySpark fails with IllegalArgumentException: Wrong > FS:

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976990#comment-14976990 ] Bolke de Bruin commented on SPARK-10181: I will apply it too our install if it works against 1.5

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal

[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954582#comment-14954582 ] Bolke de Bruin commented on SPARK-10181: Yes that is correct. > HiveContext is not used with

[jira] [Updated] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-10181: --- Summary: HiveContext is not used with keytab principal but with user principal/unix username

[jira] [Updated] (SPARK-10181) In a kerberized environment HiveContext is not used with keytab principal but with user principal

[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-10181: --- Summary: In a kerberized environment HiveContext is not used with keytab principal but with

[jira] [Updated] (SPARK-10181) HiveContext is not used with keytab principal but with user principal

[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-10181: --- Environment: kerberos Labels: hive hivecontext kerberos (was: ) Component/s:

[jira] [Created] (SPARK-10181) In a kerberized environment Hive is not used with keytab princip but with user principal

Bolke de Bruin created SPARK-10181: -- Summary: In a kerberized environment Hive is not used with keytab princip but with user principal Key: SPARK-10181 URL: https://issues.apache.org/jira/browse/SPARK-10181

[jira] [Commented] (SPARK-9887) After recent hive patches PySpark fails with IllegalArgumentException: Wrong FS: hdfs:

[ https://issues.apache.org/jira/browse/SPARK-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694092#comment-14694092 ] Bolke de Bruin commented on SPARK-9887: --- Yes actually. I will test the latest and

[jira] [Created] (SPARK-9887) After recent hive patches PySpark fails with IllegalArgumentException: Wrong FS: hdfs:

Bolke de Bruin created SPARK-9887: - Summary: After recent hive patches PySpark fails with IllegalArgumentException: Wrong FS: hdfs: Key: SPARK-9887 URL: https://issues.apache.org/jira/browse/SPARK-9887

[jira] [Updated] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-9019: -- Attachment: debug-log-spark-1.5-fail spark-submit-log-1.5.0-fail spark-submit

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14633807#comment-14633807 ] Bolke de Bruin commented on SPARK-9019: --- As mentioned in the PR request the traces

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632341#comment-14632341 ] Bolke de Bruin commented on SPARK-9019: --- I have created PR-#7489 for this issue.

[jira] [Issue Comment Deleted] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-9019: -- Comment: was deleted (was: I have created PR-#7489 for this issue. ) spark-submit fails on

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631367#comment-14631367 ] Bolke de Bruin commented on SPARK-9019: --- Ok. I tracked down the log entry due to a

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631367#comment-14631367 ] Bolke de Bruin edited comment on SPARK-9019 at 7/17/15 2:00 PM:

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629432#comment-14629432 ] Bolke de Bruin edited comment on SPARK-9019 at 7/16/15 8:39 AM:

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629432#comment-14629432 ] Bolke de Bruin commented on SPARK-9019: --- I tried running this on an update

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625980#comment-14625980 ] Bolke de Bruin commented on SPARK-9019: --- Tracing this down it seems that the tokens

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626043#comment-14626043 ] Bolke de Bruin commented on SPARK-9019: --- Will try in a few minutes, however it did

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626183#comment-14626183 ] Bolke de Bruin commented on SPARK-9019: --- [~srowen] unfortunately the patch from

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626183#comment-14626183 ] Bolke de Bruin edited comment on SPARK-9019 at 7/14/15 10:41 AM:

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626113#comment-14626113 ] Bolke de Bruin commented on SPARK-9019: --- Now with debug info (not yet with patch):

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626300#comment-14626300 ] Bolke de Bruin edited comment on SPARK-9019 at 7/14/15 1:00 PM:

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626256#comment-14626256 ] Bolke de Bruin commented on SPARK-9019: --- And some more debugging information. Please

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626300#comment-14626300 ] Bolke de Bruin commented on SPARK-9019: --- It might be that we have a configuration

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626574#comment-14626574 ] Bolke de Bruin commented on SPARK-9019: --- Can this be related to YARN-3103?

[jira] [Issue Comment Deleted] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-9019: -- Comment: was deleted (was: - this was incorrect - ) spark-submit fails on yarn with kerberos

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625980#comment-14625980 ] Bolke de Bruin edited comment on SPARK-9019 at 7/14/15 7:33 AM:

[jira] [Created] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

Bolke de Bruin created SPARK-9019: - Summary: spark-submit fails on yarn with kerberos enabled Key: SPARK-9019 URL: https://issues.apache.org/jira/browse/SPARK-9019 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625349#comment-14625349 ] Bolke de Bruin commented on SPARK-9019: --- Please note that keytab was successfully

[jira] [Commented] (SPARK-8623) Hadoop RDDs fail to properly serialize configuration

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604180#comment-14604180 ] Bolke de Bruin commented on SPARK-8623: --- Thanks Sandy, I applied the patch and error

[jira] [Created] (SPARK-8623) Some queries in spark-sql lead to NullPointerException when using Yarn

Bolke de Bruin created SPARK-8623: - Summary: Some queries in spark-sql lead to NullPointerException when using Yarn Key: SPARK-8623 URL: https://issues.apache.org/jira/browse/SPARK-8623 Project:

[jira] [Updated] (SPARK-8623) Some queries in spark-sql lead to NullPointerException when using Yarn

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-8623: -- Description: The following query was executed using spark-sql --master yarn-client on

[jira] [Comment Edited] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597450#comment-14597450 ] Bolke de Bruin edited comment on SPARK-5111 at 6/24/15 1:49 PM:

[jira] [Comment Edited] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597450#comment-14597450 ] Bolke de Bruin edited comment on SPARK-5111 at 6/24/15 1:48 PM:

[jira] [Commented] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597450#comment-14597450 ] Bolke de Bruin commented on SPARK-5111: --- I did a different approach here:

[jira] [Comment Edited] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595451#comment-14595451 ] Bolke de Bruin edited comment on SPARK-5111 at 6/22/15 7:18 AM:

[jira] [Commented] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595451#comment-14595451 ] Bolke de Bruin commented on SPARK-5111: --- Further analaysis gives that the latest

[jira] [Commented] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595205#comment-14595205 ] Bolke de Bruin commented on SPARK-5111: --- This patch does not work on a hadoop 2.6 +