[jira] [Updated] (SPARK-36328) HadoopRDD#getPartitions fetches FileSystem Delegation Token for every partition

[ https://issues.apache.org/jira/browse/SPARK-36328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated SPARK-36328: -- Description: Spark Job creates a separate JobConf for every RDD (every hive table partition)

[jira] [Updated] (SPARK-36328) HadoopRDD#getPartitions fetches FileSystem Delegation Token for every partition

[ https://issues.apache.org/jira/browse/SPARK-36328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated SPARK-36328: -- Summary: HadoopRDD#getPartitions fetches FileSystem Delegation Token for every partition

[jira] [Created] (SPARK-36328) HadoopRDD#getPartitions fetches FileSystem Delegation Token for evert partition

Prabhu Joseph created SPARK-36328: - Summary: HadoopRDD#getPartitions fetches FileSystem Delegation Token for evert partition Key: SPARK-36328 URL: https://issues.apache.org/jira/browse/SPARK-36328

[jira] [Comment Edited] (SPARK-26867) Spark Support of YARN Placement Constraint

[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782270#comment-16782270 ] Prabhu Joseph edited comment on SPARK-26867 at 3/2/19 3:52 AM: --- [~srowen]

[jira] [Commented] (SPARK-26867) Spark Support of YARN Placement Constraint

[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782270#comment-16782270 ] Prabhu Joseph commented on SPARK-26867: --- Spark can allow users to configure the Placement

[jira] [Updated] (SPARK-26867) Spark Support of YARN Placement Constraint

[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated SPARK-26867: -- Summary: Spark Support of YARN Placement Constraint (was: Spark Support for YARN Placement

[jira] [Updated] (SPARK-26867) Spark Support of YARN Placement Constraint

[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated SPARK-26867: -- Component/s: YARN > Spark Support of YARN Placement Constraint >

[jira] [Created] (SPARK-26867) Spark Support for YARN Placement Constraint

Prabhu Joseph created SPARK-26867: - Summary: Spark Support for YARN Placement Constraint Key: SPARK-26867 URL: https://issues.apache.org/jira/browse/SPARK-26867 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24192) Invalid Spark URL in local spark session since upgrading from org.apache.spark:spark-sql_2.11:2.2.1 to org.apache.spark:spark-sql_2.11:2.3.0

[ https://issues.apache.org/jira/browse/SPARK-24192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549707#comment-16549707 ] Prabhu Joseph commented on SPARK-24192: --- We have faced this issue and this happens when the

[jira] [Updated] (SPARK-24008) SQL/Hive Context fails with NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-24008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated SPARK-24008: -- Description: SQL / Hive Context fails with NullPointerException while getting configuration

[jira] [Commented] (SPARK-24008) SQL/Hive Context fails with NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-24008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443484#comment-16443484 ] Prabhu Joseph commented on SPARK-24008: --- Yes it's driver specific. But better to handle this case

[jira] [Updated] (SPARK-24008) SQL/Hive Context fails with NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-24008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated SPARK-24008: -- Attachment: Repro > SQL/Hive Context fails with NullPointerException >

[jira] [Created] (SPARK-24008) SQL/Hive Context fails with NullPointerException

Prabhu Joseph created SPARK-24008: - Summary: SQL/Hive Context fails with NullPointerException Key: SPARK-24008 URL: https://issues.apache.org/jira/browse/SPARK-24008 Project: Spark Issue

[jira] [Created] (SPARK-22587) Spark job fails if fs.defaultFS and application jar are different url

Prabhu Joseph created SPARK-22587: - Summary: Spark job fails if fs.defaultFS and application jar are different url Key: SPARK-22587 URL: https://issues.apache.org/jira/browse/SPARK-22587 Project:

[jira] [Commented] (SPARK-22426) Spark AM launching containers on node where External spark shuffle service failed to initialize

[ https://issues.apache.org/jira/browse/SPARK-22426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237769#comment-16237769 ] Prabhu Joseph commented on SPARK-22426: --- Thanks [~jerryshao], we can close this as a duplicate. >

[jira] [Commented] (SPARK-22426) Spark AM launching containers on node where External spark shuffle service failed to initialize

[ https://issues.apache.org/jira/browse/SPARK-22426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235500#comment-16235500 ] Prabhu Joseph commented on SPARK-22426: --- Node and NodeManager process is fine, External Spark

[jira] [Created] (SPARK-22426) Spark AM launching containers on node where External spark shuffle service failed to initialize

Prabhu Joseph created SPARK-22426: - Summary: Spark AM launching containers on node where External spark shuffle service failed to initialize Key: SPARK-22426 URL: https://issues.apache.org/jira/browse/SPARK-22426

[jira] [Updated] (SPARK-22426) Spark AM launching containers on node where External spark shuffle service failed to initialize

[ https://issues.apache.org/jira/browse/SPARK-22426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated SPARK-22426: -- Component/s: YARN > Spark AM launching containers on node where External spark shuffle service

[jira] [Created] (SPARK-22199) Spark Job on YARN fails with executors "Slave registration failed"

Prabhu Joseph created SPARK-22199: - Summary: Spark Job on YARN fails with executors "Slave registration failed" Key: SPARK-22199 URL: https://issues.apache.org/jira/browse/SPARK-22199 Project: Spark

[jira] [Comment Edited] (SPARK-16225) Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value

[ https://issues.apache.org/jira/browse/SPARK-16225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350718#comment-15350718 ] Prabhu Joseph edited comment on SPARK-16225 at 6/27/16 10:00 AM: - Thanks

[jira] [Commented] (SPARK-16225) Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value

[ https://issues.apache.org/jira/browse/SPARK-16225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350718#comment-15350718 ] Prabhu Joseph commented on SPARK-16225: --- Thanks [~srowen] > Spark Sql throws

[jira] [Created] (SPARK-16225) Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value

Prabhu Joseph created SPARK-16225: - Summary: Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value Key: SPARK-16225 URL: https://issues.apache.org/jira/browse/SPARK-16225 Project:

[jira] [Created] (SPARK-15918) unionAll returns wrong result when two dataframes has schema in different order

Prabhu Joseph created SPARK-15918: - Summary: unionAll returns wrong result when two dataframes has schema in different order Key: SPARK-15918 URL: https://issues.apache.org/jira/browse/SPARK-15918

[jira] [Resolved] (SPARK-13181) Spark delay in task scheduling within executor

[ https://issues.apache.org/jira/browse/SPARK-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph resolved SPARK-13181. --- Resolution: Not A Problem > Spark delay in task scheduling within executor >

[jira] [Commented] (SPARK-13181) Spark delay in task scheduling within executor

[ https://issues.apache.org/jira/browse/SPARK-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15132115#comment-15132115 ] Prabhu Joseph commented on SPARK-13181: --- Okay, the reason for the task delay within executor when

[jira] [Updated] (SPARK-13181) Spark delay in task scheduling within executor

[ https://issues.apache.org/jira/browse/SPARK-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated SPARK-13181: -- Attachment: ran3.JPG > Spark delay in task scheduling within executor >

[jira] [Created] (SPARK-13181) Spark delay in task scheduling within executor

Prabhu Joseph created SPARK-13181: - Summary: Spark delay in task scheduling within executor Key: SPARK-13181 URL: https://issues.apache.org/jira/browse/SPARK-13181 Project: Spark Issue Type:

[jira] [Created] (SPARK-13182) Spark Executor retries infinitely

Prabhu Joseph created SPARK-13182: - Summary: Spark Executor retries infinitely Key: SPARK-13182 URL: https://issues.apache.org/jira/browse/SPARK-13182 Project: Spark Issue Type: Bug