[jira] [Created] (SPARK-48500) On the client side, there is no information about the exception that caused the job to fail

2024-06-02 Thread Sergey Kotlov (Jira)
Sergey Kotlov created SPARK-48500: - Summary: On the client side, there is no information about the exception that caused the job to fail Key: SPARK-48500 URL: https://issues.apache.org/jira/browse/SPARK-48500

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

2021-11-03 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Description: In this example, reading unnecessary nested fields still happens. Data preparati

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

2021-11-03 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Description: In this example, reading unnecessary nested fields still happens. Data preparati

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

2021-11-03 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Description: In this example, reading unnecessary nested fields still happens. Data preparati

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

2021-11-02 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Summary: Spark SQL reads unnecessary nested fields (filter after explode) (was: Spark SQL rea

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecсessary nested fields (filter after explode)

2021-11-02 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Summary: Spark SQL reads unnecсessary nested fields (filter after explode) (was: Spark SQL re

[jira] [Created] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

2021-11-02 Thread Sergey Kotlov (Jira)
Sergey Kotlov created SPARK-37201: - Summary: Spark SQL reads unnecessary nested fields (filter after explode) Key: SPARK-37201 URL: https://issues.apache.org/jira/browse/SPARK-37201 Project: Spark

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-07 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316697#comment-17316697 ] Sergey Kotlov commented on SPARK-34674: --- The fix that I currently use:  [https://g

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-28 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310235#comment-17310235 ] Sergey Kotlov commented on SPARK-34674: --- Thanks for looking into this problem, [~d

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-23 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307398#comment-17307398 ] Sergey Kotlov commented on SPARK-34674: --- I saw it in the sources. But you are righ

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-20 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305419#comment-17305419 ] Sergey Kotlov commented on SPARK-34674: --- Thanks for response, [~dongjoon] I haven