[jira] [Assigned] (SPARK-23432) Expose executor memory metrics in the web UI for executors

[ https://issues.apache.org/jira/browse/SPARK-23432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-23432: Assignee: Zhongwei Zhu > Expose executor memory metrics in the web UI for executors >

[jira] [Resolved] (SPARK-23432) Expose executor memory metrics in the web UI for executors

[ https://issues.apache.org/jira/browse/SPARK-23432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-23432. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30186

[jira] [Commented] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227217#comment-17227217 ] Apache Spark commented on SPARK-3: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33302) Failed to push down filters through Expand

[ https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227212#comment-17227212 ] angerszhu commented on SPARK-33302: --- working on  this > Failed to push down filters through Expand >

[jira] [Commented] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227201#comment-17227201 ] Apache Spark commented on SPARK-32691: -- User 'huangtianhua' has created a pull request for this

[jira] [Commented] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227200#comment-17227200 ] Apache Spark commented on SPARK-32691: -- User 'huangtianhua' has created a pull request for this

[jira] [Assigned] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32691: Assignee: Apache Spark (was: zhengruifeng) > Test org.apache.spark.DistributedSuite

[jira] [Assigned] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32691: Assignee: zhengruifeng (was: Apache Spark) > Test org.apache.spark.DistributedSuite

[jira] [Commented] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227196#comment-17227196 ] huangtianhua commented on SPARK-32691: -- We have found the problem, it is take long time to

[jira] [Commented] (SPARK-33326) Partition Parameters are not updated even after ANALYZE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-33326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227190#comment-17227190 ] angerszhu commented on SPARK-33326: --- Can you show which hive version  you are using? Seems in current

[jira] [Resolved] (SPARK-33364) Expose purge option in TableCatalog.dropTable

[ https://issues.apache.org/jira/browse/SPARK-33364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33364. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30267

[jira] [Assigned] (SPARK-33364) Expose purge option in TableCatalog.dropTable

[ https://issues.apache.org/jira/browse/SPARK-33364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33364: - Assignee: Terry Kim > Expose purge option in TableCatalog.dropTable >

[jira] [Resolved] (SPARK-33130) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MsSqlServer dialect)

[ https://issues.apache.org/jira/browse/SPARK-33130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33130. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30038

[jira] [Assigned] (SPARK-33130) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MsSqlServer dialect)

[ https://issues.apache.org/jira/browse/SPARK-33130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33130: --- Assignee: Prashant Sharma > Support ALTER TABLE in JDBC v2 Table Catalog: add, update type

[jira] [Resolved] (SPARK-33342) In the threadDump page, when a thread is blocked by anther thread, the blocking thread name and url were both displayed incorrect, causing the url to fail to jump.

[ https://issues.apache.org/jira/browse/SPARK-33342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-33342. Resolution: Fixed Issue resolved by pull request 30249

[jira] [Assigned] (SPARK-33342) In the threadDump page, when a thread is blocked by anther thread, the blocking thread name and url were both displayed incorrect, causing the url to fail to jump.

[ https://issues.apache.org/jira/browse/SPARK-33342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-33342: -- Assignee: akiyamaneko > In the threadDump page, when a thread is blocked by anther

[jira] [Commented] (SPARK-32860) Encoders::bean doc incorrectly states maps are not supported

[ https://issues.apache.org/jira/browse/SPARK-32860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227177#comment-17227177 ] Apache Spark commented on SPARK-32860: -- User 'hannahkamundson' has created a pull request for this

[jira] [Commented] (SPARK-33369) Skip schema inference in DataframeWriter.save() if table provider supports external metadata

[ https://issues.apache.org/jira/browse/SPARK-33369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227174#comment-17227174 ] Apache Spark commented on SPARK-33369: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-33369) Skip schema inference in DataframeWriter.save() if table provider supports external metadata

[ https://issues.apache.org/jira/browse/SPARK-33369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33369: Assignee: Apache Spark (was: Gengliang Wang) > Skip schema inference in

[jira] [Commented] (SPARK-33369) Skip schema inference in DataframeWriter.save() if table provider supports external metadata

[ https://issues.apache.org/jira/browse/SPARK-33369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227173#comment-17227173 ] Apache Spark commented on SPARK-33369: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-33369) Skip schema inference in DataframeWriter.save() if table provider supports external metadata

[ https://issues.apache.org/jira/browse/SPARK-33369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33369: Assignee: Gengliang Wang (was: Apache Spark) > Skip schema inference in

[jira] [Updated] (SPARK-33369) Skip schema inference in DataframeWriter.save() if table provider supports external metadata

[ https://issues.apache.org/jira/browse/SPARK-33369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-33369: --- Description: For all the v2 data sources which are not FileDataSourceV2, Spark always

[jira] [Created] (SPARK-33369) Skip schema inference in DataframeWriter.save() if table provider supports external metadata

Gengliang Wang created SPARK-33369: -- Summary: Skip schema inference in DataframeWriter.save() if table provider supports external metadata Key: SPARK-33369 URL: https://issues.apache.org/jira/browse/SPARK-33369

[jira] [Created] (SPARK-33368) SimplifyConditionals simplifies non-deterministic expressions

Yuming Wang created SPARK-33368: --- Summary: SimplifyConditionals simplifies non-deterministic expressions Key: SPARK-33368 URL: https://issues.apache.org/jira/browse/SPARK-33368 Project: Spark

[jira] [Assigned] (SPARK-33367) Move the table commands from ddl.scala to table.scala

[ https://issues.apache.org/jira/browse/SPARK-33367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33367: Assignee: Apache Spark > Move the table commands from ddl.scala to table.scala >

[jira] [Commented] (SPARK-33367) Move the table commands from ddl.scala to table.scala

[ https://issues.apache.org/jira/browse/SPARK-33367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227169#comment-17227169 ] Apache Spark commented on SPARK-33367: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33367) Move the table commands from ddl.scala to table.scala

[ https://issues.apache.org/jira/browse/SPARK-33367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33367: Assignee: (was: Apache Spark) > Move the table commands from ddl.scala to

[jira] [Created] (SPARK-33367) Move the table commands from ddl.scala to table.scala

Terry Kim created SPARK-33367: - Summary: Move the table commands from ddl.scala to table.scala Key: SPARK-33367 URL: https://issues.apache.org/jira/browse/SPARK-33367 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-32860) Encoders::bean doc incorrectly states maps are not supported

[ https://issues.apache.org/jira/browse/SPARK-32860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32860: Assignee: (was: Apache Spark) > Encoders::bean doc incorrectly states maps are not

[jira] [Commented] (SPARK-32860) Encoders::bean doc incorrectly states maps are not supported

[ https://issues.apache.org/jira/browse/SPARK-32860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227155#comment-17227155 ] Apache Spark commented on SPARK-32860: -- User 'hannahkamundson' has created a pull request for this

[jira] [Assigned] (SPARK-32860) Encoders::bean doc incorrectly states maps are not supported

[ https://issues.apache.org/jira/browse/SPARK-32860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32860: Assignee: Apache Spark > Encoders::bean doc incorrectly states maps are not supported >

[jira] [Commented] (SPARK-33366) Migrate LOAD DATA to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227127#comment-17227127 ] Apache Spark commented on SPARK-33366: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33366) Migrate LOAD DATA to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33366: Assignee: (was: Apache Spark) > Migrate LOAD DATA to new resolution framework >

[jira] [Commented] (SPARK-33366) Migrate LOAD DATA to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227126#comment-17227126 ] Apache Spark commented on SPARK-33366: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33366) Migrate LOAD DATA to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33366: Assignee: Apache Spark > Migrate LOAD DATA to new resolution framework >

[jira] [Commented] (SPARK-33326) Partition Parameters are not updated even after ANALYZE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-33326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227112#comment-17227112 ] angerszhu commented on SPARK-33326: --- working  on this. > Partition Parameters are not updated even

[jira] [Created] (SPARK-33366) Migrate LOAD DATA to new resolution framework

Terry Kim created SPARK-33366: - Summary: Migrate LOAD DATA to new resolution framework Key: SPARK-33366 URL: https://issues.apache.org/jira/browse/SPARK-33366 Project: Spark Issue Type: Sub-task

[jira] [Issue Comment Deleted] (SPARK-33326) Partition Parameters are not updated even after ANALYZE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-33326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33326: -- Comment: was deleted (was: Working. on this. [~dabondor] Your hive version is  2.3? Since seems

[jira] [Comment Edited] (SPARK-33326) Partition Parameters are not updated even after ANALYZE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-33326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227107#comment-17227107 ] angerszhu edited comment on SPARK-33326 at 11/6/20, 2:05 AM: - Working. on

[jira] [Commented] (SPARK-33326) Partition Parameters are not updated even after ANALYZE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-33326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227107#comment-17227107 ] angerszhu commented on SPARK-33326: --- Working. on this > Partition Parameters are not updated even

[jira] [Resolved] (SPARK-33365) Update SBT to 1.4.2

[ https://issues.apache.org/jira/browse/SPARK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33365. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30268

[jira] [Assigned] (SPARK-33365) Update SBT to 1.4.2

[ https://issues.apache.org/jira/browse/SPARK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33365: - Assignee: William Hyun > Update SBT to 1.4.2 > --- > >

[jira] [Resolved] (SPARK-33360) simplify DS v2 write resolution

[ https://issues.apache.org/jira/browse/SPARK-33360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33360. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30264

[jira] [Commented] (SPARK-33361) Dataset.observe() functionality does not work with structured streaming

[ https://issues.apache.org/jira/browse/SPARK-33361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227078#comment-17227078 ] Jungtaek Lim commented on SPARK-33361: -- cc. [~hvanhovell] > Dataset.observe() functionality does

[jira] [Commented] (SPARK-33359) foreachBatch sink outputs wrong metrics

[ https://issues.apache.org/jira/browse/SPARK-33359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227064#comment-17227064 ] John Wesley commented on SPARK-33359: - Thanks for the clarification. How about numInputRows? >

[jira] [Resolved] (SPARK-33359) foreachBatch sink outputs wrong metrics

[ https://issues.apache.org/jira/browse/SPARK-33359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33359. -- Resolution: Not A Problem > foreachBatch sink outputs wrong metrics >

[jira] [Commented] (SPARK-33359) foreachBatch sink outputs wrong metrics

[ https://issues.apache.org/jira/browse/SPARK-33359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227029#comment-17227029 ] Jungtaek Lim commented on SPARK-33359: -- That's by design. The metric is available only for V2 sink.

[jira] [Commented] (SPARK-33365) Update SBT to 1.4.2

[ https://issues.apache.org/jira/browse/SPARK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227027#comment-17227027 ] Apache Spark commented on SPARK-33365: -- User 'williamhyun' has created a pull request for this

[jira] [Commented] (SPARK-33365) Update SBT to 1.4.2

[ https://issues.apache.org/jira/browse/SPARK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227026#comment-17227026 ] Apache Spark commented on SPARK-33365: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-33365) Update SBT to 1.4.2

[ https://issues.apache.org/jira/browse/SPARK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33365: Assignee: Apache Spark > Update SBT to 1.4.2 > --- > >

[jira] [Assigned] (SPARK-33365) Update SBT to 1.4.2

[ https://issues.apache.org/jira/browse/SPARK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33365: Assignee: (was: Apache Spark) > Update SBT to 1.4.2 > --- > >

[jira] [Created] (SPARK-33365) Update SBT to 1.4.2

William Hyun created SPARK-33365: Summary: Update SBT to 1.4.2 Key: SPARK-33365 URL: https://issues.apache.org/jira/browse/SPARK-33365 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33364) Expose purge option in TableCatalog.dropTable

[ https://issues.apache.org/jira/browse/SPARK-33364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226950#comment-17226950 ] Apache Spark commented on SPARK-33364: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33364) Expose purge option in TableCatalog.dropTable

[ https://issues.apache.org/jira/browse/SPARK-33364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33364: Assignee: Apache Spark > Expose purge option in TableCatalog.dropTable >

[jira] [Assigned] (SPARK-33364) Expose purge option in TableCatalog.dropTable

[ https://issues.apache.org/jira/browse/SPARK-33364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33364: Assignee: (was: Apache Spark) > Expose purge option in TableCatalog.dropTable >

[jira] [Created] (SPARK-33364) Expose purge option in TableCatalog.dropTable

Terry Kim created SPARK-33364: - Summary: Expose purge option in TableCatalog.dropTable Key: SPARK-33364 URL: https://issues.apache.org/jira/browse/SPARK-33364 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-33185: --- Assignee: Erik Krogen > YARN: Print direct links to driver logs alongside

[jira] [Resolved] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-33185. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request

[jira] [Resolved] (SPARK-33353) Cache dependencies for Coursier with new sbt in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-33353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33353. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30259

[jira] [Resolved] (SPARK-33362) skipSchemaResolution should still require query to be resolved

[ https://issues.apache.org/jira/browse/SPARK-33362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33362. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-33363) Add prompt information related to the current task when pyspark starts

[ https://issues.apache.org/jira/browse/SPARK-33363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33363: Assignee: (was: Apache Spark) > Add prompt information related to the current task

[jira] [Commented] (SPARK-33363) Add prompt information related to the current task when pyspark starts

[ https://issues.apache.org/jira/browse/SPARK-33363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226867#comment-17226867 ] Apache Spark commented on SPARK-33363: -- User 'akiyamaneko' has created a pull request for this

[jira] [Assigned] (SPARK-33363) Add prompt information related to the current task when pyspark starts

[ https://issues.apache.org/jira/browse/SPARK-33363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33363: Assignee: Apache Spark > Add prompt information related to the current task when pyspark

[jira] [Updated] (SPARK-33363) Add prompt information related to the current task when pyspark starts

[ https://issues.apache.org/jira/browse/SPARK-33363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated SPARK-33363: Attachment: screenshot.png > Add prompt information related to the current task when pyspark

[jira] [Created] (SPARK-33363) Add prompt information related to the current task when pyspark starts

akiyamaneko created SPARK-33363: --- Summary: Add prompt information related to the current task when pyspark starts Key: SPARK-33363 URL: https://issues.apache.org/jira/browse/SPARK-33363 Project: Spark

[jira] [Commented] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226834#comment-17226834 ] Dongjoon Hyun commented on SPARK-33349: --- Hi, [~redsk]. It's possible if we have a test case. For

[jira] [Commented] (SPARK-33362) skipSchemaResolution should still require query to be resolved

[ https://issues.apache.org/jira/browse/SPARK-33362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226745#comment-17226745 ] Apache Spark commented on SPARK-33362: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33362) skipSchemaResolution should still require query to be resolved

[ https://issues.apache.org/jira/browse/SPARK-33362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33362: Assignee: Wenchen Fan (was: Apache Spark) > skipSchemaResolution should still require

[jira] [Assigned] (SPARK-33362) skipSchemaResolution should still require query to be resolved

[ https://issues.apache.org/jira/browse/SPARK-33362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33362: Assignee: Apache Spark (was: Wenchen Fan) > skipSchemaResolution should still require

[jira] [Created] (SPARK-33362) skipSchemaResolution should still require query to be resolved

Wenchen Fan created SPARK-33362: --- Summary: skipSchemaResolution should still require query to be resolved Key: SPARK-33362 URL: https://issues.apache.org/jira/browse/SPARK-33362 Project: Spark

[jira] [Assigned] (SPARK-33360) simplify DS v2 write resolution

[ https://issues.apache.org/jira/browse/SPARK-33360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33360: Assignee: Wenchen Fan (was: Apache Spark) > simplify DS v2 write resolution >

[jira] [Assigned] (SPARK-33360) simplify DS v2 write resolution

[ https://issues.apache.org/jira/browse/SPARK-33360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33360: Assignee: Apache Spark (was: Wenchen Fan) > simplify DS v2 write resolution >

[jira] [Commented] (SPARK-33360) simplify DS v2 write resolution

[ https://issues.apache.org/jira/browse/SPARK-33360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226739#comment-17226739 ] Apache Spark commented on SPARK-33360: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-33360) simplify DS v2 write resolution

[ https://issues.apache.org/jira/browse/SPARK-33360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226738#comment-17226738 ] Apache Spark commented on SPARK-33360: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-33361) Dataset.observe() functionality does not work with structured streaming

John Wesley created SPARK-33361: --- Summary: Dataset.observe() functionality does not work with structured streaming Key: SPARK-33361 URL: https://issues.apache.org/jira/browse/SPARK-33361 Project: Spark

[jira] [Created] (SPARK-33360) simplify DS v2 write resolution

Wenchen Fan created SPARK-33360: --- Summary: simplify DS v2 write resolution Key: SPARK-33360 URL: https://issues.apache.org/jira/browse/SPARK-33360 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-33359) foreachBatch sink outputs wrong metrics

John Wesley created SPARK-33359: --- Summary: foreachBatch sink outputs wrong metrics Key: SPARK-33359 URL: https://issues.apache.org/jira/browse/SPARK-33359 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33327) grouped by first and last against date column returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-33327: --- Description: The attached csv file has two columns, namely "User" and "FromDate".  The import

[jira] [Updated] (SPARK-33327) grouped by first and last against date column returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-33327: --- Description: The attached csv file has two columns, namely "User" and "FromDate".  The import

[jira] [Updated] (SPARK-33327) grouped by first and last against date column returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-33327: --- Description: The attached csv file has two columns, namely "User" and "FromDate".  The import

[jira] [Updated] (SPARK-33327) grouped by first and last against date column returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-33327: --- Description: The attached csv file has two columns, namely "User" and "FromDate".  The import

[jira] [Updated] (SPARK-33327) grouped by first and last against date column returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-33327: --- Description: The attached csv file has two columns, namely "User" and "FromDate".  The import

[jira] [Commented] (SPARK-33327) grouped by first and last against date column returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226712#comment-17226712 ] Punit Shah commented on SPARK-33327: The correct behaviour of running the query should be: cnt,

[jira] [Commented] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226665#comment-17226665 ] Nicola Bova commented on SPARK-33349: - [~dongjoon] Would you consider upgrading kubernetes-client to

[jira] [Assigned] (SPARK-33358) Spark SQL CLI command processing loop can't exit while one comand fail

[ https://issues.apache.org/jira/browse/SPARK-33358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33358: Assignee: (was: Apache Spark) > Spark SQL CLI command processing loop can't exit

[jira] [Assigned] (SPARK-33358) Spark SQL CLI command processing loop can't exit while one comand fail

[ https://issues.apache.org/jira/browse/SPARK-33358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33358: Assignee: Apache Spark > Spark SQL CLI command processing loop can't exit while one

[jira] [Commented] (SPARK-33358) Spark SQL CLI command processing loop can't exit while one comand fail

[ https://issues.apache.org/jira/browse/SPARK-33358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226629#comment-17226629 ] Apache Spark commented on SPARK-33358: -- User 'artiship' has created a pull request for this issue:

[jira] [Created] (SPARK-33358) Spark SQL CLI command processing loop can't exit while one comand fail

Lichuanliang created SPARK-33358: Summary: Spark SQL CLI command processing loop can't exit while one comand fail Key: SPARK-33358 URL: https://issues.apache.org/jira/browse/SPARK-33358 Project:

[jira] [Assigned] (SPARK-33356) DAG Scheduler exhibits exponential runtime with PartitionerAwareUnion

[ https://issues.apache.org/jira/browse/SPARK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33356: Assignee: (was: Apache Spark) > DAG Scheduler exhibits exponential runtime with

[jira] [Commented] (SPARK-33356) DAG Scheduler exhibits exponential runtime with PartitionerAwareUnion

[ https://issues.apache.org/jira/browse/SPARK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226611#comment-17226611 ] Apache Spark commented on SPARK-33356: -- User 'lucasbru' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33356) DAG Scheduler exhibits exponential runtime with PartitionerAwareUnion

[ https://issues.apache.org/jira/browse/SPARK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33356: Assignee: Apache Spark > DAG Scheduler exhibits exponential runtime with

[jira] [Created] (SPARK-33357) Support SparkLauncher in Kubernetes

hong dongdong created SPARK-33357: - Summary: Support SparkLauncher in Kubernetes Key: SPARK-33357 URL: https://issues.apache.org/jira/browse/SPARK-33357 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-33356) DAG Scheduler exhibits exponential runtime with PartitionerAwareUnion

[ https://issues.apache.org/jira/browse/SPARK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy updated SPARK-33356: --- Description: The current implementation of the {{DAGScheduler}} exhibits exponential

[jira] [Created] (SPARK-33356) DAG Scheduler exhibits exponential runtime with PartitionerAwareUnion

Lucas Brutschy created SPARK-33356: -- Summary: DAG Scheduler exhibits exponential runtime with PartitionerAwareUnion Key: SPARK-33356 URL: https://issues.apache.org/jira/browse/SPARK-33356 Project:

[jira] [Resolved] (SPARK-30294) Read-only state store unnecessarily creates and deletes the temp file for delta file every batch

[ https://issues.apache.org/jira/browse/SPARK-30294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-30294. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 26935

[jira] [Assigned] (SPARK-30294) Read-only state store unnecessarily creates and deletes the temp file for delta file every batch

[ https://issues.apache.org/jira/browse/SPARK-30294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-30294: Assignee: Jungtaek Lim > Read-only state store unnecessarily creates and deletes the

[jira] [Commented] (SPARK-33336) provided an invalid fromOffset when spark streaming running

[ https://issues.apache.org/jira/browse/SPARK-6?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226592#comment-17226592 ] Yu Wang commented on SPARK-6: - [~hyukjin.kwon] thanks for your answer , someone has tried the higher

[jira] [Created] (SPARK-33355) Batch fix compilation warnings about "method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated (since 2.13.0)"

Yang Jie created SPARK-33355: Summary: Batch fix compilation warnings about "method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated (since 2.13.0)" Key: SPARK-33355 URL:

[jira] [Commented] (SPARK-32934) Improve the performance for NTH_VALUE and Reactor the OffsetWindowFunction

[ https://issues.apache.org/jira/browse/SPARK-32934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226587#comment-17226587 ] Apache Spark commented on SPARK-32934: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-33339) Pyspark application will hang due to non Exception

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lrz updated SPARK-9: Description: When a system.exit exception occurs during the process, the python worker exits abnormally, and

  1   2   >