Eren Avsarogullari created SPARK-18066:
--
Summary: Add Pool usage policies test coverage to FIFO & FAIR
Schedulers
Key: SPARK-18066
URL: https://issues.apache.org/jira/browse/SPARK-18066
Project:
[
https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-18066:
---
Description:
The following Pool usage cases need to have Unit test coverage :
- FIFO
[
https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-18066:
---
Description:
The following Pool usage cases need to have Unit test coverage :
- FIFO
[
https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-18066:
---
Summary: Add Pool usage policies test coverage for FIFO & FAIR Schedulers
(was: Add
Eren Avsarogullari created SPARK-37710:
--
Summary: Log clear message for Input/output error
Key: SPARK-37710
URL: https://issues.apache.org/jira/browse/SPARK-37710
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-37710:
---
Description:
*Input/output error* usually points environmental issues such as disk
[
https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-37710:
---
Summary: Add clear error message for java.io.IOException: Input/output
error (was:
[
https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-37710:
---
Description:
*Input/output error* usually points environmental issues such as disk
[
https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-37710:
---
Description:
*Input/output error* usually points environmental issues such as disk
[
https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-37710:
---
Summary: Add detailed error message for java.io.IOException occurring on
Kryo flow
[
https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-37710:
---
Description:
*Input/output error* usually points environmental issues such as disk
[
https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-37710:
---
Summary: Add detailed log message for java.io.IOException occurring on Kryo
flow (w
Eren Avsarogullari created SPARK-38222:
--
Summary: Expose nodeDesc attribute in SQL Rest API
Key: SPARK-38222
URL: https://issues.apache.org/jira/browse/SPARK-38222
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-38222:
---
Summary: Expose Node Description attribute in SQL Rest API (was: Expose
nodeDesc at
[
https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-38222:
---
Attachment: Spark_SQL_REST_Result_with-nodeDesc
> Expose Node Description attribute
Eren Avsarogullari created SPARK-19466:
--
Summary: Improve Fair Scheduler Logging
Key: SPARK-19466
URL: https://issues.apache.org/jira/browse/SPARK-19466
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-19466:
---
Description:
Fair Scheduler Logging for the following cases can be useful for the use
Eren Avsarogullari created SPARK-19567:
--
Summary: Support some Schedulable variables immutability and access
Key: SPARK-19567
URL: https://issues.apache.org/jira/browse/SPARK-19567
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862983#comment-15862983
]
Eren Avsarogullari commented on SPARK-19567:
Hi [~srowen],
Thanks for quick
Eren Avsarogullari created SPARK-19662:
--
Summary: Add Fair Scheduler Unit Test coverage for different build
cases
Key: SPARK-19662
URL: https://issues.apache.org/jira/browse/SPARK-19662
Project:
[
https://issues.apache.org/jira/browse/SPARK-19662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-19662:
---
Description:
Fair Scheduler can be built via one of the following options:
- By setti
Eren Avsarogullari created SPARK-17584:
--
Summary: Add test coverage for TaskState and ExecutorState
Key: SPARK-17584
URL: https://issues.apache.org/jira/browse/SPARK-17584
Project: Spark
Eren Avsarogullari created SPARK-17663:
--
Summary: SchedulableBuilder should handle invalid data access via
scheduler.allocation.file
Key: SPARK-17663
URL: https://issues.apache.org/jira/browse/SPARK-17663
[
https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17663:
---
Description:
If spark.scheduler.allocation.file has invalid minShare or/and weight, t
[
https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17663:
---
Description:
If spark.scheduler.allocation.file has invalid minShare or/and weight, t
[
https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17663:
---
Description:
If spark.scheduler.allocation.file has invalid *minShare* or/and *weight
[
https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17663:
---
Affects Version/s: (was: 2.0.1)
2.1.0
> SchedulableBuilder
[
https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17663:
---
Description:
If spark.scheduler.allocation.file has invalid minShare or/and weight va
[
https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17759:
---
Description:
If _spark.scheduler.allocation.file_ has duplicate pools, all of them ar
Eren Avsarogullari created SPARK-17759:
--
Summary: SchedulableBuilder should avoid to create duplicate fair
scheduler-pools.
Key: SPARK-17759
URL: https://issues.apache.org/jira/browse/SPARK-17759
[
https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17759:
---
Attachment: duplicate_pools.png
> SchedulableBuilder should avoid to create duplicate
[
https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17759:
---
Description:
If _spark.scheduler.allocation.file_ has duplicate pools, all of them ar
[
https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17759:
---
Attachment: duplicate_pools2.png
> SchedulableBuilder should avoid to create duplicat
[
https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17759:
---
Summary: FairSchedulableBuilder should avoid to create duplicate fair
scheduler-pools
[
https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17759:
---
Description:
If _spark.scheduler.allocation.file_ has duplicate pools, all of them ar
Eren Avsarogullari created SPARK-17894:
--
Summary: Uniqueness of TaskSetManager name
Key: SPARK-17894
URL: https://issues.apache.org/jira/browse/SPARK-17894
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17894:
---
Description:
TaskSetManager should have unique name to avoid adding duplicate ones to
[
https://issues.apache.org/jira/browse/SPARK-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17894:
---
Summary: Ensure uniqueness of TaskSetManager name (was: Uniqueness of
TaskSetManager
[
https://issues.apache.org/jira/browse/SPARK-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17894:
---
Description:
TaskSetManager should have unique name to avoid adding duplicate ones to
[
https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17759:
---
Description:
If _spark.scheduler.allocation.file_ has duplicate pools, all of them ar
[
https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-17759:
---
Summary: Avoid adding duplicate schedulables (was: FairSchedulableBuilder
should avo
Eren Avsarogullari created SPARK-32026:
--
Summary: Support consistency on Prometheus driver and executor
metrics format
Key: SPARK-32026
URL: https://issues.apache.org/jira/browse/SPARK-32026
Proj
[
https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-32026:
---
Summary: Add PrometheusServlet Unit Test coverage (was: Support
consistency on Prom
[
https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17148211#comment-17148211
]
Eren Avsarogullari commented on SPARK-32026:
Currently, _PrometheusServlet_
[
https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-32026:
---
Summary: Add PrometheusServletSuite (was: Add PrometheusServlet Unit Test
coverage)
[
https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-32026:
---
Description:
This Jira aims to be added _PrometheusServletSuite_.
*Note:* This jira
Eren Avsarogullari created SPARK-32548:
--
Summary: Add Application attemptId support to SQL Rest API
Key: SPARK-32548
URL: https://issues.apache.org/jira/browse/SPARK-32548
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-32548:
---
Description:
Currently, Spark Public Rest APIs support Application attemptId except
Eren Avsarogullari created SPARK-31440:
--
Summary: Improve SQL Rest API
Key: SPARK-31440
URL: https://issues.apache.org/jira/browse/SPARK-31440
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Description:
SQL Rest API exposes query execution metrics as Public API. This Jira a
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Attachment: improved_version.json
> Improve SQL Rest API
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Attachment: current_version.json
> Improve SQL Rest API
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Description:
SQL Rest API exposes query execution metrics as Public API. This Jira a
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Description:
SQL Rest API exposes query execution metrics as Public API. This Jira a
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Attachment: improved_version.json
> Improve SQL Rest API
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Attachment: (was: improved_version.json)
> Improve SQL Rest API
> --
Eren Avsarogullari created SPARK-31566:
--
Summary: Add SQL Rest API Documentation
Key: SPARK-31566
URL: https://issues.apache.org/jira/browse/SPARK-31566
Project: Spark
Issue Type: Docume
[
https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31566:
---
Description:
SQL Rest API exposes query execution metrics as Public API. Its documen
[
https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31566:
---
Description:
SQL Rest API exposes query execution metrics as Public API. Its documen
[
https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31566:
---
Description:
SQL Rest API exposes query execution metrics as Public API. Its documen
[
https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17095948#comment-17095948
]
Eren Avsarogullari commented on SPARK-31566:
Hi Pablo,
There is ongoing PR
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Attachment: improved_version_May1th.json
> Improve SQL Rest API
> --
Eren Avsarogullari created SPARK-45443:
--
Summary: Revisit TableCacheQueryStage to avoid replicated IMR
materialization
Key: SPARK-45443
URL: https://issues.apache.org/jira/browse/SPARK-45443
Proj
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Summary: Revisit TableCacheQueryStage to avoid replicated InMemoryRelation
materiali
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Attachment: IMR Materialization - Stage 3.png
IMR Materialization - S
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-45443:
---
Description:
TableCacheQueryStage is created per InMemoryTableScanExec by
AdaptiveS
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773050#comment-17773050
]
Eren Avsarogullari commented on SPARK-45443:
Hi [~ulysses],
Firstly, thank
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773050#comment-17773050
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:24 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773050#comment-17773050
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:25 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773050#comment-17773050
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:27 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773050#comment-17773050
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:29 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773050#comment-17773050
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:33 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773050#comment-17773050
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:40 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773050#comment-17773050
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:42 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773480#comment-17773480
]
Eren Avsarogullari commented on SPARK-45443:
> But this idea only work for o
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773480#comment-17773480
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/9/23 9:16 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773480#comment-17773480
]
Eren Avsarogullari edited comment on SPARK-45443 at 10/9/23 9:17 PM:
-
Eren Avsarogullari created SPARK-46639:
--
Summary: Add WindowExec SQLMetrics
Key: SPARK-46639
URL: https://issues.apache.org/jira/browse/SPARK-46639
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-46639:
---
Description:
Currently, WindowExec Physical Operator has only spillSize SQLMetric. T
Eren Avsarogullari created SPARK-47148:
--
Summary: [AQE] Avoid to materialize ShuffleQueryStage on the
cancellation
Key: SPARK-47148
URL: https://issues.apache.org/jira/browse/SPARK-47148
Project:
[
https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-47148:
---
Summary: Avoid to materialize AQE ShuffleQueryStage on the cancellation
(was: [AQE]
[
https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-46639:
---
Attachment: WindowExec SQLMetrics.png
> Add WindowExec SQLMetrics
>
[
https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-46639:
---
Description:
Currently, WindowExec Physical Operator has only spillSize SQLMetric. T
[
https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-46639:
---
Description:
Currently, WindowExec Physical Operator has only spillSize SQLMetric. T
[
https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-47148:
---
Description:
AQE can materialize *ShuffleQueryStage* on the cancellation. This cause
[
https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-47148:
---
Summary: Avoid to materialize AQE ExchangeQueryStageExec on the
cancellation (was:
[
https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-47148:
---
Description:
AQE can materialize both *ShuffleQueryStage* and *BroadcastQueryStage*
[
https://issues.apache.org/jira/browse/SPARK-41214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-41214:
---
Attachment: DAG when AQE=ON and AQECachedDFSupport=ON with fix.png
DA
Eren Avsarogullari created SPARK-41214:
--
Summary: Sub-plan metrics under InMemoryRelation are missed when
AQE Cached DataFrame Support is enabled
Key: SPARK-41214
URL: https://issues.apache.org/jira/browse/SP
[
https://issues.apache.org/jira/browse/SPARK-41214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-41214:
---
Description:
*spark.sql.optimizer.canChangeCachedPlanOutputPartitioning* enables AQE
[
https://issues.apache.org/jira/browse/SPARK-41214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-41214:
---
Summary: SubPlan metrics are missed when AQE is enabled under
InMemoryRelation (was
1 - 100 of 103 matches
Mail list logo