[
https://issues.apache.org/jira/browse/SPARK-49690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883148#comment-17883148
]
Asif commented on SPARK-49690:
--
Not sure if this is a bug or expected behaviour.
Given tha
[
https://issues.apache.org/jira/browse/SPARK-49727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883147#comment-17883147
]
Asif commented on SPARK-49727:
--
This issue is addressed in the PR for
[https://issues.apac
[
https://issues.apache.org/jira/browse/SPARK-49727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-49727:
-
Labels: pull-request-available (was: )
> A Bean class with a serializable POJO field looses data when converted
[
https://issues.apache.org/jira/browse/SPARK-49727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-49727:
-
Description:
If a Bean class contains a serializable POJO ( without any getter/setter)
property, the encoder
Asif created SPARK-49727:
Summary: A Bean class with a serializable POJO field looses data
when converted back from dataframe, as dataset
Key: SPARK-49727
URL: https://issues.apache.org/jira/browse/SPARK-49727
[
https://issues.apache.org/jira/browse/SPARK-46679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882866#comment-17882866
]
Asif commented on SPARK-46679:
--
[~andoni.teso] Hi. I have opened a PR for this. Though it
[
https://issues.apache.org/jira/browse/SPARK-49690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-49690:
-
Description:
A UDT type field does not show up as constituent struct type in the schema.
Instead it shows up as
[
https://issues.apache.org/jira/browse/SPARK-49690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-49690:
-
Description:
A UDT type field does not show up as constituent struct type in the schema.
Instead it shows up as
Asif created SPARK-49690:
Summary: UDT type is not expanded into its StructType in the
schema definition
Key: SPARK-49690
URL: https://issues.apache.org/jira/browse/SPARK-49690
Project: Spark
Issue
Asif created SPARK-49618:
Summary: Union ( & UnionExec) nodes equality not take into account
unaligned positions of branches causing NO ( reuse of exchange and cached plans)
Key: SPARK-49618
URL: https://issues.apache.org
[
https://issues.apache.org/jira/browse/SPARK-46679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878487#comment-17878487
]
Asif commented on SPARK-46679:
--
Sorry.. there has been delay in internal review.. will subm
[
https://issues.apache.org/jira/browse/SPARK-46679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876379#comment-17876379
]
Asif commented on SPARK-46679:
--
[~andoni.teso] Hi. I will be opening a PR for this in a day
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Affects Version/s: 4.0.0
> SPIP: Constraint Propagation code causes OOM issues or increasing compilation
> time
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45658:
-
Affects Version/s: 4.0.0
> Canonicalization of DynamicPruningSubquery is broken
> --
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Affects Version/s: 4.0.0
> SPIP: Improving performance of BroadcastHashJoin queries with stream side
> join key
[
https://issues.apache.org/jira/browse/SPARK-45926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45926:
-
Affects Version/s: 4.0.0
> The InMemoryV2FilterBatchScan and InMemoryBatchScan are not implementing
> equals an
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Affects Version/s: 4.0.0
> Minimizing calls to HiveMetaStore layer for getting partitions, when tables
> are r
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-46671:
-
Affects Version/s: 4.0.0
> InferFiltersFromConstraint rule is creating a redundant filter
>
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45959:
-
Affects Version/s: 4.0.0
> SPIP: Abusing DataSet.withColumn can cause huge tree with severe perf
> degradation
[
https://issues.apache.org/jira/browse/SPARK-45866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45866:
-
Affects Version/s: 4.0.0
> Reuse of exchange in AQE does not happen when run time filters are pushed
> down to
[
https://issues.apache.org/jira/browse/SPARK-47609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47609:
-
Affects Version/s: 4.0.0
> CacheManager Lookup can miss picking InMemoryRelation corresponding to subplan
>
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47320:
-
Affects Version/s: 4.0.0
> Datasets involving self joins behave in an inconsistent and unintuitive
> manner
>
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Labels: SPIP pull-request-available (was: SPIP)
> SPIP: Constraint Propagation code causes OOM issues or increa
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Shepherd: Peter Toth (was: Wenchen Fan)
> Minimizing calls to HiveMetaStore layer for getting partitions, when
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Shepherd: Wenchen Fan
> Minimizing calls to HiveMetaStore layer for getting partitions, when tables
> are repe
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45959:
-
Priority: Major (was: Minor)
> SPIP: Abusing DataSet.withColumn can cause huge tree with severe perf
> degrada
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Priority: Major (was: Minor)
> Minimizing calls to HiveMetaStore layer for getting partitions, when tables
>
[
https://issues.apache.org/jira/browse/SPARK-47609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47609:
-
Description:
This issue became apparent while bringing my PR
[https://github.com/apache/spark/pull/43854]
in s
[
https://issues.apache.org/jira/browse/SPARK-47609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47609:
-
Description:
This issue became apparent while bringing my PR
[https://github.com/apache/spark/pull/43854]
in s
Asif created SPARK-47609:
Summary: CacheManager Lookup can miss picking InMemoryRelation
corresponding to subplan
Key: SPARK-47609
URL: https://issues.apache.org/jira/browse/SPARK-47609
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17831116#comment-17831116
]
Asif edited comment on SPARK-26708 at 3/27/24 12:58 AM:
I believ
[
https://issues.apache.org/jira/browse/SPARK-26708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17831117#comment-17831117
]
Asif edited comment on SPARK-26708 at 3/27/24 12:54 AM:
Towards
[
https://issues.apache.org/jira/browse/SPARK-26708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17831116#comment-17831116
]
Asif commented on SPARK-26708:
--
I believe the current caching logic is suboptimal and accor
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47320:
-
Description:
The behaviour of Datasets involving self joins behave in an unintuitive manner
in terms when Analy
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47320:
-
Labels: pull-request-available (was: )
> Datasets involving self joins behave in an inconsistent and unintuitiv
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47320:
-
Description:
The behaviour of Datasets involving self joins behave in an unintuitive manner
in terms when Analy
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47320:
-
Description:
The behaviour of Datasets involving self joins behave in an unintuitive manner
in terms when Analy
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47320:
-
Description:
The behaviour of Datasets involving self joins behave in an unintuitive manner
in terms when Analy
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47320:
-
Description:
The behaviour of Datasets involving self joins behave in an unintuitive manner
in terms when Analy
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47320:
-
Description:
The behaviour of Datasets involving self joins behave in an unintuitive manner
in terms when Analy
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17824877#comment-17824877
]
Asif commented on SPARK-47320:
--
Opened following PR
[https://github.com/apache/spark/pull/4
[
https://issues.apache.org/jira/browse/SPARK-47320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17824589#comment-17824589
]
Asif commented on SPARK-47320:
--
will be linking the bug to an open PR
> Datasets involving
Asif created SPARK-47320:
Summary: Datasets involving self joins behave in an inconsistent
and unintuitive manner
Key: SPARK-47320
URL: https://issues.apache.org/jira/browse/SPARK-47320
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17824102#comment-17824102
]
Asif commented on SPARK-39441:
--
this issue should be resolved by the PR for ticket
[https:
[
https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17824102#comment-17824102
]
Asif edited comment on SPARK-39441 at 3/6/24 5:33 PM:
--
this issue s
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17823510#comment-17823510
]
Asif edited comment on SPARK-33152 at 3/5/24 6:43 PM:
--
[~tedjenks]
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17823512#comment-17823512
]
Asif commented on SPARK-33152:
--
other than using my PR, the safe option would be to disable
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17823510#comment-17823510
]
Asif commented on SPARK-33152:
--
[~tedjenks] .. Unfortunately I am not a committer. As part
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17823344#comment-17823344
]
Asif commented on SPARK-33152:
--
[~tedjenks] The issue has always been there because of th
[
https://issues.apache.org/jira/browse/SPARK-47217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47217:
-
Description:
In case of some flavours of nested joins involving repetition of relation, the
projected columns
[
https://issues.apache.org/jira/browse/SPARK-47217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47217:
-
Description:
In case of some flavours of self join queries or nested joins involving
repetition of relation, th
[
https://issues.apache.org/jira/browse/SPARK-47217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-47217:
-
Description:
In case of some flavours of nested self join queries, the projected columns
when passed to the Da
Asif created SPARK-47217:
Summary: De-duplication of Relations in Joins, can result in plan
resolution failure
Key: SPARK-47217
URL: https://issues.apache.org/jira/browse/SPARK-47217
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-46671:
-
Description:
while bring my old PR which uses a different approach to the
ConstraintPropagation algorithm (
[
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif reopened SPARK-46671:
--
After further analysis , I believe , that what I said originally in the ticket
is valid and that the code Does cr
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-46671.
--
Resolution: Not A Bug
> InferFiltersFromConstraint rule is creating a redundant filter
> -
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805434#comment-17805434
]
Asif commented on SPARK-46671:
--
on further thoughts , I am wrong.. There should be 2 separa
[
https://issues.apache.org/jira/browse/SPARK-46671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805435#comment-17805435
]
Asif commented on SPARK-46671:
--
so closing the ticket
> InferFiltersFromConstraint rule is
Asif created SPARK-46671:
Summary: InferFiltersFromConstraint rule is creating a redundant
filter
Key: SPARK-46671
URL: https://issues.apache.org/jira/browse/SPARK-46671
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45959:
-
Description:
Though documentation clearly recommends to add all columns in a single shot,
but in reality is dif
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45959:
-
Summary: SPIP: Abusing DataSet.withColumn can cause huge tree with severe
perf degradation (was: Abusing DataSe
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45959:
-
Priority: Minor (was: Major)
> Abusing DataSet.withColumn can cause huge tree with severe perf degradation
> --
[
https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786941#comment-17786941
]
Asif commented on SPARK-45959:
--
will create a PR for the same..
> Abusing DataSet.withColu
Asif created SPARK-45959:
Summary: Abusing DataSet.withColumn can cause huge tree with
severe perf degradation
Key: SPARK-45959
URL: https://issues.apache.org/jira/browse/SPARK-45959
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786652#comment-17786652
]
Asif commented on SPARK-45943:
--
thanks [~wforget] for the input.. if you have solution pls
[
https://issues.apache.org/jira/browse/SPARK-45866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45866:
-
Labels: pull-request-available (was: )
> Reuse of exchange in AQE does not happen when run time filters are pus
Asif created SPARK-45943:
Summary: DataSourceV2Relation.computeStats throws
IllegalStateException in test mode
Key: SPARK-45943
URL: https://issues.apache.org/jira/browse/SPARK-45943
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif closed SPARK-45924.
this is not a bug
> Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not
> equivalent with Subquer
[
https://issues.apache.org/jira/browse/SPARK-45925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif closed SPARK-45925.
this is not an issue
> SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcastExec
> causing re-use o
[
https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-45924.
--
Resolution: Not A Bug
> Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not
> equivalent w
[
https://issues.apache.org/jira/browse/SPARK-45925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif resolved SPARK-45925.
--
Resolution: Not A Problem
> SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcastExec
> caus
[
https://issues.apache.org/jira/browse/SPARK-45866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786155#comment-17786155
]
Asif commented on SPARK-45866:
--
Now that the other PRs on which this ticket itself is depen
[
https://issues.apache.org/jira/browse/SPARK-45925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45925:
-
Labels: pull-request-available (was: )
> SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcast
[
https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45924:
-
Labels: pull-request-available (was: )
> Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not
Asif created SPARK-45926:
Summary: The InMemoryV2FilterBatchScan and InMemoryBatchScan are
not implementing equals and hashCode correctly
Key: SPARK-45926
URL: https://issues.apache.org/jira/browse/SPARK-45926
Asif created SPARK-45925:
Summary: SubqueryBroadcastExec is not equivalent with
SubqueryAdaptiveBroadcastExec causing re-use of exchange not happening in AQE
Key: SPARK-45925
URL: https://issues.apache.org/jira/browse/SPA
[ https://issues.apache.org/jira/browse/SPARK-45658 ]
Asif deleted comment on SPARK-45658:
--
was (Author: ashahid7):
I also think that during canonicalization of DynamicPruningSubquery, the
pruning key's canonicalization should be done on the basis of
[
https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45924:
-
Description:
while writing bug test for
[SPARK-45866|https://issues.apache.org/jira/projects/SPARK/issues/SPAR
Asif created SPARK-45924:
Summary: Canonicalization of SubqueryAdaptiveBroadcastExec is
broken and is not equivalent with SubqueryBroadcastExec
Key: SPARK-45924
URL: https://issues.apache.org/jira/browse/SPARK-45924
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Shepherd: (was: Peter Toth)
> Minimizing calls to HiveMetaStore layer for getting partitions, when tables
>
[
https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-33152:
-
Affects Version/s: 3.5.0
(was: 2.4.0)
(was: 3.0.1)
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Affects Version/s: 3.5.0
(was: 4.0.0)
> Minimizing calls to HiveMetaStore layer for g
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Affects Version/s: 3.5.0
(was: 3.5.1)
> SPIP: Improving performance of BroadcastHashJ
Asif created SPARK-45866:
Summary: Reuse of exchange in AQE does not happen when run time
filters are pushed down to the underlying Scan ( like iceberg )
Key: SPARK-45866
URL: https://issues.apache.org/jira/browse/SPARK-4
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784567#comment-17784567
]
Asif commented on SPARK-45658:
--
I also think that during canonicalization of DynamicPruning
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784282#comment-17784282
]
Asif commented on SPARK-44662:
--
The changes for iceberg which support broadcast-var-pushdow
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17782927#comment-17782927
]
Asif commented on SPARK-44662:
--
The majority of file changes are due to additional tpcds te
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Attachment: perf results broadcast var pushdown - Partitioned TPCDS.pdf
> SPIP: Improving performance of Broadca
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Affects Version/s: 3.5.1
(was: 3.3.3)
> SPIP: Improving performance of BroadcastHashJ
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-44662:
-
Description:
h2. *Q1. What are you trying to do? Articulate your objectives using absolutely
no jargon.*
On th
[
https://issues.apache.org/jira/browse/SPARK-36786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781976#comment-17781976
]
Asif commented on SPARK-36786:
--
I had put this on back burner as my changes were on 3.2, so
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45658:
-
Description:
The canonicalization of (buildKeys: Seq[Expression]) in the class
DynamicPruningSubquery is broken
[
https://issues.apache.org/jira/browse/SPARK-45658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45658:
-
Priority: Major (was: Critical)
> Canonicalization of DynamicPruningSubquery is broken
> --
Asif created SPARK-45658:
Summary: Canonicalization of DynamicPruningSubquery is broken
Key: SPARK-45658
URL: https://issues.apache.org/jira/browse/SPARK-45658
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Affects Version/s: 4.0.0
(was: 3.5.1)
> Minimizing calls to HiveMetaStore layer for g
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45373:
-
Description:
In the rule PruneFileSourcePartitions where the CatalogFileIndex gets converted
to InMemoryFileInd
[ https://issues.apache.org/jira/browse/SPARK-45373 ]
Asif deleted comment on SPARK-45373:
--
was (Author: ashahid7):
Will be generating a PR for this.
> Minimizing calls to HiveMetaStore layer for getting partitions, when tables
> are repeated
>
[
https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770220#comment-17770220
]
Asif commented on SPARK-45373:
--
Will be generating a PR for this.
> Minimizing calls to Hi
1 - 100 of 163 matches
Mail list logo