Maxim Gekk created SPARK-34445:
--
Summary: Make
`spark.sql.legacy.replaceDatabricksSparkAvro.enabled` as non-internal
Key: SPARK-34445
URL: https://issues.apache.org/jira/browse/SPARK-34445
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285071#comment-17285071
]
Jungtaek Lim commented on SPARK-32883:
--
Thanks for the head-up. [~chengsu] please p
Yuming Wang created SPARK-3:
---
Summary: Pushdown scalar-subquery filter to FileSourceScan
Key: SPARK-3
URL: https://issues.apache.org/jira/browse/SPARK-3
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-3:
Description:
We can pushdown {{a < (select max(d) from t2)}} to FileSourceScan:
{code:sql}
CREATE
[
https://issues.apache.org/jira/browse/SPARK-32883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285060#comment-17285060
]
Cheng Su commented on SPARK-32883:
--
[~smilegator] - thanks for heads up. Sorry for miss
[
https://issues.apache.org/jira/browse/SPARK-32883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285057#comment-17285057
]
Xiao Li commented on SPARK-32883:
-
[https://dist.apache.org/repos/dist/dev/spark/v3.1.1-
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-10816:
Description:
Currently structured streaming supports two kinds of windows: tumbling window
and sl
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-10816:
Description:
Currently structured streaming supports two kinds of windows: tumbling window
and sl
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-10816:
Description:
Currently structured streaming supports two kinds of windows: tumbling window
and sl
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-10816:
Summary: EventTime based sessionization (session window) (was: EventTime
based sessionization)
>
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285018#comment-17285018
]
Apache Spark commented on SPARK-10816:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285017#comment-17285017
]
Apache Spark commented on SPARK-10816:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-34443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285006#comment-17285006
]
Apache Spark commented on SPARK-34443:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-34443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34443:
Assignee: Kousuke Saruta (was: Apache Spark)
> Replace symbol literals with Symbol const
[
https://issues.apache.org/jira/browse/SPARK-34443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285005#comment-17285005
]
Apache Spark commented on SPARK-34443:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-34443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34443:
Assignee: Apache Spark (was: Kousuke Saruta)
> Replace symbol literals with Symbol const
[
https://issues.apache.org/jira/browse/SPARK-34443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-34443:
---
Summary: Replace symbol literals with Symbol constructor invocations to
comply with Scala 2.
Kousuke Saruta created SPARK-34443:
--
Summary: Replace symbol literals with Symbol constructor
invocations
Key: SPARK-34443
URL: https://issues.apache.org/jira/browse/SPARK-34443
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-33434:
-
Fix Version/s: 3.1.2
> Document spark.conf.isModifiable()
> --
>
[
https://issues.apache.org/jira/browse/SPARK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-33052.
--
Fix Version/s: 3.1.1
Assignee: Takeshi Yamamuro
Resolution: Fixed
Reso
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284964#comment-17284964
]
Jungtaek Lim edited comment on SPARK-10816 at 2/15/21, 11:29 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-34442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-34442:
-
Assignee: Dongjoon Hyun
> Pin Sphinx version to `sphinx<3.5.0`
> --
[
https://issues.apache.org/jira/browse/SPARK-34442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-34442.
---
Fix Version/s: 3.0.2
Resolution: Fixed
Issue resolved by pull request 31568
[https://
[
https://issues.apache.org/jira/browse/SPARK-34442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284965#comment-17284965
]
Apache Spark commented on SPARK-34442:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-34442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-34442:
--
Priority: Blocker (was: Major)
> Pin Sphinx version to `sphinx<3.5.0`
> -
[
https://issues.apache.org/jira/browse/SPARK-34442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-34442:
--
Target Version/s: 3.0.2
> Pin Sphinx version to `sphinx<3.5.0`
> -
[
https://issues.apache.org/jira/browse/SPARK-34442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34442:
Assignee: (was: Apache Spark)
> Pin Sphinx version to `sphinx<3.5.0`
> --
[
https://issues.apache.org/jira/browse/SPARK-34442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34442:
Assignee: Apache Spark
> Pin Sphinx version to `sphinx<3.5.0`
> -
Dongjoon Hyun created SPARK-34442:
-
Summary: Pin Sphinx version to `sphinx<3.5.0`
Key: SPARK-34442
URL: https://issues.apache.org/jira/browse/SPARK-34442
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-34442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-34442:
--
Component/s: (was: Project Infra)
Documentation
> Pin Sphinx version to `
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284964#comment-17284964
]
Jungtaek Lim commented on SPARK-10816:
--
Probably the code size is different because
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284959#comment-17284959
]
Jungtaek Lim commented on SPARK-10816:
--
cc. [~XuanYuan]
> EventTime based sessioni
[
https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284955#comment-17284955
]
Jean-Francis Roy commented on SPARK-34441:
--
It even seems we cannot reproduce t
[
https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284954#comment-17284954
]
Jean-Francis Roy commented on SPARK-25243:
--
```
from_json() doesn't support the
[
https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284954#comment-17284954
]
Jean-Francis Roy edited comment on SPARK-25243 at 2/15/21, 9:25 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284954#comment-17284954
]
Jean-Francis Roy edited comment on SPARK-25243 at 2/15/21, 9:25 PM:
--
Jean-Francis Roy created SPARK-34441:
Summary: from_json documentation is wrong about malformed JSONs
output
Key: SPARK-34441
URL: https://issues.apache.org/jira/browse/SPARK-34441
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284951#comment-17284951
]
Jean-Francis Roy commented on SPARK-25243:
--
The documentation still states that
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284950#comment-17284950
]
Jungtaek Lim commented on SPARK-10816:
--
First of all, I'd like to say thanks for fi
[
https://issues.apache.org/jira/browse/SPARK-34201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-34201.
---
Fix Version/s: 3.0.2
Resolution: Fixed
This is resolved via https://github.com/apache
[
https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh reassigned SPARK-34198:
---
Assignee: (was: L. C. Hsieh)
> Add RocksDB StateStore as external module
>
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284931#comment-17284931
]
L. C. Hsieh commented on SPARK-10816:
-
This feature is inactive in last two years. W
[
https://issues.apache.org/jira/browse/SPARK-34431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-34431.
---
Fix Version/s: 3.0.2
3.1.1
Resolution: Fixed
Issue resolved by pul
[
https://issues.apache.org/jira/browse/SPARK-34431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-34431:
-
Assignee: Maxim Gekk
> Only load hive-site.xml once
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-34440:
---
Affects Version/s: (was: 3.1.0)
3.2.0
> Allow saving/loading datetime in
[
https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-34440:
---
Fix Version/s: (was: 3.2.0)
> Allow saving/loading datetime in ORC w/o rebasing
> --
[
https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-34440:
---
Fix Version/s: (was: 3.1.0)
3.2.0
> Allow saving/loading datetime in ORC w/o
[
https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-34440:
---
Description: Currently, Spark always performs rebasing of date/timestamp
columns in ORC datasource b
Maxim Gekk created SPARK-34440:
--
Summary: Allow saving/loading datetime in ORC w/o rebasing
Key: SPARK-34440
URL: https://issues.apache.org/jira/browse/SPARK-34440
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-26138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-26138:
Summary: Pushdown limit through InnerLike when condition is empty (was:
Cross join requires push
[
https://issues.apache.org/jira/browse/SPARK-26138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284703#comment-17284703
]
Apache Spark commented on SPARK-26138:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-26138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284700#comment-17284700
]
Apache Spark commented on SPARK-26138:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-28220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284653#comment-17284653
]
Yuming Wang commented on SPARK-28220:
-
It seems this is not a issue:
{code:sql}
pos
[
https://issues.apache.org/jira/browse/SPARK-30386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-30386.
-
Resolution: Invalid
> Pushdown limit to outer join through projects
> --
[
https://issues.apache.org/jira/browse/SPARK-34439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34439:
Assignee: Apache Spark
> Recognize `spark_catalog` in new identifier while view/table ren
[
https://issues.apache.org/jira/browse/SPARK-34439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34439:
Assignee: (was: Apache Spark)
> Recognize `spark_catalog` in new identifier while vie
[
https://issues.apache.org/jira/browse/SPARK-34439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284625#comment-17284625
]
Apache Spark commented on SPARK-34439:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-34439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284624#comment-17284624
]
Apache Spark commented on SPARK-34439:
--
User 'MaxGekk' has created a pull request f
Maxim Gekk created SPARK-34439:
--
Summary: Recognize `spark_catalog` in new identifier while
view/table renaming
Key: SPARK-34439
URL: https://issues.apache.org/jira/browse/SPARK-34439
Project: Spark
59 matches
Mail list logo