[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268063#comment-17268063
]
Chao Sun commented on SPARK-33507:
--
[~aokolnychyi] could you elaborate on the question?
[
https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272333#comment-17272333
]
Chao Sun commented on SPARK-34052:
--
[~hyukjin.kwon] [~cloud_fan] do you think we should
[
https://issues.apache.org/jira/browse/SPARK-27589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273161#comment-17273161
]
Chao Sun commented on SPARK-27589:
--
[~xkrogen] FWIW I'm working on a POC for SPARK-3293
Chao Sun created SPARK-34271:
Summary: Use majorMinorPatchVersion for Hive version parsing
Key: SPARK-34271
URL: https://issues.apache.org/jira/browse/SPARK-34271
Project: Spark
Issue Type: Impro
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34108:
-
Description:
Currently, caching a temporary or permenant view doesn't work in certain cases.
For instan
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34108:
-
Summary: Cache lookup doesn't work in certain cases (was: Caching with
permanent view doesn't work in c
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-34108.
--
Resolution: Duplicate
> Cache lookup doesn't work in certain cases
> -
Chao Sun created SPARK-34347:
Summary: CatalogImpl.uncacheTable should invalidate in cascade for
temp views
Key: SPARK-34347
URL: https://issues.apache.org/jira/browse/SPARK-34347
Project: Spark
Chao Sun created SPARK-34419:
Summary: Move PartitionTransforms from java to scala directory
Key: SPARK-34419
URL: https://issues.apache.org/jira/browse/SPARK-34419
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289200#comment-17289200
]
Chao Sun commented on SPARK-33212:
--
Thanks for the report [~ouyangxc.zte]. Can you prov
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289652#comment-17289652
]
Chao Sun commented on SPARK-33212:
--
Thanks for the details [~ouyangxc.zte]!
{quote}
Ge
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290127#comment-17290127
]
Chao Sun commented on SPARK-33212:
--
Thanks again [~ouyangxc.zte].
{{org.apache.hadoop.
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290613#comment-17290613
]
Chao Sun commented on SPARK-33212:
--
I was able to reproduce the error in my local envir
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290613#comment-17290613
]
Chao Sun edited comment on SPARK-33212 at 2/25/21, 2:21 AM:
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290707#comment-17290707
]
Chao Sun commented on SPARK-33212:
--
Yes. I think the only class Spark needs from this j
[
https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-32703:
-
Summary: Replace deprecated API calls from SpecificParquetRecordReaderBase
(was: Enable dictionary filt
[
https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-32703:
-
Description: Currently in {{SpecificParquetRecordReaderBase}} we use
deprecated APIs in a few places fro
[
https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305109#comment-17305109
]
Chao Sun commented on SPARK-34780:
--
Thanks for the reporting [~mikechen], the test case
[
https://issues.apache.org/jira/browse/SPARK-30497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308067#comment-17308067
]
Chao Sun commented on SPARK-30497:
--
[~cloud_fan] this is resolved right?
> migrate DES
[
https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308262#comment-17308262
]
Chao Sun commented on SPARK-34780:
--
Sorry for the late reply [~mikechen]! There's somet
[
https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308854#comment-17308854
]
Chao Sun commented on SPARK-34780:
--
[~mikechen], yes you're right. I'm not sure if this
Chao Sun created SPARK-36820:
Summary: Disable LZ4 test for Hadoop 2.7 profile
Key: SPARK-36820
URL: https://issues.apache.org/jira/browse/SPARK-36820
Project: Spark
Issue Type: Bug
Com
[
https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36820:
-
Issue Type: Test (was: Bug)
> Disable LZ4 test for Hadoop 2.7 profile
> ---
Chao Sun created SPARK-36828:
Summary: Remove Guava from Spark binary distribution
Key: SPARK-36828
URL: https://issues.apache.org/jira/browse/SPARK-36828
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-36828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36828:
-
Issue Type: Improvement (was: Bug)
> Remove Guava from Spark binary distribution
>
[
https://issues.apache.org/jira/browse/SPARK-36835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17419499#comment-17419499
]
Chao Sun commented on SPARK-36835:
--
Sorry for the regression [~joshrosen]. I forgot exa
Chao Sun created SPARK-36863:
Summary: Update dependency manifests for all released artifacts
Key: SPARK-36863
URL: https://issues.apache.org/jira/browse/SPARK-36863
Project: Spark
Issue Type: Im
Chao Sun created SPARK-36873:
Summary: Add provided Guava dependency for network-yarn module
Key: SPARK-36873
URL: https://issues.apache.org/jira/browse/SPARK-36873
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36873:
-
Description:
In Spark 3.1 and earlier the network-yarn module implicitly relies on guava
from hadoop-cl
[
https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36873:
-
Description:
In Spark 3.1 and earlier the network-yarn module implicitly relies on guava
from hadoop-cl
[
https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36873:
-
Issue Type: Bug (was: Improvement)
> Add provided Guava dependency for network-yarn module
> --
Chao Sun created SPARK-36879:
Summary: Support Parquet v2 data page encodings for the vectorized
path
Key: SPARK-36879
URL: https://issues.apache.org/jira/browse/SPARK-36879
Project: Spark
Issue
Chao Sun created SPARK-36891:
Summary: Add new test suite to cover Parquet decoding
Key: SPARK-36891
URL: https://issues.apache.org/jira/browse/SPARK-36891
Project: Spark
Issue Type: Test
Chao Sun created SPARK-36935:
Summary: Enhance ParquetSchemaConverter to capture Parquet
repetition & definition level
Key: SPARK-36935
URL: https://issues.apache.org/jira/browse/SPARK-36935
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-36891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36891:
-
Parent: SPARK-35743
Issue Type: Sub-task (was: Test)
> Refactor SpecificParquetRecordReaderBase
[
https://issues.apache.org/jira/browse/SPARK-36936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17425162#comment-17425162
]
Chao Sun commented on SPARK-36936:
--
[~colin.williams] which version of {{spark-hadoop-c
[
https://issues.apache.org/jira/browse/SPARK-36936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426255#comment-17426255
]
Chao Sun commented on SPARK-36936:
--
[~colin.williams] Spark 3.2.0 is not released yet -
[
https://issues.apache.org/jira/browse/SPARK-35640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17428522#comment-17428522
]
Chao Sun commented on SPARK-35640:
--
[~catalinii] this change seems unrelated since it's
[
https://issues.apache.org/jira/browse/SPARK-37069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17432624#comment-17432624
]
Chao Sun commented on SPARK-37069:
--
Thanks for the ping [~zhouyifan279]! yes this is a
[
https://issues.apache.org/jira/browse/SPARK-35703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35703:
-
Summary: Relax constraint for Spark bucket join and remove
HashClusteredDistribution (was: Remove HashC
Chao Sun created SPARK-37113:
Summary: Upgrade Parquet to 1.12.2
Key: SPARK-37113
URL: https://issues.apache.org/jira/browse/SPARK-37113
Project: Spark
Issue Type: Improvement
Component
Chao Sun created SPARK-37166:
Summary: SPIP: Storage Partitioned Join
Key: SPARK-37166
URL: https://issues.apache.org/jira/browse/SPARK-37166
Project: Spark
Issue Type: New Feature
Comp
[
https://issues.apache.org/jira/browse/SPARK-37166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17436963#comment-17436963
]
Chao Sun commented on SPARK-37166:
--
[~xkrogen] sure just linked.
> SPIP: Storage Parti
Chao Sun created SPARK-37205:
Summary: Support mapreduce.job.send-token-conf when starting
containers in YARN
Key: SPARK-37205
URL: https://issues.apache.org/jira/browse/SPARK-37205
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37205:
-
Description: {{mapreduce.job.send-token-conf}} is a useful feature in
Hadoop (see [YARN-5910|https://iss
[
https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37218.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34496
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439554#comment-17439554
]
Chao Sun commented on SPARK-37218:
--
[~dongjoon] please assign this to yourself - someho
[
https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37220.
--
Fix Version/s: 3.3.0
Resolution: Fixed
> Do not split input file for Parquet reader with aggreg
[
https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17440042#comment-17440042
]
Chao Sun commented on SPARK-37220:
--
Thanks [~hyukjin.kwon]!
> Do not split input file
[
https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-36998:
Assignee: Thejdeep Gudivada (was: Thejdeep)
> Handle concurrent eviction of same application in
[
https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17440066#comment-17440066
]
Chao Sun commented on SPARK-36998:
--
Fixed
> Handle concurrent eviction of same applica
[
https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-35437:
Assignee: dzcxzl
> Use expressions to filter Hive partitions at client side
> ---
[
https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-35437.
--
Resolution: Fixed
Issue resolved by pull request 34431
[https://github.com/apache/spark/pull/34431]
>
[
https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35437:
-
Priority: Major (was: Minor)
> Use expressions to filter Hive partitions at client side
> -
[
https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37239:
Assignee: Yang Jie
> Avoid unnecessary `setReplication` in Yarn mode
> --
[
https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37239.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34520
[https://github.com
Chao Sun created SPARK-37342:
Summary: Upgrade Apache Arrow to 6.0.0
Key: SPARK-37342
URL: https://issues.apache.org/jira/browse/SPARK-37342
Project: Spark
Issue Type: Improvement
Compo
[
https://issues.apache.org/jira/browse/SPARK-37342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37342:
-
Component/s: Build
(was: Spark Core)
> Upgrade Apache Arrow to 6.0.0
>
[
https://issues.apache.org/jira/browse/SPARK-37166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37166.
--
Fix Version/s: 3.3.0
Assignee: Chao Sun
Resolution: Fixed
> SPIP: Storage Partitioned
Chao Sun created SPARK-37375:
Summary: Umbrella: Storage Partitioned Join
Key: SPARK-37375
URL: https://issues.apache.org/jira/browse/SPARK-37375
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-37166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37166:
-
Parent: SPARK-37375
Issue Type: Sub-task (was: New Feature)
> SPIP: Storage Partitioned Join
>
Chao Sun created SPARK-37376:
Summary: Introduce a new DataSource V2 interface HasPartitionKey
Key: SPARK-37376
URL: https://issues.apache.org/jira/browse/SPARK-37376
Project: Spark
Issue Type:
Chao Sun created SPARK-37377:
Summary: Refactor V2 Partitioning interface and remove deprecated
usage of Distribution
Key: SPARK-37377
URL: https://issues.apache.org/jira/browse/SPARK-37377
Project: Spark
Chao Sun created SPARK-37378:
Summary: Convert V2 Transform expressions into catalyst
expressions and load their associated functions from V2 FunctionCatalog
Key: SPARK-37378
URL: https://issues.apache.org/jira/browse
[
https://issues.apache.org/jira/browse/SPARK-35867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-35867.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34611
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-35867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-35867:
Assignee: Kazuyuki Tanimura
> Enable vectorized read for VectorizedPlainValuesReader.readBooleans
[
https://issues.apache.org/jira/browse/SPARK-36529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36529:
-
Attachment: image.png
> Decouple CPU with IO work in vectorized Parquet reader
> ---
[
https://issues.apache.org/jira/browse/SPARK-36529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36529:
-
Attachment: (was: image.png)
> Decouple CPU with IO work in vectorized Parquet reader
>
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37445.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34715
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37445:
Assignee: angerszhu
> Update hadoop-profile
> -
>
> Key: SPAR
[
https://issues.apache.org/jira/browse/SPARK-37205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37205:
Assignee: Chao Sun
> Support mapreduce.job.send-token-conf when starting containers in YARN
> ---
[
https://issues.apache.org/jira/browse/SPARK-37205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37205.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34635
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37561.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34822
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37561:
Assignee: dzcxzl
> Avoid loading all functions when obtaining hive's DelegationToken
> --
Chao Sun created SPARK-37600:
Summary: Upgrade to Hadoop 3.3.2
Key: SPARK-37600
URL: https://issues.apache.org/jira/browse/SPARK-37600
Project: Spark
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/SPARK-37573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37573:
Assignee: angerszhu
> IsolatedClient fallbackVersion should be build in version, not always 2.7.
[
https://issues.apache.org/jira/browse/SPARK-37573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37573.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34830
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37217.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34493
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37217:
Assignee: dzcxzl
> The number of dynamic partitions should early check when writing to external
[
https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37481:
-
Fix Version/s: 3.2.1
(was: 3.2.0)
> Disappearance of skipped stages mislead the b
[
https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37217:
-
Fix Version/s: 3.2.1
> The number of dynamic partitions should early check when writing to external
> t
[
https://issues.apache.org/jira/browse/SPARK-37633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37633.
--
Fix Version/s: 3.3.0
3.2.1
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-37633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37633:
Assignee: Manu Zhang
> Unwrap cast should skip if downcast failed with ansi enabled
> ---
[
https://issues.apache.org/jira/browse/SPARK-37633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37633:
-
Affects Version/s: (was: 3.0.3)
> Unwrap cast should skip if downcast failed with ansi enabled
> ---
[
https://issues.apache.org/jira/browse/SPARK-37974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37974.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 35262
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37974:
Assignee: Parth Chandra
> Implement vectorized DELTA_BYTE_ARRAY and DELTA_LENGTH_BYTE_ARRAY enco
[
https://issues.apache.org/jira/browse/SPARK-37974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37974:
-
Fix Version/s: 3.3.0
(was: 3.4.0)
> Implement vectorized DELTA_BYTE_ARRAY and DE
[
https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37377:
-
Summary: Initial implementation of Storage-Partitioned Join (was: Refactor
V2 Partitioning interface an
[
https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37377:
-
Description: This Jira tracks the initial implementation of
storage-partitioned join. (was: Currently {
[
https://issues.apache.org/jira/browse/SPARK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37378.
--
Resolution: Duplicate
This JIRA is covered as part of SPARK-37377
> Convert V2 Transform expressions
[
https://issues.apache.org/jira/browse/SPARK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37378:
-
Fix Version/s: 3.4.0
> Convert V2 Transform expressions into catalyst expressions and load their
> asso
[
https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-34863:
Assignee: Chao Sun (was: Apache Spark)
> Support nested column in Spark Parquet vectorized reade
[
https://issues.apache.org/jira/browse/SPARK-38786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-38786:
Assignee: Kazuyuki Tanimura
> Test Bug in StatisticsSuite "change stats after add/drop partition
[
https://issues.apache.org/jira/browse/SPARK-38786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-38786.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36075
[https://github.com
Chao Sun created SPARK-38840:
Summary: Enable
spark.sql.parquet.enableNestedColumnVectorizedReader on master branch by default
Key: SPARK-38840
URL: https://issues.apache.org/jira/browse/SPARK-38840
Proje
Chao Sun created SPARK-38891:
Summary: Skipping allocating vector for repetition & definition
levels when possible
Key: SPARK-38891
URL: https://issues.apache.org/jira/browse/SPARK-38891
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-38573.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36067
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-38573:
Assignee: Kazuyuki Tanimura
> Support Auto Partition Statistics Collection
>
[
https://issues.apache.org/jira/browse/SPARK-38891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-38891.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36202
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-38891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-38891:
Assignee: Chao Sun
> Skipping allocating vector for repetition & definition levels when possible
1 - 100 of 494 matches
Mail list logo
