[jira] [Commented] (SPARK-35589) BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

[ https://issues.apache.org/jira/browse/SPARK-35589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354822#comment-17354822 ] Apache Spark commented on SPARK-35589: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-35589) BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

[ https://issues.apache.org/jira/browse/SPARK-35589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35589: Assignee: Apache Spark > BlockManagerMasterEndpoint should not ignore index-only shuffle

[jira] [Commented] (SPARK-35589) BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

[ https://issues.apache.org/jira/browse/SPARK-35589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354821#comment-17354821 ] Apache Spark commented on SPARK-35589: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-35589) BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

[ https://issues.apache.org/jira/browse/SPARK-35589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35589: Assignee: (was: Apache Spark) > BlockManagerMasterEndpoint should not ignore

[jira] [Commented] (SPARK-35587) Initial porting of Koalas documentation

[ https://issues.apache.org/jira/browse/SPARK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354820#comment-17354820 ] Apache Spark commented on SPARK-35587: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-35587) Initial porting of Koalas documentation

[ https://issues.apache.org/jira/browse/SPARK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35587: Assignee: (was: Apache Spark) > Initial porting of Koalas documentation >

[jira] [Assigned] (SPARK-35587) Initial porting of Koalas documentation

[ https://issues.apache.org/jira/browse/SPARK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35587: Assignee: Apache Spark > Initial porting of Koalas documentation >

[jira] [Commented] (SPARK-33933) Broadcast timeout happened unexpectedly in AQE

[ https://issues.apache.org/jira/browse/SPARK-33933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354818#comment-17354818 ] Apache Spark commented on SPARK-33933: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-35589) BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

Dongjoon Hyun created SPARK-35589: - Summary: BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating Key: SPARK-35589 URL: https://issues.apache.org/jira/browse/SPARK-35589

[jira] [Created] (SPARK-35588) Merge Binder integration and quickstart notebook.

Hyukjin Kwon created SPARK-35588: Summary: Merge Binder integration and quickstart notebook. Key: SPARK-35588 URL: https://issues.apache.org/jira/browse/SPARK-35588 Project: Spark Issue

[jira] [Assigned] (SPARK-35585) Support propagate empty relation through project/filter

[ https://issues.apache.org/jira/browse/SPARK-35585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35585: Assignee: Apache Spark > Support propagate empty relation through project/filter >

[jira] [Commented] (SPARK-35585) Support propagate empty relation through project/filter

[ https://issues.apache.org/jira/browse/SPARK-35585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354815#comment-17354815 ] Apache Spark commented on SPARK-35585: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-35585) Support propagate empty relation through project/filter

[ https://issues.apache.org/jira/browse/SPARK-35585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35585: Assignee: (was: Apache Spark) > Support propagate empty relation through

[jira] [Commented] (SPARK-35585) Support propagate empty relation through project/filter

[ https://issues.apache.org/jira/browse/SPARK-35585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354816#comment-17354816 ] Apache Spark commented on SPARK-35585: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-35423) The output of PCA is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-35423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354810#comment-17354810 ] shahid commented on SPARK-35423: I would like to analyse this issue > The output of PCA is inconsistent

[jira] [Updated] (SPARK-35579) Fix a bug in janino or work around it in Spark.

[ https://issues.apache.org/jira/browse/SPARK-35579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35579: Priority: Blocker (was: Critical) > Fix a bug in janino or work around it in Spark. >

[jira] [Commented] (SPARK-35583) Move JDBC data source options from Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-35583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354804#comment-17354804 ] Apache Spark commented on SPARK-35583: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35583) Move JDBC data source options from Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-35583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35583: Assignee: (was: Apache Spark) > Move JDBC data source options from Python and Scala

[jira] [Assigned] (SPARK-35583) Move JDBC data source options from Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-35583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35583: Assignee: Apache Spark > Move JDBC data source options from Python and Scala into a

[jira] [Commented] (SPARK-35583) Move JDBC data source options from Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-35583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354803#comment-17354803 ] Apache Spark commented on SPARK-35583: -- User 'itholic' has created a pull request for this issue:

[jira] [Created] (SPARK-35587) Initial porting of Koalas documentation

Hyukjin Kwon created SPARK-35587: Summary: Initial porting of Koalas documentation Key: SPARK-35587 URL: https://issues.apache.org/jira/browse/SPARK-35587 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34885) Port/integrate Koalas documentation into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34885: - Target Version/s: 3.2.0 > Port/integrate Koalas documentation into PySpark >

[jira] [Updated] (SPARK-34885) Port/integrate Koalas documentation into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34885: - Parent: (was: SPARK-34849) Issue Type: Improvement (was: Sub-task) >

[jira] [Assigned] (SPARK-35586) Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests

[ https://issues.apache.org/jira/browse/SPARK-35586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35586: Assignee: Kousuke Saruta (was: Apache Spark) > Set a default value for

[jira] [Assigned] (SPARK-35586) Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests

[ https://issues.apache.org/jira/browse/SPARK-35586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35586: Assignee: Apache Spark (was: Kousuke Saruta) > Set a default value for

[jira] [Commented] (SPARK-35586) Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests

[ https://issues.apache.org/jira/browse/SPARK-35586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354798#comment-17354798 ] Apache Spark commented on SPARK-35586: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-35586) Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests

[ https://issues.apache.org/jira/browse/SPARK-35586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35586: --- Description: In kubernetes/integration-tests/pom.xml, there is no default value for

[jira] [Created] (SPARK-35586) Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests

Kousuke Saruta created SPARK-35586: -- Summary: Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests Key: SPARK-35586 URL:

[jira] [Assigned] (SPARK-35077) Migrate to transformWithPruning for leftover optimizer rules

[ https://issues.apache.org/jira/browse/SPARK-35077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35077: Assignee: Apache Spark > Migrate to transformWithPruning for leftover optimizer rules >

[jira] [Commented] (SPARK-35077) Migrate to transformWithPruning for leftover optimizer rules

[ https://issues.apache.org/jira/browse/SPARK-35077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354795#comment-17354795 ] Apache Spark commented on SPARK-35077: -- User 'sigmod' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35077) Migrate to transformWithPruning for leftover optimizer rules

[ https://issues.apache.org/jira/browse/SPARK-35077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35077: Assignee: (was: Apache Spark) > Migrate to transformWithPruning for leftover

[jira] [Assigned] (SPARK-35077) Migrate to transformWithPruning for leftover optimizer rules

[ https://issues.apache.org/jira/browse/SPARK-35077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35077: Assignee: Apache Spark > Migrate to transformWithPruning for leftover optimizer rules >

[jira] [Created] (SPARK-35585) Support propagate empty relation through project/filter

XiDuo You created SPARK-35585: - Summary: Support propagate empty relation through project/filter Key: SPARK-35585 URL: https://issues.apache.org/jira/browse/SPARK-35585 Project: Spark Issue

[jira] [Commented] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354783#comment-17354783 ] Apache Spark commented on SPARK-35576: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354782#comment-17354782 ] Apache Spark commented on SPARK-35576: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-35544) Add tree pattern pruning into Analyzer rules

[ https://issues.apache.org/jira/browse/SPARK-35544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35544: -- Assignee: Yingyi Bu > Add tree pattern pruning into Analyzer rules >

[jira] [Resolved] (SPARK-35544) Add tree pattern pruning into Analyzer rules

[ https://issues.apache.org/jira/browse/SPARK-35544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35544. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32686

[jira] [Commented] (SPARK-35584) Increase the timeout in FallbackStorageSuite

[ https://issues.apache.org/jira/browse/SPARK-35584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354765#comment-17354765 ] Apache Spark commented on SPARK-35584: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35584) Increase the timeout in FallbackStorageSuite

[ https://issues.apache.org/jira/browse/SPARK-35584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35584: Assignee: (was: Apache Spark) > Increase the timeout in FallbackStorageSuite >

[jira] [Assigned] (SPARK-35584) Increase the timeout in FallbackStorageSuite

[ https://issues.apache.org/jira/browse/SPARK-35584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35584: Assignee: Apache Spark > Increase the timeout in FallbackStorageSuite >

[jira] [Updated] (SPARK-35584) Increase the timeout in FallbackStorageSuite

[ https://issues.apache.org/jira/browse/SPARK-35584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-35584: Description: The aarch64 case failed due to:   {{Discovery starting. Discovery completed in 2

[jira] [Commented] (SPARK-34059) Use for/foreach rather than map to make sure execute it eagerly

[ https://issues.apache.org/jira/browse/SPARK-34059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354762#comment-17354762 ] Apache Spark commented on SPARK-34059: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-34059) Use for/foreach rather than map to make sure execute it eagerly

[ https://issues.apache.org/jira/browse/SPARK-34059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354761#comment-17354761 ] Apache Spark commented on SPARK-34059: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-32166) Metastore problem on Spark3.0 with Hive3.0

[ https://issues.apache.org/jira/browse/SPARK-32166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354759#comment-17354759 ] angerszhu commented on SPARK-32166: ---

[jira] [Commented] (SPARK-21957) Add current_user function

[ https://issues.apache.org/jira/browse/SPARK-21957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354755#comment-17354755 ] Apache Spark commented on SPARK-21957: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-21957) Add current_user function

[ https://issues.apache.org/jira/browse/SPARK-21957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354756#comment-17354756 ] Apache Spark commented on SPARK-21957: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-35584) Increase the timeout in FallbackStorageSuite

[ https://issues.apache.org/jira/browse/SPARK-35584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354753#comment-17354753 ] Yikun Jiang commented on SPARK-35584: - I also see some random timeout failed test on github action,

[jira] [Created] (SPARK-35584) Increase the timeout in FallbackStorageSuite

Yikun Jiang created SPARK-35584: --- Summary: Increase the timeout in FallbackStorageSuite Key: SPARK-35584 URL: https://issues.apache.org/jira/browse/SPARK-35584 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-35583) Move JDBC data source options from Python and Scala into a single page

Haejoon Lee created SPARK-35583: --- Summary: Move JDBC data source options from Python and Scala into a single page Key: SPARK-35583 URL: https://issues.apache.org/jira/browse/SPARK-35583 Project: Spark

[jira] [Resolved] (SPARK-35433) Move CSV data source options from Python and Scala into a single page.

[ https://issues.apache.org/jira/browse/SPARK-35433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35433. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32658

[jira] [Assigned] (SPARK-35433) Move CSV data source options from Python and Scala into a single page.

[ https://issues.apache.org/jira/browse/SPARK-35433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35433: Assignee: Haejoon Lee > Move CSV data source options from Python and Scala into a single

[jira] [Resolved] (SPARK-35578) Add a test case for a janino bug

[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35578. -- Fix Version/s: 3.2.0 Assignee: Wenchen Fan Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-35582) Remove # noqa in Python API documents.

[ https://issues.apache.org/jira/browse/SPARK-35582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354732#comment-17354732 ] Haejoon Lee commented on SPARK-35582: - I'm working on this > Remove # noqa in Python API documents.

[jira] [Created] (SPARK-35582) Remove # noqa in Python API documents.

Haejoon Lee created SPARK-35582: --- Summary: Remove # noqa in Python API documents. Key: SPARK-35582 URL: https://issues.apache.org/jira/browse/SPARK-35582 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-35573) Support R 4.1.0

[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35573: Assignee: Hyukjin Kwon (was: Dongjoon Hyun) > Support R 4.1.0 > --- > >

[jira] [Updated] (SPARK-35573) Make SparkR tests pass with R 4.1+

[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35573: - Summary: Make SparkR tests pass with R 4.1+ (was: Support R 4.1.0) > Make SparkR tests pass

[jira] [Updated] (SPARK-35573) Support R 4.1.0

[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35573: - Fix Version/s: 3.1.3 3.0.3 > Support R 4.1.0 > --- > >

[jira] [Resolved] (SPARK-35573) Support R 4.1.0

[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35573. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32709

[jira] [Assigned] (SPARK-35573) Support R 4.1.0

[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35573: Assignee: Dongjoon Hyun > Support R 4.1.0 > --- > > Key:

[jira] [Resolved] (SPARK-35453) Move Koalas accessor to pandas_on_spark accessor

[ https://issues.apache.org/jira/browse/SPARK-35453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35453. -- Fix Version/s: 3.2.0 Assignee: Haejoon Lee Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-35561) partition result is incorrect when insert into partition table with int datatype partition column

[ https://issues.apache.org/jira/browse/SPARK-35561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354728#comment-17354728 ] YuanGuanhu commented on SPARK-35561: [~Stelyus] I know,but the amazing thing is, if I execute this

[jira] [Reopened] (SPARK-35396) Support to manual close/release entries in MemoryStore and InMemoryRelation instead of replying on GC

[ https://issues.apache.org/jira/browse/SPARK-35396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chendi.Xue reopened SPARK-35396: Reopen this JIRA, since this Jira is aim to add manual close to both MemoryStore and

[jira] [Commented] (SPARK-35396) Support to manual close/release entries in MemoryStore and InMemoryRelation instead of replying on GC

[ https://issues.apache.org/jira/browse/SPARK-35396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354724#comment-17354724 ] Apache Spark commented on SPARK-35396: -- User 'xuechendi' has created a pull request for this issue:

[jira] [Commented] (SPARK-35396) Support to manual close/release entries in MemoryStore and InMemoryRelation instead of replying on GC

[ https://issues.apache.org/jira/browse/SPARK-35396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354723#comment-17354723 ] Apache Spark commented on SPARK-35396: -- User 'xuechendi' has created a pull request for this issue:

[jira] [Commented] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

[ https://issues.apache.org/jira/browse/SPARK-34731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354670#comment-17354670 ] John Pugliesi commented on SPARK-34731: --- To clarify, does this issue potentially prevent event

[jira] [Resolved] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35576. --- Fix Version/s: 3.2.0 Resolution: Fixed This is resolved via

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35576: -- Affects Version/s: 1.6.3 > Redact the sensitive info in the result of Set command >

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35576: -- Affects Version/s: 2.0.2 > Redact the sensitive info in the result of Set command >

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35576: -- Affects Version/s: 2.1.3 > Redact the sensitive info in the result of Set command >

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35576: -- Affects Version/s: 2.2.3 > Redact the sensitive info in the result of Set command >

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35576: -- Affects Version/s: 2.3.4 > Redact the sensitive info in the result of Set command >

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35576: -- Affects Version/s: 2.4.8 3.0.2 > Redact the sensitive info in the

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35576: -- Issue Type: Bug (was: Task) > Redact the sensitive info in the result of Set command >

[jira] [Assigned] (SPARK-35581) Casting special strings to DATE/TIMESTAMP returns inconsistent results

[ https://issues.apache.org/jira/browse/SPARK-35581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35581: Assignee: Max Gekk (was: Apache Spark) > Casting special strings to DATE/TIMESTAMP

[jira] [Assigned] (SPARK-35581) Casting special strings to DATE/TIMESTAMP returns inconsistent results

[ https://issues.apache.org/jira/browse/SPARK-35581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35581: Assignee: Apache Spark (was: Max Gekk) > Casting special strings to DATE/TIMESTAMP

[jira] [Commented] (SPARK-35581) Casting special strings to DATE/TIMESTAMP returns inconsistent results

[ https://issues.apache.org/jira/browse/SPARK-35581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354651#comment-17354651 ] Apache Spark commented on SPARK-35581: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-35581) Casting special strings to DATE/TIMESTAMP returns inconsistent results

Max Gekk created SPARK-35581: Summary: Casting special strings to DATE/TIMESTAMP returns inconsistent results Key: SPARK-35581 URL: https://issues.apache.org/jira/browse/SPARK-35581 Project: Spark

[jira] [Commented] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354637#comment-17354637 ] Adam Binford commented on SPARK-35564: -- A 2x gain would be pretty significant to us, I don't know

[jira] [Created] (SPARK-35580) Support subexpression elimination for higher order functions

Adam Binford created SPARK-35580: Summary: Support subexpression elimination for higher order functions Key: SPARK-35580 URL: https://issues.apache.org/jira/browse/SPARK-35580 Project: Spark

[jira] [Commented] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354590#comment-17354590 ] L. C. Hsieh commented on SPARK-35564: - > I don't really think this is much of a corner case, but a

[jira] [Commented] (SPARK-35561) partition result is incorrect when insert into partition table with int datatype partition column

[ https://issues.apache.org/jira/browse/SPARK-35561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354556#comment-17354556 ] Franck Thang commented on SPARK-35561: -- I personally don't expect 001 because the type is an INT,

[jira] [Assigned] (SPARK-35567) Explain cost is not showing statistics for all the nodes

[ https://issues.apache.org/jira/browse/SPARK-35567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35567: --- Assignee: shahid > Explain cost is not showing statistics for all the nodes >

[jira] [Resolved] (SPARK-35567) Explain cost is not showing statistics for all the nodes

[ https://issues.apache.org/jira/browse/SPARK-35567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35567. - Fix Version/s: 3.2.0 Resolution: Fixed > Explain cost is not showing statistics for all

[jira] [Commented] (SPARK-35578) Add a test case for a janino bug

[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354508#comment-17354508 ] Apache Spark commented on SPARK-35578: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-35578) Add a test case for a janino bug

[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354507#comment-17354507 ] Apache Spark commented on SPARK-35578: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35578) Add a test case for a janino bug

[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35578: Assignee: Apache Spark > Add a test case for a janino bug >

[jira] [Assigned] (SPARK-35578) Add a test case for a janino bug

[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35578: Assignee: (was: Apache Spark) > Add a test case for a janino bug >

[jira] [Updated] (SPARK-35579) Fix a bug in janino or work around it in Spark.

[ https://issues.apache.org/jira/browse/SPARK-35579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35579: Priority: Critical (was: Major) > Fix a bug in janino or work around it in Spark. >

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35576: --- Affects Version/s: 3.1.2 > Redact the sensitive info in the result of Set command >

[jira] [Created] (SPARK-35579) Fix a bug in janino or work around it in Spark.

Wenchen Fan created SPARK-35579: --- Summary: Fix a bug in janino or work around it in Spark. Key: SPARK-35579 URL: https://issues.apache.org/jira/browse/SPARK-35579 Project: Spark Issue Type:

[jira] [Created] (SPARK-35578) Add a test case for a janino bug

Wenchen Fan created SPARK-35578: --- Summary: Add a test case for a janino bug Key: SPARK-35578 URL: https://issues.apache.org/jira/browse/SPARK-35578 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Summary: Adapt uses of JDK 17 Internal APIs (was: Adapt uses of JDK 17 Internal APIs (Unsafe,

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Description: I tried to run a Spark pipeline using the most recent 3.2.0-SNAPSHOT with Spark

[jira] [Commented] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354447#comment-17354447 ] Adam Binford commented on SPARK-35564: -- >Do you mean "Create a subexpression if an expression will

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Description: I tried to run a Spark pipeline using the most recent 3.2.0-SNAPSHOT with Spark

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Summary: Adapt uses of JDK 17 Internal APIs (Unsafe, etc) (was: Adapt uses of JDK Internal

[jira] [Commented] (SPARK-35577) Allow to log container output for docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354429#comment-17354429 ] Apache Spark commented on SPARK-35577: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35577) Allow to log container output for docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35577: Assignee: Kousuke Saruta (was: Apache Spark) > Allow to log container output for docker

[jira] [Assigned] (SPARK-35577) Allow to log container output for docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35577: Assignee: Apache Spark (was: Kousuke Saruta) > Allow to log container output for docker

[jira] [Commented] (SPARK-35577) Allow to log container output for docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354428#comment-17354428 ] Apache Spark commented on SPARK-35577: -- User 'sarutak' has created a pull request for this issue:

  1   2   >