[jira] [Assigned] (SPARK-37795) Add a scalastyle rule to ban `org.apache.log4j`

2021-12-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37795: - Assignee: William Hyun > Add a scalastyle rule to ban `org.apache.log4j` >

[jira] [Resolved] (SPARK-37795) Add a scalastyle rule to ban `org.apache.log4j`

2021-12-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37795. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35077

[jira] [Assigned] (SPARK-37798) Pyspark Pandas API: Cross and Conditional Merging

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37798: Assignee: Apache Spark > Pyspark Pandas API: Cross and Conditional Merging >

[jira] [Commented] (SPARK-37798) Pyspark Pandas API: Cross and Conditional Merging

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467355#comment-17467355 ] Apache Spark commented on SPARK-37798: -- User 'aa1371' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37798) Pyspark Pandas API: Cross and Conditional Merging

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37798: Assignee: (was: Apache Spark) > Pyspark Pandas API: Cross and Conditional Merging >

[jira] [Created] (SPARK-37798) Pyspark Pandas API: Cross and Conditional Merging

2021-12-31 Thread A S (Jira)
A S created SPARK-37798: --- Summary: Pyspark Pandas API: Cross and Conditional Merging Key: SPARK-37798 URL: https://issues.apache.org/jira/browse/SPARK-37798 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-37794) Remove log4j bridge api usage

2021-12-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37794: - Assignee: L. C. Hsieh > Remove log4j bridge api usage > -

[jira] [Resolved] (SPARK-37794) Remove log4j bridge api usage

2021-12-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37794. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35075

[jira] [Commented] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute

2021-12-31 Thread jingxiong zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467251#comment-17467251 ] jingxiong zhong commented on SPARK-37677: - I found that unzip is implemented by decompressing

[jira] [Commented] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467236#comment-17467236 ] Apache Spark commented on SPARK-37677: -- User 'zhongjingxiong' has created a pull request for this

[jira] [Assigned] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37677: Assignee: (was: Apache Spark) > spark on k8s, when the user want to push

[jira] [Commented] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467235#comment-17467235 ] Apache Spark commented on SPARK-37677: -- User 'zhongjingxiong' has created a pull request for this

[jira] [Assigned] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37677: Assignee: Apache Spark > spark on k8s, when the user want to push python3.6.6.zip to the

[jira] [Updated] (SPARK-37099) Impl a rank-based filter to optimize top-k computation

2021-12-31 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-37099: - Attachment: q67.png q67_optimized.png > Impl a rank-based filter to optimize

[jira] [Comment Edited] (SPARK-37099) Impl a rank-based filter to optimize top-k computation

2021-12-31 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467230#comment-17467230 ] zhengruifeng edited comment on SPARK-37099 at 12/31/21, 11:39 AM: --

[jira] [Comment Edited] (SPARK-37099) Impl a rank-based filter to optimize top-k computation

2021-12-31 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467230#comment-17467230 ] zhengruifeng edited comment on SPARK-37099 at 12/31/21, 11:38 AM: --

[jira] [Commented] (SPARK-37099) Impl a rank-based filter to optimize top-k computation

2021-12-31 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467230#comment-17467230 ] zhengruifeng commented on SPARK-37099: -- 10TiB TPC-DS - q67:  58min -> 10min   > Impl a rank-based

[jira] [Commented] (SPARK-37797) Spark Thrift Server's query timeout doesn't cancel the synchronous query

2021-12-31 Thread ramakrishna chilaka (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467183#comment-17467183 ] ramakrishna chilaka commented on SPARK-37797: - [~hyukjin.kwon] Can you please check this.

[jira] [Created] (SPARK-37797) Spark Thrift Server's query timeout doesn't cancel the synchronous query

2021-12-31 Thread ramakrishna chilaka (Jira)
ramakrishna chilaka created SPARK-37797: --- Summary: Spark Thrift Server's query timeout doesn't cancel the synchronous query Key: SPARK-37797 URL: https://issues.apache.org/jira/browse/SPARK-37797

[jira] [Assigned] (SPARK-37792) Spark shell sets log level to INFO by default

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37792: Assignee: Apache Spark > Spark shell sets log level to INFO by default >

[jira] [Assigned] (SPARK-37792) Spark shell sets log level to INFO by default

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37792: Assignee: (was: Apache Spark) > Spark shell sets log level to INFO by default >

[jira] [Commented] (SPARK-37792) Spark shell sets log level to INFO by default

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467171#comment-17467171 ] Apache Spark commented on SPARK-37792: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37792) Spark shell sets log level to INFO by default

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37792: Assignee: Apache Spark > Spark shell sets log level to INFO by default >

[jira] [Commented] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467164#comment-17467164 ] Apache Spark commented on SPARK-30789: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2021-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467163#comment-17467163 ] Apache Spark commented on SPARK-30789: -- User 'beliefer' has created a pull request for this issue: