[jira] [Updated] (SPARK-36493) Skip Retrieving keytab with SparkFiles.get if keytab found in the CWD of Yarn Container

2021-08-17 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option {{if

[jira] [Updated] (SPARK-36493) Skip Retrieving keytab with SparkFiles.get if keytab found in the CWD of Yarn Container

2021-08-17 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Summary: Skip Retrieving keytab with SparkFiles.get if keytab found in the CWD of Yarn Container (was: SparkF

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-17 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option {{if

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-17 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option {{if

[jira] [Commented] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398051#comment-17398051 ] Zikun commented on SPARK-36493: --- A PR is submitted for this issue https://github.com/apac

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if (k

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if (k

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if (k

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if (k

[jira] [Created] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
Zikun created SPARK-36493: - Summary: SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option Key: SPARK-36493 URL: https://issues.apache.org/jira/browse/SPARK-36493 Project: Spark

[jira] [Commented] (SPARK-24837) Add kafka as spark metrics sink

2020-12-04 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17244300#comment-17244300 ] Zikun commented on SPARK-24837: --- Why is this marked as resolved? The kafka sink for spark

[jira] [Updated] (SPARK-32096) Improve sorting performance for Spark SQL rank window function​

2020-09-20 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-32096: -- Description: Spark SQL rank window function needs to sort the data in each window partition,  and it relies on

[jira] [Created] (SPARK-32947) Support top-N sort for Spark SQL window function

2020-09-20 Thread Zikun (Jira)
Zikun created SPARK-32947: - Summary: Support top-N sort for Spark SQL window function Key: SPARK-32947 URL: https://issues.apache.org/jira/browse/SPARK-32947 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-32096) Improve sorting performance for Spark SQL rank window function​

2020-09-10 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-32096: -- Description: Spark SQL rank window function needs to sort the data in each window partition,  and it relies on

[jira] [Updated] (SPARK-32096) Improve sorting performance for Spark SQL rank window function​

2020-09-10 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-32096: -- Attachment: windowSortPerf (1).docx > Improve sorting performance for Spark SQL rank window function​ > --

[jira] [Updated] (SPARK-32096) Improve sorting performance for Spark SQL rank window function​

2020-09-10 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-32096: -- Summary: Improve sorting performance for Spark SQL rank window function​ (was: Support top-N sort for Spark S

[jira] [Comment Edited] (SPARK-32096) Support top-N sort for Spark SQL rank window function

2020-06-28 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17147548#comment-17147548 ] Zikun edited comment on SPARK-32096 at 6/29/20, 4:44 AM: - Yes, w

[jira] [Commented] (SPARK-32096) Support top-N sort for Spark SQL rank window function

2020-06-28 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17147548#comment-17147548 ] Zikun commented on SPARK-32096: --- Yes, we need to do top-N sort for each window partition i

[jira] [Commented] (SPARK-32096) Support top-N sort for Spark SQL rank window function

2020-06-28 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17147538#comment-17147538 ] Zikun commented on SPARK-32096: --- [~viirya] Yes, a filter of window rank <= 100 means a top

[jira] [Updated] (SPARK-32096) Support top-N sort for Spark SQL rank window function

2020-06-24 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-32096: -- Description: In Spark SQL, there are two types of sort execution, *_SortExec_* and *_TakeOrderedAndProjectExe

[jira] [Updated] (SPARK-32096) Support top-N sort for Spark SQL rank window function

2020-06-24 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-32096: -- Summary: Support top-N sort for Spark SQL rank window function (was: Support top-N sort for Spark SQL window

[jira] [Created] (SPARK-32096) Support top-N sort for Spark SQL window function

2020-06-24 Thread Zikun (Jira)
Zikun created SPARK-32096: - Summary: Support top-N sort for Spark SQL window function Key: SPARK-32096 URL: https://issues.apache.org/jira/browse/SPARK-32096 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

2018-01-19 Thread Zikun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-21994: -- Attachment: Srinivasa Reddy Vundela.url > Spark 2.2 can not read Parquet table created by itself >