[jira] [Updated] (SPARK-32869) Ignore deprecation warnings for sbt

2020-09-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32869: --- Parent: SPARK-25075 Issue Type: Sub-task (was: Bug) > Ignore deprecation warni

[jira] [Updated] (SPARK-32869) Ignore deprecation warnings for sbt

2020-09-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32869: --- Description: If we build Spark with scala-2.13 and sbt, some deprecation warnings

[jira] [Created] (SPARK-32869) Ignore deprecation warnings for sbt

2020-09-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32869: -- Summary: Ignore deprecation warnings for sbt Key: SPARK-32869 URL: https://issues.apache.org/jira/browse/SPARK-32869 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-32843) Add an optimization rule to combine range repartition and range operation

2020-09-10 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32843: -- Summary: Add an optimization rule to combine range repartition and range operation Key: SPARK-32843 URL: https://issues.apache.org/jira/browse/SPARK-32843

[jira] [Updated] (SPARK-32822) Change the number of partitions to zero when a range is empty with WholeStageCodegen disabled or falled back

2020-09-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32822: --- Summary: Change the number of partitions to zero when a range is empty

[jira] [Updated] (SPARK-32822) Change the number of partitions to zero when a range is empty with WholeStageCodegen disabled or falled back

2020-09-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32822: --- Description: If WholeStageCodegen effects, the number of partitions of an empty range

[jira] [Created] (SPARK-32822) Change the number of partition to zero when a range is empty with WholeStageCodegen disabled or falled back

2020-09-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32822: -- Summary: Change the number of partition to zero when a range is empty with WholeStageCodegen disabled or falled back Key: SPARK-32822 URL: https://issues.apache.org/jira

[jira] [Created] (SPARK-32820) Remove redundant shuffle exchanges inserted by EnsureRequirements

2020-09-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32820: -- Summary: Remove redundant shuffle exchanges inserted by EnsureRequirements Key: SPARK-32820 URL: https://issues.apache.org/jira/browse/SPARK-32820 Project: Spark

[jira] [Created] (SPARK-32774) Don't track docs/.jekyll-cache

2020-09-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32774: -- Summary: Don't track docs/.jekyll-cache Key: SPARK-32774 URL: https://issues.apache.org/jira/browse/SPARK-32774 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-09-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188808#comment-17188808 ] Kousuke Saruta commented on SPARK-32119: Yeah, it's a bug fix so we may have a chance

[jira] [Updated] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

2020-09-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32773: --- Description: Jars/files specified with --jars / --files options are listed by sc.listJars

[jira] [Updated] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

2020-09-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32773: --- Description: Jars/files specified with --jars / --files options are listed by sc.listJars

[jira] [Updated] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

2020-09-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32773: --- Summary: The behavior of listJars and listFiles is not consistent between YARN and other

[jira] [Created] (SPARK-32773) The behavior of listJars and listFiles is not consistent with YARN and other cluster managers

2020-09-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32773: -- Summary: The behavior of listJars and listFiles is not consistent with YARN and other cluster managers Key: SPARK-32773 URL: https://issues.apache.org/jira/browse/SPARK-32773

[jira] [Updated] (SPARK-32772) Reduce log messages for spark-sql CLI

2020-09-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32772: --- Description: When we launch spark-sql CLI, too many log messages are shown and it's

[jira] [Updated] (SPARK-32772) Reduce log messages for spark-sql CLI

2020-09-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32772: --- Summary: Reduce log messages for spark-sql CLI (was: Suppress log for spark-sql CLI

[jira] [Created] (SPARK-32772) Suppress log for spark-sql CLI

2020-09-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32772: -- Summary: Suppress log for spark-sql CLI Key: SPARK-32772 URL: https://issues.apache.org/jira/browse/SPARK-32772 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32771) The example of expressions.Aggregator in Javadoc / Scaladoc is wrong

2020-09-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32771: -- Summary: The example of expressions.Aggregator in Javadoc / Scaladoc is wrong Key: SPARK-32771 URL: https://issues.apache.org/jira/browse/SPARK-32771 Project

[jira] [Created] (SPARK-32610) Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version

2020-08-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32610: -- Summary: Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version Key: SPARK-32610 URL: https://issues.apache.org/jira/browse/SPARK-32610

[jira] [Updated] (SPARK-32538) Use local time zone for the timestamp logged in unit-tests.log

2020-08-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32538: --- Summary: Use local time zone for the timestamp logged in unit-tests.log (was: Timestamp

[jira] [Created] (SPARK-32538) Timestamp logged in unit-tests.log is fixed to Ameria/Los_Angeles.

2020-08-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32538: -- Summary: Timestamp logged in unit-tests.log is fixed to Ameria/Los_Angeles. Key: SPARK-32538 URL: https://issues.apache.org/jira/browse/SPARK-32538 Project

[jira] [Created] (SPARK-32525) The layout of monitoring.html is broken

2020-08-03 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32525: -- Summary: The layout of monitoring.html is broken Key: SPARK-32525 URL: https://issues.apache.org/jira/browse/SPARK-32525 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-07-31 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32119: --- Description: ExecutorPlugin can't work with Standalone Cluster and Kubernetes when a jar

[jira] [Updated] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-07-31 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32119: --- Summary: ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

[jira] [Updated] (SPARK-32462) Don't save the previous search text for datatable

2020-07-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32462: --- Description: DataTable is used in stage-page and executors-page for pagination and filter

[jira] [Created] (SPARK-32462) Don't save the previous search text for datatable

2020-07-27 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32462: -- Summary: Don't save the previous search text for datatable Key: SPARK-32462 URL: https://issues.apache.org/jira/browse/SPARK-32462 Project: Spark Issue

[jira] [Resolved] (SPARK-32236) Local cluster should shutdown gracefully

2020-07-09 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-32236. Resolution: Duplicate > Local cluster should shutdown gracefu

[jira] [Created] (SPARK-32236) Local cluster should shutdown gracefully

2020-07-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32236: -- Summary: Local cluster should shutdown gracefully Key: SPARK-32236 URL: https://issues.apache.org/jira/browse/SPARK-32236 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32200) Redirect to the history page when accessed to /history without appliation id

2020-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32200: --- Affects Version/s: (was: 3.0.1) 3.0.0 > Redirect to the hist

[jira] [Updated] (SPARK-32200) Redirect to the history page when accessed to /history without appliation id

2020-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32200: --- Affects Version/s: (was: 3.0.0) > Redirect to the history page when acces

[jira] [Created] (SPARK-32214) The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

2020-07-07 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32214: -- Summary: The type conversion function generated in makeFromJava for "other" type uses a wrong variable. Key: SPARK-32214 URL: https://issues.apache.org/jira/br

[jira] [Created] (SPARK-32200) Redirect to the history page when accessed to /history without appliation id

2020-07-06 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32200: -- Summary: Redirect to the history page when accessed to /history without appliation id Key: SPARK-32200 URL: https://issues.apache.org/jira/browse/SPARK-32200

[jira] [Commented] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17152220#comment-17152220 ] Kousuke Saruta commented on SPARK-32153: Thanks [~shaneknapp]! > .m2 repository corruption

[jira] [Updated] (SPARK-32177) Remove the weird line from near the Spark logo on mouseover in the WebUI

2020-07-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32177: --- Affects Version/s: (was: 3.0.0) > Remove the weird line from near the Spark l

[jira] [Created] (SPARK-32177) Remove the weird line from near the Spark logo on mouseover in the WebUI

2020-07-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32177: -- Summary: Remove the weird line from near the Spark logo on mouseover in the WebUI Key: SPARK-32177 URL: https://issues.apache.org/jira/browse/SPARK-32177 Project

[jira] [Created] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32175: -- Summary: Fix the order between initialization for ExecutorPlugin and starting heartbeat thread Key: SPARK-32175 URL: https://issues.apache.org/jira/browse/SPARK-32175

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Description: Build task on Jenkins-worker4 often fails with dependency problem. [https

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Description: Build task on Jenkins-worker4 often fails with dependency problem. [https

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Description: Build task on Jenkins-worker4 often fails with dependency problem. [https

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Description: Build task on Jenkins-worker4 often fails with dependency problem. [https

[jira] [Commented] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150048#comment-17150048 ] Kousuke Saruta commented on SPARK-32153: [~shaneknapp] Could you look into this? >

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Issue Type: Bug (was: Improvement) > .m2 repository corruption can happen on Jenk

[jira] [Created] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32153: -- Summary: .m2 repository corruption can happen on Jenkins-worker4 Key: SPARK-32153 URL: https://issues.apache.org/jira/browse/SPARK-32153 Project: Spark

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

2020-06-30 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148790#comment-17148790 ] Kousuke Saruta commented on SPARK-32119: Yeah I know it works with extraClassPath but as you

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

2020-06-29 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148257#comment-17148257 ] Kousuke Saruta commented on SPARK-32119: [~lucacanali] Thanks. I got this is a known limitation

[jira] [Updated] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

2020-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32119: --- Affects Version/s: 3.0.1 > ExecutorPlugin doesn't work with Standalone Clus

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

2020-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147427#comment-17147427 ] Kousuke Saruta commented on SPARK-32119: Sorry, it's just a mistake. I've modified

[jira] [Updated] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

2020-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32119: --- Issue Type: Bug (was: Improvement) > ExecutorPlugin doesn't work with Standalone Clus

[jira] [Updated] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

2020-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32119: --- Description: ExecutorPlugin can't work with Standalone Cluster (maybe with other cluster

[jira] [Created] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

2020-06-28 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32119: -- Summary: ExecutorPlugin doesn't work with Standalone Cluster Key: SPARK-32119 URL: https://issues.apache.org/jira/browse/SPARK-32119 Project: Spark

[jira] [Resolved] (SPARK-31871) Display the canvas element icon for sorting column

2020-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-31871. Resolution: Fixed This issue is resolved in [https://github.com/apache/spark/pull/28799

[jira] [Assigned] (SPARK-31871) Display the canvas element icon for sorting column

2020-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-31871: -- Assignee: liucht-inspur > Display the canvas element icon for sorting col

[jira] [Updated] (SPARK-31871) Display the canvas element icon for sorting column

2020-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31871: --- Affects Version/s: 2.4.6 > Display the canvas element icon for sorting col

[jira] [Updated] (SPARK-31871) Display the canvas element icon for sorting column

2020-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31871: --- Fix Version/s: 2.4.7 > Display the canvas element icon for sorting col

[jira] [Assigned] (SPARK-32000) Fix the flaky testcase for partially launched task in barrier-mode.

2020-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-32000: -- Assignee: (was: Kousuke Saruta) > Fix the flaky testcase for partially launc

[jira] [Updated] (SPARK-32000) Fix the flaky testcase for partially launched task in barrier-mode.

2020-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32000: --- Description: I noticed sometimes the testcase for SPARK-31485 fails. (was: I noticed

[jira] [Assigned] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-31996: -- Assignee: (was: Kousuke Saruta) > Specify the version of ChromeDri

[jira] [Updated] (SPARK-32000) Fix the flaky testcase for partially launched task in barrier-mode.

2020-06-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32000: --- Issue Type: Bug (was: Improvement) > Fix the flaky testcase for partially launched t

[jira] [Created] (SPARK-32000) Fix the flaky testcase for partially launched task in barrier-mode.

2020-06-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-32000: -- Summary: Fix the flaky testcase for partially launched task in barrier-mode. Key: SPARK-32000 URL: https://issues.apache.org/jira/browse/SPARK-32000 Project

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Description: SPARK-31765 upgraded HtmlUnit due to a security reason and Selenium was also

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Summary: Specify the version of ChromeDriver and RemoteWebDriver which can work with guava

[jira] [Updated] (SPARK-31996) Specify the version of chrome-driver and remote-driver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Description: SPARK-31765 upgraded HtmlUnit due to a security reason and Selenium was also

[jira] [Updated] (SPARK-31996) Specify the version of chrome-driver and remote-driver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Summary: Specify the version of chrome-driver and remote-driver which can work with guava

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver and RemoteDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Description: SPARK-31765 upgraded HtmlUnit due to a security reason and Selenium was also

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver and RemoteDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Summary: Specify the version of ChromeDriver and RemoteDriver which can work with guava

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Description: SPARK-31765 upgraded HtmlUnit due to a security reason and Selenium was also

[jira] [Created] (SPARK-31996) Specify the version of ChromeDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31996: -- Summary: Specify the version of ChromeDriver which can work with guava 14.0.1 Key: SPARK-31996 URL: https://issues.apache.org/jira/browse/SPARK-31996 Project

[jira] [Updated] (SPARK-31983) Tables of structured streaming tab show wrong result for duration column

2020-06-14 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31983: --- Fix Version/s: 3.0.1 > Tables of structured streaming tab show wrong result for durat

[jira] [Commented] (SPARK-31983) Tables of structured streaming tab show wrong result for duration column

2020-06-14 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135323#comment-17135323 ] Kousuke Saruta commented on SPARK-31983: Resolved for 3.0 by [https://github.com/apache/spark

[jira] [Updated] (SPARK-31971) Add pagination support for all jobs timeline

2020-06-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31971: --- Description: If there are lots of jobs, rendering performance of all jobs timeline can

[jira] [Updated] (SPARK-31971) Add pagination support for all jobs timeline

2020-06-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31971: --- Description: If there are lots of jobs, rendering performance of all jobs timeline can

[jira] [Created] (SPARK-31971) Add pagination support for all jobs timeline

2020-06-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31971: -- Summary: Add pagination support for all jobs timeline Key: SPARK-31971 URL: https://issues.apache.org/jira/browse/SPARK-31971 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133109#comment-17133109 ] Kousuke Saruta edited comment on SPARK-31967 at 6/11/20, 9:51 AM

[jira] [Commented] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133109#comment-17133109 ] Kousuke Saruta commented on SPARK-31967: For now, I'm considering a solution like StagePage does

[jira] [Commented] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133049#comment-17133049 ] Kousuke Saruta commented on SPARK-31967: This issue can be related. [https://github.com/visjs

[jira] [Commented] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133039#comment-17133039 ] Kousuke Saruta commented on SPARK-31967: I'll investigate. > Loading jobs UI page takes

[jira] [Updated] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31941: --- Fix Version/s: 2.4.7 3.1.0 3.0.1 > Handl

[jira] [Commented] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130373#comment-17130373 ] Kousuke Saruta commented on SPARK-31941: Fixed in https://github.com/apache/spark/pull/28768

[jira] [Updated] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31941: --- Affects Version/s: 3.0.0 2.4.6 > Handling the exception in Spar

[jira] [Resolved] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-31941. Resolution: Fixed > Handling the exception in SparkUI for getSparkUser met

[jira] [Assigned] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-31941: -- Assignee: Saurabh Chawla > Handling the exception in SparkUI for getSparkUser met

[jira] [Issue Comment Deleted] (SPARK-30119) Support pagination for spark streaming tab

2020-06-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-30119: --- Comment: was deleted (was: This issue is resolved in https://github.com/apache/spark/pull

[jira] [Reopened] (SPARK-30119) Support pagination for spark streaming tab

2020-06-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reopened SPARK-30119: > Support pagination for spark streaming

[jira] [Resolved] (SPARK-30119) Support pagination for spark streaming tab

2020-06-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-30119. Fix Version/s: 3.1.0 Resolution: Fixed This issue is resolved in https

[jira] [Assigned] (SPARK-30119) Support pagination for spark streaming tab

2020-06-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-30119: -- Assignee: Rakesh Raushan > Support pagination for spark streaming

[jira] [Created] (SPARK-31886) Fix the wrong coloring of nodes in DAG-viz

2020-06-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31886: -- Summary: Fix the wrong coloring of nodes in DAG-viz Key: SPARK-31886 URL: https://issues.apache.org/jira/browse/SPARK-31886 Project: Spark Issue Type

[jira] [Updated] (SPARK-31882) DAG-viz is not rendered correctly with pagination.

2020-05-31 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31882: --- Description: Because DAG-viz for a job fetches link urls for each stage from the stage

[jira] [Created] (SPARK-31882) DAG-viz is not rendered correctly with pagination.

2020-05-31 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31882: -- Summary: DAG-viz is not rendered correctly with pagination. Key: SPARK-31882 URL: https://issues.apache.org/jira/browse/SPARK-31882 Project: Spark Issue

Re: Build time limit in PR builder

2020-05-28 Thread Kousuke Saruta
Thanks all. It's very helpful! - Kousuke On 2020/05/29 3:31, shane knapp ☠ wrote: https://github.com/apache/spark/pull/28666 On Thu, May 28, 2020 at 11:20 AM shane knapp ☠ mailto:skn...@berkeley.edu>> wrote: i'll get a PR put together now. On Thu, May 28, 2020 at 8:26 AM Hyukjin

[jira] [Comment Edited] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118242#comment-17118242 ] Kousuke Saruta edited comment on SPARK-31764 at 5/28/20, 2:34 AM

[jira] [Comment Edited] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118242#comment-17118242 ] Kousuke Saruta edited comment on SPARK-31764 at 5/28/20, 2:34 AM

[jira] [Comment Edited] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118242#comment-17118242 ] Kousuke Saruta edited comment on SPARK-31764 at 5/28/20, 2:33 AM

[jira] [Updated] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31764: --- Issue Type: Bug (was: Improvement) > JsonProtocol doesn't write RDDInfo#isBarr

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118242#comment-17118242 ] Kousuke Saruta commented on SPARK-31764: As you say, it's more proper to mark the label &quo

[jira] [Resolved] (SPARK-31642) Support pagination for spark structured streaming tab

2020-05-23 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-31642. Fix Version/s: 3.1.0 Assignee: Rakesh Raushan Resolution: Fixed > Supp

[jira] [Created] (SPARK-31804) Add real headless browser support for HistoryServer tests

2020-05-23 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31804: -- Summary: Add real headless browser support for HistoryServer tests Key: SPARK-31804 URL: https://issues.apache.org/jira/browse/SPARK-31804 Project: Spark

[jira] [Created] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

2020-05-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31765: -- Summary: Upgrade HtmlUnit >= 2.37.0 Key: SPARK-31765 URL: https://issues.apache.org/jira/browse/SPARK-31765 Project: Spark Issue Type: Improvem

[jira] [Created] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31764: -- Summary: JsonProtocol doesn't write RDDInfo#isBarrier Key: SPARK-31764 URL: https://issues.apache.org/jira/browse/SPARK-31764 Project: Spark Issue Type

[jira] [Updated] (SPARK-31756) Add real headless browser support for UI test

2020-05-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31756: --- Description: In the current master, there are two problems for UI test. 1. Lots of tests

[jira] [Updated] (SPARK-31756) Add real headless browser support for UI test

2020-05-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31756: --- Description: In the current master, there are two problems for UI test. 1. Lots of tests

<    2   3   4   5   6   7   8   9   10   11   >