[jira] [Updated] (SPARK-35746) Task id in the Stage page timeline is incorrect

[ https://issues.apache.org/jira/browse/SPARK-35746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35746: --- Attachment: image-2021-06-12-07-03-09-808.png > Task id in the Stage page timeline is incorrect >

[jira] [Updated] (SPARK-35746) Task id in the Stage page timeline is incorrect

[ https://issues.apache.org/jira/browse/SPARK-35746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35746: --- Description: !image-2021-06-12-07-03-09-808.png! (was: !image-2021-06-12-06-56-21-486.png!) > Task id in

[jira] [Created] (SPARK-35746) Task id in the Stage page timeline is incorrect

shahid created SPARK-35746: -- Summary: Task id in the Stage page timeline is incorrect Key: SPARK-35746 URL: https://issues.apache.org/jira/browse/SPARK-35746 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-35423) The output of PCA is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-35423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354810#comment-17354810 ] shahid commented on SPARK-35423: I would like to analyse this issue > The output of PCA is inconsistent

[jira] [Updated] (SPARK-35567) Explain cost is not showing statistics for all the nodes

[ https://issues.apache.org/jira/browse/SPARK-35567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35567: --- Description: Explain cost command doesn't show statistics for all the nodes in most of the TPCDS queries

[jira] [Updated] (SPARK-35567) Explain cost is not showing statistics for all the nodes

[ https://issues.apache.org/jira/browse/SPARK-35567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35567: --- Attachment: image-2021-05-31-05-09-09-637.png > Explain cost is not showing statistics for all the nodes >

[jira] [Created] (SPARK-35567) Explain cost is not showing statistics for all the nodes

shahid created SPARK-35567: -- Summary: Explain cost is not showing statistics for all the nodes Key: SPARK-35567 URL: https://issues.apache.org/jira/browse/SPARK-35567 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-22639) no rowcount estimation returned if groupby clause involves substring

[ https://issues.apache.org/jira/browse/SPARK-22639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-22639: --- Labels: (was: bulk-closed) > no rowcount estimation returned if groupby clause involves substring >

[jira] [Updated] (SPARK-22639) no rowcount estimation returned if groupby clause involves substring

[ https://issues.apache.org/jira/browse/SPARK-22639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-22639: --- Affects Version/s: 3.1.1 > no rowcount estimation returned if groupby clause involves substring >

[jira] [Reopened] (SPARK-22639) no rowcount estimation returned if groupby clause involves substring

[ https://issues.apache.org/jira/browse/SPARK-22639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid reopened SPARK-22639: This is happening with latest master as well > no rowcount estimation returned if groupby clause involves

[jira] [Resolved] (SPARK-35409) Explain spark sql plan command using show is difficult to read

[ https://issues.apache.org/jira/browse/SPARK-35409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-35409. Resolution: Won't Fix > Explain spark sql plan command using show is difficult to read >

[jira] [Updated] (SPARK-35409) Explain spark sql plan command using show is difficult to read

[ https://issues.apache.org/jira/browse/SPARK-35409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35409: --- Attachment: (was: image-2021-05-15-13-20-39-138.png) > Explain spark sql plan command using show is

[jira] [Updated] (SPARK-35409) Explain spark sql plan command using show is difficult to read

[ https://issues.apache.org/jira/browse/SPARK-35409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35409: --- Description: scala> sql("explain cost select * from store_sales").show(false)           was: scala>

[jira] [Updated] (SPARK-35409) Explain spark sql plan command using show is difficult to read

[ https://issues.apache.org/jira/browse/SPARK-35409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35409: --- Attachment: image-2021-05-15-13-20-39-138.png > Explain spark sql plan command using show is difficult to

[jira] [Updated] (SPARK-35409) Explain spark sql plan command using show is difficult to read

[ https://issues.apache.org/jira/browse/SPARK-35409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35409: --- Description: scala> sql("explain cost select * from store_sales").show(false)

[jira] [Created] (SPARK-35409) Explain spark sql plan command using show is difficult to read

shahid created SPARK-35409: -- Summary: Explain spark sql plan command using show is difficult to read Key: SPARK-35409 URL: https://issues.apache.org/jira/browse/SPARK-35409 Project: Spark Issue

[jira] [Updated] (SPARK-35409) Explain spark sql plan command using show is difficult to read

[ https://issues.apache.org/jira/browse/SPARK-35409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-35409: --- Description: scala> sql("explain cost select * from store_sales").show(false)

[jira] [Created] (SPARK-35368) [SQL]Update histogram statistics for RANGE operator stats estimation

shahid created SPARK-35368: -- Summary: [SQL]Update histogram statistics for RANGE operator stats estimation Key: SPARK-35368 URL: https://issues.apache.org/jira/browse/SPARK-35368 Project: Spark

[jira] [Comment Edited] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342171#comment-17342171 ] shahid edited comment on SPARK-35079 at 5/10/21, 10:29 PM: --- Seems It is not

[jira] [Commented] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342171#comment-17342171 ] shahid commented on SPARK-35079: Seems It is not reproducible with master branch?

[jira] [Created] (SPARK-35362) Update null count in the column stats for UNION stats estimation

shahid created SPARK-35362: -- Summary: Update null count in the column stats for UNION stats estimation Key: SPARK-35362 URL: https://issues.apache.org/jira/browse/SPARK-35362 Project: Spark Issue

[jira] [Commented] (SPARK-30092) Number of active tasks is negative in Live UI Executors page

[ https://issues.apache.org/jira/browse/SPARK-30092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987799#comment-16987799 ] shahid commented on SPARK-30092: [~zhongyu09]Do you have any steps for reproducing the issue? > Number

[jira] [Resolved] (SPARK-30068) Flaky test: org.apache.spark.sql.hive.thriftserver.ui.ThriftServerPageSuite

[ https://issues.apache.org/jira/browse/SPARK-30068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-30068. Resolution: Done > Flaky test: org.apache.spark.sql.hive.thriftserver.ui.ThriftServerPageSuite >

[jira] [Commented] (SPARK-30092) Number of active tasks is negative in UI Executors page

[ https://issues.apache.org/jira/browse/SPARK-30092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985805#comment-16985805 ] shahid commented on SPARK-30092: Is it Live UI or History UI? Also could you please check if any event

[jira] [Created] (SPARK-29902) Add listener event queue capacity configuration to documentation

shahid created SPARK-29902: -- Summary: Add listener event queue capacity configuration to documentation Key: SPARK-29902 URL: https://issues.apache.org/jira/browse/SPARK-29902 Project: Spark Issue

[jira] [Commented] (SPARK-29827) Wrong persist strategy in mllib.clustering.BisectingKMeans.run

[ https://issues.apache.org/jira/browse/SPARK-29827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971336#comment-16971336 ] shahid commented on SPARK-29827: I would like to analyze this issue > Wrong persist strategy in

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968760#comment-16968760 ] shahid commented on SPARK-29765: Event drop can also happen that if we don't provide sufficient memory.

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968737#comment-16968737 ] shahid commented on SPARK-29765: Thanks. Yes, you can try increasing

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968707#comment-16968707 ] shahid commented on SPARK-29765: Yes, then it seems some event drop has happened. Could you check the

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968652#comment-16968652 ] shahid commented on SPARK-29765: I still not sure about the root cause, as I am not able to reproduce

[jira] [Comment Edited] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968642#comment-16968642 ] shahid edited comment on SPARK-29765 at 11/6/19 7:39 PM: - Just to narrow down

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968642#comment-16968642 ] shahid commented on SPARK-29765: Just to narrow down the problem, can you please increase

[jira] [Updated] (SPARK-29588) Improvements in WebUI JDBC/ODBC server page

[ https://issues.apache.org/jira/browse/SPARK-29588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-29588: --- Priority: Major (was: Minor) > Improvements in WebUI JDBC/ODBC server page >

[jira] [Created] (SPARK-29726) Support KV store for listener HiveThriftServer2Listener

shahid created SPARK-29726: -- Summary: Support KV store for listener HiveThriftServer2Listener Key: SPARK-29726 URL: https://issues.apache.org/jira/browse/SPARK-29726 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29726) Support KV store for listener HiveThriftServer2Listener

[ https://issues.apache.org/jira/browse/SPARK-29726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965409#comment-16965409 ] shahid commented on SPARK-29726: I will raise a PR > Support KV store for listener

[jira] [Commented] (SPARK-29725) Add UT for WebUI page for JDBC/ODBC tab

[ https://issues.apache.org/jira/browse/SPARK-29725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965408#comment-16965408 ] shahid commented on SPARK-29725: I will raise a PR > Add UT for WebUI page for JDBC/ODBC tab >

[jira] [Created] (SPARK-29725) Add UT for WebUI page for JDBC/ODBC tab

shahid created SPARK-29725: -- Summary: Add UT for WebUI page for JDBC/ODBC tab Key: SPARK-29725 URL: https://issues.apache.org/jira/browse/SPARK-29725 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29724) Support JDBC/ODBC tab for HistoryServer WebUI

[ https://issues.apache.org/jira/browse/SPARK-29724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965407#comment-16965407 ] shahid commented on SPARK-29724: I will raise a PR > Support JDBC/ODBC tab for HistoryServer WebUI >

[jira] [Created] (SPARK-29724) Support JDBC/ODBC tab for HistoryServer WebUI

shahid created SPARK-29724: -- Summary: Support JDBC/ODBC tab for HistoryServer WebUI Key: SPARK-29724 URL: https://issues.apache.org/jira/browse/SPARK-29724 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29590) Support hiding table in JDBC/ODBC server page in WebUI

[ https://issues.apache.org/jira/browse/SPARK-29590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961006#comment-16961006 ] shahid commented on SPARK-29590: Hi [~hyukjin.kwon], This JIRA is similar to the JIRA

[jira] [Commented] (SPARK-29590) Support hiding table in JDBC/ODBC server page in WebUI

[ https://issues.apache.org/jira/browse/SPARK-29590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958909#comment-16958909 ] shahid commented on SPARK-29590: I will raise a PR > Support hiding table in JDBC/ODBC server page in

[jira] [Commented] (SPARK-29589) Support pagination for sql session stats table in JDBC/ODBC server page

[ https://issues.apache.org/jira/browse/SPARK-29589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958907#comment-16958907 ] shahid commented on SPARK-29589: I will raise a PR > Support pagination for sql session stats table in

[jira] [Created] (SPARK-29590) Support hiding table in JDBC/ODBC server page in WebUI

shahid created SPARK-29590: -- Summary: Support hiding table in JDBC/ODBC server page in WebUI Key: SPARK-29590 URL: https://issues.apache.org/jira/browse/SPARK-29590 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29588) Improvements in WebUI JDBC/ODBC server page

[ https://issues.apache.org/jira/browse/SPARK-29588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-29588: --- Summary: Improvements in WebUI JDBC/ODBC server page (was: Improvements in JDBC/ODBC server page) >

[jira] [Created] (SPARK-29589) Support pagination for sql session stats table in JDBC/ODBC server page

shahid created SPARK-29589: -- Summary: Support pagination for sql session stats table in JDBC/ODBC server page Key: SPARK-29589 URL: https://issues.apache.org/jira/browse/SPARK-29589 Project: Spark

[jira] [Created] (SPARK-29588) Improvements in JDBC/ODBC server page

shahid created SPARK-29588: -- Summary: Improvements in JDBC/ODBC server page Key: SPARK-29588 URL: https://issues.apache.org/jira/browse/SPARK-29588 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-29571) Fix UT in AllExecutionsPageSuite class

[ https://issues.apache.org/jira/browse/SPARK-29571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958171#comment-16958171 ] shahid commented on SPARK-29571: Could you clarify which UT is failing? > Fix UT in

[jira] [Created] (SPARK-29559) Support pagination for JDBC/ODBC UI page

shahid created SPARK-29559: -- Summary: Support pagination for JDBC/ODBC UI page Key: SPARK-29559 URL: https://issues.apache.org/jira/browse/SPARK-29559 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29235) CrossValidatorModel.avgMetrics disappears after model is written/read again

[ https://issues.apache.org/jira/browse/SPARK-29235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937427#comment-16937427 ] shahid commented on SPARK-29235: I would like to analyze the issue. > CrossValidatorModel.avgMetrics

[jira] [Commented] (SPARK-28599) Support pagination and sorting for ThriftServerPage

[ https://issues.apache.org/jira/browse/SPARK-28599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898614#comment-16898614 ] shahid commented on SPARK-28599: Thanks [~yumwang]. I will analyze this. In SQL tab, we supported

[jira] [Commented] (SPARK-25788) Elastic net penalties for GLMs

[ https://issues.apache.org/jira/browse/SPARK-25788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887874#comment-16887874 ] shahid commented on SPARK-25788: [~pralabhkumar] yeah. Please go ahead. I think I don't have enough time

[jira] [Commented] (SPARK-27802) SparkUI throws NoSuchElementException when inconsistency appears between `ExecutorStageSummaryWrapper`s and `ExecutorSummaryWrapper`s

[ https://issues.apache.org/jira/browse/SPARK-27802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872740#comment-16872740 ] shahid commented on SPARK-27802: Could you please provide a reproducible step for the issue? > SparkUI

[jira] [Commented] (SPARK-25861) Remove unused refreshInterval parameter from the headerSparkPage method.

[ https://issues.apache.org/jira/browse/SPARK-25861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835598#comment-16835598 ] shahid commented on SPARK-25861: [~drKalko]Normally Browser supports refresh page. This JIRA was for

[jira] [Commented] (SPARK-27636) Remove cached RDD blocks after PIC execution

[ https://issues.apache.org/jira/browse/SPARK-27636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833462#comment-16833462 ] shahid commented on SPARK-27636: I will raise a PR > Remove cached RDD blocks after PIC execution >

[jira] [Created] (SPARK-27636) Remove cached RDD blocks after PIC execution

shahid created SPARK-27636: -- Summary: Remove cached RDD blocks after PIC execution Key: SPARK-27636 URL: https://issues.apache.org/jira/browse/SPARK-27636 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

[ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821286#comment-16821286 ] shahid edited comment on SPARK-27068 at 4/18/19 4:31 PM: - cc [~srowen] Can we

[jira] [Commented] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

[ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821286#comment-16821286 ] shahid commented on SPARK-27068: cc [~srowen] Can we raise a PR for the issue?. The actual issue is,

[jira] [Commented] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820525#comment-16820525 ] shahid commented on SPARK-27468: [~zsxwing] Thanks > "Storage Level" in "RDD Storage Page" is not

[jira] [Commented] (SPARK-27485) Certain query plans fail to run when autoBroadcastJoinThreshold is set to -1

[ https://issues.apache.org/jira/browse/SPARK-27485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820189#comment-16820189 ] shahid commented on SPARK-27485: Could you please share test to reproduce this? > Certain query plans

[jira] [Created] (SPARK-27486) Enable History server storage information test

shahid created SPARK-27486: -- Summary: Enable History server storage information test Key: SPARK-27486 URL: https://issues.apache.org/jira/browse/SPARK-27486 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-27486) Enable History server storage information test

[ https://issues.apache.org/jira/browse/SPARK-27486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819759#comment-16819759 ] shahid commented on SPARK-27486: I will raise a PR > Enable History server storage information test >

[jira] [Commented] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819679#comment-16819679 ] shahid commented on SPARK-27468: Hi [~srfnmnk], I tried to reproduce in the master branch. The steps

[jira] [Updated] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27468: --- Attachment: Screenshot from 2019-04-17 10-42-55.png > "Storage Level" in "RDD Storage Page" is not correct

[jira] [Comment Edited] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819662#comment-16819662 ] shahid edited comment on SPARK-16859 at 4/17/19 2:07 AM: - [~Hauer] [~toopt4] Can

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819662#comment-16819662 ] shahid commented on SPARK-16859: [~Hauer][~toopt4] Can you try enabling

[jira] [Commented] (SPARK-27465) Kafka Client 0.11.0.0 is not Supporting the kafkatestutils package

[ https://issues.apache.org/jira/browse/SPARK-27465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818658#comment-16818658 ] shahid commented on SPARK-27465: I will analyze the issue. > Kafka Client 0.11.0.0 is not Supporting

[jira] [Commented] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818662#comment-16818662 ] shahid commented on SPARK-27468: I would like to analyze the issue. > "Storage Level" in "RDD Storage

[jira] [Commented] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

[ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815435#comment-16815435 ] shahid commented on SPARK-27068: Hi [~vanzin], Currently when cleaning up jobs when the UI job limit

[jira] [Commented] (SPARK-27434) memory leak in spark driver

[ https://issues.apache.org/jira/browse/SPARK-27434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815424#comment-16815424 ] shahid commented on SPARK-27434: Could you please provide steps for reproducing the issue? > memory

[jira] [Commented] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

[ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815010#comment-16815010 ] shahid commented on SPARK-27068: Already failed jobs is in a single table right?. I meant, For running

[jira] [Commented] (SPARK-20656) Incremental parsing of event logs in SHS

[ https://issues.apache.org/jira/browse/SPARK-20656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802945#comment-16802945 ] shahid commented on SPARK-20656: I would like to work on it. > Incremental parsing of event logs in

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798178#comment-16798178 ] shahid commented on SPARK-27204: Yes. actually, for loading the UI page, SHS need to replay the entire

[jira] [Updated] (SPARK-27231) Stack overflow error, when we increase the number of iteration in PIC

[ https://issues.apache.org/jira/browse/SPARK-27231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27231: --- Description: val dataset = spark.createDataFrame(Seq( (0L, 1L, 1.0), (0L, 2L, 1.0),

[jira] [Commented] (SPARK-27231) Stack overflow error, when we increase the number of iteration in PIC

[ https://issues.apache.org/jira/browse/SPARK-27231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798170#comment-16798170 ] shahid commented on SPARK-27231: I am analyzing the issue, > Stack overflow error, when we increase the

[jira] [Created] (SPARK-27231) Stack overflow error, when we increase the number of iteration in PIC

shahid created SPARK-27231: -- Summary: Stack overflow error, when we increase the number of iteration in PIC Key: SPARK-27231 URL: https://issues.apache.org/jira/browse/SPARK-27231 Project: Spark

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797888#comment-16797888 ] shahid commented on SPARK-27204: Hi @HyukjinKwon, this is still an issue after SPARK-18085. I will raise

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797066#comment-16797066 ] shahid commented on SPARK-27169: Yes. that means many event drops happens. Can you try increasing the

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797066#comment-16797066 ] shahid edited comment on SPARK-27169 at 3/20/19 11:26 AM: -- Yes. that means many

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797040#comment-16797040 ] shahid commented on SPARK-27169: Hi, It seems, from the above log we can't say that event drop has

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796110#comment-16796110 ] shahid commented on SPARK-27204: Thanks. I will analyze, > First time Loading application page from

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795878#comment-16795878 ] shahid edited comment on SPARK-27169 at 3/19/19 9:38 AM: - Thank you. Could you

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795878#comment-16795878 ] shahid commented on SPARK-27169: Thank you. Could you please provide full event log if possible? I

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794794#comment-16794794 ] shahid commented on SPARK-27169: Do you have eventlog corresponding to the application? > number of

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793675#comment-16793675 ] shahid edited comment on SPARK-27169 at 3/16/19 8:40 AM: - Seems event drop has

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793675#comment-16793675 ] shahid commented on SPARK-27169: Seems event drop has happened. > number of active tasks is negative

[jira] [Updated] (SPARK-27145) Close store after test, in the SQLAppStatusListenerSuite

[ https://issues.apache.org/jira/browse/SPARK-27145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27145: --- Summary: Close store after test, in the SQLAppStatusListenerSuite (was: Close store after test, in

[jira] [Created] (SPARK-27145) Close store after test, in SQLAppStatusListenerSuite

shahid created SPARK-27145: -- Summary: Close store after test, in SQLAppStatusListenerSuite Key: SPARK-27145 URL: https://issues.apache.org/jira/browse/SPARK-27145 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-23134. Resolution: Duplicate > WebUI is showing the cache table details even after cache idle timeout >

[jira] [Issue Comment Deleted] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-23134: --- Comment: was deleted (was: Will resolve once the Jira SPARK-27012 merged) > WebUI is showing the cache

[jira] [Reopened] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid reopened SPARK-23134: > WebUI is showing the cache table details even after cache idle timeout >

[jira] [Resolved] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-23134. Resolution: Duplicate > WebUI is showing the cache table details even after cache idle timeout >

[jira] [Reopened] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid reopened SPARK-23134: Will resolve once the Jira SPARK-27012 merged > WebUI is showing the cache table details even after cache

[jira] [Resolved] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-23134. Resolution: Duplicate > WebUI is showing the cache table details even after cache idle timeout >

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670 ] shahid edited comment on SPARK-27019 at 3/2/19 9:44 PM: seems event reordering

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781826#comment-16781826 ] shahid edited comment on SPARK-27019 at 3/1/19 4:11 PM: Yes. The issue happened

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781826#comment-16781826 ] shahid commented on SPARK-27019: Yes. The issue happened because of the event reordering when the query

[jira] [Updated] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27019: --- Attachment: Screenshot from 2019-03-01 21-31-48.png > Spark UI's SQL tab shows inconsistent values >

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670 ] shahid commented on SPARK-27019: seems event reordering has happened. Job start event came after sql

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670 ] shahid edited comment on SPARK-27019 at 3/1/19 1:33 PM: seems event reordering

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670 ] shahid edited comment on SPARK-27019 at 3/1/19 1:29 PM: seems event reordering

  1   2   3   >