[jira] [Commented] (SPARK-23413) Sorting tasks by Host / Executor ID on the Stage page does not work

2018-02-13 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362513#comment-16362513 ] Attila Zsolt Piros commented on SPARK-23413: I am working on that. > Sorting tasks by Host /

[jira] [Created] (SPARK-23413) Sorting tasks by Host / Executor ID on the Stage page does not work

2018-02-13 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-23413: -- Summary: Sorting tasks by Host / Executor ID on the Stage page does not work Key: SPARK-23413 URL: https://issues.apache.org/jira/browse/SPARK-23413

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Description: Start spark as: {code:bash} $ bin/spark-shell --master

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Description: Start spark as: {code:bash} $ bin/spark-shell --master

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Attachment: (was: Screen Shot 2018-02-12 at 11.24.22.png) > Storage info's

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Attachment: Storage_Tab.png > Storage info's Cached Partitions doesn't consider the

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Attachment: Spark_2.4.0-SNAPSHOT.png Spark_2.2.1.png > Storage

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Description: Start spark as: {code:bash} $ bin/spark-shell --master

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Attachment: Screen Shot 2018-02-12 at 11.24.22.png > Storage info's Cached

[jira] [Created] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-23394: -- Summary: Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does) Key: SPARK-23394 URL:

[jira] [Commented] (SPARK-20659) Remove StorageStatus, or make it private.

2018-02-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354430#comment-16354430 ] Attila Zsolt Piros commented on SPARK-20659: [~vanzin] I would like to ask a few questions: -

[jira] [Commented] (SPARK-20659) Remove StorageStatus, or make it private.

2018-02-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354191#comment-16354191 ] Attila Zsolt Piros commented on SPARK-20659: I would like to take this issue. > Remove

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_3.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages_3.png multiple_stages_2.png

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_1.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_2.png) > reflect stage level blacklisting on

[jira] [Commented] (SPARK-23235) Add executor Threaddump to api

2018-01-29 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343184#comment-16343184 ] Attila Zsolt Piros commented on SPARK-23235: I am working on this issue. Is it ok to extend

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_2.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages_3.png > reflect stage level blacklisting on executor tab

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_3.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages_2.png > reflect stage level blacklisting on executor tab

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages_3.png multiple_stages_2.png

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339510#comment-16339510 ] Attila Zsolt Piros commented on SPARK-23189: I have introduced a new attribute for live

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages.png > reflect stage level blacklisting on executor tab

[jira] [Comment Edited] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339389#comment-16339389 ] Attila Zsolt Piros edited comment on SPARK-23189 at 1/25/18 3:38 PM: -

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339389#comment-16339389 ] Attila Zsolt Piros commented on SPARK-23189: I have uploaded some images about the very first

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: afterStageCompleted.png backlisted.png > reflect stage

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-23 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336372#comment-16336372 ] Attila Zsolt Piros commented on SPARK-23189: [~tgraves] I see so only active stages are

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-23 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335769#comment-16335769 ] Attila Zsolt Piros commented on SPARK-23189: In case of listing only the active stages only I

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

2018-01-23 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335623#comment-16335623 ] Attila Zsolt Piros commented on SPARK-22915: If nobody is working on this currently I would

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-23 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335609#comment-16335609 ] Attila Zsolt Piros commented on SPARK-23189: I am working on this issue. > reflect stage

[jira] [Created] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-23 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-23189: -- Summary: reflect stage level blacklisting on executor tab Key: SPARK-23189 URL: https://issues.apache.org/jira/browse/SPARK-23189 Project: Spark

[jira] [Updated] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22577: --- Attachment: node_blacklisting_for_stage.png > executor page blacklist status should

[jira] [Issue Comment Deleted] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23055: --- Comment: was deleted (was: At failure the query status is: {code:javascript}

[jira] [Comment Edited] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323978#comment-16323978 ] Attila Zsolt Piros edited comment on SPARK-23055 at 1/12/18 1:58 PM: -

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323978#comment-16323978 ] Attila Zsolt Piros commented on SPARK-23055: At failure the query status is: ``` status: {

[jira] [Updated] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-11 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22577: --- Attachment: app_blacklisting.png > executor page blacklist status should update with

[jira] [Comment Edited] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-09 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318408#comment-16318408 ] Attila Zsolt Piros edited comment on SPARK-22577 at 1/9/18 2:14 PM:

[jira] [Comment Edited] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-09 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318408#comment-16318408 ] Attila Zsolt Piros edited comment on SPARK-22577 at 1/9/18 1:40 PM:

[jira] [Updated] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-09 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22577: --- Attachment: stage_blacklisting.png Uploading screenshot where stage level

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-28 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305643#comment-16305643 ] Attila Zsolt Piros commented on SPARK-22577: I started working on this issue > executor page

[jira] [Commented] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-18 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294869#comment-16294869 ] Attila Zsolt Piros commented on SPARK-22806: Thanks! In this case within SPARK-22362 I will

[jira] [Comment Edited] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292995#comment-16292995 ] Attila Zsolt Piros edited comment on SPARK-22806 at 12/15/17 6:38 PM:

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Attachment: WindowFunctionsWithGroupByError.scala Test to reproduce the error >

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Created] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-22806: -- Summary: Window Aggregate functions: unexpected result at ordered partition Key: SPARK-22806 URL: https://issues.apache.org/jira/browse/SPARK-22806

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Commented] (SPARK-22362) Add unit test for Window Aggregate Functions

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292902#comment-16292902 ] Attila Zsolt Piros commented on SPARK-22362: I am working on this subtask. > Add unit test

[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

2017-12-14 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290964#comment-16290964 ] Attila Zsolt Piros commented on SPARK-22359: I would like to join and take the subtask

<    1   2   3   4