[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

2017-12-14 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290964#comment-16290964 ] Attila Zsolt Piros commented on SPARK-22359: I would like to join and take the subtask

[jira] [Commented] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-18 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294869#comment-16294869 ] Attila Zsolt Piros commented on SPARK-22806: Thanks! In this case within SPARK-22362 I will

[jira] [Commented] (SPARK-22362) Add unit test for Window Aggregate Functions

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292902#comment-16292902 ] Attila Zsolt Piros commented on SPARK-22362: I am working on this subtask. > Add unit test

[jira] [Created] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-22806: -- Summary: Window Aggregate functions: unexpected result at ordered partition Key: SPARK-22806 URL: https://issues.apache.org/jira/browse/SPARK-22806

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Attachment: WindowFunctionsWithGroupByError.scala Test to reproduce the error >

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Comment Edited] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292995#comment-16292995 ] Attila Zsolt Piros edited comment on SPARK-22806 at 12/15/17 6:38 PM:

[jira] [Updated] (SPARK-22806) Window Aggregate functions: unexpected result at ordered partition

2017-12-15 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22806: --- Description: I got different results for aggregate functions (even for sum and

[jira] [Commented] (SPARK-19181) SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short.

2018-05-08 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467137#comment-16467137 ] Attila Zsolt Piros commented on SPARK-19181: I am working on this. >

[jira] [Commented] (SPARK-19526) Spark should raise an exception when it tries to read a Hive view but it doesn't have read access on the corresponding table(s)

2018-06-07 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504827#comment-16504827 ] Attila Zsolt Piros commented on SPARK-19526: I started working on this issue. > Spark

[jira] [Commented] (SPARK-24578) Reading remote cache block behavior changes and causes timeout issue

2018-06-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517416#comment-16517416 ] Attila Zsolt Piros commented on SPARK-24578: I have written a small test I know it is a bit 

[jira] [Commented] (SPARK-24578) Reading remote cache block behavior changes and causes timeout issue

2018-06-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517287#comment-16517287 ] Attila Zsolt Piros commented on SPARK-24578: The copyByteBuf() along with transferTo() is

[jira] [Commented] (SPARK-24578) Reading remote cache block behavior changes and causes timeout issue

2018-06-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517452#comment-16517452 ] Attila Zsolt Piros commented on SPARK-24578: [~wbzhao] Yes, you are right, readerIndex is

[jira] [Commented] (SPARK-24578) Reading remote cache block behavior changes and causes timeout issue

2018-06-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517515#comment-16517515 ] Attila Zsolt Piros commented on SPARK-24578: [~wbzhao] oh sorry I read your comment late,

[jira] [Comment Edited] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-09 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318408#comment-16318408 ] Attila Zsolt Piros edited comment on SPARK-22577 at 1/9/18 2:14 PM:

[jira] [Updated] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-11 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22577: --- Attachment: app_blacklisting.png > executor page blacklist status should update with

[jira] [Updated] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-09 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22577: --- Attachment: stage_blacklisting.png Uploading screenshot where stage level

[jira] [Comment Edited] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-09 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318408#comment-16318408 ] Attila Zsolt Piros edited comment on SPARK-22577 at 1/9/18 1:40 PM:

[jira] [Updated] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22577: --- Attachment: node_blacklisting_for_stage.png > executor page blacklist status should

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-23 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335609#comment-16335609 ] Attila Zsolt Piros commented on SPARK-23189: I am working on this issue. > reflect stage

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

2018-01-23 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335623#comment-16335623 ] Attila Zsolt Piros commented on SPARK-22915: If nobody is working on this currently I would

[jira] [Created] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-23 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-23189: -- Summary: reflect stage level blacklisting on executor tab Key: SPARK-23189 URL: https://issues.apache.org/jira/browse/SPARK-23189 Project: Spark

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-23 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335769#comment-16335769 ] Attila Zsolt Piros commented on SPARK-23189: In case of listing only the active stages only I

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages_3.png multiple_stages_2.png

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_2.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages_2.png > reflect stage level blacklisting on executor tab

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages_3.png > reflect stage level blacklisting on executor tab

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-26 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_3.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages.png > reflect stage level blacklisting on executor tab

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339510#comment-16339510 ] Attila Zsolt Piros commented on SPARK-23189: I have introduced a new attribute for live

[jira] [Comment Edited] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339389#comment-16339389 ] Attila Zsolt Piros edited comment on SPARK-23189 at 1/25/18 3:38 PM: -

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: afterStageCompleted.png backlisted.png > reflect stage

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-25 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339389#comment-16339389 ] Attila Zsolt Piros commented on SPARK-23189: I have uploaded some images about the very first

[jira] [Issue Comment Deleted] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23055: --- Comment: was deleted (was: At failure the query status is: {code:javascript}

[jira] [Commented] (SPARK-23235) Add executor Threaddump to api

2018-01-29 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343184#comment-16343184 ] Attila Zsolt Piros commented on SPARK-23235: I am working on this issue. Is it ok to extend

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_1.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_2.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: (was: multiple_stages_3.png) > reflect stage level blacklisting on

[jira] [Updated] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23189: --- Attachment: multiple_stages_3.png multiple_stages_2.png

[jira] [Commented] (SPARK-20659) Remove StorageStatus, or make it private.

2018-02-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354191#comment-16354191 ] Attila Zsolt Piros commented on SPARK-20659: I would like to take this issue. > Remove

[jira] [Commented] (SPARK-20659) Remove StorageStatus, or make it private.

2018-02-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354430#comment-16354430 ] Attila Zsolt Piros commented on SPARK-20659: [~vanzin] I would like to ask a few questions: -

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Description: Start spark as: {code:bash} $ bin/spark-shell --master

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Attachment: Storage_Tab.png > Storage info's Cached Partitions doesn't consider the

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Attachment: Spark_2.4.0-SNAPSHOT.png Spark_2.2.1.png > Storage

[jira] [Created] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-23394: -- Summary: Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does) Key: SPARK-23394 URL:

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Attachment: Screen Shot 2018-02-12 at 11.24.22.png > Storage info's Cached

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Description: Start spark as: {code:bash} $ bin/spark-shell --master

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Description: Start spark as: {code:bash} $ bin/spark-shell --master

[jira] [Updated] (SPARK-23394) Storage info's Cached Partitions doesn't consider the replications (but sc.getRDDStorageInfo does)

2018-02-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23394: --- Attachment: (was: Screen Shot 2018-02-12 at 11.24.22.png) > Storage info's

[jira] [Created] (SPARK-23413) Sorting tasks by Host / Executor ID on the Stage page does not work

2018-02-13 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-23413: -- Summary: Sorting tasks by Host / Executor ID on the Stage page does not work Key: SPARK-23413 URL: https://issues.apache.org/jira/browse/SPARK-23413

[jira] [Updated] (SPARK-23413) Sorting tasks by Host / Executor ID on the Stage page does not work

2018-02-13 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23413: --- Description: Sorting tasks by Host / Executor ID throws exceptions:  {code}

[jira] [Commented] (SPARK-23413) Sorting tasks by Host / Executor ID on the Stage page does not work

2018-02-13 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362513#comment-16362513 ] Attila Zsolt Piros commented on SPARK-23413: I am working on that. > Sorting tasks by Host /

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-28 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305643#comment-16305643 ] Attila Zsolt Piros commented on SPARK-22577: I started working on this issue > executor page

[jira] [Created] (SPARK-24594) Introduce metrics for YARN executor allocation problems

2018-06-19 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-24594: -- Summary: Introduce metrics for YARN executor allocation problems Key: SPARK-24594 URL: https://issues.apache.org/jira/browse/SPARK-24594 Project: Spark

[jira] [Commented] (SPARK-24594) Introduce metrics for YARN executor allocation problems

2018-06-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517028#comment-16517028 ] Attila Zsolt Piros commented on SPARK-24594: I am working on this. > Introduce metrics for

[jira] [Updated] (SPARK-24594) Introduce metrics for YARN executor allocation problems

2018-06-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-24594: --- Description: Within SPARK-16630 it come up to introduce metrics for YARN executor

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323978#comment-16323978 ] Attila Zsolt Piros commented on SPARK-23055: At failure the query status is: ``` status: {

[jira] [Comment Edited] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323978#comment-16323978 ] Attila Zsolt Piros edited comment on SPARK-23055 at 1/12/18 1:58 PM: -

[jira] [Commented] (SPARK-23189) reflect stage level blacklisting on executor tab

2018-01-23 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336372#comment-16336372 ] Attila Zsolt Piros commented on SPARK-23189: [~tgraves] I see so only active stages are

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

2018-02-27 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378987#comment-16378987 ] Attila Zsolt Piros commented on SPARK-22915: I am also very close to a PR. > ML test for

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

2018-02-27 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379056#comment-16379056 ] Attila Zsolt Piros commented on SPARK-22915: Thank you as I have already a lot of work in it.

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-03-08 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391649#comment-16391649 ] Attila Zsolt Piros commented on SPARK-16630: I am working on this issue. > Blacklist a node

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16428721#comment-16428721 ] Attila Zsolt Piros commented on SPARK-16630: Yes you are right more executors can be

[jira] [Comment Edited] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-10 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432165#comment-16432165 ] Attila Zsolt Piros edited comment on SPARK-16630 at 4/10/18 12:15 PM:

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-10 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432165#comment-16432165 ] Attila Zsolt Piros commented on SPARK-16630: I have question regarding limiting the number of

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-10 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432415#comment-16432415 ] Attila Zsolt Piros commented on SPARK-16630: I would need the expiry times to choose the most

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-10 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432495#comment-16432495 ] Attila Zsolt Piros commented on SPARK-16630: Let me illustrate my problem with an example: -

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-05 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427123#comment-16427123 ] Attila Zsolt Piros commented on SPARK-16630: [~irashid] I would reuse

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-05 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427181#comment-16427181 ] Attila Zsolt Piros commented on SPARK-16630: [~tgraves] what about stopping YARN backlisting

[jira] [Updated] (SPARK-23728) ML test with expected exceptions testing streaming fails on 2.3

2018-03-17 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23728: --- Summary: ML test with expected exceptions testing streaming fails on 2.3 (was: ML

[jira] [Commented] (SPARK-23728) ML test with expected exceptions via streaming fails on 2.3

2018-03-17 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403850#comment-16403850 ] Attila Zsolt Piros commented on SPARK-23728: I am soon creating a PR. > ML test with

[jira] [Created] (SPARK-23728) ML test with expected exceptions via streaming fails on 2.3

2018-03-17 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-23728: -- Summary: ML test with expected exceptions via streaming fails on 2.3 Key: SPARK-23728 URL: https://issues.apache.org/jira/browse/SPARK-23728 Project:

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-03-05 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386789#comment-16386789 ] Attila Zsolt Piros commented on SPARK-16630: I have checked the existing sources and I would

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-03-05 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387071#comment-16387071 ] Attila Zsolt Piros commented on SPARK-16630: Of course we can consider

[jira] [Created] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2018-11-10 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-26002: -- Summary: SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01 Key: SPARK-26002 URL: https://issues.apache.org/jira/browse/SPARK-26002

[jira] [Commented] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2018-11-10 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682404#comment-16682404 ] Attila Zsolt Piros commented on SPARK-26002: I am already working on a fix. > SQL date

[jira] [Commented] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

2019-01-14 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742243#comment-16742243 ] Attila Zsolt Piros commented on SPARK-26615: I am working on it (soon a PR will be created)

[jira] [Created] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

2019-01-14 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-26615: -- Summary: Fixing transport server/client resource leaks in the core unittests Key: SPARK-26615 URL: https://issues.apache.org/jira/browse/SPARK-26615

[jira] [Updated] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

2019-01-14 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26615: --- Affects Version/s: 3.0.0 > Fixing transport server/client resource leaks in the

[jira] [Created] (SPARK-26688) Provide configuration of initially blacklisted YARN nodes

2019-01-22 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-26688: -- Summary: Provide configuration of initially blacklisted YARN nodes Key: SPARK-26688 URL: https://issues.apache.org/jira/browse/SPARK-26688 Project: Spark

[jira] [Commented] (SPARK-26688) Provide configuration of initially blacklisted YARN nodes

2019-01-22 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748632#comment-16748632 ] Attila Zsolt Piros commented on SPARK-26688: I am working on this. > Provide configuration

[jira] [Updated] (SPARK-26688) Provide configuration of initially blacklisted YARN nodes

2019-01-22 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26688: --- Description: Introducing new config for initially blacklisted YARN nodes. This

[jira] [Commented] (SPARK-24920) Spark should allow sharing netty's memory pools across all uses

2018-12-10 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715040#comment-16715040 ] Attila Zsolt Piros commented on SPARK-24920: I started to work on it. I would keep a

[jira] [Comment Edited] (SPARK-24920) Spark should allow sharing netty's memory pools across all uses

2018-12-10 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715040#comment-16715040 ] Attila Zsolt Piros edited comment on SPARK-24920 at 12/10/18 4:39 PM:

[jira] [Created] (SPARK-26232) Remove old Netty3 artifact from the build

2018-11-30 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-26232: -- Summary: Remove old Netty3 artifact from the build Key: SPARK-26232 URL: https://issues.apache.org/jira/browse/SPARK-26232 Project: Spark Issue

[jira] [Updated] (SPARK-26232) Remove old Netty3 dependency from the build

2018-11-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26232: --- Summary: Remove old Netty3 dependency from the build (was: Remove old Netty3

[jira] [Resolved] (SPARK-26232) Remove old Netty3 dependency from the build

2018-11-30 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-26232. Resolution: Won't Fix One of the third party tool uses Netty3, so as a transitive

[jira] [Updated] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-20 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26118: --- Issue Type: New Feature (was: Bug) > Make Jetty's requestHeaderSize configurable

[jira] [Updated] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-20 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26118: --- Issue Type: Bug (was: Improvement) > Make Jetty's requestHeaderSize configurable

[jira] [Created] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-19 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-26118: -- Summary: Make Jetty's requestHeaderSize configurable in Spark Key: SPARK-26118 URL: https://issues.apache.org/jira/browse/SPARK-26118 Project: Spark

[jira] [Commented] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692018#comment-16692018 ] Attila Zsolt Piros commented on SPARK-26118: I am working on a PR. > Make Jetty's

[jira] [Updated] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26118: --- Affects Version/s: (was: 2.3.2) (was: 2.4.0)

[jira] [Commented] (SPARK-26688) Provide configuration of initially blacklisted YARN nodes

2019-01-22 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748922#comment-16748922 ] Attila Zsolt Piros commented on SPARK-26688: As I know a node only could have one label. So

[jira] [Updated] (SPARK-27021) Netty related thread leaks ()

2019-03-01 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27021: --- Summary: Netty related thread leaks () (was: Netty related thread leaks) > Netty

[jira] [Updated] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

2019-03-01 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27021: --- Summary: Leaking Netty event loop group for shuffle chunk fetch requests (was:

[jira] [Updated] (SPARK-27021) Netty related thread leaks (event loop group for shuffle chunk fetch requests)

2019-03-01 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27021: --- Summary: Netty related thread leaks (event loop group for shuffle chunk fetch

[jira] [Commented] (SPARK-27021) Netty related thread leaks

2019-03-01 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781707#comment-16781707 ] Attila Zsolt Piros commented on SPARK-27021: I am already working on it. > Netty related

  1   2   3   4   >