[jira] [Resolved] (SPARK-27770) Add aggregates.sql - Part1

2019-05-23 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-27770. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24640 [https://gi

[jira] [Commented] (SPARK-21492) Memory leak in SortMergeJoin

2019-05-20 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844313#comment-16844313 ] Xingbo Jiang commented on SPARK-21492: -- I'm working on this, will post a simple des

[jira] [Commented] (SPARK-27520) Introduce a global config system to replace hadoopConfiguration

2019-05-09 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16836750#comment-16836750 ] Xingbo Jiang commented on SPARK-27520: -- The major problem of `SparkContext.hadoopCo

[jira] [Resolved] (SPARK-27510) Master fall into dead loop while launching executor failed in Worker

2019-05-03 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-27510. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24408 [https://gi

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2019-04-30 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830770#comment-16830770 ] Xingbo Jiang commented on SPARK-18406: -- This problem still exists in PythonRunner,

[jira] [Commented] (SPARK-27520) Introduce a global config system to replace hadoopConfiguration

2019-04-19 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821805#comment-16821805 ] Xingbo Jiang commented on SPARK-27520: -- cc [~Ngone51] Would you like to pick up thi

[jira] [Created] (SPARK-27520) Introduce a global config system to replace hadoopConfiguration

2019-04-19 Thread Xingbo Jiang (JIRA)
Xingbo Jiang created SPARK-27520: Summary: Introduce a global config system to replace hadoopConfiguration Key: SPARK-27520 URL: https://issues.apache.org/jira/browse/SPARK-27520 Project: Spark

[jira] [Commented] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-03-04 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783550#comment-16783550 ] Xingbo Jiang commented on SPARK-27005: -- I updated the above document, so the Spark

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-03-04 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 3/4/19 4:44 PM:

[jira] [Created] (SPARK-27024) Design executor interface to support GPU resources

2019-03-01 Thread Xingbo Jiang (JIRA)
Xingbo Jiang created SPARK-27024: Summary: Design executor interface to support GPU resources Key: SPARK-27024 URL: https://issues.apache.org/jira/browse/SPARK-27024 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-02-27 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 2/27/19 4:50 PM: ---

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-02-27 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 2/27/19 4:49 PM: ---

[jira] [Updated] (SPARK-24615) Accelerator-aware task scheduling for Spark

2019-02-27 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-24615: - Epic Name: Support GPU Scheduling > Accelerator-aware task scheduling for Spark > --

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-02-27 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 2/27/19 4:48 PM: ---

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-02-27 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 2/27/19 4:48 PM: ---

[jira] [Commented] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-02-27 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779503#comment-16779503 ] Xingbo Jiang commented on SPARK-27005: -- *API Changes [draft pending design discussi

[jira] [Created] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-02-27 Thread Xingbo Jiang (JIRA)
Xingbo Jiang created SPARK-27005: Summary: Design sketch: Accelerator-aware scheduling Key: SPARK-27005 URL: https://issues.apache.org/jira/browse/SPARK-27005 Project: Spark Issue Type: Story

[jira] [Updated] (SPARK-24615) Accelerator-aware task scheduling for Spark

2019-02-27 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-24615: - Issue Type: Epic (was: Improvement) > Accelerator-aware task scheduling for Spark > ---

[jira] [Comment Edited] (SPARK-24615) Accelerator-aware task scheduling for Spark

2019-02-26 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778026#comment-16778026 ] Xingbo Jiang edited comment on SPARK-24615 at 2/26/19 3:07 PM: ---

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

2019-02-26 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778026#comment-16778026 ] Xingbo Jiang commented on SPARK-24615: -- I updated the SPIP and Product docs, please

[jira] [Resolved] (SPARK-25901) Barrier mode spawns a bunch of threads that get collected on gc

2018-11-02 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-25901. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22912 [https://gi

[jira] [Resolved] (SPARK-25845) Fix MatchError for calendar interval type in rangeBetween

2018-10-28 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-25845. -- Resolution: Fixed Fix Version/s: 3.0.0 Resolved by https://github.com/apache/spark/pull

<    1   2