[jira] [Commented] (SPARK-11085) Add support for HTTP proxy

2016-02-10 Thread Prosper Burq (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140906#comment-15140906 ] Prosper Burq commented on SPARK-11085: -- Hi, Is this problem still unresolved ? I tried several

[jira] [Created] (SPARK-13266) Python DataFrameReader converts None to "None" instead of null

2016-02-10 Thread mathieu longtin (JIRA)
mathieu longtin created SPARK-13266: --- Summary: Python DataFrameReader converts None to "None" instead of null Key: SPARK-13266 URL: https://issues.apache.org/jira/browse/SPARK-13266 Project: Spark

[jira] [Updated] (SPARK-13268) SQL Timestamp stored as GMT but toString returns GMT-08:00

2016-02-10 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Ganelin updated SPARK-13268: - Description: There is an issue with how timestamps are displayed/converted to Strings in Spark

[jira] [Created] (SPARK-13268) SQL Timestamp stored as GMT but toString returns GMT-08:00

2016-02-10 Thread Ilya Ganelin (JIRA)
Ilya Ganelin created SPARK-13268: Summary: SQL Timestamp stored as GMT but toString returns GMT-08:00 Key: SPARK-13268 URL: https://issues.apache.org/jira/browse/SPARK-13268 Project: Spark

[jira] [Created] (SPARK-13267) Document ?params for the v1 REST API

2016-02-10 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-13267: -- Summary: Document ?params for the v1 REST API Key: SPARK-13267 URL: https://issues.apache.org/jira/browse/SPARK-13267 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-13267) Document ?params for the v1 REST API

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13267: Assignee: (was: Apache Spark) > Document ?params for the v1 REST API >

[jira] [Assigned] (SPARK-13267) Document ?params for the v1 REST API

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13267: Assignee: Apache Spark > Document ?params for the v1 REST API >

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

2016-02-10 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141243#comment-15141243 ] Evan Chan commented on SPARK-12449: --- [~rxin] I agree with [~stephank85] and others that this would be a

[jira] [Updated] (SPARK-13268) SQL Timestamp stored as GMT but toString returns GMT-08:00

2016-02-10 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Ganelin updated SPARK-13268: - Description: There is an issue with how timestamps are displayed/converted to Strings in Spark

[jira] [Commented] (SPARK-13267) Document ?params for the v1 REST API

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141104#comment-15141104 ] Apache Spark commented on SPARK-13267: -- User 'steveloughran' has created a pull request for this

[jira] [Commented] (SPARK-13253) Error aliasing array columns.

2016-02-10 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141252#comment-15141252 ] kevin yu commented on SPARK-13253: -- I can recreate the problem, I am looking at it now > Error aliasing

[jira] [Assigned] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12705: Assignee: Davies Liu (was: Apache Spark) > Sorting column can't be resolved if it's not

[jira] [Reopened] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-02-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-12705: Assignee: Davies Liu (was: Xiao Li) The Q98 is still can't be analyzed, I will send a PR to fix

[jira] [Commented] (SPARK-13174) Add API and options for csv data sources

2016-02-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141438#comment-15141438 ] Davies Liu commented on SPARK-13174: [~GayathriMurali] Yes, there is a way, but it's not as good as

[jira] [Resolved] (SPARK-5095) Support launching multiple mesos executors in coarse grained mesos mode

2016-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-5095. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Support launching

[jira] [Commented] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141387#comment-15141387 ] Apache Spark commented on SPARK-12705: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12705: Assignee: Apache Spark (was: Davies Liu) > Sorting column can't be resolved if it's not

[jira] [Resolved] (SPARK-13254) Fix planning of TakeOrderedAndProject operator

2016-02-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13254. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11145

[jira] [Commented] (SPARK-13061) Error in spark rest api application info for job names contains spaces

2016-02-10 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141340#comment-15141340 ] Devaraj K commented on SPARK-13061: --- You have mentioned the id as 'Spark shell' in the issue

[jira] [Updated] (SPARK-13269) Expose more executor stats in stable status API

2016-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13269: -- Issue Type: Improvement (was: Bug) > Expose more executor stats in stable status API >

[jira] [Created] (SPARK-13269) Expose more executor stats in stable status API

2016-02-10 Thread Andrew Or (JIRA)
Andrew Or created SPARK-13269: - Summary: Expose more executor stats in stable status API Key: SPARK-13269 URL: https://issues.apache.org/jira/browse/SPARK-13269 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13270) Improve readability of whole stage codegen by skipping empty lines and outputting the pipeline plan

2016-02-10 Thread Nong Li (JIRA)
Nong Li created SPARK-13270: --- Summary: Improve readability of whole stage codegen by skipping empty lines and outputting the pipeline plan Key: SPARK-13270 URL: https://issues.apache.org/jira/browse/SPARK-13270

[jira] [Commented] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141520#comment-15141520 ] Apache Spark commented on SPARK-13054: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Created] (SPARK-13273) Improve test coverage of CatalystQl

2016-02-10 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13273: - Summary: Improve test coverage of CatalystQl Key: SPARK-13273 URL: https://issues.apache.org/jira/browse/SPARK-13273 Project: Spark Issue Type:

[jira] [Created] (SPARK-13274) Fix Aggregator Links on GroupedDataset Scala API

2016-02-10 Thread Raela Wang (JIRA)
Raela Wang created SPARK-13274: -- Summary: Fix Aggregator Links on GroupedDataset Scala API Key: SPARK-13274 URL: https://issues.apache.org/jira/browse/SPARK-13274 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-13274) Fix Aggregator Links on GroupedDataset Scala API

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13274: Assignee: (was: Apache Spark) > Fix Aggregator Links on GroupedDataset Scala API >

[jira] [Assigned] (SPARK-13271) Better error message if 'path' is not specified

2016-02-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-13271: Assignee: Shixiong Zhu > Better error message if 'path' is not specified >

[jira] [Commented] (SPARK-13274) Fix Aggregator Links on GroupedDataset Scala API

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141656#comment-15141656 ] Apache Spark commented on SPARK-13274: -- User 'raelawang' has created a pull request for this issue:

[jira] [Commented] (SPARK-13271) Better error message if 'path' is not specified

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141552#comment-15141552 ] Apache Spark commented on SPARK-13271: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13271) Better error message if 'path' is not specified

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13271: Assignee: (was: Apache Spark) > Better error message if 'path' is not specified >

[jira] [Assigned] (SPARK-13271) Better error message if 'path' is not specified

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13271: Assignee: Apache Spark > Better error message if 'path' is not specified >

[jira] [Resolved] (SPARK-13163) Column width on new History Server DataTables not getting set correctly

2016-02-10 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-13163. --- Resolution: Fixed Fix Version/s: 2.0.0 > Column width on new History Server

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2016-02-10 Thread Oscar Boykin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141589#comment-15141589 ] Oscar Boykin commented on SPARK-11416: -- Related issue:

[jira] [Updated] (SPARK-13126) History Server page always has horizontal scrollbar

2016-02-10 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-13126: -- Assignee: Zhuo Liu > History Server page always has horizontal scrollbar >

[jira] [Created] (SPARK-13275) With dynamic allocation, executors appear to be added before job starts

2016-02-10 Thread Stephanie Bodoff (JIRA)
Stephanie Bodoff created SPARK-13275: Summary: With dynamic allocation, executors appear to be added before job starts Key: SPARK-13275 URL: https://issues.apache.org/jira/browse/SPARK-13275

[jira] [Updated] (SPARK-13275) With dynamic allocation, executors appear to be added before job starts

2016-02-10 Thread Stephanie Bodoff (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephanie Bodoff updated SPARK-13275: - Attachment: webui.png > With dynamic allocation, executors appear to be added before job

[jira] [Commented] (SPARK-11714) Make Spark on Mesos honor port restrictions

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141653#comment-15141653 ] Apache Spark commented on SPARK-11714: -- User 'skonto' has created a pull request for this issue:

[jira] [Created] (SPARK-13271) Better error message if 'path' is not specified

2016-02-10 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-13271: Summary: Better error message if 'path' is not specified Key: SPARK-13271 URL: https://issues.apache.org/jira/browse/SPARK-13271 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13270) Improve readability of whole stage codegen by skipping empty lines and outputting the pipeline plan

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141571#comment-15141571 ] Apache Spark commented on SPARK-13270: -- User 'nongli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13270) Improve readability of whole stage codegen by skipping empty lines and outputting the pipeline plan

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13270: Assignee: (was: Apache Spark) > Improve readability of whole stage codegen by

[jira] [Assigned] (SPARK-13270) Improve readability of whole stage codegen by skipping empty lines and outputting the pipeline plan

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13270: Assignee: Apache Spark > Improve readability of whole stage codegen by skipping empty

[jira] [Updated] (SPARK-13271) Better error message if 'path' is not specified

2016-02-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13271: - Component/s: SQL > Better error message if 'path' is not specified >

[jira] [Updated] (SPARK-13271) Better error message if 'path' is not specified

2016-02-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13271: - Issue Type: Improvement (was: Bug) > Better error message if 'path' is not specified >

[jira] [Resolved] (SPARK-13126) History Server page always has horizontal scrollbar

2016-02-10 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-13126. --- Resolution: Fixed Fix Version/s: 2.0.0 > History Server page always has horizontal

[jira] [Resolved] (SPARK-13057) Add benchmark codes and the performance results for implemented compression schemes for InMemoryRelation

2016-02-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13057. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.0.0 > Add

[jira] [Resolved] (SPARK-12414) Remove closure serializer

2016-02-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12414. - Resolution: Fixed Assignee: Sean Owen (was: Andrew Or) Fix Version/s: 2.0.0 >

[jira] [Created] (SPARK-13272) Clean-up CatalystQl

2016-02-10 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13272: - Summary: Clean-up CatalystQl Key: SPARK-13272 URL: https://issues.apache.org/jira/browse/SPARK-13272 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13274) Fix Aggregator Links on GroupedDataset Scala API

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141607#comment-15141607 ] Apache Spark commented on SPARK-13274: -- User 'raelawang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13274) Fix Aggregator Links on GroupedDataset Scala API

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13274: Assignee: Apache Spark > Fix Aggregator Links on GroupedDataset Scala API >

[jira] [Commented] (SPARK-13266) Python DataFrameReader converts None to "None" instead of null

2016-02-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141619#comment-15141619 ] Shixiong Zhu commented on SPARK-13266: -- Could you submit a PR? > Python DataFrameReader converts

[jira] [Created] (SPARK-13276) Parse Table Identifiers/Expression skips bad characters at the end of the passed string

2016-02-10 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13276: - Summary: Parse Table Identifiers/Expression skips bad characters at the end of the passed string Key: SPARK-13276 URL: https://issues.apache.org/jira/browse/SPARK-13276

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2016-02-10 Thread Ignacio tartavull (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141761#comment-15141761 ] Ignacio tartavull commented on SPARK-3789: -- Is there any update in the status of this ticket? >

[jira] [Commented] (SPARK-9438) restarting leader zookeeper causes spark master to die when the spark master election is assigned to zookeeper

2016-02-10 Thread Thomas Demoor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141835#comment-15141835 ] Thomas Demoor commented on SPARK-9438: -- We have witnessed this as well in 1.3. Losing the ZK leader

[jira] [Assigned] (SPARK-13278) Launcher fails to start with JDK 9 EA

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13278: Assignee: (was: Apache Spark) > Launcher fails to start with JDK 9 EA >

[jira] [Assigned] (SPARK-13278) Launcher fails to start with JDK 9 EA

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13278: Assignee: Apache Spark > Launcher fails to start with JDK 9 EA >

[jira] [Commented] (SPARK-13278) Launcher fails to start with JDK 9 EA

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141868#comment-15141868 ] Apache Spark commented on SPARK-13278: -- User 'cl4es' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13276) Parse Table Identifiers/Expression skips bad characters at the end of the passed string

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13276: Assignee: (was: Apache Spark) > Parse Table Identifiers/Expression skips bad

[jira] [Assigned] (SPARK-13276) Parse Table Identifiers/Expression skips bad characters at the end of the passed string

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13276: Assignee: Apache Spark > Parse Table Identifiers/Expression skips bad characters at the

[jira] [Commented] (SPARK-13276) Parse Table Identifiers/Expression skips bad characters at the end of the passed string

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141733#comment-15141733 ] Apache Spark commented on SPARK-13276: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Updated] (SPARK-13056) Map column would throw NPE if value is null

2016-02-10 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-13056: - Assignee: Adrian Wang > Map column would throw NPE if value is null >

[jira] [Resolved] (SPARK-13056) Map column would throw NPE if value is null

2016-02-10 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-13056. -- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 [~marmbrus]

[jira] [Created] (SPARK-13277) ANTLR ignores other rule using the USING keyword

2016-02-10 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13277: - Summary: ANTLR ignores other rule using the USING keyword Key: SPARK-13277 URL: https://issues.apache.org/jira/browse/SPARK-13277 Project: Spark

[jira] [Created] (SPARK-13278) Launcher fails to start with JDK 9 EA

2016-02-10 Thread Claes Redestad (JIRA)
Claes Redestad created SPARK-13278: -- Summary: Launcher fails to start with JDK 9 EA Key: SPARK-13278 URL: https://issues.apache.org/jira/browse/SPARK-13278 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13262) cannot coerce type 'environment' to vector of type 'list'

2016-02-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141877#comment-15141877 ] Shivaram Venkataraman commented on SPARK-13262: --- Can you paste the code you ran that led to

[jira] [Created] (SPARK-13279) Spark driver stuck holding a global lock when there are 200k tasks submitted in a stage

2016-02-10 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-13279: --- Summary: Spark driver stuck holding a global lock when there are 200k tasks submitted in a stage Key: SPARK-13279 URL: https://issues.apache.org/jira/browse/SPARK-13279

[jira] [Updated] (SPARK-13279) Spark driver stuck holding a global lock when there are 200k tasks submitted in a stage

2016-02-10 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-13279: Description: While running a large pipeline with 200k tasks, we found that the executors were not

[jira] [Resolved] (SPARK-13276) Parse Table Identifiers/Expression skips bad characters at the end of the passed string

2016-02-10 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-13276. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-12706) support grouping/grouping_id function together group set

2016-02-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12706. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10677

[jira] [Commented] (SPARK-13268) SQL Timestamp stored as GMT but toString returns GMT-08:00

2016-02-10 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15142267#comment-15142267 ] Jayadevan M commented on SPARK-13268: - @Ilya Ganelin Can you tell how you import ZonedDateTime in

[jira] [Commented] (SPARK-13279) Spark driver stuck holding a global lock when there are 200k tasks submitted in a stage

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15142286#comment-15142286 ] Apache Spark commented on SPARK-13279: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13279) Spark driver stuck holding a global lock when there are 200k tasks submitted in a stage

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13279: Assignee: (was: Apache Spark) > Spark driver stuck holding a global lock when there

[jira] [Assigned] (SPARK-13279) Spark driver stuck holding a global lock when there are 200k tasks submitted in a stage

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13279: Assignee: Apache Spark > Spark driver stuck holding a global lock when there are 200k

[jira] [Resolved] (SPARK-13234) Remove duplicated SQL metrics

2016-02-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13234. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11163

[jira] [Assigned] (SPARK-13277) ANTLR ignores other rule using the USING keyword

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13277: Assignee: (was: Apache Spark) > ANTLR ignores other rule using the USING keyword >

[jira] [Assigned] (SPARK-13277) ANTLR ignores other rule using the USING keyword

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13277: Assignee: Apache Spark > ANTLR ignores other rule using the USING keyword >

[jira] [Resolved] (SPARK-13270) Improve readability of whole stage codegen by skipping empty lines and outputting the pipeline plan

2016-02-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13270. - Resolution: Fixed Assignee: Nong Li Fix Version/s: 2.0.0 > Improve readability

[jira] [Commented] (SPARK-13061) Error in spark rest api application info for job names contains spaces

2016-02-10 Thread Avihoo Mamka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15142318#comment-15142318 ] Avihoo Mamka commented on SPARK-13061: -- I'm executing this request using Python requests {code:xml}

[jira] [Resolved] (SPARK-13235) Remove an Extra Distinct in Union

2016-02-10 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-13235. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Remove an

[jira] [Updated] (SPARK-13279) Spark driver stuck holding a global lock when there are 200k tasks submitted in a stage

2016-02-10 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-13279: Description: While running a large pipeline with 200k tasks, we found that the executors were not

[jira] [Updated] (SPARK-13279) Spark driver stuck holding a global lock when there are 200k tasks submitted in a stage

2016-02-10 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-13279: Description: While running a large pipeline with 200k tasks, we found that the executors were not

[jira] [Commented] (SPARK-13260) count(*) does not work with CSV data source

2016-02-10 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15142295#comment-15142295 ] Thomas Sebastian commented on SPARK-13260: -- HI [~falaki] Could you give more details about this

[jira] [Created] (SPARK-13281) Switch broadcast of RDD to exception from warning

2016-02-10 Thread holdenk (JIRA)
holdenk created SPARK-13281: --- Summary: Switch broadcast of RDD to exception from warning Key: SPARK-13281 URL: https://issues.apache.org/jira/browse/SPARK-13281 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11565) replace deprecated DigestUtils.shaHex call

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11565: -- Assignee: Gabor Liptak > replace deprecated DigestUtils.shaHex call >

[jira] [Resolved] (SPARK-11565) replace deprecated DigestUtils.shaHex call

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11565. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9532

[jira] [Updated] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11518: -- Assignee: Jon Maurer > The script spark-submit.cmd can not handle spark directory with space. >

[jira] [Resolved] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11518. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10789

[jira] [Commented] (SPARK-12846) Follow up SPARK-12707, Update documentation and other related code

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140645#comment-15140645 ] Sean Owen commented on SPARK-12846: --- [~zjffdu] can you elaborate on this or close it? > Follow up

[jira] [Commented] (SPARK-13061) Error in spark rest api application info for job names contains spaces

2016-02-10 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140601#comment-15140601 ] Devaraj K commented on SPARK-13061: --- [~avihoo], I am trying to reproduce the issue but I see the id

[jira] [Resolved] (SPARK-13203) Add scalastyle rule banning use of mutable.SynchronizedBuffer

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13203. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11134

[jira] [Commented] (SPARK-13061) Error in spark rest api application info for job names contains spaces

2016-02-10 Thread Avihoo Mamka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140610#comment-15140610 ] Avihoo Mamka commented on SPARK-13061: -- First thing I do is to get the applications running (that is

[jira] [Commented] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

2016-02-10 Thread Tsai Li Ming (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140623#comment-15140623 ] Tsai Li Ming commented on SPARK-3220: - I built Derrick's kmeans against Spark 1.6.0 and ran {code}

[jira] [Updated] (SPARK-13203) Add scalastyle rule banning use of mutable.SynchronizedBuffer

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13203: -- Assignee: Ted Yu > Add scalastyle rule banning use of mutable.SynchronizedBuffer >

[jira] [Updated] (SPARK-13203) Add scalastyle rule banning use of mutable.SynchronizedBuffer

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13203: -- Priority: Trivial (was: Minor) > Add scalastyle rule banning use of mutable.SynchronizedBuffer >

[jira] [Comment Edited] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

2016-02-10 Thread Tsai Li Ming (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140623#comment-15140623 ] Tsai Li Ming edited comment on SPARK-3220 at 2/10/16 11:01 AM: --- I built

[jira] [Resolved] (SPARK-9307) Logging: Make it either stable or private[spark]

2016-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9307. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11103

[jira] [Assigned] (SPARK-12414) Remove closure serializer

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12414: Assignee: Andrew Or (was: Apache Spark) > Remove closure serializer >

[jira] [Assigned] (SPARK-12414) Remove closure serializer

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12414: Assignee: Apache Spark (was: Andrew Or) > Remove closure serializer >

[jira] [Created] (SPARK-13265) Refactoring of basic ML import/export for other file system besides HDFS

2016-02-10 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-13265: --- Summary: Refactoring of basic ML import/export for other file system besides HDFS Key: SPARK-13265 URL: https://issues.apache.org/jira/browse/SPARK-13265 Project:

[jira] [Updated] (SPARK-13265) Refactoring of basic ML import/export for other file system besides HDFS

2016-02-10 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-13265: Description: We can't save a model into other file system besides HDFS, for example Amazon S3.

[jira] [Commented] (SPARK-12414) Remove closure serializer

2016-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140696#comment-15140696 ] Apache Spark commented on SPARK-12414: -- User 'srowen' has created a pull request for this issue:

  1   2   >