[jira] [Commented] (SPARK-9876) Upgrade parquet-mr to 1.8.1

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305766#comment-15305766 ] Apache Spark commented on SPARK-9876: - User 'HyukjinKwon' has created a pull request for this issue:

[jira] [Commented] (SPARK-14507) Decide if we should still support CREATE EXTERNAL TABLE AS SELECT

2016-05-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305752#comment-15305752 ] Yin Huai commented on SPARK-14507: -- Actually, for a CREATE TABLE USING AS SELECT command, we do not

[jira] [Updated] (SPARK-15604) Spark-SQL: Get com.esotericsoftware.kryo.KryoException: java.lang.NullPointerException when runing query_1.sql of TPC-DS

2016-05-28 Thread wenjing wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wenjing wang updated SPARK-15604: - Attachment: 4_2.png 4_1.png 3_2.png 3_1.png

[jira] [Commented] (SPARK-13207) _SUCCESS should not break partition discovery

2016-05-28 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305703#comment-15305703 ] Simeon Simeonov commented on SPARK-13207: - [~yhuai] I see the same problem with common metadata

[jira] [Assigned] (SPARK-15646) When spark.sql.hive.convertCTAS is true, we may still convert the table to a parquet table when TEXTFILE or SEQUENCEFILE is specified.

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15646: Assignee: Apache Spark > When spark.sql.hive.convertCTAS is true, we may still convert

[jira] [Commented] (SPARK-14507) Decide if we should still support CREATE EXTERNAL TABLE AS SELECT

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305694#comment-15305694 ] Apache Spark commented on SPARK-14507: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-15646) When spark.sql.hive.convertCTAS is true, we may still convert the table to a parquet table when TEXTFILE or SEQUENCEFILE is specified.

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305695#comment-15305695 ] Apache Spark commented on SPARK-15646: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15646) When spark.sql.hive.convertCTAS is true, we may still convert the table to a parquet table when TEXTFILE or SEQUENCEFILE is specified.

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15646: Assignee: (was: Apache Spark) > When spark.sql.hive.convertCTAS is true, we may still

[jira] [Created] (SPARK-15646) When spark.sql.hive.convertCTAS is true, we may still convert the table to a parquet table when TEXTFILE or SEQUENCEFILE is specified.

2016-05-28 Thread Yin Huai (JIRA)
Yin Huai created SPARK-15646: Summary: When spark.sql.hive.convertCTAS is true, we may still convert the table to a parquet table when TEXTFILE or SEQUENCEFILE is specified. Key: SPARK-15646 URL:

[jira] [Commented] (SPARK-14507) Decide if we should still support CREATE EXTERNAL TABLE AS SELECT

2016-05-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305689#comment-15305689 ] Yin Huai commented on SPARK-14507: -- Yea. For Spark SQL, as long as the user provides a location, we will

[jira] [Commented] (SPARK-14507) Decide if we should still support CREATE EXTERNAL TABLE AS SELECT

2016-05-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305690#comment-15305690 ] Yin Huai commented on SPARK-14507: -- I am making EXTERNAL keyword optional when a location is provided.

[jira] [Assigned] (SPARK-15645) Fix some typos of Streaming module

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15645: Assignee: (was: Apache Spark) > Fix some typos of Streaming module >

[jira] [Commented] (SPARK-15645) Fix some typos of Streaming module

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305685#comment-15305685 ] Apache Spark commented on SPARK-15645: -- User 'keypointt' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15645) Fix some typos of Streaming module

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15645: Assignee: Apache Spark > Fix some typos of Streaming module >

[jira] [Created] (SPARK-15645) Fix some typos of Streaming module

2016-05-28 Thread Xin Ren (JIRA)
Xin Ren created SPARK-15645: --- Summary: Fix some typos of Streaming module Key: SPARK-15645 URL: https://issues.apache.org/jira/browse/SPARK-15645 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14507) Decide if we should still support CREATE EXTERNAL TABLE AS SELECT

2016-05-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-14507: Assignee: Yin Huai > Decide if we should still support CREATE EXTERNAL TABLE AS SELECT >

[jira] [Commented] (SPARK-12169) SparkR 2.0

2016-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305665#comment-15305665 ] Shivaram Venkataraman commented on SPARK-12169: --- I think the SparkSession R API is the only

[jira] [Commented] (SPARK-15598) Change Aggregator.zero to Aggregator.init

2016-05-28 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305651#comment-15305651 ] koert kuipers commented on SPARK-15598: --- how will change this impact usage like this: {noformat}

[jira] [Comment Edited] (SPARK-15598) Change Aggregator.zero to Aggregator.init

2016-05-28 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305651#comment-15305651 ] koert kuipers edited comment on SPARK-15598 at 5/28/16 9:54 PM: how would

[jira] [Updated] (SPARK-15549) Disable bucketing when the output doesn't contain all bucketing columns

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15549: -- Assignee: Yadong Qi > Disable bucketing when the output doesn't contain all bucketing columns >

[jira] [Commented] (SPARK-12169) SparkR 2.0

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305647#comment-15305647 ] Sean Owen commented on SPARK-12169: --- Are the remaining issues really for 2.0? or can the umbrella be

[jira] [Updated] (SPARK-15643) ML 2.0 QA: migration guide update

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15643: -- Target Version/s: 2.0.0 > ML 2.0 QA: migration guide update > - > >

[jira] [Updated] (SPARK-15643) ML 2.0 QA: migration guide update

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15643: -- Priority: Blocker (was: Minor) I'm assuming any issue whose purpose is to get something done before a

[jira] [Resolved] (SPARK-15636) Make aggregate expressions more concise in explain

2016-05-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15636. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13367

[jira] [Commented] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305535#comment-15305535 ] Apache Spark commented on SPARK-5581: - User 'dafrista' has created a pull request for this issue:

[jira] [Assigned] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5581: --- Assignee: Apache Spark > When writing sorted map output file, avoid open / close between

[jira] [Assigned] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5581: --- Assignee: (was: Apache Spark) > When writing sorted map output file, avoid open / close

[jira] [Updated] (SPARK-15637) SparkR tests failing on R 3.2.2

2016-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15637: -- Assignee: Felix Cheung > SparkR tests failing on R 3.2.2 >

[jira] [Resolved] (SPARK-15637) SparkR tests failing on R 3.2.2

2016-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15637. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Assigned] (SPARK-15608) Add document for ML IsotonicRegression

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15608: Assignee: Apache Spark > Add document for ML IsotonicRegression >

[jira] [Commented] (SPARK-15608) Add document for ML IsotonicRegression

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305504#comment-15305504 ] Apache Spark commented on SPARK-15608: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-15608) Add document for ML IsotonicRegression

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15608: Assignee: (was: Apache Spark) > Add document for ML IsotonicRegression >

[jira] [Updated] (SPARK-15549) Disable bucketing when the output doesn't contain all bucketing columns

2016-05-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15549: Assignee: (was: Yadong Qi) > Disable bucketing when the output doesn't contain all bucketing

[jira] [Updated] (SPARK-15549) Disable bucketing when the output doesn't contain all bucketing columns

2016-05-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15549: Assignee: Yadong Qi > Disable bucketing when the output doesn't contain all bucketing columns >

[jira] [Resolved] (SPARK-15549) Disable bucketing when the output doesn't contain all bucketing columns

2016-05-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15549. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13321

[jira] [Assigned] (SPARK-15644) Replace SQLContext with SparkSession in MLlib

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15644: Assignee: Apache Spark > Replace SQLContext with SparkSession in MLlib >

[jira] [Assigned] (SPARK-15644) Replace SQLContext with SparkSession in MLlib

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15644: Assignee: (was: Apache Spark) > Replace SQLContext with SparkSession in MLlib >

[jira] [Commented] (SPARK-15644) Replace SQLContext with SparkSession in MLlib

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305437#comment-15305437 ] Apache Spark commented on SPARK-15644: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Updated] (SPARK-15644) Replace SQLContext with SparkSession in MLlib

2016-05-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15644: Description: Use the latest Sparksession to replace the existing SQLContext in MLlib (was: Replace

[jira] [Updated] (SPARK-15529) Replace SQLContext and HiveContext with SparkSession in Test

2016-05-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15529: Description: Use the latest Sparksession to replace the existing SQLContext and HiveContext in test cases.

[jira] [Created] (SPARK-15644) Replace SQLContext with SparkSession in MLlib

2016-05-28 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15644: --- Summary: Replace SQLContext with SparkSession in MLlib Key: SPARK-15644 URL: https://issues.apache.org/jira/browse/SPARK-15644 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12431) add local checkpointing to GraphX

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12431: Assignee: Apache Spark > add local checkpointing to GraphX >

[jira] [Assigned] (SPARK-12431) add local checkpointing to GraphX

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12431: Assignee: (was: Apache Spark) > add local checkpointing to GraphX >

[jira] [Commented] (SPARK-12431) add local checkpointing to GraphX

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305412#comment-15305412 ] Apache Spark commented on SPARK-12431: -- User 'adeandrade' has created a pull request for this issue:

[jira] [Commented] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305404#comment-15305404 ] Weichen Xu commented on SPARK-15640: OK, I got it, thanks! > Build mllib fail, asBreeze method not

[jira] [Commented] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-05-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305401#comment-15305401 ] Yanbo Liang commented on SPARK-13448: - Add them to the migration guide at SPARK-15643. > Document

[jira] [Updated] (SPARK-15643) ML 2.0 QA: migration guide update

2016-05-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15643: Issue Type: Improvement (was: Bug) > ML 2.0 QA: migration guide update >

[jira] [Assigned] (SPARK-15643) ML 2.0 QA: migration guide update

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15643: Assignee: (was: Apache Spark) > ML 2.0 QA: migration guide update >

[jira] [Commented] (SPARK-15643) ML 2.0 QA: migration guide update

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305397#comment-15305397 ] Apache Spark commented on SPARK-15643: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15643) ML 2.0 QA: migration guide update

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15643: Assignee: Apache Spark > ML 2.0 QA: migration guide update >

[jira] [Created] (SPARK-15643) ML 2.0 QA: migration guide update

2016-05-28 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-15643: --- Summary: ML 2.0 QA: migration guide update Key: SPARK-15643 URL: https://issues.apache.org/jira/browse/SPARK-15643 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14810) ML, Graph 2.0 QA: API: Binary incompatible changes

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14810: -- Priority: Blocker (was: Major) > ML, Graph 2.0 QA: API: Binary incompatible changes >

[jira] [Updated] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15124: -- Priority: Blocker (was: Major) > R 2.0 QA: New R APIs and API docs >

[jira] [Updated] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14816: -- Priority: Blocker (was: Major) > Update MLlib, GraphX, SparkR websites for 2.0 >

[jira] [Updated] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14817: -- Priority: Blocker (was: Major) > ML, Graph, R 2.0 QA: Programming guide update and migration guide >

[jira] [Updated] (SPARK-14811) ML, Graph 2.0 QA: API: New Scala APIs, docs

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14811: -- Priority: Blocker (was: Major) > ML, Graph 2.0 QA: API: New Scala APIs, docs >

[jira] [Updated] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14812: -- Priority: Blocker (was: Major) > ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed

[jira] [Updated] (SPARK-14808) Spark MLlib, GraphX, SparkR 2.0 QA umbrella

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14808: -- Priority: Blocker (was: Critical) > Spark MLlib, GraphX, SparkR 2.0 QA umbrella >

[jira] [Updated] (SPARK-15426) Spark 2.0 SQL API audit

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15426: -- Priority: Blocker (was: Major) > Spark 2.0 SQL API audit > --- > >

[jira] [Updated] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new features & APIs

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14815: -- Priority: Blocker (was: Major) > ML, Graph, R 2.0 QA: Update user guide for new features & APIs >

[jira] [Updated] (SPARK-14118) Implement DDL/DML commands for Spark 2.0

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14118: -- Priority: Blocker (was: Critical) > Implement DDL/DML commands for Spark 2.0 >

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13448: -- Priority: Blocker (was: Major) > Document MLlib behavior changes in Spark 2.0 >

[jira] [Updated] (SPARK-15457) Eliminate MLlib 2.0 build warnings from deprecations

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15457: -- Priority: Blocker (was: Minor) > Eliminate MLlib 2.0 build warnings from deprecations >

[jira] [Updated] (SPARK-15086) Update Java API once the Scala one is finalized

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15086: -- Priority: Blocker (was: Major) Fix Version/s: (was: 2.0.0) (I think this has to happen

[jira] [Commented] (SPARK-15641) Incorrect Completed for Incomplete applications in HistoryServer

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305339#comment-15305339 ] Sean Owen commented on SPARK-15641: --- Looks like an easy fix to formatDate in historypage.js. Return an

[jira] [Reopened] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-15640: --- That is not a workaround; it was never a Spark problem > Build mllib fail, asBreeze method not found >

[jira] [Resolved] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15640. --- Resolution: Not A Problem > Build mllib fail, asBreeze method not found >

[jira] [Closed] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu closed SPARK-15640. -- Resolution: Workaround > Build mllib fail, asBreeze method not found >

[jira] [Comment Edited] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305318#comment-15305318 ] Weichen Xu edited comment on SPARK-15640 at 5/28/16 11:45 AM: -- yeah, that's

[jira] [Commented] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305318#comment-15305318 ] Weichen Xu commented on SPARK-15640: yeah, that's right, the official mllib_local jar out-of-date, to

[jira] [Commented] (SPARK-15100) Audit: ml.feature

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305308#comment-15305308 ] Apache Spark commented on SPARK-15100: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Commented] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305297#comment-15305297 ] Yanbo Liang commented on SPARK-15640: - [~WeichenXu123] ml.linalg.Vector locates at mllib-local

[jira] [Assigned] (SPARK-13638) Support for saving with a quote mode

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13638: Assignee: (was: Apache Spark) > Support for saving with a quote mode >

[jira] [Commented] (SPARK-13638) Support for saving with a quote mode

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305277#comment-15305277 ] Apache Spark commented on SPARK-13638: -- User 'jurriaan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13638) Support for saving with a quote mode

2016-05-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13638: Assignee: Apache Spark > Support for saving with a quote mode >

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

2016-05-28 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305275#comment-15305275 ] Benjamin Fradet commented on SPARK-15581: - Thanks, we should maybe add it to the roadmap, don't

[jira] [Updated] (SPARK-15642) Metadata gets lost when selecting a field of a StructType

2016-05-28 Thread Christian Zommerfelds (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Zommerfelds updated SPARK-15642: -- Summary: Metadata gets lost when selecting a field of a StructType (was:

[jira] [Created] (SPARK-15642) Metadata gets lost when accessing a field of a StructType

2016-05-28 Thread Christian Zommerfelds (JIRA)
Christian Zommerfelds created SPARK-15642: - Summary: Metadata gets lost when accessing a field of a StructType Key: SPARK-15642 URL: https://issues.apache.org/jira/browse/SPARK-15642 Project:

[jira] [Updated] (SPARK-15642) Metadata gets lost when accessing a field of a StructType

2016-05-28 Thread Christian Zommerfelds (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Zommerfelds updated SPARK-15642: -- Issue Type: Bug (was: Improvement) > Metadata gets lost when accessing a

[jira] [Commented] (SPARK-13638) Support for saving with a quote mode

2016-05-28 Thread Jurriaan Pruis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305263#comment-15305263 ] Jurriaan Pruis commented on SPARK-13638: [~rxin] Sure! > Support for saving with a quote mode >

[jira] [Updated] (SPARK-15641) Incorrect Completed for Incomplete applications in HistoryServer

2016-05-28 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-15641: Attachment: spark-historyserver-completed-incorrect.png > Incorrect Completed for

[jira] [Created] (SPARK-15641) Incorrect Completed for Incomplete applications in HistoryServer

2016-05-28 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-15641: --- Summary: Incorrect Completed for Incomplete applications in HistoryServer Key: SPARK-15641 URL: https://issues.apache.org/jira/browse/SPARK-15641 Project:

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

2016-05-28 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305239#comment-15305239 ] zhengruifeng commented on SPARK-15581: -- In regard to gbt, xgboost4j may be involved > MLlib 2.1

[jira] [Created] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15640: -- Summary: Build mllib fail, asBreeze method not found Key: SPARK-15640 URL: https://issues.apache.org/jira/browse/SPARK-15640 Project: Spark Issue Type: Bug