[jira] [Resolved] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13890. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove some internal classes' dependency on SQLCo

[jira] [Commented] (SPARK-10840) SparkSQL doesn't work well with JSON

2016-03-14 Thread Jordan Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194820#comment-15194820 ] Jordan Sarraf commented on SPARK-10840: --- Sounds logical. Got the point. Thanks for

[jira] [Updated] (SPARK-13207) _SUCCESS should not break partition discovery

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13207: Fix Version/s: 1.6.2 > _SUCCESS should not break partition discovery >

[jira] [Assigned] (SPARK-13892) remove useless lateral view handling

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13892: Assignee: Apache Spark > remove useless lateral view handling > --

[jira] [Commented] (SPARK-13892) remove useless lateral view handling

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194795#comment-15194795 ] Apache Spark commented on SPARK-13892: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-13892) remove useless lateral view handling

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13892: Assignee: (was: Apache Spark) > remove useless lateral view handling > ---

[jira] [Created] (SPARK-13892) remove useless lateral view handling

2016-03-14 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-13892: --- Summary: remove useless lateral view handling Key: SPARK-13892 URL: https://issues.apache.org/jira/browse/SPARK-13892 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-13870) Add scalastyle escaping correctly in CVSSuite.scala

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13870. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > Add scalastyle e

[jira] [Resolved] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13888. - Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 > Remove Streaming

[jira] [Resolved] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13884. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove DescribeCommand's dependency on LogicalPla

[jira] [Assigned] (SPARK-13891) Issue an exception when hitting max iteration limit in testing

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13891: Assignee: (was: Apache Spark) > Issue an exception when hitting max iteration limit in

[jira] [Commented] (SPARK-13891) Issue an exception when hitting max iteration limit in testing

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194761#comment-15194761 ] Apache Spark commented on SPARK-13891: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-13891) Issue an exception when hitting max iteration limit in testing

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13891: Assignee: Apache Spark > Issue an exception when hitting max iteration limit in testing >

[jira] [Created] (SPARK-13891) Issue an exception when hitting max iteration limit in testing

2016-03-14 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13891: --- Summary: Issue an exception when hitting max iteration limit in testing Key: SPARK-13891 URL: https://issues.apache.org/jira/browse/SPARK-13891 Project: Spark Issue T

[jira] [Commented] (SPARK-13034) PySpark ml.classification support export/import

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194746#comment-15194746 ] Apache Spark commented on SPARK-13034: -- User 'GayathriMurali' has created a pull req

[jira] [Resolved] (SPARK-13353) Fast serialization for collecting DataFrame

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13353. - Resolution: Fixed Assignee: Davies Liu Fix Version/s: 2.0.0 > Fast serialization

[jira] [Resolved] (SPARK-13661) Avoid the copy of UnsafeRow in HashedRelation

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13661. - Resolution: Fixed Assignee: Davies Liu Fix Version/s: 2.0.0 > Avoid the copy of U

[jira] [Assigned] (SPARK-13889) Integer overflow when calculating the max number of executor failure

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13889: Assignee: Apache Spark > Integer overflow when calculating the max number of executor fail

[jira] [Commented] (SPARK-13889) Integer overflow when calculating the max number of executor failure

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194737#comment-15194737 ] Apache Spark commented on SPARK-13889: -- User 'carsonwang' has created a pull request

[jira] [Assigned] (SPARK-13889) Integer overflow when calculating the max number of executor failure

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13889: Assignee: (was: Apache Spark) > Integer overflow when calculating the max number of ex

[jira] [Commented] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194735#comment-15194735 ] Apache Spark commented on SPARK-13890: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13890: Assignee: Apache Spark (was: Reynold Xin) > Remove some internal classes' dependency on S

[jira] [Assigned] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13890: Assignee: Reynold Xin (was: Apache Spark) > Remove some internal classes' dependency on S

[jira] [Commented] (SPARK-13712) Add OneVsOne to ML

2016-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194734#comment-15194734 ] Joseph K. Bradley commented on SPARK-13712: --- Hm, my understanding is that ECOC-

[jira] [Created] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13890: --- Summary: Remove some internal classes' dependency on SQLContext Key: SPARK-13890 URL: https://issues.apache.org/jira/browse/SPARK-13890 Project: Spark Issue Ty

[jira] [Commented] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194731#comment-15194731 ] Apache Spark commented on SPARK-13888: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13888: Assignee: Apache Spark > Remove Streaming Akka docs from Spark > -

[jira] [Assigned] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13888: Assignee: (was: Apache Spark) > Remove Streaming Akka docs from Spark > --

[jira] [Created] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-13888: Summary: Remove Streaming Akka docs from Spark Key: SPARK-13888 URL: https://issues.apache.org/jira/browse/SPARK-13888 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13889) Integer overflow when calculating the max number of executor failure

2016-03-14 Thread Carson Wang (JIRA)
Carson Wang created SPARK-13889: --- Summary: Integer overflow when calculating the max number of executor failure Key: SPARK-13889 URL: https://issues.apache.org/jira/browse/SPARK-13889 Project: Spark

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is ArrayTyp

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is ArrayTyp

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is ArrayTyp

[jira] [Commented] (SPARK-5433) Spark EC2 doesn't mount local disks for all instance types

2016-03-14 Thread Geet Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194722#comment-15194722 ] Geet Kumar commented on SPARK-5433: --- The spark-ec2 script does not mount disks for the d

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is ArrayTyp

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is ArrayTyp

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is ArrayTyp

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is ArrayTyp

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is ArrayTyp

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL One of them is ArrayType(

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL One of them is ArrayType(

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL One of them is ArrayType(

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL One of them is ArrayType(

[jira] [Created] (SPARK-13887) PyLint should fail fast to make errors easier to discover

2016-03-14 Thread holdenk (JIRA)
holdenk created SPARK-13887: --- Summary: PyLint should fail fast to make errors easier to discover Key: SPARK-13887 URL: https://issues.apache.org/jira/browse/SPARK-13887 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-13887) PyLint should fail fast to make errors easier to discover

2016-03-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-13887: Component/s: PySpark Build > PyLint should fail fast to make errors easier to discover > -

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Summary: ArrayType of BinaryType not supported in Row.equals method (was: Binary Type ) > Ar

[jira] [Created] (SPARK-13886) Binary Type

2016-03-14 Thread MahmoudHanafy (JIRA)
MahmoudHanafy created SPARK-13886: - Summary: Binary Type Key: SPARK-13886 URL: https://issues.apache.org/jira/browse/SPARK-13886 Project: Spark Issue Type: Bug Components: SQL

[jira] [Created] (SPARK-13885) Spark On Yarn attempt id representation regression

2016-03-14 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-13885: --- Summary: Spark On Yarn attempt id representation regression Key: SPARK-13885 URL: https://issues.apache.org/jira/browse/SPARK-13885 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

2016-03-14 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194665#comment-15194665 ] KaiXinXIaoLei commented on SPARK-13102: --- I just use F12 to debug, and the error inf

[jira] [Commented] (SPARK-13877) Consider removing Kafka modules from Spark / Spark Streaming

2016-03-14 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194653#comment-15194653 ] Saisai Shao commented on SPARK-13877: - I agreed to move this out, so it could easily

[jira] [Commented] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194647#comment-15194647 ] Apache Spark commented on SPARK-13884: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13884: Assignee: Apache Spark (was: Reynold Xin) > Remove DescribeCommand's dependency on Logica

[jira] [Assigned] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13884: Assignee: Reynold Xin (was: Apache Spark) > Remove DescribeCommand's dependency on Logica

[jira] [Created] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13884: --- Summary: Remove DescribeCommand's dependency on LogicalPlan Key: SPARK-13884 URL: https://issues.apache.org/jira/browse/SPARK-13884 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13034) PySpark ml.classification support export/import

2016-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13034: -- Shepherd: Joseph K. Bradley Target Version/s: 2.0.0 > PySpark ml.classifica

[jira] [Assigned] (SPARK-13883) buildReader implementation for parquet

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13883: Assignee: Michael Armbrust (was: Apache Spark) > buildReader implementation for parquet >

[jira] [Commented] (SPARK-13883) buildReader implementation for parquet

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194638#comment-15194638 ] Apache Spark commented on SPARK-13883: -- User 'marmbrus' has created a pull request f

[jira] [Assigned] (SPARK-13883) buildReader implementation for parquet

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13883: Assignee: Apache Spark (was: Michael Armbrust) > buildReader implementation for parquet >

[jira] [Created] (SPARK-13883) buildReader implementation for parquet

2016-03-14 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-13883: Summary: buildReader implementation for parquet Key: SPARK-13883 URL: https://issues.apache.org/jira/browse/SPARK-13883 Project: Spark Issue Type: Su

[jira] [Resolved] (SPARK-13791) Add MetadataLog and HDFSMetadataLog

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13791. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11625 [htt

[jira] [Updated] (SPARK-10380) Confusing examples in pyspark SQL docs

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10380: - Assignee: Reynold Xin > Confusing examples in pyspark SQL docs >

[jira] [Resolved] (SPARK-10380) Confusing examples in pyspark SQL docs

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10380. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11698 [htt

[jira] [Resolved] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13882. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove org.apache.spark.sql.execution.local > ---

[jira] [Resolved] (SPARK-11826) Subtract BlockMatrix

2016-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11826. --- Resolution: Fixed Fix Version/s: 2.0.0 > Subtract BlockMatrix > --

[jira] [Resolved] (SPARK-13664) Simplify and Speedup HadoopFSRelation

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13664. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11646 [htt

[jira] [Updated] (SPARK-13877) Consider removing Kafka modules from Spark / Spark Streaming

2016-03-14 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-13877: -- Summary: Consider removing Kafka modules from Spark / Spark Streaming (was: Consider removing Kafka mo

[jira] [Updated] (SPARK-13877) Consider removing Kafka modules from Spark

2016-03-14 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-13877: -- Component/s: Streaming > Consider removing Kafka modules from Spark > -

[jira] [Issue Comment Deleted] (SPARK-13712) Add OneVsOne to ML

2016-03-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-13712: - Comment: was deleted (was: OK, I have closed the PR. I had also planned to implement ECC after th

[jira] [Commented] (SPARK-13712) Add OneVsOne to ML

2016-03-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194554#comment-15194554 ] zhengruifeng commented on SPARK-13712: -- OK, I have closed the PR. I had also planned

[jira] [Commented] (SPARK-13712) Add OneVsOne to ML

2016-03-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194555#comment-15194555 ] zhengruifeng commented on SPARK-13712: -- OK, I have closed the PR. I had also planned

[jira] [Assigned] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13118: Assignee: (was: Apache Spark) > Support for classes defined in package objects > -

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194479#comment-15194479 ] Apache Spark commented on SPARK-13118: -- User 'jodersky' has created a pull request f

[jira] [Assigned] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13118: Assignee: Apache Spark > Support for classes defined in package objects >

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194465#comment-15194465 ] Jakob Odersky commented on SPARK-13118: --- Sure, I'll submit a PR with the test > Su

[jira] [Updated] (SPARK-12718) SQL generation support for window functions

2016-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12718: --- Assignee: Wenchen Fan (was: Xiao Li) > SQL generation support for window functions > ---

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194436#comment-15194436 ] Michael Armbrust commented on SPARK-13118: -- Its likely that we have fixed this w

[jira] [Updated] (SPARK-13244) Unify DataFrame and Dataset API

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13244: Issue Type: Sub-task (was: Improvement) Parent: SPARK-13485 > Unify DataFrame and Dataset

[jira] [Updated] (SPARK-13843) Move streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13843: Summary: Move streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter

[jira] [Resolved] (SPARK-13843) Remove streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13843. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove streaming-flume, streaming-mqtt, streaming

[jira] [Commented] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194404#comment-15194404 ] Apache Spark commented on SPARK-13882: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13882: Assignee: Reynold Xin (was: Apache Spark) > Remove org.apache.spark.sql.execution.local >

[jira] [Assigned] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13882: Assignee: Apache Spark (was: Reynold Xin) > Remove org.apache.spark.sql.execution.local >

[jira] [Created] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13882: --- Summary: Remove org.apache.spark.sql.execution.local Key: SPARK-13882 URL: https://issues.apache.org/jira/browse/SPARK-13882 Project: Spark Issue Type: Improve

[jira] [Assigned] (SPARK-13880) Rename DataFrame.scala as Dataset.scala

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13880: Assignee: Reynold Xin (was: Apache Spark) > Rename DataFrame.scala as Dataset.scala > ---

[jira] [Assigned] (SPARK-13881) Remove LegacyFunctions

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13881: Assignee: Apache Spark (was: Reynold Xin) > Remove LegacyFunctions >

[jira] [Assigned] (SPARK-13881) Remove LegacyFunctions

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13881: Assignee: Reynold Xin (was: Apache Spark) > Remove LegacyFunctions >

[jira] [Assigned] (SPARK-13880) Rename DataFrame.scala as Dataset.scala

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13880: Assignee: Apache Spark (was: Reynold Xin) > Rename DataFrame.scala as Dataset.scala > ---

[jira] [Commented] (SPARK-13880) Rename DataFrame.scala as Dataset.scala

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194396#comment-15194396 ] Apache Spark commented on SPARK-13880: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-13881) Remove LegacyFunctions

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194397#comment-15194397 ] Apache Spark commented on SPARK-13881: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-13881) Remove LegacyFunctions

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13881: --- Summary: Remove LegacyFunctions Key: SPARK-13881 URL: https://issues.apache.org/jira/browse/SPARK-13881 Project: Spark Issue Type: Sub-task Component

[jira] [Created] (SPARK-13880) Rename DataFrame.scala as Dataset.scala

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13880: --- Summary: Rename DataFrame.scala as Dataset.scala Key: SPARK-13880 URL: https://issues.apache.org/jira/browse/SPARK-13880 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-13879) Decide DDL/DML commands that need Spark native implementation in 2.0

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13879: Summary: Decide DDL/DML commands that need Spark native implementation in 2.0 (was: Decide command

[jira] [Commented] (SPARK-13879) Decide commands that need Spark native implementation in 2.0

2016-03-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194382#comment-15194382 ] Yin Huai commented on SPARK-13879: -- Just uploaded the initial doc (https://issues.apach

[jira] [Closed] (SPARK-13854) Add constraints to outer join

2016-03-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-13854. --- Resolution: Not A Problem > Add constraints to outer join > - > >

[jira] [Updated] (SPARK-13879) Decide commands that need Spark native implementation in 2.0

2016-03-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13879: - Attachment: Implementing native DDL and DML statements for Spark 2.pdf > Decide commands that need Spark

[jira] [Updated] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13859: Description: Testing Spark SQL using TPC queries. Query 38 returns wrong results compared to offic

[jira] [Updated] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13858: Description: Testing Spark SQL using TPC queries. Query 21 returns wrong results compared to offic

[jira] [Created] (SPARK-13879) Decide commands that need Spark native implementation in 2.0

2016-03-14 Thread Yin Huai (JIRA)
Yin Huai created SPARK-13879: Summary: Decide commands that need Spark native implementation in 2.0 Key: SPARK-13879 URL: https://issues.apache.org/jira/browse/SPARK-13879 Project: Spark Issue T

[jira] [Updated] (SPARK-13879) Decide commands that need Spark native implementation in 2.0

2016-03-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13879: - Target Version/s: 2.0.0 > Decide commands that need Spark native implementation in 2.0 >

[jira] [Updated] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13861: Description: Testing Spark SQL using TPC queries. Query 40 returns wrong results compared to offic

  1   2   3   4   >