[jira] [Commented] (SPARK-17741) Grammar to parse top level and nested data fields separately

2016-10-01 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539707#comment-15539707 ] Jiang Xingbo commented on SPARK-17741: -- I'm working on this - Perhaps we can also add more testcases

[jira] [Created] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

2016-10-01 Thread Franck Tago (JIRA)
Franck Tago created SPARK-17758: --- Summary: Spark Aggregate function LAST returns null on an empty partition Key: SPARK-17758 URL: https://issues.apache.org/jira/browse/SPARK-17758 Project: Spark

[jira] [Updated] (SPARK-17716) Hidden Markov Model (HMM)

2016-10-01 Thread Runxin Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runxin Li updated SPARK-17716: -- Description: Had an offline chat with [~Lil'Rex], who implemented HMM on Spark at

[jira] [Updated] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-10-01 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-16872: - Description: I implement Gaussian NB according to scikit-learn's {{GaussianNB}}. In GaussianNB

[jira] [Updated] (SPARK-17716) Hidden Markov Model (HMM)

2016-10-01 Thread Runxin Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runxin Li updated SPARK-17716: -- Description: Had an offline chat with [~Lil'Rex], who implemented HMM on Spark at

[jira] [Assigned] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16872: Assignee: Apache Spark (was: zhengruifeng) > Include Gaussian Naive Bayes Classifier >

[jira] [Assigned] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16872: Assignee: zhengruifeng (was: Apache Spark) > Include Gaussian Naive Bayes Classifier >

[jira] [Commented] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539581#comment-15539581 ] Apache Spark commented on SPARK-16872: -- User 'zhengruifeng' has created a pull request for this

[jira] [Updated] (SPARK-17721) Erroneous computation in multiplication of transposed SparseMatrix with SparseVector

2016-10-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-17721: -- Fix Version/s: 2.1.0 2.0.2 > Erroneous computation in

[jira] [Resolved] (SPARK-17721) Erroneous computation in multiplication of transposed SparseMatrix with SparseVector

2016-10-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-17721. --- Resolution: Fixed Fix Version/s: (was: 2.0.2) (was:

[jira] [Assigned] (SPARK-17757) Remove CreateNamedStruct expressions

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17757: Assignee: Apache Spark (was: Herman van Hovell) > Remove CreateNamedStruct expressions >

[jira] [Assigned] (SPARK-17757) Remove CreateNamedStruct expressions

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17757: Assignee: Herman van Hovell (was: Apache Spark) > Remove CreateNamedStruct expressions >

[jira] [Commented] (SPARK-17757) Remove CreateNamedStruct expressions

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539507#comment-15539507 ] Apache Spark commented on SPARK-17757: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Created] (SPARK-17757) Remove CreateNamedStruct expressions

2016-10-01 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-17757: - Summary: Remove CreateNamedStruct expressions Key: SPARK-17757 URL: https://issues.apache.org/jira/browse/SPARK-17757 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539441#comment-15539441 ] Apache Spark commented on SPARK-17753: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17753: Assignee: (was: Apache Spark) > Simple case in spark sql throws ParseException >

[jira] [Assigned] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17753: Assignee: Apache Spark > Simple case in spark sql throws ParseException >

[jira] [Updated] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-10-01 Thread Kevin Ushey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Ushey updated SPARK-17752: Description: Run the following code (modify SPARK_HOME to point to a Spark 2.0.0 installation as

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread kanika dhuria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539376#comment-15539376 ] kanika dhuria commented on SPARK-17753: --- Yeah, Thanks! > Simple case in spark sql throws

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539368#comment-15539368 ] Herman van Hovell commented on SPARK-17753: --- Yeah, the current grammar doesn't allow us to use

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread kanika dhuria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539358#comment-15539358 ] kanika dhuria commented on SPARK-17753: --- Hi Herman, I have tried with symbolic also, it doesn't

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539354#comment-15539354 ] Herman van Hovell commented on SPARK-17753: --- We do not support the GTE/LTE/GT/LT/EQ/NEQ

[jira] [Updated] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17753: -- Description: Simple case in sql throws parser exception in spark 2.0. The following

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539295#comment-15539295 ] Dongjoon Hyun commented on SPARK-17753: --- Hmm. It's not so each to fix this. Maybe, I'll try later.

[jira] [Commented] (SPARK-17671) Spark 2.0 history server summary page is slow even set spark.history.ui.maxApplications

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539115#comment-15539115 ] Apache Spark commented on SPARK-17671: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-17704) ChiSqSelector performance improvement.

2016-10-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17704: -- Priority: Minor (was: Major) > ChiSqSelector performance improvement. >

[jira] [Updated] (SPARK-17704) ChiSqSelector performance improvement.

2016-10-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17704: -- Assignee: Yanbo Liang > ChiSqSelector performance improvement. >

[jira] [Updated] (SPARK-17704) ChiSqSelector performance improvement.

2016-10-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17704: -- Assignee: Yanbo Liang > ChiSqSelector performance improvement. >

[jira] [Resolved] (SPARK-17704) ChiSqSelector performance improvement.

2016-10-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17704. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15299

[jira] [Updated] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

2016-10-01 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-17756: --- External issue URL: http://stackoverflow.com/q/39804337/1560062 >

[jira] [Created] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

2016-10-01 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-17756: -- Summary: java.lang.ClassCastException when using cartesian with DStream.transform Key: SPARK-17756 URL: https://issues.apache.org/jira/browse/SPARK-17756

[jira] [Commented] (SPARK-17749) Unresolved columns when nesting SQL join clauses

2016-10-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538985#comment-15538985 ] Dongjoon Hyun commented on SPARK-17749: --- IMHO, it could be a MINOR issue since we have a workaround

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

2016-10-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538983#comment-15538983 ] Dongjoon Hyun commented on SPARK-17753: --- Hi, [~kdhuria]. Right, `CASE WHEN` seems to have a bug on

[jira] [Commented] (SPARK-17749) Unresolved columns when nesting SQL join clauses

2016-10-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538938#comment-15538938 ] Dongjoon Hyun commented on SPARK-17749: --- Hi, [~andreasdamm]. Thank you for reporting issue. I saw

[jira] [Comment Edited] (SPARK-17749) Unresolved columns when nesting SQL join clauses

2016-10-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538938#comment-15538938 ] Dongjoon Hyun edited comment on SPARK-17749 at 10/1/16 6:04 PM: Hi,

[jira] [Resolved] (SPARK-17697) BinaryLogisticRegressionSummary, GLM Summary should handle non-Double numeric types

2016-10-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-17697. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 >

[jira] [Issue Comment Deleted] (SPARK-17697) BinaryLogisticRegressionSummary, GLM Summary should handle non-Double numeric types

2016-10-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-17697: -- Comment: was deleted (was: Leaving open for follow-up to fix all GLM issues) >

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-10-01 Thread Ashish Shrowty (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538927#comment-15538927 ] Ashish Shrowty commented on SPARK-17709: [~dkbiswal] I just went through manual steps of creating

[jira] [Comment Edited] (SPARK-17709) spark 2.0 join - column resolution error

2016-10-01 Thread Ashish Shrowty (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538927#comment-15538927 ] Ashish Shrowty edited comment on SPARK-17709 at 10/1/16 6:00 PM: -

[jira] [Commented] (SPARK-17750) Cannot create view which includes interval arithmetic

2016-10-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538899#comment-15538899 ] Dongjoon Hyun commented on SPARK-17750: --- Hi, [~andreasdamm]. You can see your cases in the test

[jira] [Issue Comment Deleted] (SPARK-2620) case class cannot be used as key for reduce

2016-10-01 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Comment: was deleted (was: With Scala 2.11 we get around by creating a package: {code}

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

2016-10-01 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538581#comment-15538581 ] Maciej Szymkiewicz commented on SPARK-2620: --- With Scala 2.11 we get around by creating a

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

2016-10-01 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Affects Version/s: 1.3.0 1.4.0 1.5.0 >

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

2016-10-01 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Affects Version/s: 2.1.0 > case class cannot be used as key for reduce >

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

2016-10-01 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Affects Version/s: 1.6.0 2.0.0 > case class cannot be used as

[jira] [Commented] (SPARK-14914) Test Cases fail on Windows

2016-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538195#comment-15538195 ] Apache Spark commented on SPARK-14914: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-969) Persistent web ui

2016-10-01 Thread Semet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538162#comment-15538162 ] Semet commented on SPARK-969: - I agree that archiving this page for post mortem analysis is helpful. >

[jira] [Commented] (SPARK-17731) Metrics for Structured Streaming

2016-10-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538117#comment-15538117 ] Reynold Xin commented on SPARK-17731: - cc [~c...@koeninger.org] > Metrics for Structured Streaming >

[jira] [Comment Edited] (SPARK-17619) To add support for pattern matching in ArrayContains Expression.

2016-10-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538078#comment-15538078 ] Reynold Xin edited comment on SPARK-17619 at 10/1/16 7:23 AM: -- It seems

[jira] [Closed] (SPARK-17619) To add support for pattern matching in ArrayContains Expression.

2016-10-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-17619. --- Resolution: Won't Fix > To add support for pattern matching in ArrayContains Expression. >

[jira] [Commented] (SPARK-17619) To add support for pattern matching in ArrayContains Expression.

2016-10-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538078#comment-15538078 ] Reynold Xin commented on SPARK-17619: - It seems really strange to add support for this specific case,

[jira] [Resolved] (SPARK-17740) Spark tests should mock / interpose HDFS to ensure that streams are closed

2016-10-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17740. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.1.0 > Spark tests should