[jira] [Resolved] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-11 Thread Brett Randall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brett Randall resolved SPARK-15685. --- Resolution: Fixed Fix Version/s: 2.0.2 > StackOverflowError (VirtualMachineError) or

[jira] [Commented] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-11 Thread Brett Randall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248776#comment-16248776 ] Brett Randall commented on SPARK-15685: --- [~srowen] this seems to be fixed in 2.0.2, but I don't

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-11 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248745#comment-16248745 ] Tejas Patil commented on SPARK-22042: - Am trying out the suggestion discussed in

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248743#comment-16248743 ] Apache Spark commented on SPARK-22042: -- User 'tejasapatil' has created a pull request for this

[jira] [Resolved] (SPARK-8824) Support Parquet time related logical types

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-8824. Resolution: Fixed > Support Parquet time related logical types >

[jira] [Resolved] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-10365. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19702

[jira] [Assigned] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-10365: --- Assignee: Wenchen Fan > Support Parquet logical type TIMESTAMP_MICROS >

[jira] [Updated] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15685: -- Priority: Major (was: Critical) Fix Version/s: (was: 2.0.2) > StackOverflowError

[jira] [Updated] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-11 Thread Brett Randall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brett Randall updated SPARK-15685: -- Fix Version/s: 2.0.2 > StackOverflowError (VirtualMachineError) or NoClassDefFoundError >

[jira] [Commented] (SPARK-22464) <=> is not supported by Hive metastore partition predicate pushdown

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248635#comment-16248635 ] Apache Spark commented on SPARK-22464: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

2017-11-11 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248628#comment-16248628 ] Timothy Hunter commented on SPARK-21866: [~josephkb] if I am not mistaken, the image code is

[jira] [Commented] (SPARK-22488) The view resolution in the SparkSession internal table() API

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248618#comment-16248618 ] Apache Spark commented on SPARK-22488: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22488) The view resolution in the SparkSession internal table() API

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22488. - Resolution: Fixed Fix Version/s: 2.3.0 > The view resolution in the SparkSession internal

[jira] [Updated] (SPARK-22496) beeline display operation log

2017-11-11 Thread StephenZou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] StephenZou updated SPARK-22496: --- Description: For now,when end user runs queries in beeline or in hue through STS, no logs are

[jira] [Assigned] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21693: Assignee: (was: Apache Spark) > AppVeyor tests reach the time limit, 1.5 hours,

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248524#comment-16248524 ] Apache Spark commented on SPARK-21693: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21693: Assignee: Apache Spark > AppVeyor tests reach the time limit, 1.5 hours, sometimes in

[jira] [Assigned] (SPARK-22462) SQL metrics missing after foreach operation on dataframe

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22462: --- Assignee: Liang-Chi Hsieh > SQL metrics missing after foreach operation on dataframe >

[jira] [Resolved] (SPARK-22462) SQL metrics missing after foreach operation on dataframe

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22462. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19689

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248470#comment-16248470 ] Hyukjin Kwon commented on SPARK-21693: -- For caching, yup, so, looks that's why the test failures are

[jira] [Resolved] (SPARK-22433) Linear regression R^2 train/test terminology related

2017-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22433. --- Resolution: Won't Fix I would say it's not essential to change anything given this discussion, but

[jira] [Assigned] (SPARK-22476) Add new function dayofweek in R

2017-11-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22476: Assignee: Hyukjin Kwon > Add new function dayofweek in R >

[jira] [Resolved] (SPARK-22476) Add new function dayofweek in R

2017-11-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22476. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19706

[jira] [Resolved] (SPARK-19759) ALSModel.predict on Dataframes : potential optimization by not using blas

2017-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19759. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19685

[jira] [Assigned] (SPARK-19759) ALSModel.predict on Dataframes : potential optimization by not using blas

2017-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19759: - Assignee: Marco Gaido > ALSModel.predict on Dataframes : potential optimization by not using

[jira] [Assigned] (SPARK-22496) beeline display operation log

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22496: Assignee: Apache Spark > beeline display operation log > - >

[jira] [Assigned] (SPARK-22496) beeline display operation log

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22496: Assignee: (was: Apache Spark) > beeline display operation log >

[jira] [Commented] (SPARK-22496) beeline display operation log

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248422#comment-16248422 ] Apache Spark commented on SPARK-22496: -- User 'ChenjunZou' has created a pull request for this issue:

[jira] [Created] (SPARK-22496) beeline display operation log

2017-11-11 Thread StephenZou (JIRA)
StephenZou created SPARK-22496: -- Summary: beeline display operation log Key: SPARK-22496 URL: https://issues.apache.org/jira/browse/SPARK-22496 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-22406) pyspark version tag is wrong on PyPi

2017-11-11 Thread Holden Karau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248405#comment-16248405 ] Holden Karau commented on SPARK-22406: -- Yes, although this should be fixed in the documented upload