[jira] [Updated] (SPARK-23011) Support alternative function form with group aggregate pandas UDF

2018-01-16 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-23011: --- Summary: Support alternative function form with group aggregate pandas UDF (was: Prepend missing grouping co

[jira] [Resolved] (SPARK-22392) columnar reader interface

2018-01-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22392. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20153 [https://githu

[jira] [Assigned] (SPARK-22392) columnar reader interface

2018-01-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22392: --- Assignee: Wenchen Fan > columnar reader interface > -- > >

[jira] [Created] (SPARK-23088) History server not showing incomplete/running applications

2018-01-16 Thread paul mackles (JIRA)
paul mackles created SPARK-23088: Summary: History server not showing incomplete/running applications Key: SPARK-23088 URL: https://issues.apache.org/jira/browse/SPARK-23088 Project: Spark Is

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2018-01-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327144#comment-16327144 ] Steve Loughran commented on SPARK-6305: --- It'll be related to HADOOP-12956 , HDFS-128

[jira] [Assigned] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2018-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14948: Assignee: (was: Apache Spark) > Exception when joining DataFrames derived form the sam

[jira] [Commented] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2018-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327139#comment-16327139 ] Apache Spark commented on SPARK-14948: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2018-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14948: Assignee: Apache Spark > Exception when joining DataFrames derived form the same DataFrame

[jira] [Resolved] (SPARK-23060) RDD's apply function

2018-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23060. --- Resolution: Won't Fix > RDD's apply function > > > Key: SPARK-23

[jira] [Resolved] (SPARK-22991) High read latency with spark streaming 2.2.1 and kafka 0.10.0.1

2018-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22991. --- Resolution: Not A Problem > High read latency with spark streaming 2.2.1 and kafka 0.10.0.1 > ---

[jira] [Created] (SPARK-23087) CheckCartesianProduct too restrictive when condition is constant folded to false/null

2018-01-16 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-23087: - Summary: CheckCartesianProduct too restrictive when condition is constant folded to false/null Key: SPARK-23087 URL: https://issues.apache.org/jira/browse/SPARK-23087

[jira] [Resolved] (SPARK-22978) Register Vectorized UDFs for SQL Statement

2018-01-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22978. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20171 [https://git

[jira] [Commented] (SPARK-22991) High read latency with spark streaming 2.2.1 and kafka 0.10.0.1

2018-01-16 Thread zhaoshijie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327028#comment-16327028 ] zhaoshijie commented on SPARK-22991: [~kiranjapannavar] I encounter something like th

[jira] [Comment Edited] (SPARK-22923) Non-equi join(theta join) should use sort merge join

2018-01-16 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16325074#comment-16325074 ] Marco Gaido edited comment on SPARK-22923 at 1/16/18 10:47 AM:

[jira] [Updated] (SPARK-23086) Spark SQL cannot support high concurrency for lock in HiveMetastoreCatalog

2018-01-16 Thread pin_zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pin_zhang updated SPARK-23086: -- Description: * Hive metastore is mysql * Set hive.server2.thrift.max.worker.threads=500 create tabl

[jira] [Created] (SPARK-23086) Spark SQL cannot support high concurrency for lock in HiveMetastoreCatalog

2018-01-16 Thread pin_zhang (JIRA)
pin_zhang created SPARK-23086: - Summary: Spark SQL cannot support high concurrency for lock in HiveMetastoreCatalog Key: SPARK-23086 URL: https://issues.apache.org/jira/browse/SPARK-23086 Project: Spark

[jira] [Commented] (SPARK-22457) Tables are supposed to be MANAGED only taking into account whether a path is provided

2018-01-16 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16326959#comment-16326959 ] Jacek Laskowski commented on SPARK-22457: -  That should be fairly easy to fix _if

[jira] [Commented] (SPARK-23060) RDD's apply function

2018-01-16 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16326866#comment-16326866 ] Nick Pentreath commented on SPARK-23060: I agree I don't see enough of a compelli

<    1   2   3