[jira] [Commented] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413341#comment-16413341 ] Hyukjin Kwon commented on SPARK-23645: -- This was fixed by just simply documenting the limitation but

[jira] [Assigned] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23645: Assignee: Stu (Michael Stewart) > pandas_udf can not be called with keyword arguments >

[jira] [Resolved] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23645. -- Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by pull

[jira] [Resolved] (SPARK-23700) Cleanup unused imports

2018-03-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23700. -- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.4.0 Fixed in

[jira] [Commented] (SPARK-23710) Upgrade Hive to 2.3.2

2018-03-25 Thread Darek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413234#comment-16413234 ] Darek commented on SPARK-23710: --- It passed all the tests and we need it for Hadoop 3.0, we need to merge

[jira] [Resolved] (SPARK-23549) Spark SQL unexpected behavior when comparing timestamp to date

2018-03-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23549. - Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 > Spark SQL unexpected

[jira] [Commented] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413213#comment-16413213 ] Herman van Hovell commented on SPARK-23598: --- [~dongjoon] thanks for doing this. As for the

[jira] [Commented] (SPARK-23740) Add FPGrowth Param for filtering out very common items

2018-03-25 Thread Teng Peng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413199#comment-16413199 ] Teng Peng commented on SPARK-23740: --- I suppose `beforehand` means before itemsets been generated,

[jira] [Resolved] (SPARK-23167) Update TPCDS queries from v1.4 to v2.7 (latest)

2018-03-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23167. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.4.0 > Update TPCDS queries

[jira] [Commented] (SPARK-20839) Incorrect Dynamic PageRank calculation

2018-03-25 Thread Ziyan LIANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413032#comment-16413032 ] Ziyan LIANG commented on SPARK-20839: - Got the same confusion, is there some documents or reference

[jira] [Commented] (SPARK-23437) [ML] Distributed Gaussian Process Regression for MLlib

2018-03-25 Thread Sujith Jay Nair (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413013#comment-16413013 ] Sujith Jay Nair commented on SPARK-23437: - +1 for the this initiative. To garner support for this

[jira] [Comment Edited] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-25 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412974#comment-16412974 ] Stavros Kontopoulos edited comment on SPARK-23790 at 3/25/18 10:36 AM:

[jira] [Commented] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-25 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412974#comment-16412974 ] Stavros Kontopoulos commented on SPARK-23790: - [~q79969786] I see the PRs you created to fix

[jira] [Commented] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-25 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412960#comment-16412960 ] Yuming Wang commented on SPARK-23790: - Can you try https://github.com/apache/spark/pull/20898? >

[jira] [Commented] (SPARK-23792) Documentation improvements for datetime functions

2018-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412949#comment-16412949 ] Apache Spark commented on SPARK-23792: -- User 'abradbury' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23792) Documentation improvements for datetime functions

2018-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23792: Assignee: (was: Apache Spark) > Documentation improvements for datetime functions >

[jira] [Assigned] (SPARK-23792) Documentation improvements for datetime functions

2018-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23792: Assignee: Apache Spark > Documentation improvements for datetime functions >

[jira] [Created] (SPARK-23792) Documentation improvements for datetime functions

2018-03-25 Thread A Bradbury (JIRA)
A Bradbury created SPARK-23792: -- Summary: Documentation improvements for datetime functions Key: SPARK-23792 URL: https://issues.apache.org/jira/browse/SPARK-23792 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-03-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412918#comment-16412918 ] Felix Cheung commented on SPARK-23780: -- though there are other methods  

[jira] [Commented] (SPARK-23710) Upgrade Hive to 2.3.2

2018-03-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412917#comment-16412917 ] Xiao Li commented on SPARK-23710: - What are the potential behavior changes this JIRA could introduce?

[jira] [Commented] (SPARK-23255) Add user guide and examples for DataFrame image reading functions

2018-03-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412908#comment-16412908 ] Hyukjin Kwon commented on SPARK-23255: -- Hey [~imatiach], are you interested in this? > Add user

[jira] [Updated] (SPARK-23784) Cannot use custom Aggregator with groupBy/agg

2018-03-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23784: - Component/s: (was: Project Infra) SQL > Cannot use custom Aggregator with

[jira] [Resolved] (SPARK-23761) Dataframe filter(udf) followed by groupby in pyspark throws a casting error

2018-03-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23761. -- Resolution: Cannot Reproduce > Dataframe filter(udf) followed by groupby in pyspark throws a