[jira] [Updated] (SPARK-27011) reset command fails after cache table

2019-03-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27011: - Description: Commands to reproduce  {code} spark-sql> create table abcde ( a int); spark-sql>

[jira] [Updated] (SPARK-27011) reset command fails after cache table

2019-03-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27011: - Description: Commands to reproduce  {code:java} spark-sql> create table abcde ( a int);

[jira] [Updated] (SPARK-27011) reset command fails after cache table

2019-03-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27011: - Description: Commands to reproduce  {code:java} spark-sql> create table abcde ( a int);

[jira] [Resolved] (SPARK-27135) Description column under jobs does not show complete text if there is overflow

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27135. --- Resolution: Not A Problem > Description column under jobs does not show complete text if there is

[jira] [Assigned] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27164: - Assignee: Ajith S > RDD.countApprox on empty RDDs schedules jobs which never complete >

[jira] [Updated] (SPARK-26979) [PySpark] Some SQL functions do not take column names

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26979: -- Docs Text: In Spark 3.0, certain Pyspark SQL functions that previously only accepted a Column object

[jira] [Assigned] (SPARK-26979) [PySpark] Some SQL functions do not take column names

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26979: - Assignee: Andre Sa de Mello > [PySpark] Some SQL functions do not take column names >

[jira] [Resolved] (SPARK-26979) [PySpark] Some SQL functions do not take column names

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26979. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23882

[jira] [Resolved] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27164. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24100

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

2019-03-17 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794551#comment-16794551 ] Ajith S commented on SPARK-26961: - [~srowen] ok, will raise a PR for this. Thanks > Found Java-level

[jira] [Resolved] (SPARK-27070) DefaultPartitionCoalescer can lock up driver for hours

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27070. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24116

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794532#comment-16794532 ] Sean Owen commented on SPARK-26961: --- Yes, I think implementing in Java is viable just for this reason.

[jira] [Resolved] (SPARK-23749) Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

2019-03-17 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-23749. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is

[jira] [Commented] (SPARK-23749) Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

2019-03-17 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794526#comment-16794526 ] Dongjoon Hyun commented on SPARK-23749: --- Sure, [~yumwang]! > Replace built-in Hive API

[jira] [Commented] (SPARK-27142) Provide REST API for SQL level information

2019-03-17 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794519#comment-16794519 ] Ajith S commented on SPARK-27142: - [~srowen] any inputs about proposal.? > Provide REST API for SQL

[jira] [Resolved] (SPARK-27122) YARN test failures in Java 9+

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27122. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24088

[jira] [Assigned] (SPARK-27122) YARN test failures in Java 9+

2019-03-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27122: - Assignee: Ajith S > YARN test failures in Java 9+ > - > >

[jira] [Commented] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

2019-03-17 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794454#comment-16794454 ] Takeshi Yamamuro commented on SPARK-27170: -- yea, yes. The mode is available in v3.0. > Better

[jira] [Comment Edited] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

2019-03-17 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794429#comment-16794429 ] Takeshi Yamamuro edited comment on SPARK-27170 at 3/17/19 10:53 AM:

[jira] [Assigned] (SPARK-27183) YarnConfiguration in ApplicationMaster should be cluster-specific

2019-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27183: Assignee: Apache Spark > YarnConfiguration in ApplicationMaster should be

[jira] [Commented] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

2019-03-17 Thread Wataru Yukawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794447#comment-16794447 ] Wataru Yukawa commented on SPARK-27170: --- >Any other query with hard-to-read parsing error message?

[jira] [Assigned] (SPARK-27183) YarnConfiguration in ApplicationMaster should be cluster-specific

2019-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27183: Assignee: (was: Apache Spark) > YarnConfiguration in ApplicationMaster should be

[jira] [Created] (SPARK-27183) YarnConfiguration in ApplicationMaster should be cluster-specific

2019-03-17 Thread Kent Yao (JIRA)
Kent Yao created SPARK-27183: Summary: YarnConfiguration in ApplicationMaster should be cluster-specific Key: SPARK-27183 URL: https://issues.apache.org/jira/browse/SPARK-27183 Project: Spark

[jira] [Commented] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

2019-03-17 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794429#comment-16794429 ] Takeshi Yamamuro commented on SPARK-27170: -- Any other query with hard-to-read parsing error

[jira] [Created] (SPARK-27182) Move the conflict source code of the sql/core module to sql/core/v1.2.1

2019-03-17 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-27182: --- Summary: Move the conflict source code of the sql/core module to sql/core/v1.2.1 Key: SPARK-27182 URL: https://issues.apache.org/jira/browse/SPARK-27182 Project: Spark

[jira] [Assigned] (SPARK-27182) Move the conflict source code of the sql/core module to sql/core/v1.2.1

2019-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27182: Assignee: (was: Apache Spark) > Move the conflict source code of the sql/core module

[jira] [Assigned] (SPARK-27182) Move the conflict source code of the sql/core module to sql/core/v1.2.1

2019-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27182: Assignee: Apache Spark > Move the conflict source code of the sql/core module to

[jira] [Assigned] (SPARK-26736) if filter condition has rand() function it does not do partition prunning

2019-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26736: Assignee: Apache Spark > if filter condition has rand() function it does not do

[jira] [Assigned] (SPARK-26736) if filter condition has rand() function it does not do partition prunning

2019-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26736: Assignee: (was: Apache Spark) > if filter condition has rand() function it does not