[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773890#comment-16773890 ] angerszhu commented on SPARK-21918: --- Come back boy, :([~huLiu] > HiveClient shouldn't share Hive

[jira] [Created] (SPARK-27185) mapPartition to replace map to speedUp Dataset's toLocalIterator process

angerszhu created SPARK-27185: - Summary: mapPartition to replace map to speedUp Dataset's toLocalIterator process Key: SPARK-27185 URL: https://issues.apache.org/jira/browse/SPARK-27185 Project: Spark

[jira] [Created] (SPARK-27916) SparkThreatServer memory leak

angerszhu created SPARK-27916: - Summary: SparkThreatServer memory leak Key: SPARK-27916 URL: https://issues.apache.org/jira/browse/SPARK-27916 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Description: When we use SparkSQL, about add jar command, if we add a wrong path of HDFS such as

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Description: When we use SparkSQL, about add jar command, if we add a wrong path of HDFS such as

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Attachment: image-2019-06-19-21-23-22-061.png > Spark SQL add jar with wrong hdfs path, SparkContext

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Description: When we use SparkSQL, about add jar command, if we add a wrong path of HDFS such as

[jira] [Created] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

angerszhu created SPARK-28106: - Summary: Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed Key: SPARK-28106 URL: https://issues.apache.org/jira/browse/SPARK-28106

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Description: When we use SparkSQL, about add jar command, if we add a wrong path of HDFS such as

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Attachment: image-2019-06-20-11-49-13-691.png > Spark SQL add jar with wrong hdfs path, SparkContext

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Description: When we use SparkSQL, about add jar command, if we add a wrong path of HDFS such as

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Attachment: image-2019-06-20-11-50-36-418.png > Spark SQL add jar with wrong hdfs path, SparkContext

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Description: When we use SparkSQL, about add jar command, if we add a wrong path of HDFS such as

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28106: -- Attachment: image-2019-06-20-11-51-06-889.png > Spark SQL add jar with wrong hdfs path, SparkContext

[jira] [Commented] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

[ https://issues.apache.org/jira/browse/SPARK-27602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830836#comment-16830836 ] angerszhu commented on SPARK-27602: --- Want to do this need to change the calculate model. I am tring to

[jira] [Created] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

angerszhu created SPARK-27602: - Summary: SparkSQL CBO can't get true size of partition table after partition pruning Key: SPARK-27602 URL: https://issues.apache.org/jira/browse/SPARK-27602 Project: Spark

[jira] [Updated] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

[ https://issues.apache.org/jira/browse/SPARK-27602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-27602: -- Attachment: image-2019-05-05-11-46-41-240.png > SparkSQL CBO can't get true size of partition table

[jira] [Commented] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

[ https://issues.apache.org/jira/browse/SPARK-27602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833194#comment-16833194 ] angerszhu commented on SPARK-27602: --- [~hyukjin.kwon] Extract the framework of CBO how to calculate

[jira] [Commented] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

[ https://issues.apache.org/jira/browse/SPARK-27602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833209#comment-16833209 ] angerszhu commented on SPARK-27602: --- [~hyukjin.kwon] The first step result is just like this.  The

[jira] [Created] (SPARK-28169) Spark can’t push down predicate for OR expression

angerszhu created SPARK-28169: - Summary: Spark can’t push down predicate for OR expression Key: SPARK-28169 URL: https://issues.apache.org/jira/browse/SPARK-28169 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28169) Spark can’t push down predicate for OR expression

[ https://issues.apache.org/jira/browse/SPARK-28169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28169: -- Description: Spark can't push down filter condition of Or: Such as if I have a table

[jira] [Commented] (SPARK-28327) Spark SQL can't support union with left query have queryOrganization

[ https://issues.apache.org/jira/browse/SPARK-28327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882581#comment-16882581 ] angerszhu commented on SPARK-28327: --- [~yumwang]Thank you for you Seems current SparkSQL's SQL

[jira] [Updated] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

[ https://issues.apache.org/jira/browse/SPARK-28311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28311: -- Description: {code:java} SessionHandle getSessionHandle(TOpenSessionReq req, TOpenSessionResp res)

[jira] [Created] (SPARK-28311) Spark Thrift Server protocol version compatibility setup too late

angerszhu created SPARK-28311: - Summary: Spark Thrift Server protocol version compatibility setup too late Key: SPARK-28311 URL: https://issues.apache.org/jira/browse/SPARK-28311 Project: Spark

[jira] [Created] (SPARK-28292) Enable inject user-defined Hint

angerszhu created SPARK-28292: - Summary: Enable inject user-defined Hint Key: SPARK-28292 URL: https://issues.apache.org/jira/browse/SPARK-28292 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13263) SQL generation support for tablesample

[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822891#comment-16822891 ] angerszhu commented on SPARK-13263: --- [~Tagar]  I make some change in Spark SQL's ASTBuild, can

[jira] [Created] (SPARK-28227) Spark can’t support TRANSFORM with aggregation

angerszhu created SPARK-28227: - Summary: Spark can’t support TRANSFORM with aggregation Key: SPARK-28227 URL: https://issues.apache.org/jira/browse/SPARK-28227 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906265#comment-16906265 ] angerszhu commented on SPARK-28707: --- [~S71955] In case Limit , # it will take(n) of  each

[jira] [Comment Edited] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906265#comment-16906265 ] angerszhu edited comment on SPARK-28707 at 8/13/19 2:34 PM: [~S71955] In

[jira] [Created] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

angerszhu created SPARK-28726: - Summary: Spark with DynamicAllocation always got connect rest by peers Key: SPARK-28726 URL: https://issues.apache.org/jira/browse/SPARK-28726 Project: Spark

[jira] [Updated] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28726: -- Description: When use Spark with dynamic allocation, we set idle time to 5s We always got exception

[jira] [Commented] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

[ https://issues.apache.org/jira/browse/SPARK-27602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895736#comment-16895736 ] angerszhu commented on SPARK-27602: --- [~lishuming] It's hard to combine several  partition's stats

[jira] [Commented] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

[ https://issues.apache.org/jira/browse/SPARK-27602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895737#comment-16895737 ] angerszhu commented on SPARK-27602: --- Seems in hive 1.2.1, we can't get true partition level stats too.

[jira] [Created] (SPARK-28613) Spark SQL action collect just judge size of compressed RDD's size, not accurate enough

angerszhu created SPARK-28613: - Summary: Spark SQL action collect just judge size of compressed RDD's size, not accurate enough Key: SPARK-28613 URL: https://issues.apache.org/jira/browse/SPARK-28613

[jira] [Updated] (SPARK-28613) Spark SQL action collect just judge size of compressed RDD's size, not accurate enough

[ https://issues.apache.org/jira/browse/SPARK-28613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28613: -- Description: When we run action DataFrame.collect() , for the configuration 

[jira] [Updated] (SPARK-28613) Spark SQL action collect just judge size of compressed RDD's size, not accurate enough

[ https://issues.apache.org/jira/browse/SPARK-28613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28613: -- Description: When we run action DataFrame.collect() , for the configuration 

[jira] [Comment Edited] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908711#comment-16908711 ] angerszhu edited comment on SPARK-28726 at 8/16/19 5:04 AM: [~hyukjin.kwon]

[jira] [Commented] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908714#comment-16908714 ] angerszhu commented on SPARK-28726: --- [~hyukjin.kwon] Just SparkthriftServer run sql with dynamic

[jira] [Commented] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908711#comment-16908711 ] angerszhu commented on SPARK-28726: --- [~hyukjin.kwon] spark thrift server， sql dynamic allocation

[jira] [Comment Edited] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908711#comment-16908711 ] angerszhu edited comment on SPARK-28726 at 8/16/19 5:00 AM: [~hyukjin.kwon]

[jira] [Comment Edited] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908711#comment-16908711 ] angerszhu edited comment on SPARK-28726 at 8/16/19 4:59 AM: [~hyukjin.kwon]

[jira] [Comment Edited] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908714#comment-16908714 ] angerszhu edited comment on SPARK-28726 at 8/16/19 6:03 AM: [~hyukjin.kwon]

[jira] [Commented] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907131#comment-16907131 ] angerszhu commented on SPARK-28726: --- [~ajithshetty]   also happen when higher timeouts > Spark with

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906076#comment-16906076 ] angerszhu commented on SPARK-28707: --- When we call a limit, it will change to a SinglePartition, it

[jira] [Resolved] (SPARK-28466) FileSystem closed error when to call Hive.moveFile

[ https://issues.apache.org/jira/browse/SPARK-28466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-28466. --- Resolution: Won't Fix > FileSystem closed error when to call Hive.moveFile >

[jira] [Commented] (SPARK-28653) Create table using DDL statement should not auto create the destination folder

[ https://issues.apache.org/jira/browse/SPARK-28653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916032#comment-16916032 ] angerszhu commented on SPARK-28653: --- I tried it in Spark SQL, both situation will create path. >

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915225#comment-16915225 ] angerszhu commented on SPARK-21067: --- the root cause is in Spark we use just one SessionState. In

[jira] [Commented] (SPARK-28872) Will Spark SQL suport the auto analyze for table or partitions like hive by seting hive.stats.autogather=true.

[ https://issues.apache.org/jira/browse/SPARK-28872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915966#comment-16915966 ] angerszhu commented on SPARK-28872: --- See conf  `spark.sql.statistics.size.autoUpdate.enabled` > Will

[jira] [Updated] (SPARK-28954) For SparkCLI, start up with conf of HIVEAUXJARS, we add jar with SessionStateResourceLoader's addJar() API

[ https://issues.apache.org/jira/browse/SPARK-28954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28954: -- Description: When startup SparkSQL CLI . For extra jar passed through hive conf 

[jira] [Created] (SPARK-28954) For SparkCLI, start up with conf of HIVEAUXJARS, we add jar with SessionStateResourceLoader's addJar() API

angerszhu created SPARK-28954: - Summary: For SparkCLI, start up with conf of HIVEAUXJARS, we add jar with SessionStateResourceLoader's addJar() API Key: SPARK-28954 URL:

[jira] [Updated] (SPARK-28901) SparkThriftServer SparkExecuteStatementOpration handle cancel status.

[ https://issues.apache.org/jira/browse/SPARK-28901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28901: -- Description: Current SparkThriftServer still can't support handle cancel sql , when we connect

[jira] [Created] (SPARK-28901) SparkThriftServer SparkExecuteStatementOpration handle cancel status.

angerszhu created SPARK-28901: - Summary: SparkThriftServer SparkExecuteStatementOpration handle cancel status. Key: SPARK-28901 URL: https://issues.apache.org/jira/browse/SPARK-28901 Project: Spark

[jira] [Created] (SPARK-28982) Support ThriftServer GetTypeInfoOperation for Spark's own type

angerszhu created SPARK-28982: - Summary: Support ThriftServer GetTypeInfoOperation for Spark's own type Key: SPARK-28982 URL: https://issues.apache.org/jira/browse/SPARK-28982 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-29015) Can not support "add jar" on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29015: -- Comment: was deleted (was: I have tried in Java8, the same error, maybe not jdk's problem.) > Can

[jira] [Commented] (SPARK-29015) Can not support "add jar" on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928429#comment-16928429 ] angerszhu commented on SPARK-29015: --- [~oceaneast]  Hi , have you find the root cause of this problem?

[jira] [Updated] (SPARK-29015) Can't use 'add jar' jar's class as create table serde class on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29015: -- Summary: Can't use 'add jar' jar's class as create table serde class on JDK 11 (was: Can not support

[jira] [Commented] (SPARK-29015) Can not support "add jar" on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925348#comment-16925348 ] angerszhu commented on SPARK-29015: --- I have tried in Java8, the same error, maybe not jdk's problem.

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927243#comment-16927243 ] angerszhu commented on SPARK-29038: --- I ma interested in the match about : you create a MV table 

[jira] [Issue Comment Deleted] (SPARK-29022) SparkSQLCLI can not use 'ADD JAR' 's jar as Serder class

[ https://issues.apache.org/jira/browse/SPARK-29022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29022: -- Comment: was deleted (was: PR [https://github.com/apache/spark/pull/25729]) > SparkSQLCLI can not

[jira] [Created] (SPARK-29036) SparkThriftServer may can't cancel job after call a cancel before start.

angerszhu created SPARK-29036: - Summary: SparkThriftServer may can't cancel job after call a cancel before start. Key: SPARK-29036 URL: https://issues.apache.org/jira/browse/SPARK-29036 Project: Spark

[jira] [Updated] (SPARK-29022) SparkSQLCLI can use 'ADD JAR' 's jar as Serder class

[ https://issues.apache.org/jira/browse/SPARK-29022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29022: -- Description: Spark SQL CLI can't use class in jars add by SQL 'ADD JAR' {code:java} spark-sql> add

[jira] [Commented] (SPARK-29022) SparkSQLCLI can use 'ADD JAR' 's jar as Serder class

[ https://issues.apache.org/jira/browse/SPARK-29022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925669#comment-16925669 ] angerszhu commented on SPARK-29022: --- PR [https://github.com/apache/spark/pull/25729] > SparkSQLCLI

[jira] [Created] (SPARK-29022) SparkSQLCLI can use 'ADD JAR' 's jar as Serder class

angerszhu created SPARK-29022: - Summary: SparkSQLCLI can use 'ADD JAR' 's jar as Serder class Key: SPARK-29022 URL: https://issues.apache.org/jira/browse/SPARK-29022 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29036) SparkThriftServer may can't cancel job after call a cancel before start.

[ https://issues.apache.org/jira/browse/SPARK-29036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29036: -- Description: Disscuss in [https://github.com/apache/spark/pull/25611] > SparkThriftServer may can't

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926658#comment-16926658 ] angerszhu commented on SPARK-29038: --- I am doing a similar framework. It can trigger cache sub-query

[jira] [Issue Comment Deleted] (SPARK-29038) SPIP: Support Spark Materialized View

[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29038: -- Comment: was deleted (was: I am doing a similar framework. It can trigger cache sub-query data of

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927217#comment-16927217 ] angerszhu commented on SPARK-29038: --- [~cltlfcjin]   *precalculating, alittle like CarbonData's Data

[jira] [Updated] (SPARK-29086) In jdk11, SparkGetColumnsOperation return empty columns

[ https://issues.apache.org/jira/browse/SPARK-29086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29086: -- Description: In jdk11,  When we create a table with jar added by 'ADD JAR' sql.  When we restart

[jira] [Updated] (SPARK-29086) Use added jar's class as Serde class, SparkGetColumnsOperation return empty columns

[ https://issues.apache.org/jira/browse/SPARK-29086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29086: -- Summary: Use added jar's class as Serde class, SparkGetColumnsOperation return empty columns (was:

[jira] [Created] (SPARK-29086) In jdk11, SparkGetColumnsOperation return empty columns

angerszhu created SPARK-29086: - Summary: In jdk11, SparkGetColumnsOperation return empty columns Key: SPARK-29086 URL: https://issues.apache.org/jira/browse/SPARK-29086 Project: Spark Issue

[jira] [Updated] (SPARK-29086) In jdk11, SparkGetColumnsOperation return empty columns

[ https://issues.apache.org/jira/browse/SPARK-29086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29086: -- Description: In jdk11,  When we create a table with jar added by 'ADD JAR' sql.  When we restart

[jira] [Created] (SPARK-29091) spark-shell don't support added jar's class as Serde class

angerszhu created SPARK-29091: - Summary: spark-shell don't support added jar's class as Serde class Key: SPARK-29091 URL: https://issues.apache.org/jira/browse/SPARK-29091 Project: Spark Issue

[jira] [Updated] (SPARK-29022) SparkSQLCLI can not use 'ADD JAR' 's jar as Serder class

[ https://issues.apache.org/jira/browse/SPARK-29022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29022: -- Attachment: image-2019-09-17-13-54-50-896.png > SparkSQLCLI can not use 'ADD JAR' 's jar as Serder

[jira] [Commented] (SPARK-29022) SparkSQLCLI can not use 'ADD JAR' 's jar as Serder class

[ https://issues.apache.org/jira/browse/SPARK-29022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931116#comment-16931116 ] angerszhu commented on SPARK-29022: --- Since after spark-2.0, when we call method

[jira] [Commented] (SPARK-29005) build failed: sparkSession.createDataFrame[Int](Seq(1,2))

[ https://issues.apache.org/jira/browse/SPARK-29005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924777#comment-16924777 ] angerszhu commented on SPARK-29005: --- Int is not a subclass of trait `Product`   {code:java} def

[jira] [Commented] (SPARK-29005) build failed: sparkSession.createDataFrame[Int](Seq(1,2))

[ https://issues.apache.org/jira/browse/SPARK-29005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925022#comment-16925022 ] angerszhu commented on SPARK-29005: --- [~zhouzach] case class implement Product. Int, Float, Long

[jira] [Commented] (SPARK-29022) SparkSQLCLI can not use 'ADD JAR' 's jar as Serder class

[ https://issues.apache.org/jira/browse/SPARK-29022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932268#comment-16932268 ] angerszhu commented on SPARK-29022: --- In spark-2.0, run with hive load by 'maven' will meet this error.

[jira] [Commented] (SPARK-29091) spark-shell don't support added jar's class as Serde class

[ https://issues.apache.org/jira/browse/SPARK-29091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930212#comment-16930212 ] angerszhu commented on SPARK-29091: --- [~hyukjin.kwon] emmm, this bug also happen in jdk8,

[jira] [Updated] (SPARK-29091) spark-shell don't support added jar's class as Serde class

[ https://issues.apache.org/jira/browse/SPARK-29091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29091: -- Description: {code:java} Welcome to __ / __/__ ___ _/ /__ _\ \/

[jira] [Commented] (SPARK-29086) Use added jar's class as Serde class, SparkGetColumnsOperation return empty columns

[ https://issues.apache.org/jira/browse/SPARK-29086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930510#comment-16930510 ] angerszhu commented on SPARK-29086: --- [~yumwang] Yes, can be reproduced in JDK8 hadoop2.7/3.2 and JDK11

[jira] [Commented] (SPARK-29086) Use added jar's class as Serde class, SparkGetColumnsOperation return empty columns

[ https://issues.apache.org/jira/browse/SPARK-29086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930514#comment-16930514 ] angerszhu commented on SPARK-29086: --- Add jar before listing column is OK.  But if you call select

[jira] [Updated] (SPARK-29018) Spark ThriftServer change to it's own API

[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: Current SparkThriftServer rely on HiveServer2 too much, when Hive version changed, we

[jira] [Created] (SPARK-29018) Spark ThriftServer change to it's own API

angerszhu created SPARK-29018: - Summary: Spark ThriftServer change to it's own API Key: SPARK-29018 URL: https://issues.apache.org/jira/browse/SPARK-29018 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29167) Metrics of Analyzer/Optimizer use Scientific counting is not human readable

angerszhu created SPARK-29167: - Summary: Metrics of Analyzer/Optimizer use Scientific counting is not human readable Key: SPARK-29167 URL: https://issues.apache.org/jira/browse/SPARK-29167 Project: Spark

[jira] [Commented] (SPARK-29145) Spark SQL cannot handle "NOT IN" condition when using "JOIN"

[ https://issues.apache.org/jira/browse/SPARK-29145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933149#comment-16933149 ] angerszhu commented on SPARK-29145: --- maybe we should just use: {code:java} sql("""select * from A

[jira] [Updated] (SPARK-28618) SparkSQL Plan CollectLimitExec may cause OOM

[ https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28618: -- Attachment: image-2019-08-05-14-02-51-577.png > SparkSQL Plan CollectLimitExec may cause OOM >

[jira] [Created] (SPARK-28618) SparkSQL Plan CollectLimitExec may cause OOM

angerszhu created SPARK-28618: - Summary: SparkSQL Plan CollectLimitExec may cause OOM Key: SPARK-28618 URL: https://issues.apache.org/jira/browse/SPARK-28618 Project: Spark Issue Type: Wish

[jira] [Updated] (SPARK-28618) SparkSQL Plan CollectLimitExec may cause OOM

[ https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28618: -- Description: When we call a limit in SQL or DataFrame, it will execute like below,if we call

[jira] [Resolved] (SPARK-28618) SparkSQL Plan CollectLimitExec may cause OOM

[ https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-28618. --- Resolution: Auto Closed > SparkSQL Plan CollectLimitExec may cause OOM >

[jira] [Updated] (SPARK-28618) SparkSQL Plan CollectLimitExec may cause OOM

[ https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28618: -- Attachment: image-2019-08-05-14-03-16-112.png > SparkSQL Plan CollectLimitExec may cause OOM >

[jira] [Updated] (SPARK-28618) SparkSQL Plan CollectLimitExec may cause OOM

[ https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28618: -- Description: When we call a limit in SQL or DataFrame, it will execute like below,if we call

[jira] [Comment Edited] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901847#comment-16901847 ] angerszhu edited comment on SPARK-21918 at 8/7/19 7:55 AM: --- .    

[jira] [Resolved] (SPARK-27916) SparkThreatServer memory leak when 'spark.sql.hive.thriftServer.singleSession' enabled

[ https://issues.apache.org/jira/browse/SPARK-27916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-27916. --- Resolution: Invalid > SparkThreatServer memory leak when >

[jira] [Comment Edited] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901847#comment-16901847 ] angerszhu edited comment on SPARK-21918 at 8/7/19 7:58 AM: --- .    

[jira] [Updated] (SPARK-28169) Spark can’t push down partition predicate for OR expression

[ https://issues.apache.org/jira/browse/SPARK-28169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28169: -- Summary: Spark can’t push down partition predicate for OR expression (was: Spark can’t push down

[jira] [Commented] (SPARK-11248) Spark hivethriftserver is using the wrong user to while getting HDFS permissions

[ https://issues.apache.org/jira/browse/SPARK-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901908#comment-16901908 ] angerszhu commented on SPARK-11248: --- I have make a patch for this problem.    

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901847#comment-16901847 ] angerszhu commented on SPARK-21918: --- I have make a patch for this problem.    

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901846#comment-16901846 ] angerszhu commented on SPARK-5159: -- I have make a patch for this problem.    

[jira] [Updated] (SPARK-28551) CTAS SQL with LOCATION properties won't check location path, cause data under this location lose

[ https://issues.apache.org/jira/browse/SPARK-28551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28551: -- Description: When we run SQL like  {code:java} CRETE TABLE TBL LOCATION 'PATH_URI' AS SELECT

[jira] [Updated] (SPARK-28551) CTAS SQL with LOCATION properties won't check location path, cause data under this location lose

[ https://issues.apache.org/jira/browse/SPARK-28551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28551: -- Labels: SQL (was: ) > CTAS SQL with LOCATION properties won't check location path, cause data under

  1   2   3   4   5   6   7   8   9   10   >