[jira] [Commented] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095124#comment-17095124 ] angerszhu commented on SPARK-31602: --- cc [~cloud_fan]  > memory leak of JobConf >

[jira] [Updated] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31602: -- Description: !image-2020-04-29-14-34-39-496.png! !image-2020-04-29-14-35-55-986.png! was:

[jira] [Updated] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31602: -- Description: !image-2020-04-29-14-34-39-496.png! Screen Shot 2020-04-29 at 2.08.28 PM was:

[jira] [Updated] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31602: -- Attachment: image-2020-04-29-14-35-55-986.png > memory leak of JobConf > -- > >

[jira] [Updated] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31602: -- Attachment: image-2020-04-29-14-34-39-496.png > memory leak of JobConf > -- > >

[jira] [Commented] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095122#comment-17095122 ] angerszhu commented on SPARK-31602: --- In HadoopRDD , if you don't set  spark.hadoop.cloneConf=true, it

[jira] [Created] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
angerszhu created SPARK-31602: - Summary: memory leak of JobConf Key: SPARK-31602 URL: https://issues.apache.org/jira/browse/SPARK-31602 Project: Spark Issue Type: Bug Components: Spark

[jira] [Issue Comment Deleted] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-04-03 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31334: -- Comment: was deleted (was: cc [~cloud_fan] [~yumwang] ) > Use agg column in Having clause behave

[jira] [Commented] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-04-03 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074381#comment-17074381 ] angerszhu commented on SPARK-31334: --- I have found the reason, In analyzer when  logical plan

[jira] [Commented] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-04-03 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074296#comment-17074296 ] angerszhu commented on SPARK-31334: --- cc [~cloud_fan] [~yumwang]  > Use agg column in Having clause

[jira] [Updated] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-04-03 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31334: -- Description: {code:java} ``` test("") { Seq( (1, 3), (2, 3), (3, 6),

[jira] [Created] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-04-03 Thread angerszhu (Jira)
angerszhu created SPARK-31334: - Summary: Use agg column in Having clause behave different with column type Key: SPARK-31334 URL: https://issues.apache.org/jira/browse/SPARK-31334 Project: Spark

[jira] [Updated] (SPARK-31298) validate CTAS table path in SPARK-19724 seems conflict and External table also need to check non-empty

2020-03-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Summary: validate CTAS table path in SPARK-19724 seems conflict and External table also need to check

[jira] [Updated] (SPARK-31298) validate CTAS table path in SPARK-19724 seems conflict

2020-03-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Summary: validate CTAS table path in SPARK-19724 seems conflict (was: validate External path in

[jira] [Updated] (SPARK-31298) validate External path in SPARK-19724 seems conflict

2020-03-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Description: In  SessionCatalog.validateTableLocation() {code:java} val tableLocation = new

[jira] [Created] (SPARK-31298) validate External path in SPARK-19724 seems conflict

2020-03-29 Thread angerszhu (Jira)
angerszhu created SPARK-31298: - Summary: validate External path in SPARK-19724 seems conflict Key: SPARK-31298 URL: https://issues.apache.org/jira/browse/SPARK-31298 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069939#comment-17069939 ] angerszhu commented on SPARK-31268: --- [https://github.com/apache/spark/pull/28034] > TaskEnd event

[jira] [Commented] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067661#comment-17067661 ] angerszhu commented on SPARK-31268: --- raise a pr soon > TaskEnd event with zero Executor Metrics when

[jira] [Commented] (SPARK-31270) Expose executor memory metrics at the task detal, in the Stages tab

2020-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067657#comment-17067657 ] angerszhu commented on SPARK-31270: --- Raise a pr soon > Expose executor memory metrics at the task

[jira] [Created] (SPARK-31270) Expose executor memory metrics at the task detal, in the Stages tab

2020-03-26 Thread angerszhu (Jira)
angerszhu created SPARK-31270: - Summary: Expose executor memory metrics at the task detal, in the Stages tab Key: SPARK-31270 URL: https://issues.apache.org/jira/browse/SPARK-31270 Project: Spark

[jira] [Updated] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31268: -- Attachment: screenshot-1.png > TaskEnd event with zero Executor Metrics when task duration less then

[jira] [Created] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-26 Thread angerszhu (Jira)
angerszhu created SPARK-31268: - Summary: TaskEnd event with zero Executor Metrics when task duration less then poll interval Key: SPARK-31268 URL: https://issues.apache.org/jira/browse/SPARK-31268

[jira] [Updated] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31268: -- Description: TaskEnd event with zero Executor Metrics when task duration less then poll interval >

[jira] [Commented] (SPARK-26341) Expose executor memory metrics at the stage level, in the Stages tab

2020-03-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066572#comment-17066572 ] angerszhu commented on SPARK-26341: --- I have do this in our own version, will raise a pr soon these

[jira] [Created] (SPARK-31226) SizeBasedCoalesce logic error

2020-03-23 Thread angerszhu (Jira)
angerszhu created SPARK-31226: - Summary: SizeBasedCoalesce logic error Key: SPARK-31226 URL: https://issues.apache.org/jira/browse/SPARK-31226 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31226) SizeBasedCoalesce logic error

2020-03-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31226: -- Description: In spark UT,  SizeBasedCoalecse's logic is wrong > SizeBasedCoalesce logic error >

[jira] [Commented] (SPARK-27097) Avoid embedding platform-dependent offsets literally in whole-stage generated code

2020-03-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063909#comment-17063909 ] angerszhu commented on SPARK-27097: --- [~irashid] to be honest, I meet this problem these days.  

[jira] [Commented] (SPARK-30707) Lead/Lag window function throws AnalysisException without ORDER BY clause

2020-03-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055642#comment-17055642 ] angerszhu commented on SPARK-30707: --- add pr in [https://github.com/apache/spark/pull/27861] >

[jira] [Commented] (SPARK-30707) Lead/Lag window function throws AnalysisException without ORDER BY clause

2020-03-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1709#comment-1709 ] angerszhu commented on SPARK-30707: --- our production meet this problem too when hive sql run in spark

[jira] [Created] (SPARK-30694) If exception occured while fetching blocks by ExternalBlockClient, fail early when External Shuffle Service is not alive

2020-01-31 Thread angerszhu (Jira)
angerszhu created SPARK-30694: - Summary: If exception occured while fetching blocks by ExternalBlockClient, fail early when External Shuffle Service is not alive Key: SPARK-30694 URL:

[jira] [Created] (SPARK-30538) A not very elegant way to control ouput small file

2020-01-16 Thread angerszhu (Jira)
angerszhu created SPARK-30538: - Summary: A not very elegant way to control ouput small file Key: SPARK-30538 URL: https://issues.apache.org/jira/browse/SPARK-30538 Project: Spark Issue Type:

[jira] [Created] (SPARK-30435) update Spark SQL guide of Supported Hive Features

2020-01-06 Thread angerszhu (Jira)
angerszhu created SPARK-30435: - Summary: update Spark SQL guide of Supported Hive Features Key: SPARK-30435 URL: https://issues.apache.org/jira/browse/SPARK-30435 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29800) Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf

2020-01-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29800: -- Summary: Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf (was: Rewrite

[jira] [Updated] (SPARK-29800) Rewrite non-correlated subquery use ScalaSubquery to optimize perf

2020-01-02 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29800: -- Summary: Rewrite non-correlated subquery use ScalaSubquery to optimize perf (was: Plan Exists 's

[jira] [Updated] (SPARK-29018) Build spark thrift server on it's own code based on protocol v11

2019-12-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: h2. Background With the development of Spark and Hive,in current

[jira] [Updated] (SPARK-29018) Build spark thrift server on it's own code based on protocol v11

2019-12-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: SPIP:Build Spark thrift server based on thrift protocol v11 h2. Background With the

[jira] [Updated] (SPARK-29018) Build spark thrift server on it's own code based on protocol v11

2019-12-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: With the development of Spark and Hive,in current sql/hive-thriftserver module, we need

[jira] [Updated] (SPARK-29018) Build spark thrift server on it's own code based on protocol v11

2019-12-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Summary: Build spark thrift server on it's own code based on protocol v11 (was: Spark ThriftServer

[jira] [Created] (SPARK-30293) In HiveThriftServer2 will remove wrong statement

2019-12-17 Thread angerszhu (Jira)
angerszhu created SPARK-30293: - Summary: In HiveThriftServer2 will remove wrong statement Key: SPARK-30293 URL: https://issues.apache.org/jira/browse/SPARK-30293 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29018) Spark ThriftServer change to it's own API

2019-12-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: With the development of Spark and Hive,in current `sql/hive-thriftserver`, we need to

[jira] [Updated] (SPARK-30287) Add new module spark-service as thrift server module

2019-12-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-30287: -- Description: Add a new module of `sql/service` as spark thrift server module (was: Add a new module

[jira] [Updated] (SPARK-29018) Spark ThriftServer change to it's own API

2019-12-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: With the development of Spark and Hive,in current `sql/hive-thriftserver`, we need to

[jira] [Updated] (SPARK-29018) Spark ThriftServer change to it's own API

2019-12-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: With the development of Spark and Hive,in current `sql/hive-thriftserver`, we need to

[jira] [Updated] (SPARK-29018) Spark ThriftServer change to it's own API

2019-12-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: ### What changes were proposed in this pull request? With the development of Spark and

[jira] [Created] (SPARK-30287) Add new module spark-service as thrift server module

2019-12-17 Thread angerszhu (Jira)
angerszhu created SPARK-30287: - Summary: Add new module spark-service as thrift server module Key: SPARK-30287 URL: https://issues.apache.org/jira/browse/SPARK-30287 Project: Spark Issue Type:

[jira] [Created] (SPARK-30271) dynamic allocation won't release some executor in some case.

2019-12-16 Thread angerszhu (Jira)
angerszhu created SPARK-30271: - Summary: dynamic allocation won't release some executor in some case. Key: SPARK-30271 URL: https://issues.apache.org/jira/browse/SPARK-30271 Project: Spark

[jira] [Commented] (SPARK-16180) Task hang on fetching blocks (cached RDD)

2019-12-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-16180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997310#comment-16997310 ] angerszhu commented on SPARK-16180: --- i meet this problem recently in spark-2.4 > Task hang on

[jira] [Created] (SPARK-30237) Move `sql()` method from DataType to AbstractType

2019-12-12 Thread angerszhu (Jira)
angerszhu created SPARK-30237: - Summary: Move `sql()` method from DataType to AbstractType Key: SPARK-30237 URL: https://issues.apache.org/jira/browse/SPARK-30237 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-30223) queries in thrift server may read wrong SQL configs

2019-12-11 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994061#comment-16994061 ] angerszhu edited comment on SPARK-30223 at 12/12/19 1:49 AM: - [~cloud_fan]

[jira] [Comment Edited] (SPARK-30223) queries in thrift server may read wrong SQL configs

2019-12-11 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994061#comment-16994061 ] angerszhu edited comment on SPARK-30223 at 12/12/19 1:49 AM: - [~cloud_fan]

[jira] [Commented] (SPARK-30223) queries in thrift server may read wrong SQL configs

2019-12-11 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994061#comment-16994061 ] angerszhu commented on SPARK-30223: --- [~cloud_fan] Add ```

[jira] [Commented] (SPARK-20135) spark thriftserver2: no job running but containers not release on yarn

2019-12-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992644#comment-16992644 ] angerszhu commented on SPARK-20135: --- meet same problem in spark2.4.0 [~xwc3504] Have you have any

[jira] [Commented] (SPARK-29998) A corrupted hard disk causes the task to execute repeatedly on a machine until the job fails

2019-11-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980128#comment-16980128 ] angerszhu commented on SPARK-29998: --- [~cloud_fan] No, not same problem but all caused by disk broken.

[jira] [Commented] (SPARK-29998) A corrupted hard disk causes the task to execute repeatedly on a machine until the job fails

2019-11-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980024#comment-16980024 ] angerszhu commented on SPARK-29998: --- [~yumwang][~dongjoon] [~cloud_fan] For this problem, I think we

[jira] [Updated] (SPARK-29998) A corrupted hard disk causes the task to execute repeatedly on a machine until the job fails

2019-11-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29998: -- Description: Recently, I meet one situation: One NodeManager's disk is broken. when task begin to

[jira] [Updated] (SPARK-29998) A corrupted hard disk causes the task to execute repeatedly on a machine until the job fails

2019-11-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29998: -- Description: Recently, I meet one situation: One NodeManager's disk is broken. when task begin to

[jira] [Created] (SPARK-29998) A corrupted hard disk causes the task to execute repeatedly on a machine until the job fails

2019-11-22 Thread angerszhu (Jira)
angerszhu created SPARK-29998: - Summary: A corrupted hard disk causes the task to execute repeatedly on a machine until the job fails Key: SPARK-29998 URL: https://issues.apache.org/jira/browse/SPARK-29998

[jira] [Updated] (SPARK-29957) Bump MiniKdc to 3.2.0

2019-11-19 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29957: -- Description: Since MiniKdc version lower than hadoop-3.0 can't work well in jdk11. New encryption

[jira] [Created] (SPARK-29957) Bump MiniKdc to 3.2.0

2019-11-19 Thread angerszhu (Jira)
angerszhu created SPARK-29957: - Summary: Bump MiniKdc to 3.2.0 Key: SPARK-29957 URL: https://issues.apache.org/jira/browse/SPARK-29957 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29874) Optimize Dataset.isEmpty()

2019-11-13 Thread angerszhu (Jira)
angerszhu created SPARK-29874: - Summary: Optimize Dataset.isEmpty() Key: SPARK-29874 URL: https://issues.apache.org/jira/browse/SPARK-29874 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-29800) Plan Exists 's subquery in PlanSubqueries

2019-11-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970040#comment-16970040 ] angerszhu commented on SPARK-29800: --- raise pr soon > Plan Exists 's subquery in PlanSubqueries >

[jira] [Created] (SPARK-29800) Plan Exists 's subquery in PlanSubqueries

2019-11-08 Thread angerszhu (Jira)
angerszhu created SPARK-29800: - Summary: Plan Exists 's subquery in PlanSubqueries Key: SPARK-29800 URL: https://issues.apache.org/jira/browse/SPARK-29800 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29769) Spark SQL cannot handle "exists/not exists" condition when using "JOIN"

2019-11-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29769: -- Description: In origin master, we can'y run sql use `EXISTS/NOT EXISTS` in Join's on condition:

[jira] [Updated] (SPARK-29769) Spark SQL cannot handle "exists/not exists" condition when using "JOIN"

2019-11-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29769: -- Description: In origin master, we can'y run sql use `EXISTS/NOT EXISTS` in Join's on condition:

[jira] [Reopened] (SPARK-29769) Spark SQL cannot handle "exists/not exists" condition when using "JOIN"

2019-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu reopened SPARK-29769: --- > Spark SQL cannot handle "exists/not exists" condition when using "JOIN" >

[jira] [Resolved] (SPARK-29769) Spark SQL cannot handle "exists/not exists" condition when using "JOIN"

2019-11-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-29769. --- Resolution: Invalid > Spark SQL cannot handle "exists/not exists" condition when using "JOIN" >

[jira] [Created] (SPARK-29769) Spark SQL cannot handle "exists/not exists" condition when using "JOIN"

2019-11-05 Thread angerszhu (Jira)
angerszhu created SPARK-29769: - Summary: Spark SQL cannot handle "exists/not exists" condition when using "JOIN" Key: SPARK-29769 URL: https://issues.apache.org/jira/browse/SPARK-29769 Project: Spark

[jira] [Commented] (SPARK-17398) Failed to query on external JSon Partitioned table

2019-11-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968033#comment-16968033 ] angerszhu commented on SPARK-17398: --- [~bianqi] Hi, I meet this problem too, have you know what's the

[jira] [Created] (SPARK-29742) dev/lint-java cann't check all code we will use

2019-11-04 Thread angerszhu (Jira)
angerszhu created SPARK-29742: - Summary: dev/lint-java cann't check all code we will use Key: SPARK-29742 URL: https://issues.apache.org/jira/browse/SPARK-29742 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29599) Support pagination for session table in JDBC/ODBC Tab

2019-10-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29599: -- Summary: Support pagination for session table in JDBC/ODBC Tab (was: Support pagination for session

[jira] [Commented] (SPARK-29599) Support pagination for session table in JDBC/ODBC Session page

2019-10-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959454#comment-16959454 ] angerszhu commented on SPARK-29599: --- work on this. > Support pagination for session table in

[jira] [Created] (SPARK-29599) Support pagination for session table in JDBC/ODBC Session page

2019-10-25 Thread angerszhu (Jira)
angerszhu created SPARK-29599: - Summary: Support pagination for session table in JDBC/ODBC Session page Key: SPARK-29599 URL: https://issues.apache.org/jira/browse/SPARK-29599 Project: Spark

[jira] [Commented] (SPARK-29540) Thrift in some cases can't parse string to date

2019-10-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956863#comment-16956863 ] angerszhu commented on SPARK-29540: --- check on this. > Thrift in some cases can't parse string to date

[jira] [Created] (SPARK-29530) SparkSession.sql() method parse process not under current sparksession's conf

2019-10-21 Thread angerszhu (Jira)
angerszhu created SPARK-29530: - Summary: SparkSession.sql() method parse process not under current sparksession's conf Key: SPARK-29530 URL: https://issues.apache.org/jira/browse/SPARK-29530 Project:

[jira] [Updated] (SPARK-29492) SparkThriftServer can't support jar class as table serde class when executestatement in sync mode

2019-10-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29492: -- Description: Add UT in HiveThriftBinaryServerSuit: {code} test("jar in sync mode") {

[jira] [Comment Edited] (SPARK-29492) SparkThriftServer can't support jar class as table serde class when executestatement in sync mode

2019-10-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952804#comment-16952804 ] angerszhu edited comment on SPARK-29492 at 10/16/19 1:10 PM: - raise a pr

[jira] [Updated] (SPARK-29492) SparkThriftServer can't support jar class as table serde class when executestatement in sync mode

2019-10-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29492: -- Summary: SparkThriftServer can't support jar class as table serde class when executestatement in

[jira] [Commented] (SPARK-29492) HiveThriftBinaryServerSuite#withCLIServiceClient didn't delete created table.

2019-10-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952804#comment-16952804 ] angerszhu commented on SPARK-29492: --- raise a pr soon >

[jira] [Updated] (SPARK-29492) HiveThriftBinaryServerSuite#withCLIServiceClient didn't delete created table.

2019-10-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29492: -- Description: HiveThriftBinaryServerSuite#withCLIServiceClient didn't delete created table. >

[jira] [Created] (SPARK-29492) HiveThriftBinaryServerSuite#withCLIServiceClient didn't delete created table.

2019-10-16 Thread angerszhu (Jira)
angerszhu created SPARK-29492: - Summary: HiveThriftBinaryServerSuite#withCLIServiceClient didn't delete created table. Key: SPARK-29492 URL: https://issues.apache.org/jira/browse/SPARK-29492 Project:

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

2019-10-11 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949886#comment-16949886 ] angerszhu commented on SPARK-29295: ---  This probelm seems start from hive 1.2 I test in our env

[jira] [Commented] (SPARK-29354) Spark has direct dependency on jline, but binaries for 'without hadoop' don't have a jline jar file.

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949050#comment-16949050 ] angerszhu commented on SPARK-29354: --- [~Elixir Kook]  i download spark-2.4.4-bin-hadoop2.7  in your

[jira] [Commented] (SPARK-29354) Spark has direct dependency on jline, but binaries for 'without hadoop' don't have a jline jar file.

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948410#comment-16948410 ] angerszhu commented on SPARK-29354: --- [~Elixir Kook] [~yumwang] Jline is brought by hive-beeline

[jira] [Commented] (SPARK-29424) Prevent Spark to committing stage of too much Task

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948399#comment-16948399 ] angerszhu commented on SPARK-29424: --- [~srowen] Since resource limit is  established, these bad

[jira] [Commented] (SPARK-29409) spark drop partition always throws Exception

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948368#comment-16948368 ] angerszhu commented on SPARK-29409: --- Thanks, I will check this problem. > spark drop partition always

[jira] [Commented] (SPARK-29288) Spark SQL add jar can't support HTTP path.

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948364#comment-16948364 ] angerszhu commented on SPARK-29288: --- [~dongjoon] Sorry for later reply , the hive Jira is 

[jira] [Updated] (SPARK-29424) Prevent Spark to committing stage of too much Task

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29424: -- Description: Our user always submit bad SQL in query platform, Such as : # write wrong join condition

[jira] [Updated] (SPARK-29424) Prevent Spark to committing stage of too much Task

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29424: -- Description: Our user always submit bad SQL in query platform, Such as : # write wrong join condition

[jira] [Updated] (SPARK-29424) Prevent Spark to committing stage of too much Task

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29424: -- Description: Our user always submit bad SQL in query platform, Such as : # write wrong join condition

[jira] [Created] (SPARK-29424) Prevent Spark to committing stage of too much Task

2019-10-10 Thread angerszhu (Jira)
angerszhu created SPARK-29424: - Summary: Prevent Spark to committing stage of too much Task Key: SPARK-29424 URL: https://issues.apache.org/jira/browse/SPARK-29424 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29354) Spark has direct dependency on jline, but binaries for 'without hadoop' don't have a jline jar file.

2019-10-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948247#comment-16948247 ] angerszhu commented on SPARK-29354: --- I will check on this. > Spark has direct dependency on jline,

[jira] [Commented] (SPARK-29409) spark drop partition always throws Exception

2019-10-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948145#comment-16948145 ] angerszhu commented on SPARK-29409: --- Hive build in version and run version. > spark drop partition

[jira] [Comment Edited] (SPARK-29409) spark drop partition always throws Exception

2019-10-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947767#comment-16947767 ] angerszhu edited comment on SPARK-29409 at 10/9/19 2:54 PM: Can you show

[jira] [Commented] (SPARK-29409) spark drop partition always throws Exception

2019-10-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947767#comment-16947767 ] angerszhu commented on SPARK-29409: --- i will check on this. > spark drop partition always throws

[jira] [Issue Comment Deleted] (SPARK-29379) SHOW FUNCTIONS don't show '!=', '<>' , 'between', 'case'

2019-10-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29379: -- Comment: was deleted (was: Don't need to add new expression class. If we just add code in

[jira] [Commented] (SPARK-29379) SHOW FUNCTIONS don't show '!=', '<>' , 'between', 'case'

2019-10-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946526#comment-16946526 ] angerszhu commented on SPARK-29379: --- Don't need to add new expression class. If we just add code in

[jira] [Created] (SPARK-29379) SHOW FUNCTIONS don't show '!=', '<>' , 'between', 'case'

2019-10-07 Thread angerszhu (Jira)
angerszhu created SPARK-29379: - Summary: SHOW FUNCTIONS don't show '!=', '<>' , 'between', 'case' Key: SPARK-29379 URL: https://issues.apache.org/jira/browse/SPARK-29379 Project: Spark Issue

[jira] [Commented] (SPARK-29288) Spark SQL add jar can't support HTTP path.

2019-09-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941487#comment-16941487 ] angerszhu commented on SPARK-29288: --- [~dongjoon] Sorry for my mistake when report this issue. By the

[jira] [Resolved] (SPARK-29288) Spark SQL add jar can't support HTTP path.

2019-09-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-29288. --- Resolution: Not A Problem > Spark SQL add jar can't support HTTP path. >

[jira] [Updated] (SPARK-29308) dev/deps/spark-deps-hadoop-3.2 orc jar is incorrect

2019-09-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29308: -- Description: In hadoop 3.2, orc.classfier is empty.

<    3   4   5   6   7   8   9   10   >