[jira] [Created] (SPARK-36420) Use `isEmpty` to improve performance in Pregel's superstep

2021-08-04 Thread xiepengjie (Jira)
xiepengjie created SPARK-36420: -- Summary: Use `isEmpty` to improve performance in Pregel's superstep Key: SPARK-36420 URL: https://issues.apache.org/jira/browse/SPARK-36420 Project: Spark Issue

[jira] [Commented] (SPARK-35622) DataFrame's count function do not need groupBy and avoid shuffle

2021-06-15 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363605#comment-17363605 ] xiepengjie commented on SPARK-35622: [~hyukjin.kwon] [~dc-heros], Sorry, I was on vacation last week

[jira] [Created] (SPARK-35622) DataFrame's count function do not need groupBy and avoid shuffle

2021-06-02 Thread xiepengjie (Jira)
xiepengjie created SPARK-35622: -- Summary: DataFrame's count function do not need groupBy and avoid shuffle Key: SPARK-35622 URL: https://issues.apache.org/jira/browse/SPARK-35622 Project: Spark

[jira] [Updated] (SPARK-33755) Allow creating orc table when row format separator is defined

2020-12-11 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-33755: --- Description: When creating table like this: {code:java} create table test_orc(c1 string) row format

[jira] [Created] (SPARK-33755) Allow creating orc table when row format separator is defined

2020-12-11 Thread xiepengjie (Jira)
xiepengjie created SPARK-33755: -- Summary: Allow creating orc table when row format separator is defined Key: SPARK-33755 URL: https://issues.apache.org/jira/browse/SPARK-33755 Project: Spark

[jira] [Commented] (SPARK-33686) Spark SQL unrecognized `db.tbl`

2020-12-07 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245651#comment-17245651 ] xiepengjie commented on SPARK-33686: [~srowen]  : thx for your report, it's really not a bug, but an

[jira] [Updated] (SPARK-33691) Support partition filters in ALTER TABLE DROP PARTITION

2020-12-07 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-33691: --- Description: User 'mgaido91' has created a pull request for this issue:

[jira] [Created] (SPARK-33691) Support partition filters in ALTER TABLE DROP PARTITION

2020-12-07 Thread xiepengjie (Jira)
xiepengjie created SPARK-33691: -- Summary: Support partition filters in ALTER TABLE DROP PARTITION Key: SPARK-33691 URL: https://issues.apache.org/jira/browse/SPARK-33691 Project: Spark Issue

[jira] [Updated] (SPARK-33686) Spark SQL unrecognized `db.tbl`

2020-12-06 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-33686: --- Description: When executing command like this: {code:java} create table 

[jira] [Created] (SPARK-33686) Spark SQL unrecognized `db.tbl`

2020-12-06 Thread xiepengjie (Jira)
xiepengjie created SPARK-33686: -- Summary: Spark SQL unrecognized `db.tbl` Key: SPARK-33686 URL: https://issues.apache.org/jira/browse/SPARK-33686 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-15118) Spark SQLConf should support loading hive properties in hive-site.xml

2020-07-17 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-15118: --- Summary: Spark SQLConf should support loading hive properties in hive-site.xml (was: spark

[jira] [Comment Edited] (SPARK-15118) spark couldn't get hive properyties in hive-site.xml

2020-07-16 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159692#comment-17159692 ] xiepengjie edited comment on SPARK-15118 at 7/17/20, 5:52 AM: -- Maybe we

[jira] [Comment Edited] (SPARK-15118) spark couldn't get hive properyties in hive-site.xml

2020-07-16 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159692#comment-17159692 ] xiepengjie edited comment on SPARK-15118 at 7/17/20, 5:50 AM: -- Maybe we

[jira] [Reopened] (SPARK-15118) spark couldn't get hive properyties in hive-site.xml

2020-07-16 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie reopened SPARK-15118: Maybe we should merge HiveConf too: org.apache.spark.sql.internal.BaseSessionStateBuilder#conf ```

[jira] [Updated] (SPARK-32192) Print column name when throws ClassCastException

2020-07-06 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-32192: --- Description: We have a demo like this: {code:java} drop table if exists cast_exception_test; create 

[jira] [Updated] (SPARK-32192) Print column name when throws ClassCastException

2020-07-06 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-32192: --- Description: We have a demo like this: {code:java} drop table if exists cast_exception_test; create 

[jira] [Updated] (SPARK-32192) Print column name when throws ClassCastException

2020-07-06 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-32192: --- Description: We have a demo like this: {code:java} drop table if exists cast_exception_test; create 

[jira] [Updated] (SPARK-32192) Print column name when throws ClassCastException

2020-07-06 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-32192: --- Description: We have a demo like this: {code:java} drop table if exists cast_exception_test; create 

[jira] [Updated] (SPARK-32192) Print column name when throws ClassCastException

2020-07-06 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-32192: --- Description: We have a demo like this: {code:java} drop table if exists cast_exception_test; create 

[jira] [Created] (SPARK-32192) Print column name when throws ClassCastException

2020-07-06 Thread xiepengjie (Jira)
xiepengjie created SPARK-32192: -- Summary: Print column name when throws ClassCastException Key: SPARK-32192 URL: https://issues.apache.org/jira/browse/SPARK-32192 Project: Spark Issue Type: