[jira] [Created] (SPARK-24497) Support recursive SQL query

2018-06-08 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24497: --- Summary: Support recursive SQL query Key: SPARK-24497 URL: https://issues.apache.org/jira/browse/SPARK-24497 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-24538) Decimal type support push down to the data sources

2018-06-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510503#comment-16510503 ] Yuming Wang commented on SPARK-24538: - I'm working on this. > Decimal type support push down to the

[jira] [Created] (SPARK-24538) Decimal type support push down to the data sources

2018-06-12 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24538: --- Summary: Decimal type support push down to the data sources Key: SPARK-24538 URL: https://issues.apache.org/jira/browse/SPARK-24538 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-24538) Decimal type support push down to the data sources

2018-06-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24538: Comment: was deleted (was: I'm working on this.) > Decimal type support push down to the data

[jira] [Updated] (SPARK-24538) Decimal type support push down to the data sources

2018-06-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24538: Description: Latest parquet support decimal type statistics. then we can push down: {noformat}

[jira] [Updated] (SPARK-24538) Decimal type support push down to the data sources

2018-06-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24538: Description: Latest parquet support decimal type statistics. then we can push down to the data

[jira] [Issue Comment Deleted] (SPARK-24549) 32BitDecimalType and 64BitDecimalType support push down to the data sources

2018-06-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24549: Comment: was deleted (was: I'm working on this) > 32BitDecimalType and 64BitDecimalType support

[jira] [Commented] (SPARK-24549) 32BitDecimalType and 64BitDecimalType support push down to the data sources

2018-06-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511034#comment-16511034 ] Yuming Wang commented on SPARK-24549: - I'm working on this > 32BitDecimalType and 64BitDecimalType

[jira] [Created] (SPARK-24549) 32BitDecimalType and 64BitDecimalType support push down to the data sources

2018-06-13 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24549: --- Summary: 32BitDecimalType and 64BitDecimalType support push down to the data sources Key: SPARK-24549 URL: https://issues.apache.org/jira/browse/SPARK-24549 Project:

[jira] [Updated] (SPARK-24538) ByteArrayDecimalType support push down to the data sources

2018-06-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24538: Summary: ByteArrayDecimalType support push down to the data sources (was: Decimal type support

[jira] [Updated] (SPARK-24549) 32BitDecimalType and 64BitDecimalType support push down to the data sources

2018-06-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24549: Issue Type: Improvement (was: New Feature) > 32BitDecimalType and 64BitDecimalType support push

[jira] [Updated] (SPARK-24538) ByteArrayDecimalType support push down to the data sources

2018-06-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24538: Issue Type: Improvement (was: New Feature) > ByteArrayDecimalType support push down to the data

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

2018-07-01 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529013#comment-16529013 ] Yuming Wang commented on SPARK-20427: - [~ORichard]. Please try to use {{customSchema}} to specifying

[jira] [Created] (SPARK-24716) Refactor ParquetFilters

2018-07-02 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24716: --- Summary: Refactor ParquetFilters Key: SPARK-24716 URL: https://issues.apache.org/jira/browse/SPARK-24716 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24716) Refactor ParquetFilters

2018-07-02 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529603#comment-16529603 ] Yuming Wang commented on SPARK-24716: - I'm working on. > Refactor ParquetFilters >

[jira] [Issue Comment Deleted] (SPARK-24692) Improvement FilterPushdownBenchmark

2018-06-29 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24692: Comment: was deleted (was: I'm working on it.) > Improvement FilterPushdownBenchmark >

[jira] [Created] (SPARK-24658) Remove workaround for ANTLR bug

2018-06-25 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24658: --- Summary: Remove workaround for ANTLR bug Key: SPARK-24658 URL: https://issues.apache.org/jira/browse/SPARK-24658 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-24638) StringStartsWith support push down

2018-06-23 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24638: --- Summary: StringStartsWith support push down Key: SPARK-24638 URL: https://issues.apache.org/jira/browse/SPARK-24638 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-24706) Support ByteType and ShortType pushdown to parquet

2018-06-30 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24706: --- Summary: Support ByteType and ShortType pushdown to parquet Key: SPARK-24706 URL: https://issues.apache.org/jira/browse/SPARK-24706 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24706) Support ByteType and ShortType pushdown to parquet

2018-06-30 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528878#comment-16528878 ] Yuming Wang commented on SPARK-24706: - Benchmark result: {noformat}

[jira] [Updated] (SPARK-24706) Support ByteType and ShortType pushdown to parquet

2018-06-30 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24706: Description: Benchmark result: {noformat} ###[ Pushdown benchmark

[jira] [Updated] (SPARK-24706) Support ByteType and ShortType pushdown to parquet

2018-06-30 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24706: Description: (was: Benchmark result: {noformat} ###[ Pushdown

[jira] [Updated] (SPARK-24718) Timestamp support pushdown to parquet data source

2018-07-02 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24718: Description: Some thing like this: {code:java} case ParquetSchemaType(TIMESTAMP_MICROS, INT64,

[jira] [Updated] (SPARK-24718) Timestamp support pushdown to parquet data source

2018-07-02 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24718: Description: Some thing like this: {code:java} case ParquetSchemaType(TIMESTAMP_MICROS, INT64,

[jira] [Issue Comment Deleted] (SPARK-24716) Refactor ParquetFilters

2018-07-02 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24716: Comment: was deleted (was: I'm working on.) > Refactor ParquetFilters > ---

[jira] [Updated] (SPARK-24718) Timestamp support pushdown to parquet data source

2018-07-02 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24718: Description: Some thing like this: {code:java} // INT96 deprecated, doesn't support pushdown,

[jira] [Commented] (SPARK-24718) Timestamp support pushdown to parquet data source

2018-07-02 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530095#comment-16530095 ] Yuming Wang commented on SPARK-24718: - I'm working on > Timestamp support pushdown to parquet data

[jira] [Created] (SPARK-24718) Timestamp support pushdown to parquet data source

2018-07-02 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24718: --- Summary: Timestamp support pushdown to parquet data source Key: SPARK-24718 URL: https://issues.apache.org/jira/browse/SPARK-24718 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24096) create table as select not using hive.default.fileformat

2018-04-26 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16454463#comment-16454463 ] Yuming Wang commented on SPARK-24096: - Another related PR: https://github.com/apache/spark/pull/14430

[jira] [Resolved] (SPARK-24096) create table as select not using hive.default.fileformat

2018-04-26 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-24096. - Resolution: Duplicate > create table as select not using hive.default.fileformat >

[jira] [Created] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-22977: --- Summary: DataFrameWriter operations do not show details in SQL tab Key: SPARK-22977 URL: https://issues.apache.org/jira/browse/SPARK-22977 Project: Spark

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Attachment: after.png before.png > DataFrameWriter operations do not show details

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Attachment: after.png before.png > DataFrameWriter operations do not show details

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Description: When create !before.png! !after.png! > DataFrameWriter operations do not show

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Attachment: (was: before.png) > DataFrameWriter operations do not show details in SQL tab >

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Attachment: (was: after.png) > DataFrameWriter operations do not show details in SQL tab >

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Description: When CreateHiveTableAsSelectCommand or InsertIntoHiveTable, !before.png! !after.png!

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Description: When CreateHiveTableAsSelectCommand or InsertIntoHiveTable, SQL tab don't show

[jira] [Created] (SPARK-22894) DateTimeOperations should accept SQL like string type

2017-12-23 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-22894: --- Summary: DateTimeOperations should accept SQL like string type Key: SPARK-22894 URL: https://issues.apache.org/jira/browse/SPARK-22894 Project: Spark Issue

[jira] [Created] (SPARK-22890) Basic tests for DateTimeOperations

2017-12-22 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-22890: --- Summary: Basic tests for DateTimeOperations Key: SPARK-22890 URL: https://issues.apache.org/jira/browse/SPARK-22890 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-22893) Unified the data type mismatch message

2017-12-23 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-22893: --- Summary: Unified the data type mismatch message Key: SPARK-22893 URL: https://issues.apache.org/jira/browse/SPARK-22893 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-23175) Type conversion does not make sense under case like select ’0.1’ = 0

2018-01-21 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-23175. - Resolution: Duplicate > Type conversion does not make sense under case like select ’0.1’ = 0 >

[jira] [Updated] (SPARK-23058) Show create table can't show non printable field delim

2018-01-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23058: Summary: Show create table can't show non printable field delim (was: Show create table conn't

[jira] [Updated] (SPARK-23058) Show create table can't show non printable field delim

2018-01-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23058: Description: # create table t1: {code:sql} CREATE EXTERNAL TABLE `t1`(`col1` bigint) ROW FORMAT

[jira] [Created] (SPARK-23058) Show create table conn't show non printable field delim

2018-01-12 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-23058: --- Summary: Show create table conn't show non printable field delim Key: SPARK-23058 URL: https://issues.apache.org/jira/browse/SPARK-23058 Project: Spark Issue

[jira] [Comment Edited] (SPARK-23297) Spark job is finished but the stage process is error

2018-02-04 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351791#comment-16351791 ] Yuming Wang edited comment on SPARK-23297 at 2/4/18 1:52 PM: -

[jira] [Commented] (SPARK-23297) Spark job is finished but the stage process is error

2018-02-04 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351791#comment-16351791 ] Yuming Wang commented on SPARK-23297: - [~KaiXinXIaoLei] Try to increase

[jira] [Created] (SPARK-23336) Upgrade snappy-java to 1.1.4

2018-02-05 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-23336: --- Summary: Upgrade snappy-java to 1.1.4 Key: SPARK-23336 URL: https://issues.apache.org/jira/browse/SPARK-23336 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-23332) Update SQLQueryTestSuite to support test both default mode and hive mode for a typeCoercion TestCase

2018-02-04 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23332: Summary: Update SQLQueryTestSuite to support test both default mode and hive mode for a

[jira] [Created] (SPARK-23332) Update SQLQueryTestSuite to support test hive mode

2018-02-04 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-23332: --- Summary: Update SQLQueryTestSuite to support test hive mode Key: SPARK-23332 URL: https://issues.apache.org/jira/browse/SPARK-23332 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23297) Spark job is finished but the stage process is error

2018-02-01 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348332#comment-16348332 ] Yuming Wang commented on SPARK-23297: - It seems because {{SparkListenerTaskEnd}} events are not

[jira] [Created] (SPARK-23263) create table stored as parquet should update table size if automatic update table size is enabled

2018-01-29 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-23263: --- Summary: create table stored as parquet should update table size if automatic update table size is enabled Key: SPARK-23263 URL: https://issues.apache.org/jira/browse/SPARK-23263

[jira] [Updated] (SPARK-23336) Upgrade snappy-java to 1.1.7.1

2018-02-06 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23336: Summary: Upgrade snappy-java to 1.1.7.1 (was: Upgrade snappy-java to 1.1.4) > Upgrade snappy-java

[jira] [Commented] (SPARK-23405) The task will hang up when a small table left semi join a big table

2018-02-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362162#comment-16362162 ] Yuming Wang commented on SPARK-23405: - I think it's data skew, you should broadcast small table. >

[jira] [Commented] (SPARK-23354) spark jdbc does not maintain length of data type when I move data from MS sql server to Oracle using spark jdbc

2018-02-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357966#comment-16357966 ] Yuming Wang commented on SPARK-23354: - Do you mean custom column type? you can find more details

[jira] [Commented] (SPARK-23373) Can not execute "count distinct" queries on parquet formatted table

2018-02-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358392#comment-16358392 ] Yuming Wang commented on SPARK-23373: - I cannot reproduce on current master as your mentioned too. >

[jira] [Commented] (SPARK-23370) Spark receives a size of 0 for an Oracle Number field and defaults the field type to be BigDecimal(30,10) instead of the actual precision and scale

2018-02-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358401#comment-16358401 ] Yuming Wang commented on SPARK-23370: - User can config the column type like below now: {code:scala}

[jira] [Created] (SPARK-23510) Support read data from Hive 2.2 and Hive 2.3 metastore

2018-02-24 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-23510: --- Summary: Support read data from Hive 2.2 and Hive 2.3 metastore Key: SPARK-23510 URL: https://issues.apache.org/jira/browse/SPARK-23510 Project: Spark Issue

[jira] [Commented] (SPARK-23510) Support read data from Hive 2.2 and Hive 2.3 metastore

2018-02-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375660#comment-16375660 ] Yuming Wang commented on SPARK-23510: - [~JPMoresmau] Can you try 

[jira] [Commented] (SPARK-22722) Test Coverage for Type Coercion Compatibility

2017-12-28 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305979#comment-16305979 ] Yuming Wang commented on SPARK-22722: - [~smilegator] All tests are added, except

[jira] [Commented] (SPARK-20295) when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue

2018-06-22 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520148#comment-16520148 ] Yuming Wang commented on SPARK-20295: - [~KevinZwx] Can you try

[jira] [Updated] (SPARK-24937) Datasource partition table should load empty static partitions

2018-07-30 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24937: Summary: Datasource partition table should load empty static partitions (was: Datasource

[jira] [Issue Comment Deleted] (SPARK-24937) Datasource partition table should load empty partitions

2018-07-26 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24937: Comment: was deleted (was: I'm working on.) > Datasource partition table should load empty

[jira] [Resolved] (SPARK-24916) Fix type coercion for IN expression with subquery

2018-07-25 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-24916. - Resolution: Duplicate > Fix type coercion for IN expression with subquery >

[jira] [Resolved] (SPARK-24816) SQL interface support repartitionByRange

2018-07-31 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-24816. - Resolution: Won't Fix {{Order by}} is implement by {{rangepartitioning}}. > SQL interface

[jira] [Commented] (SPARK-19394) "assertion failed: Expected hostname" on macOS when self-assigned IP contains a percent sign

2018-07-31 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564532#comment-16564532 ] Yuming Wang commented on SPARK-19394: - Try to add {{::1             localhost}} to /etc/hosts. >

[jira] [Updated] (SPARK-24937) Datasource partition table should load empty partitions

2018-07-26 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24937: Description: How to reproduce: {code:sql} spark-sql> CREATE TABLE tbl AS SELECT 1; 18/07/26

[jira] [Updated] (SPARK-24937) Datasource partition table should load empty partitions

2018-07-26 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24937: Description: How to reproduce: {code:sql} spark-sql> CREATE TABLE tbl AS SELECT 1; spark-sql>

[jira] [Created] (SPARK-24937) Datasource partition table should load empty partitions

2018-07-26 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24937: --- Summary: Datasource partition table should load empty partitions Key: SPARK-24937 URL: https://issues.apache.org/jira/browse/SPARK-24937 Project: Spark Issue

[jira] [Commented] (SPARK-24937) Datasource partition table should load empty partitions

2018-07-26 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558386#comment-16558386 ] Yuming Wang commented on SPARK-24937: - I'm working on. > Datasource partition table should load

[jira] [Commented] (SPARK-20592) Alter table concatenate is not working as expected.

2018-08-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569673#comment-16569673 ] Yuming Wang commented on SPARK-20592: - Spark doesn't support this command:

[jira] [Commented] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-10 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576711#comment-16576711 ] Yuming Wang commented on SPARK-25085: - I'm working on this. > Insert overwrite a non-partitioned

[jira] [Created] (SPARK-25039) Binary comparison behavior should refer to Teradata

2018-08-06 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-25039: --- Summary: Binary comparison behavior should refer to Teradata Key: SPARK-25039 URL: https://issues.apache.org/jira/browse/SPARK-25039 Project: Spark Issue

[jira] [Created] (SPARK-25056) Unify the InConversion and BinaryComparison behaviour when InConversion's list only contains one datatype

2018-08-08 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-25056: --- Summary: Unify the InConversion and BinaryComparison behaviour when InConversion's list only contains one datatype Key: SPARK-25056 URL:

[jira] [Comment Edited] (SPARK-25051) where clause on dataset gives AnalysisException

2018-08-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579181#comment-16579181 ] Yuming Wang edited comment on SPARK-25051 at 8/14/18 3:13 AM: -- Yes. The bug

[jira] [Commented] (SPARK-25051) where clause on dataset gives AnalysisException

2018-08-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579181#comment-16579181 ] Yuming Wang commented on SPARK-25051: - Yes. The bug still exists. I can reproduced by: {code:scala}

[jira] [Comment Edited] (SPARK-25051) where clause on dataset gives AnalysisException

2018-08-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577401#comment-16577401 ] Yuming Wang edited comment on SPARK-25051 at 8/12/18 10:51 AM: --- Can you

[jira] [Comment Edited] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate

2018-08-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577502#comment-16577502 ] Yuming Wang edited comment on SPARK-24631 at 8/12/18 11:18 AM: --- I hit this

[jira] [Commented] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate

2018-08-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577502#comment-16577502 ] Yuming Wang commented on SPARK-24631: - I hit this issue. fixed it by recreate table/view. Can you

[jira] [Updated] (SPARK-25135) insert datasource table may all null when select from view

2018-08-16 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25135: Affects Version/s: (was: 2.4.0) 2.3.0 2.3.1 >

[jira] [Created] (SPARK-25135) insert datasource table may all null when select from view

2018-08-16 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-25135: --- Summary: insert datasource table may all null when select from view Key: SPARK-25135 URL: https://issues.apache.org/jira/browse/SPARK-25135 Project: Spark

[jira] [Commented] (SPARK-25132) Spark returns NULL for a column whose Hive metastore schema and Parquet schema are in different letter cases

2018-08-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583688#comment-16583688 ] Yuming Wang commented on SPARK-25132: - Stackoverflow has been asked this question [Spark SQL returns

[jira] [Issue Comment Deleted] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25085: Comment: was deleted (was: I'm working on this.) > Insert overwrite a non-partitioned table can

[jira] [Commented] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577221#comment-16577221 ] Yuming Wang commented on SPARK-25085: - [~lirui] A another issue you may be interest: 

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575771#comment-16575771 ] Yuming Wang commented on SPARK-25084: - [~smilegator], [~jerryshao] I think It should be target

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575777#comment-16575777 ] Yuming Wang commented on SPARK-25084: - It's a regression. > "distribute by" on multiple columns may

[jira] [Commented] (SPARK-25071) BuildSide is coming not as expected with join queries

2018-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577385#comment-16577385 ] Yuming Wang commented on SPARK-25071: - I think it's correct. CBO based on RowCount. {code:scala} def

[jira] [Commented] (SPARK-25051) where clause on dataset gives AnalysisException

2018-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577401#comment-16577401 ] Yuming Wang commented on SPARK-25051: - Can you it with Spark [2.3.2-rc4 

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Description: How to reproduce: {code:sql} spark-sql> SELECT upper('Haßler'); HASSLER {code}

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Description: How to reproduce: {code:sql} spark-sql> SELECT upper('Haßler'); HASSLER {code}

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Attachment: MySQL.png > Upper behaves incorrect for string contains "ß" >

[jira] [Created] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-25230: --- Summary: Upper behaves incorrect for string contains "ß" Key: SPARK-25230 URL: https://issues.apache.org/jira/browse/SPARK-25230 Project: Spark Issue Type:

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Attachment: WechatIMG511.jpeg > Upper behaves incorrect for string contains "ß" >

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Attachment: (was: WechatIMG511.jpeg) > Upper behaves incorrect for string contains "ß" >

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Attachment: Teradata.jpeg > Upper behaves incorrect for string contains "ß" >

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Description: How to reproduce: {code:sql} spark-sql> SELECT upper('Haßler'); HASSLER {code}

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Description: How to reproduce: {code:sql} spark-sql> SELECT upper('Haßler'); HASSLER {code}

[jira] [Updated] (SPARK-25230) Upper behavior incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Summary: Upper behavior incorrect for string contains "ß" (was: Upper behaves incorrect for

[jira] [Updated] (SPARK-25230) Upper behavior incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Description: How to reproduce: {code:sql} spark-sql> SELECT upper('Haßler'); HASSLER {code}

[jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß"

2018-08-24 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25230: Description: How to reproduce: {code:sql} spark-sql> SELECT upper('Haßler'); HASSLER {code}

<    1   2   3   4   5   6   7   8   9   10   >