[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:15 AM: Detailed error

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:15 AM: Detailed error

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:14 AM: Detailed error

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:14 AM: Detailed error

[jira] [Resolved] (SPARK-32456) Check the Distinct by assuming it as Aggregate for Structured Streaming

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32456. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32456) Check the Distinct by assuming it as Aggregate for Structured Streaming

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32456: Assignee: Yuanjian Li > Check the Distinct by assuming it as Aggregate for Structured

[jira] [Updated] (SPARK-32424) Fix silent data change for timestamp parsing if overflow happens

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32424: -- Labels: correctness (was: ) > Fix silent data change for timestamp parsing if overflow

[jira] [Resolved] (SPARK-32337) Show initial plan in AQE plan tree string

2020-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32337. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29137

[jira] [Updated] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-08-09 Thread Dustin Smith (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Smith updated SPARK-32046: - Affects Version/s: 3.0.0 > current_timestamp called in a cache dataframe freezes the time for

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-08-09 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174064#comment-17174064 ] Saurabh Chawla commented on SPARK-32234: [~ramks] - We faced the similar issue in spark3.0.0.

[jira] [Commented] (SPARK-32536) deleted not existing hdfs locations when use spark sql to execute "insert overwrite" statement to dynamic partition

2020-08-09 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174060#comment-17174060 ] Lantao Jin commented on SPARK-32536: {quote} I found that I mistake the issue condition, I reproduce

[jira] [Commented] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in PySpark

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174048#comment-17174048 ] Hyukjin Kwon commented on SPARK-32500: -- This is a nice analysis. Thanks [~JinxinTang].

[jira] [Resolved] (SPARK-32536) deleted not existing hdfs locations when use spark sql to execute "insert overwrite" statement to dynamic partition

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32536. -- Resolution: Invalid Please discuss with the vendor if the issue is reproduced with the

[jira] [Assigned] (SPARK-30866) FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30866: - Assignee: Jungtaek Lim > FileStreamSource: Cache fetched list of files beyond

[jira] [Resolved] (SPARK-30866) FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30866. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27620

[jira] [Closed] (SPARK-32566) kafka consumer cache capacity is unclear

2020-08-09 Thread srpn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] srpn closed SPARK-32566. > kafka consumer cache capacity is unclear > > > Key:

[jira] [Resolved] (SPARK-32566) kafka consumer cache capacity is unclear

2020-08-09 Thread srpn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] srpn resolved SPARK-32566. -- Resolution: Not A Problem > kafka consumer cache capacity is unclear >

[jira] [Assigned] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32575: - Assignee: Devesh Agrawal > BlockManagerDecommissionIntegrationSuite is still flaky >

[jira] [Resolved] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32575. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29388

[jira] [Created] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2020-08-09 Thread Cheng Su (Jira)
Cheng Su created SPARK-32577: Summary: Fix the config value for shuffled hash join in test in-joins.sql Key: SPARK-32577 URL: https://issues.apache.org/jira/browse/SPARK-32577 Project: Spark

[jira] [Updated] (SPARK-32576) Support PostgreSQL `bpchar` type and array of char type

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32576: -- Summary: Support PostgreSQL `bpchar` type and array of char type (was: Support PostgreSQL

[jira] [Resolved] (SPARK-32576) Support PostgreSQL `bpchar` array

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32576. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-32576) Support PostgreSQL `bpchar` array

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32576: - Assignee: Jakub Korzeniowski > Support PostgreSQL `bpchar` array >

[jira] [Commented] (SPARK-30643) Add support for embedding Hive 3

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174017#comment-17174017 ] Hyukjin Kwon commented on SPARK-30643: -- [~Kelvin.FE] you can try to create a PR to upgrade by your

[jira] [Updated] (SPARK-32576) Support PostgreSQL `bpchar` array

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32576: -- Summary: Support PostgreSQL `bpchar` array (was: Add tests for all the character types in

[jira] [Assigned] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32576: Assignee: Apache Spark > Add tests for all the character types in

[jira] [Assigned] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32576: Assignee: (was: Apache Spark) > Add tests for all the character types in

[jira] [Commented] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174016#comment-17174016 ] Apache Spark commented on SPARK-32576: -- User 'kujon' has created a pull request for this issue:

[jira] [Updated] (SPARK-32393) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32393: -- Component/s: (was: Input/Output) SQL > Add tests for all the character

[jira] [Updated] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32576: -- Component/s: (was: Input/Output) SQL > Add tests for all the character

[jira] [Updated] (SPARK-32393) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32393: -- Issue Type: Test (was: Bug) > Add tests for all the character types in

[jira] [Assigned] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32576: - Assignee: (was: Takeshi Yamamuro) > Add tests for all the character types in

[jira] [Updated] (SPARK-32393) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32393: -- Description: (was: Attempting to read the following table: {code:java} CREATE TABLE

[jira] [Updated] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32576: -- Fix Version/s: (was: 3.0.1) (was: 3.1.0) > Add tests for all the

[jira] [Created] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-32576: - Summary: Add tests for all the character types in PostgresIntegrationSuite Key: SPARK-32576 URL: https://issues.apache.org/jira/browse/SPARK-32576 Project: Spark

[jira] [Updated] (SPARK-32393) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32393: -- Summary: Add tests for all the character types in PostgresIntegrationSuite (was: PostgreSQL:

[jira] [Assigned] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32393: - Assignee: Takeshi Yamamuro > PostgreSQL: blank-padded, fixed length character arrays

[jira] [Resolved] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32393. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174004#comment-17174004 ] Apache Spark commented on SPARK-32575: -- User 'agrawaldevesh' has created a pull request for this

[jira] [Assigned] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32575: Assignee: Apache Spark > BlockManagerDecommissionIntegrationSuite is still flaky >

[jira] [Assigned] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32575: Assignee: (was: Apache Spark) > BlockManagerDecommissionIntegrationSuite is still

[jira] [Commented] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174003#comment-17174003 ] Apache Spark commented on SPARK-32575: -- User 'agrawaldevesh' has created a pull request for this

[jira] [Created] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Devesh Agrawal (Jira)
Devesh Agrawal created SPARK-32575: -- Summary: BlockManagerDecommissionIntegrationSuite is still flaky Key: SPARK-32575 URL: https://issues.apache.org/jira/browse/SPARK-32575 Project: Spark

[jira] [Commented] (SPARK-30643) Add support for embedding Hive 3

2020-08-09 Thread Zhaoyang Qin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173999#comment-17173999 ] Zhaoyang Qin commented on SPARK-30643: -- I can't understand the experts' opinion. Obviously Hive3

[jira] [Commented] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173998#comment-17173998 ] Apache Spark commented on SPARK-32393: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173997#comment-17173997 ] Apache Spark commented on SPARK-32393: -- User 'maropu' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32557) Logging and Swallowing the Exception Per Entry in History Server

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32557. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29374

[jira] [Assigned] (SPARK-32557) Logging and Swallowing the Exception Per Entry in History Server

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32557: - Assignee: Yan Xiaole > Logging and Swallowing the Exception Per Entry in History

[jira] [Updated] (SPARK-31703) Changes made by SPARK-26985 break reading parquet files correctly in BigEndian architectures (AIX + LinuxPPC64)

2020-08-09 Thread Michail Giannakopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michail Giannakopoulos updated SPARK-31703: --- Description: Trying to upgrade to Apache Spark 2.4.5 in our IBM systems

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2020-08-09 Thread Xiao Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173967#comment-17173967 ] Xiao Han commented on SPARK-29767: -- [~maropu] I also tried to reproduce this issue, there are some

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2020-08-09 Thread Xiao Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Han updated SPARK-29767: - Attachment: test.py > Core dump happening on executors while doing simple union of Data Frames >

[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32559: -- Priority: Major (was: Minor) > Fix the trim logic in UTF8String.toInt/toLong did't handle

[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32559: -- Labels: correctness (was: ) > Fix the trim logic in UTF8String.toInt/toLong did't handle

[jira] [Resolved] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32559. --- Fix Version/s: 3.0.1 Assignee: EdisonWang Resolution: Fixed > Fix the trim

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173947#comment-17173947 ] Dongjoon Hyun edited comment on SPARK-32558 at 8/9/20, 7:00 PM:

[jira] [Commented] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173947#comment-17173947 ] Dongjoon Hyun commented on SPARK-32558: --- [~ramks]. You are referring "Upgrading from Spark SQL

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32558: -- Attachment: Screen Shot 2020-08-09 at 11.41.59 AM.png > ORC target files that Spark_3.0

[jira] [Comment Edited] (SPARK-32411) GPU Cluster Fail

2020-08-09 Thread Chitral Verma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173944#comment-17173944 ] Chitral Verma edited comment on SPARK-32411 at 8/9/20, 6:38 PM:

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32558: -- Attachment: (was: image.png) > ORC target files that Spark_3.0 produces does not work

[jira] [Commented] (SPARK-32411) GPU Cluster Fail

2020-08-09 Thread Chitral Verma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173944#comment-17173944 ] Chitral Verma commented on SPARK-32411: --- [~vinhdiesal] were you able to resolve this issue? I'm

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32558: -- Attachment: image.png > ORC target files that Spark_3.0 produces does not work with

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173924#comment-17173924 ] Ramakrishna Prasad K S commented on SPARK-32234: [~saurabhc100] has the fix for this bug

[jira] [Comment Edited] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173924#comment-17173924 ] Ramakrishna Prasad K S edited comment on SPARK-32234 at 8/9/20, 5:14 PM:

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 9:00 AM:

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 9:00 AM:

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:57 AM:

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:57 AM:

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:56 AM:

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:52 AM:

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:51 AM:

[jira] [Commented] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173779#comment-17173779 ] Ramakrishna Prasad K S commented on SPARK-32558: Hi [~dongjoon] Thanks for pointing

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Attachment: image-2020-08-09-14-07-00-521.png > ORC target files that

[jira] [Updated] (SPARK-32563) spark-sql doesn't support insert into mixed static & dynamic partition

2020-08-09 Thread yx91490 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yx91490 updated SPARK-32563: Description: spark-sql doesn't support insert into mixed static & dynamic partition, for example:

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

2020-08-09 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173757#comment-17173757 ] L. C. Hsieh commented on SPARK-32481: - Why this needs to be subtask of SPARK-32480. Will SPARK-32480

[jira] [Resolved] (SPARK-32563) spark-sql doesn't support insert into mixed static & dynamic partition

2020-08-09 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32563. -- Resolution: Not A Problem > spark-sql doesn't support insert into mixed static &

[jira] [Commented] (SPARK-32563) spark-sql doesn't support insert into mixed static & dynamic partition

2020-08-09 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173752#comment-17173752 ] Takeshi Yamamuro commented on SPARK-32563: -- Yea, I think so. Then I will close this. Thanks! >

[jira] [Commented] (SPARK-32563) spark-sql doesn't support insert into mixed static & dynamic partition

2020-08-09 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173751#comment-17173751 ] L. C. Hsieh commented on SPARK-32563: - So it is not an issue anymore in 2.4, 3.0 branches, right?