[jira] [Commented] (SPARK-28429) SQL Datetime util function being casted to double instead of timestamp

[ https://issues.apache.org/jira/browse/SPARK-28429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925059#comment-16925059 ] Hyukjin Kwon commented on SPARK-28429: -- So, does this JIRA target conversions from a string literal

[jira] [Reopened] (SPARK-28429) SQL Datetime util function being casted to double instead of timestamp

[ https://issues.apache.org/jira/browse/SPARK-28429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-28429: -- > SQL Datetime util function being casted to double instead of timestamp >

[jira] [Issue Comment Deleted] (SPARK-28429) SQL Datetime util function being casted to double instead of timestamp

[ https://issues.apache.org/jira/browse/SPARK-28429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28429: - Comment: was deleted (was: [~yumwang], please update JIRA together when you close a PR.) > SQL

[jira] [Commented] (SPARK-28429) SQL Datetime util function being casted to double instead of timestamp

[ https://issues.apache.org/jira/browse/SPARK-28429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925058#comment-16925058 ] Hyukjin Kwon commented on SPARK-28429: -- [~yumwang], please update JIRA together when you close a

[jira] [Resolved] (SPARK-28429) SQL Datetime util function being casted to double instead of timestamp

[ https://issues.apache.org/jira/browse/SPARK-28429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28429. -- Resolution: Won't Fix > SQL Datetime util function being casted to double instead of

[jira] [Updated] (SPARK-28988) "CliSuite#Commands using SerDe provided in --jars" not strong enough

[ https://issues.apache.org/jira/browse/SPARK-28988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28988: - Issue Type: Test (was: Bug) > "CliSuite#Commands using SerDe provided in --jars" not strong

[jira] [Commented] (SPARK-28988) "CliSuite#Commands using SerDe provided in --jars" not strong enough

[ https://issues.apache.org/jira/browse/SPARK-28988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925051#comment-16925051 ] Yuming Wang commented on SPARK-28988: - Yes. It's test only. > "CliSuite#Commands using SerDe

[jira] [Updated] (SPARK-28988) "CliSuite#Commands using SerDe provided in --jars" not strong enough

[ https://issues.apache.org/jira/browse/SPARK-28988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28988: Priority: Minor (was: Major) > "CliSuite#Commands using SerDe provided in --jars" not strong

[jira] [Commented] (SPARK-29005) build failed: sparkSession.createDataFrame[Int](Seq(1,2))

[ https://issues.apache.org/jira/browse/SPARK-29005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925048#comment-16925048 ] Zhou Zach commented on SPARK-29005: --- [~angerszhuuu] [~hyukjin.kwon] Thanks a lot > build failed:

[jira] [Resolved] (SPARK-28915) The new keyword is not used when instantiating the WorkerOffer.

[ https://issues.apache.org/jira/browse/SPARK-28915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28915. -- Resolution: Won't Fix > The new keyword is not used when instantiating the WorkerOffer. >

[jira] [Commented] (SPARK-28984) csv files should support multi-character separators

[ https://issues.apache.org/jira/browse/SPARK-28984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925027#comment-16925027 ] Hyukjin Kwon commented on SPARK-28984: -- Please post a self-contained reproducer with showing which

[jira] [Assigned] (SPARK-28000) Add comments.sql

[ https://issues.apache.org/jira/browse/SPARK-28000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28000: Assignee: Yuming Wang > Add comments.sql > > > Key:

[jira] [Resolved] (SPARK-28000) Add comments.sql

[ https://issues.apache.org/jira/browse/SPARK-28000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28000. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25588

[jira] [Commented] (SPARK-28988) "CliSuite#Commands using SerDe provided in --jars" not strong enough

[ https://issues.apache.org/jira/browse/SPARK-28988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925025#comment-16925025 ] Hyukjin Kwon commented on SPARK-28988: -- [~yumwang], is this test only? if so can you properly set

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28990: - Description: SparkSQL create table as select from one table which may not exists throw

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28990: - Environment: (was: Any) > SparkSQL invalid call to toAttribute on unresolved object, tree:

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28990: - Target Version/s: (was: 2.4.4) > SparkSQL invalid call to toAttribute on unresolved object,

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28990: - Fix Version/s: (was: 3.0.0) > SparkSQL invalid call to toAttribute on unresolved object,

[jira] [Commented] (SPARK-29005) build failed: sparkSession.createDataFrame[Int](Seq(1,2))

[ https://issues.apache.org/jira/browse/SPARK-29005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925022#comment-16925022 ] angerszhu commented on SPARK-29005: --- [~zhouzach] case class implement Product. Int, Float, Long

[jira] [Updated] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28999: - Component/s: (was: Spark Core) Structured Streaming > Exception in thread

[jira] [Resolved] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28999. -- Resolution: Invalid Please ask questions into mailing lists. See

[jira] [Updated] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28999: - Target Version/s: (was: 2.3.0) > Exception in thread "main"

[jira] [Commented] (SPARK-29004) DataFrameWriter.save does not work with bucketBy [and sortBy]

[ https://issues.apache.org/jira/browse/SPARK-29004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925020#comment-16925020 ] Hyukjin Kwon commented on SPARK-29004: -- You should use {{saveAsTable}}. > DataFrameWriter.save

[jira] [Resolved] (SPARK-29005) build failed: sparkSession.createDataFrame[Int](Seq(1,2))

[ https://issues.apache.org/jira/browse/SPARK-29005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29005. -- Resolution: Invalid Please ask questions to mailing lists. See

[jira] [Commented] (SPARK-29009) Returning pojo from udf not working

[ https://issues.apache.org/jira/browse/SPARK-29009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925017#comment-16925017 ] Hyukjin Kwon commented on SPARK-29009: -- BTW, the POJO looks weird. It should have getter and setter

[jira] [Commented] (SPARK-29017) JobGroup and LocalProperty not respected by PySpark

[ https://issues.apache.org/jira/browse/SPARK-29017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925009#comment-16925009 ] Hyukjin Kwon commented on SPARK-29017: -- Yes, I think it's a bit headache to fix it in "right"

[jira] [Commented] (SPARK-29017) JobGroup and LocalProperty not respected by PySpark

[ https://issues.apache.org/jira/browse/SPARK-29017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925008#comment-16925008 ] Hyukjin Kwon commented on SPARK-29017: -- [~irashid], actually I have a PR open for single thread

[jira] [Commented] (SPARK-29017) JobGroup and LocalProperty not respected by PySpark

[ https://issues.apache.org/jira/browse/SPARK-29017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924975#comment-16924975 ] Imran Rashid commented on SPARK-29017: -- [~hyukjin.kwon][~holdensmagicalunicorn] [~bryanc] any

[jira] [Updated] (SPARK-29017) JobGroup and LocalProperty not respected by PySpark

[ https://issues.apache.org/jira/browse/SPARK-29017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-29017: - Description: Pyspark has {{setJobGroup}} and {{setLocalProperty}} methods, which are intended

[jira] [Created] (SPARK-29017) JobGroup and LocalProperty not respected by PySpark

Imran Rashid created SPARK-29017: Summary: JobGroup and LocalProperty not respected by PySpark Key: SPARK-29017 URL: https://issues.apache.org/jira/browse/SPARK-29017 Project: Spark Issue

[jira] [Assigned] (SPARK-28126) Support TRIM(trimStr FROM str) syntax

[ https://issues.apache.org/jira/browse/SPARK-28126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-28126: --- Assignee: Yuming Wang (was: yuming.wang) > Support TRIM(trimStr FROM str) syntax >

[jira] [Created] (SPARK-29016) Update, fix LICENSE and NOTICE for Hive 2.3

Yuming Wang created SPARK-29016: --- Summary: Update, fix LICENSE and NOTICE for Hive 2.3 Key: SPARK-29016 URL: https://issues.apache.org/jira/browse/SPARK-29016 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1529) Support DFS based shuffle in addition to Netty shuffle

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924940#comment-16924940 ] Zheng Shao commented on SPARK-1529: --- For huge Spark jobs, we are seeing frequent failures due to the

[jira] [Commented] (SPARK-29005) build failed: sparkSession.createDataFrame[Int](Seq(1,2))

[ https://issues.apache.org/jira/browse/SPARK-29005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924909#comment-16924909 ] Zhou Zach commented on SPARK-29005: --- [~angerszhuuu] Thanks for reply.But I am confused about it.I find

[jira] [Commented] (SPARK-29015) Can not support "add jar" on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924882#comment-16924882 ] ocean commented on SPARK-29015: --- I try to fix it > Can not support "add jar" on JDK 11 >

[jira] [Updated] (SPARK-29015) Can not support "add jar" on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29015: Summary: Can not support "add jar" on JDK 11 (was: "add jar" can not support on JDK 11) > Can

[jira] [Updated] (SPARK-29015) "add jar" can not support on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29015: Description: How to reproduce: Case 1: {code:bash} export JAVA_HOME=/usr/lib/jdk-11.0.3 export

[jira] [Updated] (SPARK-29015) "add jar" can not support on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29015: Summary: "add jar" can not support on JDK 11 (was: Thriftserver can not support add jar on JDK

[jira] [Updated] (SPARK-29015) Thriftserver can not support add jar on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29015: Description: How to reproduce: {code:bash} export JAVA_HOME=/usr/lib/jdk-11.0.3 export

[jira] [Updated] (SPARK-29015) Thriftserver can not support add jar on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29015: Parent: SPARK-28684 Issue Type: Sub-task (was: Bug) > Thriftserver can not support add

[jira] [Created] (SPARK-29015) Thriftserver can not support add jar on JDK 11

Yuming Wang created SPARK-29015: --- Summary: Thriftserver can not support add jar on JDK 11 Key: SPARK-29015 URL: https://issues.apache.org/jira/browse/SPARK-29015 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-29005) build failed: sparkSession.createDataFrame[Int](Seq(1,2))

[ https://issues.apache.org/jira/browse/SPARK-29005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924777#comment-16924777 ] angerszhu commented on SPARK-29005: --- Int is not a subclass of trait `Product`   {code:java} def

[jira] [Commented] (SPARK-29009) Returning pojo from udf not working

[ https://issues.apache.org/jira/browse/SPARK-29009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924774#comment-16924774 ] Marco Gaido commented on SPARK-29009: - Why do you think this is a bug? If you want a struct to be

[jira] [Updated] (SPARK-28912) MatchError exception in CheckpointWriteHandler

[ https://issues.apache.org/jira/browse/SPARK-28912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28912: Fix Version/s: (was: 2.4.5) > MatchError exception in CheckpointWriteHandler >