[jira] [Commented] (SPARK-31935) Hadoop file system config should be effective in data source options

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130065#comment-17130065 ] Apache Spark commented on SPARK-31935: -- User 'gengliangwang' has created a pull request for this

[jira] [Comment Edited] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130059#comment-17130059 ] Jungtaek Lim edited comment on SPARK-31946 at 6/10/20, 4:31 AM: Oh I see

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130059#comment-17130059 ] Jungtaek Lim commented on SPARK-31946: -- Oh I see what you meant. Thanks for making it clear. I'm

[jira] [Commented] (SPARK-31486) spark.submit.waitForCompletion flag to control spark-submit exit in Standalone Cluster Mode

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130034#comment-17130034 ] Apache Spark commented on SPARK-31486: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

2020-06-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130033#comment-17130033 ] angerszhu commented on SPARK-19169: --- [~hyukjin.kwon]   Today our user meet this error. that table

[jira] [Updated] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

2020-06-09 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-31948: - Description: {{1, aggregateByKey,}} {{reduceByKey}} and  {{foldByKey}} will always perform

[jira] [Updated] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

2020-06-09 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-31948: - Description: {{1, aggregateByKey,}} {{reduceByKey}} and  {{foldByKey}} will always perform

[jira] [Created] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

2020-06-09 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-31948: Summary: expose mapSideCombine in aggByKey/reduceByKey/foldByKey Key: SPARK-31948 URL: https://issues.apache.org/jira/browse/SPARK-31948 Project: Spark

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130015#comment-17130015 ] wuyi commented on SPARK-31946: -- oh, I mean, for the **decommission** feature, we should register someone

[jira] [Comment Edited] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130015#comment-17130015 ] wuyi edited comment on SPARK-31946 at 6/10/20, 3:27 AM: oh, I mean, for the

[jira] [Commented] (SPARK-31925) Summary.totalIterations greater than maxIters

2020-06-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130004#comment-17130004 ] Sean R. Owen commented on SPARK-31925: -- Sounds like a small bug, unless one of the iterations is

[jira] [Commented] (SPARK-31925) Summary.totalIterations greater than maxIters

2020-06-09 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130002#comment-17130002 ] zhengruifeng commented on SPARK-31925: -- also ping [~srowen]  [~weichenxu123] >

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130001#comment-17130001 ] Jungtaek Lim commented on SPARK-31946: -- It’s intended to take up non-posix compliant signal, AFAIK.

[jira] [Resolved] (SPARK-29897) Implicit cast to timestamp is failing

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29897. - Resolution: Won't Do > Implicit cast to timestamp is failing >

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129982#comment-17129982 ] wuyi commented on SPARK-31946: -- The message is good. But the failure should not be expected, IIUC. >

[jira] [Commented] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

2020-06-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129973#comment-17129973 ] angerszhu commented on SPARK-31947: --- raise pr soon > Solve string value error about Date/Timestamp in

[jira] [Created] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

2020-06-09 Thread angerszhu (Jira)
angerszhu created SPARK-31947: - Summary: Solve string value error about Date/Timestamp in ScriptTransform Key: SPARK-31947 URL: https://issues.apache.org/jira/browse/SPARK-31947 Project: Spark

[jira] [Comment Edited] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129955#comment-17129955 ] Jungtaek Lim edited comment on SPARK-31946 at 6/10/20, 2:12 AM: That

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129955#comment-17129955 ] Jungtaek Lim commented on SPARK-31946: -- That message is intended. It wasn't showing which feature

[jira] [Commented] (SPARK-31945) Make more cache enable for Python UDFs.

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129951#comment-17129951 ] Apache Spark commented on SPARK-31945: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31945) Make more cache enable for Python UDFs.

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31945: Assignee: Apache Spark > Make more cache enable for Python UDFs. >

[jira] [Updated] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31946: - Description:   {code:java} 20/06/09 22:54:54 WARN SignalUtils: Failed to register SIGPWR handler - disabling

[jira] [Commented] (SPARK-31945) Make more cache enable for Python UDFs.

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129948#comment-17129948 ] Apache Spark commented on SPARK-31945: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31945) Make more cache enable for Python UDFs.

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31945: Assignee: (was: Apache Spark) > Make more cache enable for Python UDFs. >

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129947#comment-17129947 ] wuyi commented on SPARK-31946: -- cc [~holden] > Failed to register SIGPWR handler on MacOS >

[jira] [Created] (SPARK-31946) Failed to register SIGPWR handler on MacOS

2020-06-09 Thread wuyi (Jira)
wuyi created SPARK-31946: Summary: Failed to register SIGPWR handler on MacOS Key: SPARK-31946 URL: https://issues.apache.org/jira/browse/SPARK-31946 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129944#comment-17129944 ] Wenchen Fan commented on SPARK-26905: - [~maropu] shall we also add the listed non-reserved keywords

[jira] [Created] (SPARK-31945) Make more cache enable for Python UDFs.

2020-06-09 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-31945: - Summary: Make more cache enable for Python UDFs. Key: SPARK-31945 URL: https://issues.apache.org/jira/browse/SPARK-31945 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129904#comment-17129904 ] Takeshi Yamamuro edited comment on SPARK-26905 at 6/10/20, 1:20 AM:

[jira] [Assigned] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26905: Assignee: (was: Apache Spark) > Revisit reserved/non-reserved keywords based on the

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129906#comment-17129906 ] Apache Spark commented on SPARK-26905: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26905: Assignee: Apache Spark > Revisit reserved/non-reserved keywords based on the ANSI SQL

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129905#comment-17129905 ] Takeshi Yamamuro commented on SPARK-26905: -- I've opened a PR to add TYPE in the list  a few

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129904#comment-17129904 ] Takeshi Yamamuro commented on SPARK-26905: -- Thanks for checking them, Maxim! Ah, I see. I think

[jira] [Commented] (SPARK-31944) Add instance weight support in LinearRegressionSummary

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129844#comment-17129844 ] Apache Spark commented on SPARK-31944: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31944) Add instance weight support in LinearRegressionSummary

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31944: Assignee: (was: Apache Spark) > Add instance weight support in

[jira] [Assigned] (SPARK-31944) Add instance weight support in LinearRegressionSummary

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31944: Assignee: Apache Spark > Add instance weight support in LinearRegressionSummary >

[jira] [Created] (SPARK-31944) Add instance weight support in LinearRegressionSummary

2020-06-09 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-31944: -- Summary: Add instance weight support in LinearRegressionSummary Key: SPARK-31944 URL: https://issues.apache.org/jira/browse/SPARK-31944 Project: Spark Issue

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

2020-06-09 Thread Everett Rush (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129814#comment-17129814 ] Everett Rush commented on SPARK-27249: -- [~nafshartous] Hi Nick, thanks for looping me in. I just

[jira] [Commented] (SPARK-31935) Hadoop file system config should be effective in data source options

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129747#comment-17129747 ] Apache Spark commented on SPARK-31935: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-31935) Hadoop file system config should be effective in data source options

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129746#comment-17129746 ] Apache Spark commented on SPARK-31935: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129737#comment-17129737 ] Maxim Gekk commented on SPARK-26905: Spark's reserved keywords that are not reserved in SQL2016:

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129732#comment-17129732 ] Xiao Li commented on SPARK-26905: - cc [~maropu] > Revisit reserved/non-reserved keywords based on the

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129730#comment-17129730 ] Maxim Gekk commented on SPARK-26905: Spark's ANSI Non-Reserved keywords are actually reserved

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129729#comment-17129729 ] Maxim Gekk commented on SPARK-26905: I downloaded SQL2016 reserved and non-reserved keywords from

[jira] [Updated] (SPARK-31935) Hadoop file system config should be effective in data source options

2020-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-31935: --- Affects Version/s: 2.4.7 3.0.1 > Hadoop file system config should be

[jira] [Updated] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-26905: --- Attachment: sql2016-02-nonreserved.txt sql2016-02-reserved.txt

[jira] [Resolved] (SPARK-31830) Consistent error handling for datetime formatting functions

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31830. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28650

[jira] [Resolved] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31926. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31926: --- Assignee: Kent Yao > Fix concurrency issue for ThriftCLIService to getPortNumber >

[jira] [Updated] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

2020-06-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31932: -- Fix Version/s: (was: 3.0.0) 3.1.0 3.0.1 > Add

[jira] [Updated] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31940: -- Fix Version/s: (was: 3.0.0) 3.1.0 3.0.1 > Document

[jira] [Commented] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

2020-06-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129529#comment-17129529 ] Dongjoon Hyun commented on SPARK-31220: --- Hi, [~cloud_fan]. I updated the fixed version from 3.0.0

[jira] [Updated] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31921: -- Fix Version/s: 3.1.0 > Wrong warning of "WARN Master: App app-xxx requires more resource than

[jira] [Updated] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31921: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Wrong warning of "WARN Master: App

[jira] [Updated] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

2020-06-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31220: -- Fix Version/s: (was: 3.0.0) 3.1.0 3.0.1 >

[jira] [Resolved] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31921. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28742

[jira] [Assigned] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31921: - Assignee: wuyi > Wrong warning of "WARN Master: App app-xxx requires more resource

[jira] [Assigned] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31220: --- Assignee: Yuming Wang > repartition obeys

[jira] [Resolved] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31220. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27986

[jira] [Updated] (SPARK-31943) SPARK-31500 introduces breaking changes in 2.4.6

2020-06-09 Thread Jefferson V (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jefferson V updated SPARK-31943: Labels: backward-incompatible (was: ) > SPARK-31500 introduces breaking changes in 2.4.6 >

[jira] [Updated] (SPARK-31943) SPARK-31500 introduces breaking changes in 2.4.6

2020-06-09 Thread Jefferson V (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jefferson V updated SPARK-31943: Description: [31500|[https://github.com/apache/spark/pull/28351/files]] introduced unimplemented

[jira] [Created] (SPARK-31943) SPARK-31500 introduces breaking changes in 2.4.6

2020-06-09 Thread Jefferson V (Jira)
Jefferson V created SPARK-31943: --- Summary: SPARK-31500 introduces breaking changes in 2.4.6 Key: SPARK-31943 URL: https://issues.apache.org/jira/browse/SPARK-31943 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31940. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28767

[jira] [Assigned] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31940: --- Assignee: Maxim Gekk > Document the default JVM time zone in to/fromJavaDate and legacy

[jira] [Updated] (SPARK-31486) spark.submit.waitForCompletion flag to control spark-submit exit in Standalone Cluster Mode

2020-06-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31486: - Priority: Minor (was: Major) > spark.submit.waitForCompletion flag to control spark-submit

[jira] [Resolved] (SPARK-31486) spark.submit.waitForCompletion flag to control spark-submit exit in Standalone Cluster Mode

2020-06-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31486. -- Fix Version/s: 3.1.0 Assignee: Akshat Bordia Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-31906) Enhance comments in NamedExpression.qualifier

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31906. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28726

[jira] [Assigned] (SPARK-31906) Enhance comments in NamedExpression.qualifier

2020-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31906: --- Assignee: Zhu, Lipeng > Enhance comments in NamedExpression.qualifier >

[jira] [Commented] (SPARK-28834) JDBC option "sessionInitStatement" does not executes sql statement when write data into database from dataframe

2020-06-09 Thread Thomas Uhren (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129209#comment-17129209 ] Thomas Uhren commented on SPARK-28834: -- Any chance to get this issue resolved? > JDBC option

[jira] [Commented] (SPARK-31864) Adjust AQE skew join trigger condition

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129187#comment-17129187 ] Apache Spark commented on SPARK-31864: -- User 'manuzhang' has created a pull request for this issue:

[jira] [Commented] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129185#comment-17129185 ] Apache Spark commented on SPARK-31942: -- User 'manuzhang' has created a pull request for this issue:

[jira] [Commented] (SPARK-31864) Adjust AQE skew join trigger condition

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129186#comment-17129186 ] Apache Spark commented on SPARK-31864: -- User 'manuzhang' has created a pull request for this issue:

[jira] [Commented] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129184#comment-17129184 ] Apache Spark commented on SPARK-31942: -- User 'manuzhang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31942: Assignee: Apache Spark > Revert SPARK-31864 Adjust AQE skew join trigger condition >

[jira] [Assigned] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31942: Assignee: (was: Apache Spark) > Revert SPARK-31864 Adjust AQE skew join trigger

[jira] [Created] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

2020-06-09 Thread Manu Zhang (Jira)
Manu Zhang created SPARK-31942: -- Summary: Revert SPARK-31864 Adjust AQE skew join trigger condition Key: SPARK-31942 URL: https://issues.apache.org/jira/browse/SPARK-31942 Project: Spark Issue

[jira] [Commented] (SPARK-31927) Upgrade fabric8 to 4.10.2 to support Kubernetes 1.18

2020-06-09 Thread Jaakko Pallari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129153#comment-17129153 ] Jaakko Pallari commented on SPARK-31927: Actually, the fix for SPARK-31819 is sufficient. >

[jira] [Commented] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129102#comment-17129102 ] Apache Spark commented on SPARK-31929: -- User 'zhli1142015' has created a pull request for this

[jira] [Assigned] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31929: Assignee: (was: Apache Spark) > local cache size exceeding

[jira] [Assigned] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31929: Assignee: Apache Spark > local cache size exceeding "spark.history.store.maxDiskUsage"

[jira] [Commented] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129101#comment-17129101 ] Apache Spark commented on SPARK-31929: -- User 'zhli1142015' has created a pull request for this

[jira] [Commented] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129074#comment-17129074 ] Apache Spark commented on SPARK-31941: -- User 'SaurabhChawla100' has created a pull request for this

[jira] [Assigned] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31941: Assignee: (was: Apache Spark) > Handling the exception in SparkUI for getSparkUser

[jira] [Commented] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129073#comment-17129073 ] Apache Spark commented on SPARK-31941: -- User 'SaurabhChawla100' has created a pull request for this

[jira] [Assigned] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31941: Assignee: Apache Spark > Handling the exception in SparkUI for getSparkUser method >

[jira] [Created] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

2020-06-09 Thread Saurabh Chawla (Jira)
Saurabh Chawla created SPARK-31941: -- Summary: Handling the exception in SparkUI for getSparkUser method Key: SPARK-31941 URL: https://issues.apache.org/jira/browse/SPARK-31941 Project: Spark

[jira] [Commented] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129055#comment-17129055 ] Apache Spark commented on SPARK-31940: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31940: Assignee: (was: Apache Spark) > Document the default JVM time zone in

[jira] [Assigned] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31940: Assignee: Apache Spark > Document the default JVM time zone in to/fromJavaDate and

[jira] [Commented] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129054#comment-17129054 ] Apache Spark commented on SPARK-31940: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31940: -- Summary: Document the default JVM time zone in to/fromJavaDate and legacy date formatters Key: SPARK-31940 URL: https://issues.apache.org/jira/browse/SPARK-31940

[jira] [Assigned] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31939: Assignee: (was: Apache Spark) > Fix Parsing day of year when year field pattern is

[jira] [Commented] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129025#comment-17129025 ] Apache Spark commented on SPARK-31939: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129024#comment-17129024 ] Apache Spark commented on SPARK-31939: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31939: Assignee: Apache Spark > Fix Parsing day of year when year field pattern is missing >

[jira] [Updated] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

2020-06-09 Thread zhli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhli updated SPARK-31929: - Summary: local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in

[jira] [Created] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

2020-06-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-31939: Summary: Fix Parsing day of year when year field pattern is missing Key: SPARK-31939 URL: https://issues.apache.org/jira/browse/SPARK-31939 Project: Spark Issue

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

2020-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128955#comment-17128955 ] Apache Spark commented on SPARK-29295: -- User 'turboFei' has created a pull request for this issue:

[jira] [Resolved] (SPARK-26904) API Auditing

2020-06-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26904. - Resolution: Done > API Auditing > > > Key: SPARK-26904 >

  1   2   >