[jira] [Created] (SPARK-31850) DetermineTableStats rules computes stats multiple time

2020-05-27 Thread Karuppayya (Jira)
Karuppayya created SPARK-31850: -- Summary: DetermineTableStats rules computes stats multiple time Key: SPARK-31850 URL: https://issues.apache.org/jira/browse/SPARK-31850 Project: Spark Issue

[jira] [Assigned] (SPARK-31849) Improve Python exception messages to be more Pythonic

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31849: Assignee: (was: Apache Spark) > Improve Python exception messages to be more

[jira] [Assigned] (SPARK-31849) Improve Python exception messages to be more Pythonic

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31849: Assignee: Apache Spark > Improve Python exception messages to be more Pythonic >

[jira] [Commented] (SPARK-31849) Improve Python exception messages to be more Pythonic

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118319#comment-17118319 ] Apache Spark commented on SPARK-31849: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-31849) Improve Python exception messages to be more Pythonic

2020-05-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31849: Summary: Improve Python exception messages to be more Pythonic Key: SPARK-31849 URL: https://issues.apache.org/jira/browse/SPARK-31849 Project: Spark Issue

[jira] [Commented] (SPARK-31841) Dataset.repartition leverage adaptive execution

2020-05-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118287#comment-17118287 ] Yuming Wang commented on SPARK-31841: - I try to fix this issue before:

[jira] [Created] (SPARK-31847) DAGSchedulerSuite: Rewrite the test framework to cover most of the existing major features of the Spark Scheduler, mock the necessary part wisely, and make the test fram

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31847: -- Summary: DAGSchedulerSuite: Rewrite the test framework to cover most of the existing major features of the Spark Scheduler, mock the necessary part wisely, and make the test framework better extendable.

[jira] [Created] (SPARK-31848) Break down the very huge test files, each test suite should focus on one or several major features, but not all the related behaviors

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31848: -- Summary: Break down the very huge test files, each test suite should focus on one or several major features, but not all the related behaviors Key: SPARK-31848 URL:

[jira] [Created] (SPARK-31846) DAGSchedulerSuite: For the pattern of cancel + assert, extract the general method

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31846: -- Summary: DAGSchedulerSuite: For the pattern of cancel + assert, extract the general method Key: SPARK-31846 URL: https://issues.apache.org/jira/browse/SPARK-31846

[jira] [Created] (SPARK-31845) DAGSchedulerSuite: Improve and reuse completeNextStageWithFetchFailure

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31845: -- Summary: DAGSchedulerSuite: Improve and reuse completeNextStageWithFetchFailure Key: SPARK-31845 URL: https://issues.apache.org/jira/browse/SPARK-31845 Project: Spark

[jira] [Created] (SPARK-31844) DAGSchedulerSuite: For the pattern of failed + assert, extract the general method

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31844: -- Summary: DAGSchedulerSuite: For the pattern of failed + assert, extract the general method Key: SPARK-31844 URL: https://issues.apache.org/jira/browse/SPARK-31844

[jira] [Created] (SPARK-31843) DAGSchedulerSuite: For the pattern of complete + assert, extract the general method

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31843: -- Summary: DAGSchedulerSuite: For the pattern of complete + assert, extract the general method Key: SPARK-31843 URL: https://issues.apache.org/jira/browse/SPARK-31843

[jira] [Created] (SPARK-31842) DAGSchedulerSuite: For the pattern of runevent + assert, extract the general method

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31842: -- Summary: DAGSchedulerSuite: For the pattern of runevent + assert, extract the general method Key: SPARK-31842 URL: https://issues.apache.org/jira/browse/SPARK-31842

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118248#comment-17118248 ] Apache Spark commented on SPARK-31764: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118247#comment-17118247 ] Apache Spark commented on SPARK-31764: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118244#comment-17118244 ] Jungtaek Lim commented on SPARK-31764: -- Thanks for confirming. :) > JsonProtocol doesn't write

[jira] [Comment Edited] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118242#comment-17118242 ] Kousuke Saruta edited comment on SPARK-31764 at 5/28/20, 2:34 AM: -- As

[jira] [Comment Edited] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118242#comment-17118242 ] Kousuke Saruta edited comment on SPARK-31764 at 5/28/20, 2:34 AM: -- As

[jira] [Comment Edited] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118242#comment-17118242 ] Kousuke Saruta edited comment on SPARK-31764 at 5/28/20, 2:33 AM: -- As

[jira] [Updated] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31764: --- Issue Type: Bug (was: Improvement) > JsonProtocol doesn't write RDDInfo#isBarrier >

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118242#comment-17118242 ] Kousuke Saruta commented on SPARK-31764: As you say, it's more proper to mark the label "bug"

[jira] [Assigned] (SPARK-28879) Kubernetes node selector should be configurable

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28879: Assignee: Apache Spark > Kubernetes node selector should be configurable >

[jira] [Assigned] (SPARK-28879) Kubernetes node selector should be configurable

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28879: Assignee: (was: Apache Spark) > Kubernetes node selector should be configurable >

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118203#comment-17118203 ] Xingbo Jiang commented on SPARK-31764: -- The issue is reported as "Improvement" and the affected

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118201#comment-17118201 ] Jungtaek Lim commented on SPARK-31764: -- For me this looks to be a bug - the description of PR

[jira] [Assigned] (SPARK-31839) delete duplicate code

2020-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31839: Assignee: philipse > delete duplicate code > -- > >

[jira] [Resolved] (SPARK-31839) delete duplicate code

2020-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31839. -- Fix Version/s: 3.0.0 2.4.6 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118191#comment-17118191 ] Apache Spark commented on SPARK-25351: -- User 'BryanCutler' has created a pull request for this

[jira] [Commented] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118189#comment-17118189 ] Apache Spark commented on SPARK-25351: -- User 'BryanCutler' has created a pull request for this

[jira] [Resolved] (SPARK-31763) DataFrame.inputFiles() not Available

2020-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31763. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28652

[jira] [Assigned] (SPARK-31763) DataFrame.inputFiles() not Available

2020-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31763: Assignee: Rakesh Raushan > DataFrame.inputFiles() not Available >

[jira] [Commented] (SPARK-31730) Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118183#comment-17118183 ] Apache Spark commented on SPARK-31730: -- User 'jiangxb1987' has created a pull request for this

[jira] [Resolved] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow

2020-05-27 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-25351. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 26585

[jira] [Assigned] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow

2020-05-27 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-25351: Assignee: Jalpan Randeri > Handle Pandas category type when converting from Python with

[jira] [Resolved] (SPARK-31730) Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite

2020-05-27 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-31730. -- Fix Version/s: 3.0.0 Assignee: Xingbo Jiang Resolution: Fixed Fixed by

[jira] [Updated] (SPARK-31838) The streaming output mode validator didn't treat union well

2020-05-27 Thread Xingcan Cui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui updated SPARK-31838: Description: {{UnsupportedOperationChecker.checkForStreaming}} didn't treat the union operator

[jira] [Commented] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-27 Thread James Boylan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118140#comment-17118140 ] James Boylan commented on SPARK-31800: -- Good catch. I'll be back in the office tomorrow and I will

[jira] [Updated] (SPARK-31838) The streaming output mode validator didn't treat union well

2020-05-27 Thread Xingcan Cui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui updated SPARK-31838: Description: {{UnsupportedOperationChecker.checkForStreaming}} didn't treat the union operator

[jira] [Commented] (SPARK-31841) Dataset.repartition leverage adaptive execution

2020-05-27 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118120#comment-17118120 ] koert kuipers commented on SPARK-31841: --- that is right. its a feature request i believe (unless i

[jira] [Updated] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-31764: - Fix Version/s: 3.1.0 > JsonProtocol doesn't write RDDInfo#isBarrier >

[jira] [Resolved] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-31764. -- Resolution: Fixed > JsonProtocol doesn't write RDDInfo#isBarrier >

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-27 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118118#comment-17118118 ] Xingbo Jiang commented on SPARK-31764: -- Resolved by https://github.com/apache/spark/pull/28583 >

[jira] [Commented] (SPARK-31841) Dataset.repartition leverage adaptive execution

2020-05-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118114#comment-17118114 ] Jungtaek Lim commented on SPARK-31841: -- It sounds like a question/feature request which is better

[jira] [Created] (SPARK-31841) Dataset.repartition leverage adaptive execution

2020-05-27 Thread koert kuipers (Jira)
koert kuipers created SPARK-31841: - Summary: Dataset.repartition leverage adaptive execution Key: SPARK-31841 URL: https://issues.apache.org/jira/browse/SPARK-31841 Project: Spark Issue

[jira] [Resolved] (SPARK-31797) Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31797. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by

[jira] [Issue Comment Deleted] (SPARK-31797) Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31797: - Comment: was deleted (was: Don't set Fix/Target version) > Adds TIMESTAMP_SECONDS,

[jira] [Updated] (SPARK-31827) fail datetime parsing/formatting if detect the Java 8 bug of stand-alone form

2020-05-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31827: Summary: fail datetime parsing/formatting if detect the Java 8 bug of stand-alone form (was:

[jira] [Updated] (SPARK-31797) Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31797: - Fix Version/s: (was: 3.1.0) Flags: (was: Patch) Target Version/s:

[jira] [Commented] (SPARK-25185) CBO rowcount statistics doesn't work for partitioned parquet external table

2020-05-27 Thread Ankit Dsouza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117992#comment-17117992 ] Ankit Dsouza commented on SPARK-25185: -- Hey [~zhenhuawang], can this be prioritized and fixed (if

[jira] [Comment Edited] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

2020-05-27 Thread Sudharshann D. (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110729#comment-17110729 ] Sudharshann D. edited comment on SPARK-31579 at 5/27/20, 5:59 PM: --

[jira] [Assigned] (SPARK-31835) Add zoneId to codegen related test in DateExpressionsSuite

2020-05-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31835: --- Assignee: Kent Yao > Add zoneId to codegen related test in DateExpressionsSuite >

[jira] [Resolved] (SPARK-31835) Add zoneId to codegen related test in DateExpressionsSuite

2020-05-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31835. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28653

[jira] [Assigned] (SPARK-31840) Add instance weight support in LogisticRegressionSummary

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31840: Assignee: (was: Apache Spark) > Add instance weight support in

[jira] [Assigned] (SPARK-31840) Add instance weight support in LogisticRegressionSummary

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31840: Assignee: Apache Spark > Add instance weight support in LogisticRegressionSummary >

[jira] [Commented] (SPARK-31840) Add instance weight support in LogisticRegressionSummary

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117923#comment-17117923 ] Apache Spark commented on SPARK-31840: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Created] (SPARK-31840) Add instance weight support in LogisticRegressionSummary

2020-05-27 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-31840: -- Summary: Add instance weight support in LogisticRegressionSummary Key: SPARK-31840 URL: https://issues.apache.org/jira/browse/SPARK-31840 Project: Spark Issue

[jira] [Commented] (SPARK-23443) Spark with Glue as external catalog

2020-05-27 Thread Edgar Klerks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117887#comment-17117887 ] Edgar Klerks commented on SPARK-23443: -- Working on this. Can I make work in progress PR's?  >

[jira] [Resolved] (SPARK-31719) Refactor JoinSelection

2020-05-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31719. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28540

[jira] [Assigned] (SPARK-31719) Refactor JoinSelection

2020-05-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31719: --- Assignee: Ali Afroozeh > Refactor JoinSelection > -- > >

[jira] [Commented] (SPARK-31839) delete duplicate code

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117852#comment-17117852 ] Apache Spark commented on SPARK-31839: -- User 'GuoPhilipse' has created a pull request for this

[jira] [Assigned] (SPARK-31839) delete duplicate code

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31839: Assignee: (was: Apache Spark) > delete duplicate code > -- > >

[jira] [Commented] (SPARK-31839) delete duplicate code

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117851#comment-17117851 ] Apache Spark commented on SPARK-31839: -- User 'GuoPhilipse' has created a pull request for this

[jira] [Assigned] (SPARK-31839) delete duplicate code

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31839: Assignee: Apache Spark > delete duplicate code > -- > >

[jira] [Commented] (SPARK-31837) Shift to the new highest locality level if there is when recomputeLocality

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117847#comment-17117847 ] Apache Spark commented on SPARK-31837: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31837) Shift to the new highest locality level if there is when recomputeLocality

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31837: Assignee: (was: Apache Spark) > Shift to the new highest locality level if there is

[jira] [Assigned] (SPARK-31837) Shift to the new highest locality level if there is when recomputeLocality

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31837: Assignee: Apache Spark > Shift to the new highest locality level if there is when

[jira] [Created] (SPARK-31839) delete duplicate code

2020-05-27 Thread philipse (Jira)
philipse created SPARK-31839: Summary: delete duplicate code Key: SPARK-31839 URL: https://issues.apache.org/jira/browse/SPARK-31839 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-31837) Shift to the new highest locality level if there is when recomputeLocality

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117848#comment-17117848 ] Apache Spark commented on SPARK-31837: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Updated] (SPARK-31838) The streaming output mode validator didn't treat union well

2020-05-27 Thread Xingcan Cui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui updated SPARK-31838: Parent: SPARK-31724 Issue Type: Sub-task (was: Bug) > The streaming output mode

[jira] [Created] (SPARK-31838) The streaming output mode validator didn't treat union well

2020-05-27 Thread Xingcan Cui (Jira)
Xingcan Cui created SPARK-31838: --- Summary: The streaming output mode validator didn't treat union well Key: SPARK-31838 URL: https://issues.apache.org/jira/browse/SPARK-31838 Project: Spark

[jira] [Created] (SPARK-31837) Shift to the new highest locality level if there is when recomputeLocality

2020-05-27 Thread wuyi (Jira)
wuyi created SPARK-31837: Summary: Shift to the new highest locality level if there is when recomputeLocality Key: SPARK-31837 URL: https://issues.apache.org/jira/browse/SPARK-31837 Project: Spark

[jira] [Resolved] (SPARK-31795) Stream Data with API to ServiceNow

2020-05-27 Thread Dominic Wetenkamp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominic Wetenkamp resolved SPARK-31795. --- Resolution: Workaround > Stream Data with API to ServiceNow >

[jira] [Resolved] (SPARK-31803) Make sure instance weight is not negative

2020-05-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31803. -- Fix Version/s: 3.1.0 Assignee: Huaxin Gao Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-31638) Clean code for pagination for all pages

2020-05-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31638. -- Fix Version/s: 3.1.0 Assignee: Rakesh Raushan Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31638: - Issue Type: Improvement (was: Bug) > Clean code for pagination for all pages >

[jira] [Commented] (SPARK-31809) Infer IsNotNull for all children of NullIntolerant expressions

2020-05-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117771#comment-17117771 ] Yuming Wang commented on SPARK-31809: - {noformat} hive> EXPLAIN SELECT t1.* FROM t1 JOIN t2 ON

[jira] [Commented] (SPARK-28054) Unable to insert partitioned table dynamically when partition name is upper case

2020-05-27 Thread Sandeep Katta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117759#comment-17117759 ] Sandeep Katta commented on SPARK-28054: --- [~hyukjin.kwon] is there any reason why this PR is not

[jira] [Commented] (SPARK-31836) input_file_name() gives wrong value following Python UDF usage

2020-05-27 Thread Wesley Hildebrandt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117726#comment-17117726 ] Wesley Hildebrandt commented on SPARK-31836: One last note .. with only four (or fewer)

[jira] [Created] (SPARK-31836) input_file_name() gives wrong value following Python UDF usage

2020-05-27 Thread Wesley Hildebrandt (Jira)
Wesley Hildebrandt created SPARK-31836: -- Summary: input_file_name() gives wrong value following Python UDF usage Key: SPARK-31836 URL: https://issues.apache.org/jira/browse/SPARK-31836 Project:

[jira] [Commented] (SPARK-31834) Improve error message for incompatible data types

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117689#comment-17117689 ] Apache Spark commented on SPARK-31834: -- User 'lipzhu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31834) Improve error message for incompatible data types

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31834: Assignee: Zhu, Lipeng (was: Apache Spark) > Improve error message for incompatible data

[jira] [Assigned] (SPARK-31834) Improve error message for incompatible data types

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31834: Assignee: Apache Spark (was: Zhu, Lipeng) > Improve error message for incompatible data

[jira] [Commented] (SPARK-31834) Improve error message for incompatible data types

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117688#comment-17117688 ] Apache Spark commented on SPARK-31834: -- User 'lipzhu' has created a pull request for this issue:

[jira] [Commented] (SPARK-31815) Support Hive Kerberos login in JDBC connector

2020-05-27 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117613#comment-17117613 ] Gabor Somogyi commented on SPARK-31815: --- [~agrim] why do you think an external kerberos connector

[jira] [Assigned] (SPARK-31834) Improve error message for incompatible data types

2020-05-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-31834: --- Assignee: Zhu, Lipeng > Improve error message for incompatible data types >

[jira] [Commented] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

2020-05-27 Thread Puviarasu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117569#comment-17117569 ] Puviarasu commented on SPARK-31754: --- Hello [~kabhwan],  Please find below our updates for testing

[jira] [Updated] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

2020-05-27 Thread Puviarasu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puviarasu updated SPARK-31754: -- Attachment: Excpetion-3.0.0Preview2.txt > Spark Structured Streaming: NullPointerException in Stream

[jira] [Commented] (SPARK-31835) Add zoneId to codegen related test in DateExpressionsSuite

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117557#comment-17117557 ] Apache Spark commented on SPARK-31835: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-31835) Add zoneId to codegen related test in DateExpressionsSuite

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117555#comment-17117555 ] Apache Spark commented on SPARK-31835: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31835) Add zoneId to codegen related test in DateExpressionsSuite

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31835: Assignee: Apache Spark > Add zoneId to codegen related test in DateExpressionsSuite >

[jira] [Assigned] (SPARK-31835) Add zoneId to codegen related test in DateExpressionsSuite

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31835: Assignee: (was: Apache Spark) > Add zoneId to codegen related test in

[jira] [Created] (SPARK-31835) Add zoneId to codegen related test in DateExpressionsSuite

2020-05-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-31835: Summary: Add zoneId to codegen related test in DateExpressionsSuite Key: SPARK-31835 URL: https://issues.apache.org/jira/browse/SPARK-31835 Project: Spark Issue

[jira] [Assigned] (SPARK-31763) DataFrame.inputFiles() not Available

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31763: Assignee: (was: Apache Spark) > DataFrame.inputFiles() not Available >

[jira] [Commented] (SPARK-31763) DataFrame.inputFiles() not Available

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117526#comment-17117526 ] Apache Spark commented on SPARK-31763: -- User 'iRakson' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31763) DataFrame.inputFiles() not Available

2020-05-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31763: Assignee: Apache Spark > DataFrame.inputFiles() not Available >

[jira] [Commented] (SPARK-31795) Stream Data with API to ServiceNow

2020-05-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117480#comment-17117480 ] Hyukjin Kwon commented on SPARK-31795: -- Please take a look for

[jira] [Updated] (SPARK-31834) Improve error message for incompatible data types

2020-05-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31834: Description: {code:java} spark-sql> create table SPARK_31834(a int) using parquet; spark-sql>

[jira] [Created] (SPARK-31834) Improve error message for incompatible data types

2020-05-27 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-31834: --- Summary: Improve error message for incompatible data types Key: SPARK-31834 URL: https://issues.apache.org/jira/browse/SPARK-31834 Project: Spark Issue Type:

[jira] [Reopened] (SPARK-31795) Stream Data with API to ServiceNow

2020-05-27 Thread Dominic Wetenkamp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominic Wetenkamp reopened SPARK-31795: --- ? > Stream Data with API to ServiceNow > -- > >

[jira] [Commented] (SPARK-31795) Stream Data with API to ServiceNow

2020-05-27 Thread Dominic Wetenkamp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117465#comment-17117465 ] Dominic Wetenkamp commented on SPARK-31795: --- hello Hyukjin Kwon, Where can I get an answer or

  1   2   >