[jira] [Created] (SPARK-31570) gapply and dapply docs should be more aligned, possibly combined

Michael Chirico created SPARK-31570: --- Summary: gapply and dapply docs should be more aligned, possibly combined Key: SPARK-31570 URL: https://issues.apache.org/jira/browse/SPARK-31570 Project:

[jira] [Created] (SPARK-31569) Add links to subsections in SQL Reference main page

Huaxin Gao created SPARK-31569: -- Summary: Add links to subsections in SQL Reference main page Key: SPARK-31569 URL: https://issues.apache.org/jira/browse/SPARK-31569 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-31527) date add/subtract interval only allow those day precision in ansi mode

[ https://issues.apache.org/jira/browse/SPARK-31527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31527: --- Assignee: Kent Yao > date add/subtract interval only allow those day precision in ansi

[jira] [Resolved] (SPARK-31527) date add/subtract interval only allow those day precision in ansi mode

[ https://issues.apache.org/jira/browse/SPARK-31527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31527. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28310

[jira] [Resolved] (SPARK-31557) Legacy parser incorrectly interprets pre-Gregorian dates

[ https://issues.apache.org/jira/browse/SPARK-31557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31557. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28345

[jira] [Assigned] (SPARK-31557) Legacy parser incorrectly interprets pre-Gregorian dates

[ https://issues.apache.org/jira/browse/SPARK-31557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31557: --- Assignee: Bruce Robbins > Legacy parser incorrectly interprets pre-Gregorian dates >

[jira] [Commented] (SPARK-31554) Flaky test suite org.apache.spark.sql.hive.thriftserver.CliSuite

[ https://issues.apache.org/jira/browse/SPARK-31554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092999#comment-17092999 ] Wenchen Fan commented on SPARK-31554: - I've merged https://github.com/apache/spark/pull/28156 Let's

[jira] [Assigned] (SPARK-31388) org.apache.spark.sql.hive.thriftserver.CliSuite result matching is flaky

[ https://issues.apache.org/jira/browse/SPARK-31388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31388: --- Assignee: Juliusz Sompolski > org.apache.spark.sql.hive.thriftserver.CliSuite result

[jira] [Resolved] (SPARK-31388) org.apache.spark.sql.hive.thriftserver.CliSuite result matching is flaky

[ https://issues.apache.org/jira/browse/SPARK-31388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31388. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28156

[jira] [Commented] (SPARK-31449) Investigate the difference between JDK and Spark's time zone offset calculation

[ https://issues.apache.org/jira/browse/SPARK-31449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092986#comment-17092986 ] Wenchen Fan commented on SPARK-31449: - Can we fix Spark 2.4 to use the same code as JDK's

[jira] [Resolved] (SPARK-31497) Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model

[ https://issues.apache.org/jira/browse/SPARK-31497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-31497. --- Resolution: Fixed Issue resolved by pull request 28279

[jira] [Updated] (SPARK-31497) Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model

[ https://issues.apache.org/jira/browse/SPARK-31497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-31497: -- Fix Version/s: 3.0.0 > Pyspark CrossValidator/TrainValidationSplit with pipeline estimator

[jira] [Updated] (SPARK-31497) Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model

[ https://issues.apache.org/jira/browse/SPARK-31497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-31497: -- Target Version/s: 3.0.0 > Pyspark CrossValidator/TrainValidationSplit with pipeline estimator

[jira] [Updated] (SPARK-31566) Add SQL Rest API Documentation

[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31566: --- Description: SQL Rest API exposes query execution metrics as Public API. Its

[jira] [Updated] (SPARK-25595) Ignore corrupt Avro file if flag IGNORE_CORRUPT_FILES enabled

[ https://issues.apache.org/jira/browse/SPARK-25595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25595: - Fix Version/s: 2.4.6 > Ignore corrupt Avro file if flag IGNORE_CORRUPT_FILES enabled >

[jira] [Resolved] (SPARK-31546) Backport SPARK-25595 Ignore corrupt Avro file if flag IGNORE_CORRUPT_FILES enabled

[ https://issues.apache.org/jira/browse/SPARK-31546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31546. -- Resolution: Done > Backport SPARK-25595 Ignore corrupt Avro file if flag >

[jira] [Commented] (SPARK-31546) Backport SPARK-25595 Ignore corrupt Avro file if flag IGNORE_CORRUPT_FILES enabled

[ https://issues.apache.org/jira/browse/SPARK-31546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092978#comment-17092978 ] Hyukjin Kwon commented on SPARK-31546: -- Thanks [~Gengliang.Wang]! > Backport SPARK-25595

[jira] [Created] (SPARK-31568) R: gapply documentation could be clearer about what the func argument is

Michael Chirico created SPARK-31568: --- Summary: R: gapply documentation could be clearer about what the func argument is Key: SPARK-31568 URL: https://issues.apache.org/jira/browse/SPARK-31568

[jira] [Created] (SPARK-31567) Update AppVeyor R version to 4.0.0

Dongjoon Hyun created SPARK-31567: - Summary: Update AppVeyor R version to 4.0.0 Key: SPARK-31567 URL: https://issues.apache.org/jira/browse/SPARK-31567 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-31559) AM starts with initial fetched tokens in any attempt

[ https://issues.apache.org/jira/browse/SPARK-31559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092928#comment-17092928 ] Jungtaek Lim commented on SPARK-31559: -- PR submitted: https://github.com/apache/spark/pull/28336 >

[jira] [Updated] (SPARK-31566) Add SQL Rest API Documentation

[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31566: --- Description: SQL Rest API exposes query execution metrics as Public API. Its

[jira] [Updated] (SPARK-31566) Add SQL Rest API Documentation

[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31566: --- Description: SQL Rest API exposes query execution metrics as Public API. Its

[jira] [Created] (SPARK-31566) Add SQL Rest API Documentation

Eren Avsarogullari created SPARK-31566: -- Summary: Add SQL Rest API Documentation Key: SPARK-31566 URL: https://issues.apache.org/jira/browse/SPARK-31566 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-31565) Unify the font color of label among all DAG-viz.

[ https://issues.apache.org/jira/browse/SPARK-31565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31565. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28352

[jira] [Comment Edited] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092884#comment-17092884 ] Xiao Li edited comment on SPARK-12312 at 4/26/20, 11:03 PM: How does the

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092884#comment-17092884 ] Xiao Li commented on SPARK-12312: - How the current solution handle Kerberos renewals? > JDBC connection

[jira] [Assigned] (SPARK-31489) Failure on pushing down filters with java.time.LocalDate values in ORC

[ https://issues.apache.org/jira/browse/SPARK-31489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31489: - Assignee: Maxim Gekk > Failure on pushing down filters with java.time.LocalDate values

[jira] [Resolved] (SPARK-31489) Failure on pushing down filters with java.time.LocalDate values in ORC

[ https://issues.apache.org/jira/browse/SPARK-31489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31489. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28261

[jira] [Resolved] (SPARK-31535) Fix nested CTE substitution

[ https://issues.apache.org/jira/browse/SPARK-31535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31535. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28318

[jira] [Assigned] (SPARK-31535) Fix nested CTE substitution

[ https://issues.apache.org/jira/browse/SPARK-31535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31535: - Assignee: Peter Toth > Fix nested CTE substitution > --- > >

[jira] [Created] (SPARK-31565) Unify the font color of label among all DAG-viz.

Kousuke Saruta created SPARK-31565: -- Summary: Unify the font color of label among all DAG-viz. Key: SPARK-31565 URL: https://issues.apache.org/jira/browse/SPARK-31565 Project: Spark Issue

[jira] [Resolved] (SPARK-31534) Text for tooltip should be escaped

[ https://issues.apache.org/jira/browse/SPARK-31534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31534. --- Fix Version/s: 3.1.0 Resolution: Fixed This is resolved via

[jira] [Updated] (SPARK-31534) Text for tooltip should be escaped

[ https://issues.apache.org/jira/browse/SPARK-31534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31534: -- Affects Version/s: 3.0.0 > Text for tooltip should be escaped >

[jira] [Updated] (SPARK-31432) Make SPARK_JARS_DIR configurable

[ https://issues.apache.org/jira/browse/SPARK-31432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31432: -- Summary: Make SPARK_JARS_DIR configurable (was: bin/sbin scripts should allow to customize

[jira] [Commented] (SPARK-31399) Closure cleaner broken in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092836#comment-17092836 ] Dongjoon Hyun commented on SPARK-31399: --- Hi, [~smilegator] and [~rednaxelafx]. Is there any update

[jira] [Commented] (SPARK-31449) Investigate the difference between JDK and Spark's time zone offset calculation

[ https://issues.apache.org/jira/browse/SPARK-31449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092824#comment-17092824 ] Maxim Gekk commented on SPARK-31449: [~cloud_fan] [~hyukjin.kwon] I compared results of those 2

[jira] [Resolved] (SPARK-31562) Update ExpressionDescription for substring, current_date, and current_timestamp

[ https://issues.apache.org/jira/browse/SPARK-31562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31562. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28342

[jira] [Assigned] (SPARK-31562) Update ExpressionDescription for substring, current_date, and current_timestamp

[ https://issues.apache.org/jira/browse/SPARK-31562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31562: - Assignee: Takeshi Yamamuro > Update ExpressionDescription for substring, current_date,

[jira] [Commented] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092818#comment-17092818 ] Pablo Langa Blanco commented on SPARK-31500: [https://github.com/apache/spark/pull/28351] >

[jira] [Resolved] (SPARK-31400) The catalogString doesn't distinguish Vectors in ml and mllib

[ https://issues.apache.org/jira/browse/SPARK-31400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31400. -- Fix Version/s: 3.1.0 Assignee: Junpei Zhou Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-31400) The catalogString doesn't distinguish Vectors in ml and mllib

[ https://issues.apache.org/jira/browse/SPARK-31400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31400: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > The catalogString

[jira] [Updated] (SPARK-31552) Fix potential ClassCastException in ScalaReflection arrayClassFor

[ https://issues.apache.org/jira/browse/SPARK-31552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31552: -- Fix Version/s: 2.4.6 > Fix potential ClassCastException in ScalaReflection arrayClassFor >