[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

2020-05-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099579#comment-17099579 ] Maxim Gekk commented on SPARK-31579: [~suddhuASF] The replace floorDiv by / is trivi

[jira] [Resolved] (SPARK-31467) Fix test issue with table named `test` in hive/SQLQuerySuite

2020-05-04 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31467. -- Fix Version/s: 3.0.0 Assignee: feiwang Resolution: Fixed Resolved b ht

[jira] [Resolved] (SPARK-31623) Benchmark rebasing of INT96 and TIMESTAMP_MILLIS timestamps in read/write

2020-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31623. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28431 [https://gith

[jira] [Assigned] (SPARK-31623) Benchmark rebasing of INT96 and TIMESTAMP_MILLIS timestamps in read/write

2020-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31623: --- Assignee: Maxim Gekk > Benchmark rebasing of INT96 and TIMESTAMP_MILLIS timestamps in read/

[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

2020-05-04 Thread Sudharshann D. (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099493#comment-17099493 ] Sudharshann D. commented on SPARK-31579: May I please work on this? > Replace f

[jira] [Commented] (SPARK-27963) Allow dynamic allocation without an external shuffle service

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099462#comment-17099462 ] Apache Spark commented on SPARK-27963: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-27963) Allow dynamic allocation without an external shuffle service

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099461#comment-17099461 ] Apache Spark commented on SPARK-27963: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31639. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28450 [https://

[jira] [Assigned] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31639: - Assignee: Maxim Gekk > Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099372#comment-17099372 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099371#comment-17099371 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-31640) Support SHOW PARTITIONS for DataSource V2 tables

2020-05-04 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31640: --- Summary: Support SHOW PARTITIONS for DataSource V2 tables Key: SPARK-31640 URL: https://issues.apache.org/jira/browse/SPARK-31640 Project: Spark Issue Type: Ne

[jira] [Assigned] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31639: Assignee: (was: Apache Spark) > Revert SPARK-27528 Use Parquet logical type TIMESTAMP

[jira] [Commented] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099264#comment-17099264 ] Apache Spark commented on SPARK-31639: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31639: Assignee: Apache Spark > Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by

[jira] [Created] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-31639: - Summary: Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default Key: SPARK-31639 URL: https://issues.apache.org/jira/browse/SPARK-31639 Project: Sp

[jira] [Updated] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31639: -- Reporter: Maxim Gekk (was: Dongjoon Hyun) > Revert SPARK-27528 Use Parquet logical type TIMES

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099259#comment-17099259 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099257#comment-17099257 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-27528) Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099226#comment-17099226 ] Apache Spark commented on SPARK-27528: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099171#comment-17099171 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31636: Assignee: Apache Spark > Remove HTML syntax in SQL reference > --

[jira] [Assigned] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31636: Assignee: (was: Apache Spark) > Remove HTML syntax in SQL reference > ---

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099169#comment-17099169 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099100#comment-17099100 ] Apache Spark commented on SPARK-31638: -- User 'iRakson' has created a pull request f

[jira] [Commented] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099096#comment-17099096 ] Apache Spark commented on SPARK-31638: -- User 'iRakson' has created a pull request f

[jira] [Assigned] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31638: Assignee: (was: Apache Spark) > Clean code for pagination for all pages > ---

[jira] [Assigned] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31638: Assignee: Apache Spark > Clean code for pagination for all pages > --

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Description: Clean code for pagination for different pages of spark webUI (was: Clean code

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Description: Clean code for pagination for different pages of spark web > Clean code for pag

[jira] [Created] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31638: -- Summary: Clean code for pagination for all pages Key: SPARK-31638 URL: https://issues.apache.org/jira/browse/SPARK-31638 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Environment: (was: Clean code for pagination for different pages of webUI) > Clean code

[jira] [Created] (SPARK-31637) Stage Level Scheduling UI - add tooltips for resource profile ino

2020-05-04 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-31637: - Summary: Stage Level Scheduling UI - add tooltips for resource profile ino Key: SPARK-31637 URL: https://issues.apache.org/jira/browse/SPARK-31637 Project: Spark

[jira] [Resolved] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31633. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28446 [https://

[jira] [Assigned] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31633: - Assignee: Dongjoon Hyun > Upgrade SLF4J from 1.7.16 to 1.7.30 > ---

[jira] [Created] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-31636: -- Summary: Remove HTML syntax in SQL reference Key: SPARK-31636 URL: https://issues.apache.org/jira/browse/SPARK-31636 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-31585) Support Z-order curve

2020-05-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31585: Description: Z-ordering is a technique that allows you to map multidimensional data to a single d

[jira] [Updated] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

2020-05-04 Thread appleyuchi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] appleyuchi updated SPARK-31629: --- Component/s: (was: Java API) PySpark > "py4j.protocol.Py4JJavaError: An error o

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java} case class Point(x:Double,

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java} case class Point(x:Double,

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java} case class Point(x:Double,

[jira] [Resolved] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31624. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28434 [https://gith

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java} case class Point(x:Double,

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:    Please have a look at the example below:  {code:java}   case class Point(x:Do

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java}   case class Point(x:Doubl

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:    Please have a look at the example below:  {code:java}   case class Point(x:Do

[jira] [Created] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
George George created SPARK-31635: - Summary: Spark SQL Sort fails when sorting big data points Key: SPARK-31635 URL: https://issues.apache.org/jira/browse/SPARK-31635 Project: Spark Issue Typ

[jira] [Updated] (SPARK-31590) Metadata-only queries should not include subquery in partition filters

2020-05-04 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-31590: --- Summary: Metadata-only queries should not include subquery in partition filters (was: The filter used by Me