[jira] [Created] (SPARK-30076) Upgrade Mockito to 3.1.0

2019-11-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-30076: Summary: Upgrade Mockito to 3.1.0 Key: SPARK-30076 URL: https://issues.apache.org/jira/browse/SPARK-30076 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-30073) HistoryPage render "count" cost too much time

2019-11-28 Thread deshanxiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984786#comment-16984786 ] deshanxiao commented on SPARK-30073: [~kabhwan] Sorry, I have changed it to spark2.3.2. Thank you!

[jira] [Updated] (SPARK-30073) HistoryPage render "count" cost too much time

2019-11-28 Thread deshanxiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-30073: --- Affects Version/s: (was: 3.0.0) 2.3.2 > HistoryPage render "count" cost

[jira] [Commented] (SPARK-30073) HistoryPage render "count" cost too much time

2019-11-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984782#comment-16984782 ] Jungtaek Lim commented on SPARK-30073: -- Are you playing with master branch hence set the affected

[jira] [Commented] (SPARK-30075) ArrayIndexType doesn't implement hashCode correctly

2019-11-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984760#comment-16984760 ] Jungtaek Lim commented on SPARK-30075: -- Working on the fix. Actually the fix is also available in

[jira] [Created] (SPARK-30075) ArrayIndexType doesn't implement hashCode correctly

2019-11-28 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-30075: Summary: ArrayIndexType doesn't implement hashCode correctly Key: SPARK-30075 URL: https://issues.apache.org/jira/browse/SPARK-30075 Project: Spark Issue

[jira] [Created] (SPARK-30074) The maxNumPostShufflePartitions config should obey reducePostShufflePartitions enabled

2019-11-28 Thread Yuanjian Li (Jira)
Yuanjian Li created SPARK-30074: --- Summary: The maxNumPostShufflePartitions config should obey reducePostShufflePartitions enabled Key: SPARK-30074 URL: https://issues.apache.org/jira/browse/SPARK-30074

[jira] [Updated] (SPARK-29991) Support `test-hive1.2` in PR Builder

2019-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29991: - Fix Version/s: (was: 3.0.0) > Support `test-hive1.2` in PR Builder >

[jira] [Reopened] (SPARK-29991) Support `test-hive1.2` in PR Builder

2019-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-29991: -- Reverted at https://github.com/apache/spark/commit/9351e3e76fb11e9fdaf39aef5aea86fdeccd6f28 >

[jira] [Updated] (SPARK-30073) HistoryPage render "count" cost too much time

2019-11-28 Thread deshanxiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-30073: --- Description: {code:java} "qtp1010584177-537" #537 daemon prio=5 os_prio=0 tid=0x7f2734185000

[jira] [Updated] (SPARK-30073) HistoryPage render "count" cost too much time

2019-11-28 Thread deshanxiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-30073: --- Environment: (was: {code:java} "qtp1010584177-537" #537 daemon prio=5 os_prio=0

[jira] [Created] (SPARK-30073) HistoryPage render "count" cost too much time

2019-11-28 Thread deshanxiao (Jira)
deshanxiao created SPARK-30073: -- Summary: HistoryPage render "count" cost too much time Key: SPARK-30073 URL: https://issues.apache.org/jira/browse/SPARK-30073 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28152) Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984705#comment-16984705 ] Hyukjin Kwon commented on SPARK-28152: -- it was reverted in branch-2.4 at

[jira] [Updated] (SPARK-28152) Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28152: - Fix Version/s: (was: 2.4.4) > Mapped ShortType to SMALLINT and FloatType to REAL for

[jira] [Updated] (SPARK-30022) Supporting Parsing of Simple Hive Virtual View created from Presto

2019-11-28 Thread Arun Ravi M V (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Ravi M V updated SPARK-30022: -- Description:   We have an environment were we use Apache Spark and Presto (both backed by

[jira] [Updated] (SPARK-29877) static PageRank allow checkPoint from previous computations

2019-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29877: - Fix Version/s: (was: 3.1.0) 3.0.0 Target Version/s: (was:

[jira] [Resolved] (SPARK-29877) static PageRank allow checkPoint from previous computations

2019-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29877. -- Fix Version/s: (was: 2.3.0) 3.1.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-29877) static PageRank allow checkPoint from previous computations

2019-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29877: Assignee: Joan Fontanals > static PageRank allow checkPoint from previous computations >

[jira] [Updated] (SPARK-30072) Create dedicated planner for subqueries

2019-11-28 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-30072: - Description: This PR changes subquery planning by calling the planner and plan preparation

[jira] [Created] (SPARK-30072) Create dedicated planner for subqueries

2019-11-28 Thread Ali Afroozeh (Jira)
Ali Afroozeh created SPARK-30072: Summary: Create dedicated planner for subqueries Key: SPARK-30072 URL: https://issues.apache.org/jira/browse/SPARK-30072 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30072) Create dedicated planner for subqueries

2019-11-28 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-30072: - Environment: (was: This PR changes subquery planning by calling the planner and plan

[jira] [Created] (SPARK-30071) Job description can't be set to empty jobs

2019-11-28 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-30071: -- Summary: Job description can't be set to empty jobs Key: SPARK-30071 URL: https://issues.apache.org/jira/browse/SPARK-30071 Project: Spark Issue Type:

[jira] [Created] (SPARK-30070) ANSI-F053: Overlaps datetimes predicate support

2019-11-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-30070: Summary: ANSI-F053: Overlaps datetimes predicate support Key: SPARK-30070 URL: https://issues.apache.org/jira/browse/SPARK-30070 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-30061) BufferedWriter should be closed

2019-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30061. -- Resolution: Invalid > BufferedWriter should be closed > --- > >

[jira] [Updated] (SPARK-30061) BufferedWriter should be closed

2019-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30061: - Priority: Trivial (was: Minor) > BufferedWriter should be closed >

[jira] [Updated] (SPARK-30067) A bug in getBlockHosts

2019-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30067: - Labels: (was: core) Priority: Minor (was: Trivial) Yep, thanks. I think it's at least

[jira] [Commented] (SPARK-30069) Clean up non-shuffle disk block manager files following executor exists on YARN

2019-11-28 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984353#comment-16984353 ] Lantao Jin commented on SPARK-30069: I will file a PR soon. > Clean up non-shuffle disk block

[jira] [Created] (SPARK-30069) Clean up non-shuffle disk block manager files following executor exists on YARN

2019-11-28 Thread Lantao Jin (Jira)
Lantao Jin created SPARK-30069: -- Summary: Clean up non-shuffle disk block manager files following executor exists on YARN Key: SPARK-30069 URL: https://issues.apache.org/jira/browse/SPARK-30069 Project:

[jira] [Commented] (SPARK-30067) A bug in getBlockHosts

2019-11-28 Thread madianjun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984289#comment-16984289 ] madianjun commented on SPARK-30067: --- [~srowen]  This is the PR: 

[jira] [Commented] (SPARK-30068) Flaky test: org.apache.spark.sql.hive.thriftserver.ui.ThriftServerPageSuite

2019-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984282#comment-16984282 ] Yuming Wang commented on SPARK-30068: - cc [~shahid] > Flaky test:

[jira] [Created] (SPARK-30068) Flaky test: org.apache.spark.sql.hive.thriftserver.ui.ThriftServerPageSuite

2019-11-28 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-30068: --- Summary: Flaky test: org.apache.spark.sql.hive.thriftserver.ui.ThriftServerPageSuite Key: SPARK-30068 URL: https://issues.apache.org/jira/browse/SPARK-30068 Project:

[jira] [Updated] (SPARK-30068) Flaky test: org.apache.spark.sql.hive.thriftserver.ui.ThriftServerPageSuite

2019-11-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30068: Component/s: SQL > Flaky test: org.apache.spark.sql.hive.thriftserver.ui.ThriftServerPageSuite >

[jira] [Created] (SPARK-30067) A bug in getBlockHosts

2019-11-28 Thread madianjun (Jira)
madianjun created SPARK-30067: - Summary: A bug in getBlockHosts Key: SPARK-30067 URL: https://issues.apache.org/jira/browse/SPARK-30067 Project: Spark Issue Type: Bug Components: SQL