Dongjoon Hyun created SPARK-21846:
-------------------------------------
Summary: Reduce the number of shuffle partition in Hive tests
Key: SPARK-21846
URL: https://issues.apache.org/jira/browse/SPARK-21846
Project: Spark
Issue Type: Task
Components: SQL
Affects Versions: 2.3.0
Reporter: Dongjoon Hyun
Priority: Minor
Currently, Jenkins on master branch fails due to timeout.
According to the last successful run, Hive tests takes 50 mins from 132 mins
(in Java/Scala tests)
-
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-2.7/3396/testReport/
{code}
org.apache.spark.sql.hive.execution 30 min
org.apache.spark.sql.hive 11 min
org.apache.spark.sql.hive.client 5 min 2 sec
org.apache.spark.sql.hive.orc 1 min 25 sec
..
{code}
This issue aims to reduce the test time by reducing the number of shuffle
partitions in Hive tests.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
