Yin Huai created SPARK-9925:
-------------------------------
Summary: Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests
Key: SPARK-9925
URL: https://issues.apache.org/jira/browse/SPARK-9925
Project: Spark
Issue Type: Sub-task
Components: SQL
Reporter: Yin Huai
Assignee: Yin Huai
Right now, in our TestSQLContext/TestHiveContext, we use {{override def
numShufflePartitions: Int = this.getConf(SQLConf.SHUFFLE_PARTITIONS, 5)}} to
set {{SHUFFLE_PARTITIONS}}. However, we never put it to SQLConf. So, after we
use {{withSQLConf(SQLConf.SHUFFLE_PARTITIONS.key -> "number")}}, the number of
shuffle partitions will be set back to 200.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]