Repository: incubator-impala
Updated Branches:
  refs/heads/master 4456ead84 -> d30f5f4e3


IMPALA-5772: failure in test_scratch_disk.TestScratchDir didn't occur

The buffer pool changes reduced the memory requirement for the sort,
which seems to have been enough to get the query to execute without
spilling on S3. Reduce the limit in the test to force it to spill.

Testing:
Ran in a loop locally for an hour. Ran custom cluster tests on S3.

Change-Id: If65fee3e6a4b759d0d18e30a1c30bd48db0f2a54
Reviewed-on: http://gerrit.cloudera.org:8080/7615
Reviewed-by: Tim Armstrong <tarmstr...@cloudera.com>
Tested-by: Impala Public Jenkins


Project: http://git-wip-us.apache.org/repos/asf/incubator-impala/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-impala/commit/7007cd85
Tree: http://git-wip-us.apache.org/repos/asf/incubator-impala/tree/7007cd85
Diff: http://git-wip-us.apache.org/repos/asf/incubator-impala/diff/7007cd85

Branch: refs/heads/master
Commit: 7007cd85feaf8cc6631551d889c0d99c6895ca16
Parents: 4456ead
Author: Tim Armstrong <tarmstr...@cloudera.com>
Authored: Mon Aug 7 10:48:23 2017 -0700
Committer: Impala Public Jenkins <impala-public-jenk...@gerrit.cloudera.org>
Committed: Wed Aug 9 00:04:25 2017 +0000

----------------------------------------------------------------------
 tests/custom_cluster/test_scratch_disk.py | 7 +++----
 1 file changed, 3 insertions(+), 4 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/7007cd85/tests/custom_cluster/test_scratch_disk.py
----------------------------------------------------------------------
diff --git a/tests/custom_cluster/test_scratch_disk.py 
b/tests/custom_cluster/test_scratch_disk.py
index 579ca1e..bd3c7e4 100644
--- a/tests/custom_cluster/test_scratch_disk.py
+++ b/tests/custom_cluster/test_scratch_disk.py
@@ -37,10 +37,9 @@ class TestScratchDir(CustomClusterTestSuite):
   in_mem_query = """
       select o_orderdate, o_custkey, o_comment from tpch.orders
       """
-  # Block manager memory limit that is low enough to force Impala to spill to 
disk when
-  # executing spill_query and high enough that we can execute in_mem_query 
without
-  # spilling.
-  buffer_pool_limit = "64m"
+  # Buffer pool limit that is low enough to force Impala to spill to disk when 
executing
+  # spill_query.
+  buffer_pool_limit = "32m"
 
   def count_nonempty_dirs(self, dirs):
     count = 0

Reply via email to