Daniel Becker has uploaded this change for review. ( http://gerrit.cloudera.org:8080/18387
Change subject: IMPALA-11227: FE OOM in TestParquetBloomFilter.test_fallback_from_dict_if_no_bloom_tbl_props ...................................................................... IMPALA-11227: FE OOM in TestParquetBloomFilter.test_fallback_from_dict_if_no_bloom_tbl_props The huge values clause of the insert SQL statement in TestParquetBloomFilter.test_fallback_from_dict_if_no_bloom_tbl_props could cause an OutOfMemory error in the FE. We use a SQL statement with a huge values clause (more than 40 000 elements) to insert values into a parquet table in some tests, and the size of the SQL statement string sometimes causes an OOM error. After this change, when creating these parquet tables, instead of using a huge SQL statement to insert the values, we first create a text table with the same schema, write the values to a text file, copy the file into the HDFS directory of the text table and create a parquet table from the text table. Change-Id: I923cc9ba4b6829a2f15e93365f2849b89248598b --- M tests/query_test/test_parquet_bloom_filter.py 1 file changed, 30 insertions(+), 16 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/87/18387/1 -- To view, visit http://gerrit.cloudera.org:8080/18387 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I923cc9ba4b6829a2f15e93365f2849b89248598b Gerrit-Change-Number: 18387 Gerrit-PatchSet: 1 Gerrit-Owner: Daniel Becker <daniel.bec...@cloudera.com>
