Csaba Ringhofer has uploaded this change for review. ( http://gerrit.cloudera.org:8080/24586
Change subject: IMPALA-15184: Switch tpcds json from bzip to LZ4 ...................................................................... IMPALA-15184: Switch tpcds json from bzip to LZ4 bzip is very slow, and it is enough to test it on smaller data (already covered in functional text). Switching to LZ4 (which was both untested and should be more common) decreases loading time of tpcds on all file formats from 20 min to 10 min. This was not the longest leg so far, so may not not show up in total dataload time, but becomes important in combination with other optimizations (e.g. increased parallelism). Change-Id: Ia5e787619cc9f2b1cd30d40440aecd20fcef4117 --- M testdata/bin/generate-schema-statements.py M testdata/workloads/tpcds/tpcds_core.csv 2 files changed, 2 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/86/24586/1 -- To view, visit http://gerrit.cloudera.org:8080/24586 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ia5e787619cc9f2b1cd30d40440aecd20fcef4117 Gerrit-Change-Number: 24586 Gerrit-PatchSet: 1 Gerrit-Owner: Csaba Ringhofer <[email protected]>
