Zihao Ye has uploaded this change for review. ( http://gerrit.cloudera.org:8080/20482
Change subject: IMPALA-12431: Support reading compressed JSON file ...................................................................... IMPALA-12431: Support reading compressed JSON file This patch adds the functionality to read compressed JSON files for the JSON scanner. The code for decompression mostly referred to the relevant code in the TEXT scanner. The supported compression formats are also the same as those supported by the TEXT scanner. Tests - Most of the existing end-to-end JSON format tests can run on compressed JSON format too. Change-Id: I2471855d97d4cdd51363b321055e6b06aa6d81e8 --- M be/src/exec/json/hdfs-json-scanner.cc M be/src/exec/json/hdfs-json-scanner.h M fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java M testdata/workloads/functional-query/functional-query_exhaustive.csv M testdata/workloads/tpch/tpch_core.csv M testdata/workloads/tpch/tpch_exhaustive.csv M tests/query_test/test_compressed_formats.py 7 files changed, 229 insertions(+), 36 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/82/20482/1 -- To view, visit http://gerrit.cloudera.org:8080/20482 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I2471855d97d4cdd51363b321055e6b06aa6d81e8 Gerrit-Change-Number: 20482 Gerrit-PatchSet: 1 Gerrit-Owner: Zihao Ye <[email protected]>
