[email protected] has uploaded a new patch set (#21) to the change originally created by [email protected]. ( http://gerrit.cloudera.org:8080/17771 )
Change subject: WiP: IMPALA-10798 : Prototype for JSON reader ...................................................................... WiP: IMPALA-10798 : Prototype for JSON reader This prototype allows user to create a table stored as jsonfile and query it. Steps to test: - create a json table with schema specified using eligible datatypes (int8/16/32/64/float/double/string/varchar/char/timestamp/boolean) - add your json file (with eligble datatypes and same column names as schema specified in the create command) to hdfs location - add this 'location' to your table - run a select statement Fix: - arrow library is included wherever required - json format is added to scan node base class. - json scanner files are added, that implement methods to read the json file from the specified file location Change-Id: If79364a421d862d0d837f9be694911e388d4d629 --- M CMakeLists.txt M be/CMakeLists.txt M be/src/exec/CMakeLists.txt A be/src/exec/hdfs-json-scanner.cc A be/src/exec/hdfs-json-scanner.h M be/src/exec/hdfs-scan-node-base.cc M bin/bootstrap_toolchain.py M bin/impala-config.sh A cmake_modules/FindArrow.cmake M fe/src/main/java/org/apache/impala/catalog/HdfsFileFormat.java M fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java M testdata/bin/generate-schema-statements.py M testdata/workloads/functional-query/functional-query_core.csv M testdata/workloads/functional-query/functional-query_dimensions.csv M testdata/workloads/functional-query/functional-query_exhaustive.csv M testdata/workloads/functional-query/functional-query_pairwise.csv M testdata/workloads/tpcds/tpcds_core.csv M testdata/workloads/tpcds/tpcds_exhaustive.csv M testdata/workloads/tpcds/tpcds_pairwise.csv M testdata/workloads/tpch/tpch_core.csv M testdata/workloads/tpch/tpch_dimensions.csv M testdata/workloads/tpch/tpch_exhaustive.csv M testdata/workloads/tpch/tpch_pairwise.csv M tests/common/test_dimensions.py M tests/query_test/test_decimal_queries.py M tests/query_test/test_tpch_queries.py 26 files changed, 769 insertions(+), 141 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/71/17771/21 -- To view, visit http://gerrit.cloudera.org:8080/17771 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: If79364a421d862d0d837f9be694911e388d4d629 Gerrit-Change-Number: 17771 Gerrit-PatchSet: 21 Gerrit-Owner: Anonymous Coward <[email protected]> Gerrit-Reviewer: Aman Sinha <[email protected]> Gerrit-Reviewer: Anonymous Coward <[email protected]> Gerrit-Reviewer: Anonymous Coward <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]>
