[
https://issues.apache.org/jira/browse/IMPALA-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang reassigned IMPALA-11121:
---------------------------------------
Assignee: Ye Zihao (was: Pranav Yogi Lodha)
> Support loading testdata in JSON format
> ---------------------------------------
>
> Key: IMPALA-11121
> URL: https://issues.apache.org/jira/browse/IMPALA-11121
> Project: IMPALA
> Issue Type: Sub-task
> Components: Infrastructure
> Reporter: Quanlong Huang
> Assignee: Ye Zihao
> Priority: Major
>
> For test coverage, we should generate test data in JSON format and run
> existing tests on it. We should at least support 'json/none/none'. Other
> formats like 'json/gzip/none', 'json/snap/none' could be optional.
> The goal of this JIRA is being able to generate sufficient testdata for
> IMPALA-10798. E.g. we should be able to load JSON tables using
> {code}
> ./bin/load-data.py -w functional-query --exploration_strategy=exhaustive
> --table_formats=json/none/none
> ./bin/load-data.py -w tpch --exploration_strategy=core
> --table_formats=json/none/none
> ./bin/load-data.py -w tpcds --exploration_strategy=core
> --table_formats=json/none/none
> {code}
> Then in IMPALA-10798, we can trigger tests on the json format, e.g.
> {code}
> impala-py.test --table_formats=json/none tests/query_test/test_scanners.py
> impala-py.test --table_formats=json/none
> tests/query_test/test_scanners_fuzz.py
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
