Hello Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/15814
to look at the new patch set (#5).
Change subject: IMPALA-9709: Remove Impala-lzo from the development environment
......................................................................
IMPALA-9709: Remove Impala-lzo from the development environment
This removes Impala-lzo from the Impala development environment.
Impala-lzo is not built as part of the Impala build. LZO is no
longer loaded a plugin. LZO tables are not loaded during dataload,
and LZO is no longer tested.
This removes some obsolete scan APIs that were only used by Impala-lzo.
With this commit, Impala-lzo would require code changes to build
against Impala.
The plugin infrastructure is not removed, and this leaves some
LZO support code in place. If someone were to decide to revive
Impala-lzo, they would still be able to load it as a plugin
and get the same functionality as before. This plugin support
may be removed later.
Testing:
- Dryrun of GVO
- Modified TestPartitionMetadataUncompressedTextOnly's
test_unsupported_text_compression() to add LZO case
Change-Id: I3a4f12247d8872b7e14c9feb4b2c58cfd60d4c0e
---
M CMakeLists.txt
M be/src/exec/hdfs-plugin-text-scanner.cc
M be/src/exec/hdfs-scan-node-base.cc
M be/src/exec/hdfs-scan-node-base.h
M bin/bootstrap_system.sh
M bin/clean.sh
M bin/impala-config.sh
M bin/set-ld-library-path.sh
M bin/start-impala-cluster.py
M buildall.sh
M docker/entrypoint.sh
M docker/impala_base/Dockerfile
M docker/test-with-docker.py
M fe/src/main/java/org/apache/impala/analysis/ToSqlUtils.java
M fe/src/main/java/org/apache/impala/catalog/HdfsCompression.java
M fe/src/main/java/org/apache/impala/catalog/HdfsFileFormat.java
M fe/src/test/java/org/apache/impala/analysis/AnalyzeStmtsTest.java
M fe/src/test/java/org/apache/impala/analysis/AnalyzerTest.java
D testdata/bad_text_lzo/bad_text.lzo
D testdata/bad_text_lzo/bad_text.lzo.index
M testdata/bin/create-load-data.sh
M testdata/bin/generate-schema-statements.py
M testdata/bin/generate-test-vectors.py
M testdata/bin/load_nested.py
D testdata/bin/lzo_indexer.sh
M testdata/cluster/node_templates/common/etc/hadoop/conf/core-site.xml.py
M testdata/cluster/node_templates/common/etc/hadoop/conf/yarn-site.xml.py
M testdata/datasets/functional/functional_schema_template.sql
M testdata/datasets/functional/schema_constraints.csv
M
testdata/workloads/functional-planner/queries/PlannerTest/joins-hdfs-num-rows-est-enabled.test
M testdata/workloads/functional-planner/queries/PlannerTest/joins.test
M testdata/workloads/functional-query/functional-query_dimensions.csv
M testdata/workloads/functional-query/functional-query_exhaustive.csv
M
testdata/workloads/functional-query/queries/DataErrorsTest/hdfs-scan-node-errors.test
D testdata/workloads/functional-query/queries/QueryTest/disable-lzo-plugin.test
M testdata/workloads/functional-query/queries/QueryTest/show-create-table.test
M
testdata/workloads/functional-query/queries/QueryTest/unsupported-compression-partitions.test
M testdata/workloads/perf-regression/perf-regression_dimensions.csv
M testdata/workloads/perf-regression/perf-regression_exhaustive.csv
M testdata/workloads/perf-regression/perf-regression_pairwise.csv
M testdata/workloads/targeted-perf/targeted-perf_dimensions.csv
M testdata/workloads/targeted-perf/targeted-perf_exhaustive.csv
M testdata/workloads/targeted-perf/targeted-perf_pairwise.csv
M testdata/workloads/targeted-stress/targeted-stress_dimensions.csv
M testdata/workloads/targeted-stress/targeted-stress_exhaustive.csv
M testdata/workloads/targeted-stress/targeted-stress_pairwise.csv
M testdata/workloads/tpcds-unmodified/tpcds-unmodified_dimensions.csv
M testdata/workloads/tpcds-unmodified/tpcds-unmodified_exhaustive.csv
M testdata/workloads/tpcds-unmodified/tpcds-unmodified_pairwise.csv
M testdata/workloads/tpcds/tpcds_dimensions.csv
M testdata/workloads/tpcds/tpcds_exhaustive.csv
M testdata/workloads/tpcds/tpcds_pairwise.csv
M testdata/workloads/tpch/tpch_dimensions.csv
M testdata/workloads/tpch/tpch_exhaustive.csv
M testdata/workloads/tpch/tpch_pairwise.csv
M tests/common/test_dimensions.py
M tests/custom_cluster/test_hive_text_codec_interop.py
D tests/custom_cluster/test_scanner_plugin.py
M tests/metadata/test_metadata_query_statements.py
M tests/metadata/test_partition_metadata.py
M tests/query_test/test_compressed_formats.py
M tests/query_test/test_scanners_fuzz.py
62 files changed, 85 insertions(+), 333 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/14/15814/5
--
To view, visit http://gerrit.cloudera.org:8080/15814
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I3a4f12247d8872b7e14c9feb4b2c58cfd60d4c0e
Gerrit-Change-Number: 15814
Gerrit-PatchSet: 5
Gerrit-Owner: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
