Daniel Vanko has uploaded this change for review. ( http://gerrit.cloudera.org:8080/24585
Change subject: IMPALA-5961: Convert generated TPC-DS test data to UTF-8 ...................................................................... IMPALA-5961: Convert generated TPC-DS test data to UTF-8 The TPC-DS data generator (dsdgen) emits some string columns in ISO-8859-1 (Latin-1) rather than UTF-8. For example, customer.c_birth_country contains a 0xD4 byte (o-circumflex in Latin-1) that is not valid Unicode, which will cause data-load failure if PARQUET_ANNOTATE_STRINGS_UTF8 is turned on (IMPALA-12675). Convert the generated data files to UTF-8 in testdata/datasets/tpcds/preload (via iconv) right after generation, so the loaded TPC-DS test data is valid Unicode. Change-Id: Ic72dd4ad641083c22e8759160251b620e9da605c Assisted-by: Claude Opus 4.8 (Claude Code) --- M testdata/datasets/tpcds/preload 1 file changed, 9 insertions(+), 0 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/85/24585/1 -- To view, visit http://gerrit.cloudera.org:8080/24585 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ic72dd4ad641083c22e8759160251b620e9da605c Gerrit-Change-Number: 24585 Gerrit-PatchSet: 1 Gerrit-Owner: Daniel Vanko <[email protected]>
