This is an automated email from the ASF dual-hosted git repository.
hansva pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hop.git.
from 05f98a0 Merge pull request #1236 from hansva/master
new 4f52d5f HOP-3571 : Files with a UTF-8-BOM encoding are read
incorrectly
new 58ece28 HOP-3288 : Null Pointer exception in Parquet Output
new 501baeb HOP-3288 : Null Pointer exception in Parquet Output (rat
exclusion)
new 27be9ef Merge pull request #1237 from mattcasters/master
The 3288 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
...names-basic.hpl => 0038-getfilenames-basic.hpl} | 0
...omfield.hpl => 0038-getfilenames-fromfield.hpl} | 0
...hpl => 0038-getfilenames-nofiles-exception.hpl} | 0
...mes-regexp.hpl => 0038-getfilenames-regexp.hpl} | 0
.../transforms/0039-csv-input-utf-bom.hpl | 65 ++++------
...dation.hpl => 0040-text-file-input-utf-bom.hpl} | 138 ++++++++-------------
.../datasets/golden-csv-input-utf-bom.csv | 6 +
.../transforms/files/data-with-utf-8-bom.csv | 5 +
...e-tests-group.hwf => main-0038-getfilename.hwf} | 38 +++---
...ow-denormaliser.hwf => main-0039-csv-input.hwf} | 36 ++++--
...ache-tika.hwf => main-0040-text-file-input.hwf} | 53 +++-----
...s-output.json => golden-csv-input-utf-bom.json} | 20 +--
... UNIT.json => 0039-csv-input-utf-bom UNIT.json} | 21 ++--
...json => 0040-text-file-input-utf-bom UNIT.json} | 19 ++-
.../transforms/output/ParquetWriteSupport.java | 2 +-
pom.xml | 1 +
.../common/GetFieldsSampleDataDialog.java | 20 +--
.../common/ICsvInputAwareTransformDialog.java | 17 ++-
.../transform/common/TextFileLineUtil.java | 10 +-
19 files changed, 211 insertions(+), 240 deletions(-)
rename integration-tests/transforms/{0037-getfilenames-basic.hpl =>
0038-getfilenames-basic.hpl} (100%)
rename integration-tests/transforms/{0037-getfilenames-fromfield.hpl =>
0038-getfilenames-fromfield.hpl} (100%)
rename integration-tests/transforms/{0037-getfilenames-nofiles-exception.hpl
=> 0038-getfilenames-nofiles-exception.hpl} (100%)
rename integration-tests/transforms/{0037-getfilenames-regexp.hpl =>
0038-getfilenames-regexp.hpl} (100%)
copy
plugins/transforms/textfile/src/main/samples/transforms/csvinput-basic.hpl =>
integration-tests/transforms/0039-csv-input-utf-bom.hpl (69%)
copy integration-tests/transforms/{0021-row-denormaliser-beam-validation.hpl
=> 0040-text-file-input-utf-bom.hpl} (74%)
create mode 100644
integration-tests/transforms/datasets/golden-csv-input-utf-bom.csv
create mode 100644 integration-tests/transforms/files/data-with-utf-8-bom.csv
rename integration-tests/transforms/{main-0037-getfilename-tests-group.hwf =>
main-0038-getfilename.hwf} (85%)
copy integration-tests/transforms/{main-0021-row-denormaliser.hwf =>
main-0039-csv-input.hwf} (67%)
copy integration-tests/transforms/{main-0037-apache-tika.hwf =>
main-0040-text-file-input.hwf} (68%)
copy
integration-tests/transforms/metadata/dataset/{golden-get-variables-output.json
=> golden-csv-input-utf-bom.json} (63%)
copy integration-tests/transforms/metadata/unit-test/{0030-data-grid UNIT.json
=> 0039-csv-input-utf-bom UNIT.json} (64%)
copy integration-tests/transforms/metadata/unit-test/{0030-data-grid UNIT.json
=> 0040-text-file-input-utf-bom UNIT.json} (68%)
