[
https://issues.apache.org/jira/browse/IMPALA-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898022#comment-17898022
]
ASF subversion and git services commented on IMPALA-13471:
----------------------------------------------------------
Commit fafcd600611e2b6d36327e781e2be0857b1bba98 in impala's branch
refs/heads/master from Daniel Becker
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=fafcd6006 ]
IMPALA-13471: test_enable_reading_puffin() seems to fail in the Ozone build
The tests
TestIcebergWithPuffinStatsStartupFlag::test_[dis|en]able_reading_puffin
queried an Iceberg table that is created during normal dataload from
existing non-filesystem-specific metadata and data files. Therefore the
path of the Puffin stats file that is present in the metadata.json file
does not contain any filesystem-specific prefix, for which Puffin
reading does not work on Ozone.
Note that reading Puffin stats for tables that are created normally do
work on Ozone.
This change modifies the tests to create the table on the fly, modifying
the file path to include the filesystem-specific prefix.
Change-Id: I7afec1c70d7b43bae98289d65749b01ca720e7f7
Reviewed-on: http://gerrit.cloudera.org:8080/22008
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> test_enable_reading_puffin() seems to fail in the Ozone build
> -------------------------------------------------------------
>
> Key: IMPALA-13471
> URL: https://issues.apache.org/jira/browse/IMPALA-13471
> Project: IMPALA
> Issue Type: Bug
> Reporter: Fang-Yu Rao
> Assignee: Daniel Becker
> Priority: Major
> Labels: broken-build
>
> We found that the test
> [test_enable_reading_puffin()|https://github.com/apache/impala/blame/master/tests/custom_cluster/test_iceberg_with_puffin.py#L59]
> added in IMPALA-13247 seems to fail in the Ozone build.
> +*Error Message*+
> {code}
> assert [-1, -1] == [2, 2] At index 0 diff: -1 != 2 Full diff: - [-1,
> -1] + [2, 2]
> {code}
> +*Stacktrace*+
> {code}
> custom_cluster/test_iceberg_with_puffin.py:50: in test_enable_reading_puffin
> self._read_ndv_stats_expect_result([2, 2])
> custom_cluster/test_iceberg_with_puffin.py:59: in
> _read_ndv_stats_expect_result
> assert ndvs == expected_ndv_stats
> E assert [-1, -1] == [2, 2]
> E At index 0 diff: -1 != 2
> E Full diff:
> E - [-1, -1]
> E + [2, 2]
> {code}
> According to the above, in the Ozone build, the result of "show column stats"
> was [-1, -1]. It looks like the NDV statistics is not available in the Ozone
> build.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
