[
https://issues.apache.org/jira/browse/IMPALA-13996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17947302#comment-17947302
]
Surya Hebbar edited comment on IMPALA-13996 at 4/25/25 10:57 AM:
-----------------------------------------------------------------
Possibly may have something to do with the recently merged patch -
IMPALA-11402: Add limit on files fetched by a single getPartialCatalogObject
request
Assigning to [~stigahuang], based on this comment,
https://gerrit.cloudera.org/#/c/22559/14/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java@2353
If this is not the case, please feel free to reassign.
was (Author: JIRAUSER299620):
Possibly may have something to do with the recently merged patch -
IMPALA-11402: Add limit on files fetched by a single getPartialCatalogObject
request
Assigning to [~stigahuang], based on this comment,
https://gerrit.cloudera.org/#/c/22559/14/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java@2353
Please feel free to reassign.
> TestAllowIncompleteData.test_too_many_files fails erasure coding builds
> -----------------------------------------------------------------------
>
> Key: IMPALA-13996
> URL: https://issues.apache.org/jira/browse/IMPALA-13996
> Project: IMPALA
> Issue Type: Bug
> Reporter: Surya Hebbar
> Assignee: Quanlong Huang
> Priority: Major
>
> TestAllowIncompleteData.test_too_many_files fails erasure coding builds -
> Error -
> {code}
> assert "Too many files to collect in table tpch_parquet.lineitem: 3. Current
> limit is 1 configured by startup flag 'catalog_partial_fetch_max_files'.
> Consider compacting files of the table." in "Query
> f74919e60b835567:da9967a400000000 failed:\nLocalCatalogException: Could not
> load partitions for table tpch_parq...t limit is 1 configured by startup flag
> 'catalog_partial_fetch_max_files'. Consider compacting files of the
> table.\n\n" + where "Query f74919e60b835567:da9967a400000000
> failed:\nLocalCatalogException: Could not load partitions for table
> tpch_parq...t limit is 1 configured by startup flag
> 'catalog_partial_fetch_max_files'. Consider compacting files of the
> table.\n\n" = str(ImpalaBeeswaxException()){code}
>
> Stacktrace -
> {code}
> custom_cluster/test_local_catalog.py:721: in test_too_many_files
> assert err in str(exception)
> E assert "Too many files to collect in table tpch_parquet.lineitem: 3.
> Current limit is 1 configured by startup flag
> 'catalog_partial_fetch_max_files'. Consider compacting files of the table."
> in "Query f74919e60b835567:da9967a400000000 failed:\nLocalCatalogException:
> Could not load partitions for table tpch_parq...t limit is 1 configured by
> startup flag 'catalog_partial_fetch_max_files'. Consider compacting files of
> the table.\n\n"
> E + where "Query f74919e60b835567:da9967a400000000
> failed:\nLocalCatalogException: Could not load partitions for table
> tpch_parq...t limit is 1 configured by startup flag
> 'catalog_partial_fetch_max_files'. Consider compacting files of the
> table.\n\n" = str(ImpalaBeeswaxException())
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
