This is an automated email from the ASF dual-hosted git repository.
924060929 pushed a change to branch auto-pick-64160-branch-4.1
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 8e1a4789a84 [fix](fe) Fence cold partition event row counts
omit 6062d544c51 [fix](fe) Preserve committed cache invalidation
omit 48fea1dd796 [fix](fe) Close remaining external row count invalidation
gaps
omit 830183711f7 [fix](fe) Preserve row count fences on refresh failures
omit 61020a27aab [fix](fe) Fence row count cache on metadata events
omit 74d02a9e00d [fix](fe) Invalidate external row counts after metadata
changes
add 01f3a03b819 branch-4.1: [Enhance](resource) Restrict AI resource
creation by user identity (#68147) (#68265)
add fb60467142a [opt](lance) Cache table access resolution in FE (#68305)
add 97bc869eb35 branch-4.1: [improvement](fe) Add connector property
validators (#68163)
add 70bf96e8b0b [feat](iceberg) HDFS lazy open + iceberg delete file
file_size propagation (#66773) (#67842)
add 41d1009caf9 [fix](fe) Invalidate external row counts after metadata
changes
add 446a9242e94 [fix](fe) Fence row count cache on metadata events
add 434a25e9ab1 [fix](fe) Preserve row count fences on refresh failures
add 438b2d4f681 [fix](fe) Close remaining external row count invalidation
gaps
add 18ecae819aa [fix](fe) Preserve committed cache invalidation
add fdf93c6d9ba [fix](fe) Fence cold partition event row counts
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (8e1a4789a84)
\
N -- N -- N refs/heads/auto-pick-64160-branch-4.1 (fdf93c6d9ba)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/exec/scan/file_scanner.cpp | 10 +-
.../table/iceberg_delete_file_reader_helper.cpp | 10 +-
.../table/iceberg_delete_file_reader_helper.h | 2 +-
be/src/format/table/iceberg_reader.cpp | 24 +-
be/src/format/table/iceberg_reader.h | 4 +
be/src/format_v2/orc/orc_reader.cpp | 9 +-
be/src/format_v2/table/iceberg_reader.cpp | 5 +-
be/src/io/fs/file_handle_cache.cpp | 68 +++-
be/src/io/fs/file_handle_cache.h | 10 +-
be/src/io/fs/hdfs_file_reader.cpp | 47 ++-
be/src/io/fs/hdfs_file_system.cpp | 9 +-
be/src/io/fs/local_file_reader.cpp | 2 +-
be/src/io/hdfs_util.cpp | 1 +
be/src/io/hdfs_util.h | 1 +
be/src/storage/index/index_file_reader.cpp | 10 +
.../index/inverted/inverted_index_fs_directory.cpp | 6 +-
be/test/exec/scan/vfile_scanner_exception_test.cpp | 131 ++++++-
.../iceberg_delete_file_reader_helper_test.cpp | 16 +-
.../format/table/iceberg/iceberg_reader_test.cpp | 65 ++++
.../format_v2/orc/orc_file_input_stream_test.cpp | 33 ++
be/test/format_v2/orc/orc_reader_test.cpp | 34 ++
be/test/format_v2/table/iceberg_reader_test.cpp | 120 ++++++-
be/test/io/fs/file_handle_cache_test.cpp | 391 +++++++++++++++++++++
be/test/io/fs/hdfs_file_system_test.cpp | 70 ++++
.../segment/inverted_index_file_reader_test.cpp | 27 ++
.../main/java/org/apache/doris/common/Config.java | 4 +
.../org/apache/doris/catalog/RefreshManager.java | 14 +
.../doris/datasource/ExternalMetaCacheMgr.java | 12 +
.../datasource/iceberg/source/IcebergScanNode.java | 4 +
.../doris/datasource/lance/LanceCatalogClient.java | 27 +-
.../datasource/lance/LanceExternalCatalog.java | 16 +-
.../datasource/lance/LanceNamespaceClient.java | 120 ++++++-
.../metastore/AbstractLanceProperties.java | 18 +
.../property/storage/HdfsProperties.java | 2 +
.../property/storage/OSSHdfsProperties.java | 2 +
.../plans/commands/info/CreateResourceInfo.java | 10 +
.../iceberg/source/IcebergScanNodeTest.java | 77 ++++
.../lance/LanceCatalogLifecycleTest.java | 169 +++++++++
.../lance/LanceTableAccessCacheTest.java | 279 +++++++++++++++
.../property/ConnectorPropertiesUtilsTest.java | 32 ++
.../property/metastore/LancePropertiesTest.java | 16 +
.../property/storage/HdfsPropertiesTest.java | 12 +
.../plans/commands/CreateResourceCommandTest.java | 75 ++++
.../property/ConnectorPropertiesUtils.java | 23 ++
.../foundation/property/ConnectorProperty.java | 2 +
.../property/ConnectorPropertyValidator.java | 50 +++
.../property/NoPathTraversalValidator.java | 45 +++
gensrc/thrift/PlanNodes.thrift | 1 +
48 files changed, 2033 insertions(+), 82 deletions(-)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/lance/LanceTableAccessCacheTest.java
create mode 100644
fe/fe-foundation/src/main/java/org/apache/doris/foundation/property/ConnectorPropertyValidator.java
create mode 100644
fe/fe-foundation/src/main/java/org/apache/doris/foundation/property/NoPathTraversalValidator.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
