alamb commented on code in PR #8565:
URL: https://github.com/apache/arrow-datafusion/pull/8565#discussion_r1435304695
##########
datafusion/common/src/config.rs:
##########
@@ -273,6 +273,11 @@ config_namespace! {
/// memory consumption
pub max_buffered_batches_per_output_file: usize, default = 2
+ /// When scanning file paths, whether to ignore subdirectory files,
+ /// ignored by default (true), when reading a partitioned table,
+ /// `listing_table_ignore_subdirectory` is always equal to false, even
if set to true
Review Comment:
Ah, got it -- thank you -- I will propose a clarification in a follow on PR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
