jihoonson commented on issue #9411: S3 InputSource issue when using prefix mode if a directory contains _SUCCESS files URL: https://github.com/apache/druid/issues/9411#issuecomment-591657701 Hi @sascha-coenen, I think the second `inputSource` with the `_SUCCESS` file is created for a subtask. In 0.17, the parallel task lists all objects starting with the given prefixes and creates subtasks to process each object. Unfortunately, there is no way to filter out unwanted objects for s3 input source now.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
