[
https://issues.apache.org/jira/browse/BEAM-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17546287#comment-17546287
]
Kenneth Knowles commented on BEAM-1167:
---------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/18168
> Jobs that contain FileBasedSources with globs that expand into zero files
> should fail
> -------------------------------------------------------------------------------------
>
> Key: BEAM-1167
> URL: https://issues.apache.org/jira/browse/BEAM-1167
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-core, sdk-py-core
> Reporter: Chamikara Madhusanka Jayalath
> Priority: P3
> Labels: Clarified
>
> Currently we do not fail if a glob that is used to create a FileBasedSource
> expand into zero files. This can be error prone since a typo when specifying
> a glob pattern can result in a job that silently pass without producing any
> output. I believe this should be fixed as follows.
> If a glob pattern specified as input to a FileBasedSource expand into zero
> files.
> (1) If validation of FileBasedSource is enabled, fail the job at pipeline
> construction.
> (2) If validation is disabled, fail the job at runtime by raising an
> exception at initial splitting.
> Both Java and Python SDKs have to be fixed.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
