Robert Metzger created FLINK-1572:

             Summary: Output directories are created before input paths are 
                 Key: FLINK-1572
             Project: Flink
          Issue Type: Improvement
          Components: JobManager
    Affects Versions: 0.9
            Reporter: Robert Metzger
            Priority: Minor

Flink is first creating the output directories for a job before creating the 
input splits.
If a job's input directories are wrong, the system will have created output 
directories for a failed job.

It would be much better if the system is creating the output directories "on 
demand" before data is actually written.

This message was sent by Atlassian JIRA

Reply via email to