Hey gang, The Flume user guide states "Using dfs has some restrictions and requires some extra setup. Files contents will not become available until after the sink has been closed. See the Troubleshooting section for details."
This isn't accurate. In hdfs data is available to clients as blocks complete, ie well before the file is closed. This is true even if you don't hflush the stream. Thanks, Eli
