Hi all, How "atomic" is the copyFromLocal call? i.e. on process is in the midst of uploading a file to HDFS is it possible for another process to start reading it before the upload is complete?
I am currently safeguarding my code from this possibility by uploading it to a temporary directory and the renaming it to its final destination (the assumption being that a rename is "more atomic" than copyFromLocal), but I'd like to avoid doing this in two steps if possible. Regards, Ishaaq
