Jarred, To achieve better performance IGFS is designed to be the only point to perform mutable actions, like delete, on the file system. When you remove a file from HDFS without letting IGFS know about this, IGFS thinks that the file never existed.
Please try doing all file system operations thtough IGFS. In the nearest releases we will address the issue you faced and improve usability in cases when updates can be performed without IGFS. Vladimir. On Fri, Sep 11, 2015 at 8:37 AM, jarredfox <[email protected]> wrote: > I have performed some tests to make accurate error conditions. > > first test - delete with hdfs => delete with igfs > step1. ignite start > step2. upload sample file to HDFS > step3. delete sample file ( with Hadoop Shell command) > step4. delete sample file test (with IGFS sample code) > result : well done. > > second test - read file with IGFS => delete with HDFS => delete with IGFS > step1. ignite start > step2. upload sample file to HDFS > step3. read one line from sample file with IGFS > step4. delete sample file ( with Hadoop Shell command) > step5. delete sample file test (with IGFS sample code) > result : sample file is deleted from HDFS (check with HDFS shell command) > but IGFS is not work > when i delete with fs.delete(), the return is false. > Sample file is still exist . I can read the file with IGFS. > (In practice, smple file is not exist. ) > > below is my test case and log > > # hdfs dfs -copyFromLocal ./sample.txt /temp/ > > # hadoop jar ./IGFS_read.jar /temp/sample.txt > /temp/sample.txt : file Exist > Read One Line : abcdefg > > # hdfs dfs -rm -f ./sample.txt /temp/ > Deleted ./sample.txt /temp/ > > # hadoop jar ./IGFS_delete.jar /temp/sample.txt > /temp/sample.txt : file Exist > delete : false > /temp/sample.txt : file Exist > Read One Line : abcdefg > > # hadoop dfs -ls /temp/sample.txt > ls: `/temp/sample.txt': No such file or directory > > > > > > > > > > > > > -- > View this message in context: > http://apache-ignite-users.70518.x6.nabble.com/How-use-Hadoop-accelerator-tp1314p1355.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. >
