Hello, Can you describe your flow a bit more?
Are you using ListHDFS + FetchHDFS to retrieve the data from HDFS? What value do you have for the Directory property in PutHDFS? Thanks, Bryan On Wed, Apr 6, 2016 at 7:12 AM, jamesgreen <[email protected]> wrote: > I am trying to compress a whole lot of files from my HDFS and write to > another folder on the HDFS > My Folder Structure is as follows: > \landing\databasename\prodeiw_arc\tablename\_SUCCESS > \landing\databasename\prodeiw_arc\tablename\part-m-00000 > > \landing\databasename\prodeiw_arc\tablename2\_SUCCESS > \landing\databasename\prodeiw_arc\tablename2\part-m-00000 > > I am trying to compress to the following > \landing\compressed\prodeiw_arc\tablename\_SUCCESS > \landing\compressed\prodeiw_arc\tablename\part-m-00000 > > \landing\compressed\prodeiw_arc\tablename2\_SUCCESS > \landing\compressed\prodeiw_arc\tablename2\part-m-00000 > > I have found that it compresses to > \landing\compressed\prodeiw_arc\_SUCCESS > \landing\compressed\prodeiw_arc\tablename\part-m-00000 > > it will then continue to overwrite. Is there anyway I can keep the > directory > structure when doing a PutHDFS? > > Thanks and Regards > > > > > -- > View this message in context: > http://apache-nifi-developer-list.39713.n7.nabble.com/Compression-of-Data-in-HDFS-tp8821.html > Sent from the Apache NiFi Developer List mailing list archive at > Nabble.com. >
