Hi , I found this Jira open . https://issues.apache.org/jira/browse/NIFI-1322
In some of the commercial distributions of hadoop version(Huawei Hadoop distribution) small file features are supported so that the Nifi can write lot of small files and later merge into a bingger one. I think a good approach is to put in kafka/hbase and move it to HDFS based on size. http://blog.cloudera.com/blog/2009/07/file-appends-in-hdfs/ suggest not to append . In that case do we need to keep the Jira open ? I was also an impression that Nifi is going to implement append some how in future. Tijo On Thu, Sep 8, 2016 at 1:28 AM, Jeff <[email protected]> wrote: > Hello, > > The JIRA to which you are referring (probably https://issues. > apache.org/jira/browse/NIFI-958) was closed and marked as a duplicate of > https://issues.apache.org/jira/browse/NIFI-1321 and http > s://issues.apache.org/jira/browse/NIFI-1322, so that work can be tracked > separately for PutHDFS and PutFile. There's some discussions on those > JIRAs, but to my knowledge (and JIRA-searching skills) there is no > capability to append files on HDFS. > > On Wed, Sep 7, 2016 at 12:24 PM Kulkarni, Suyog <[email protected]> > wrote: > >> Hi, >> >> I just wanted to find out if PutHDFS now supports appending files in HDFS >> or not. I noticed there was a Jira with status "Resolved" for this, but I >> wanted to know which version has this feature or if there is any patch >> available for this. Also would like to know if anyone has tried it >> successfully or not. We are currently running version 0.6. >> >> Thanks, >> Suyog Kulkarni >> [email protected]<mailto:[email protected]> >> >> >> >> >> This email transmission and any accompanying attachments may contain CSX >> privileged and confidential information intended only for the use of the >> intended addressee. Any dissemination, distribution, copying or action >> taken in reliance on the contents of this email by anyone other than the >> intended recipient is strictly prohibited. If you have received this email >> in error please immediately delete it and notify sender at the above CSX >> email address. Sender and CSX accept no liability for any damage caused >> directly or indirectly by receipt of this email. >> >
