Note that audit streams are often used for this as well. These are available for HDFS and MapR FS (at least).
Also, for MapR DB at least, you can get full changed-data-records as a call back into your code even remote from the table. On Mon, Jun 15, 2015 at 5:40 PM, Mike Carey <[email protected]> wrote: > Ooooohhhh..... Cool! > On Jun 15, 2015 5:31 PM, "Ian Maxon" <[email protected]> wrote: > > > Stumbled across this new feature in HDFS: > > https://issues.apache.org/jira/browse/HDFS-6634. Has anyone else seen > > this? Basically it would let you be notified whenever files are > > changed in HDFS, similar (but not exactly like) inotify. This sounds > > like it could let us update externally indexed data on HDFS > > incrementally doesn't it?... > > > > Just a random thought. > > > > -Ian > > >
