Yeah, I was trying to avoid that. I'm attempting to retrieve a listing on a periodic basis and then perform a series of steps based on the files.
This is the only processor I've found that will return `hdfs.lastModified` and I'm going to use that value to distribute out the files into subfolders based on year/month/date. It's been a real PITA to test because I of the cache issue.
