Is this somehtign I can do. I am using a FileOutputFormat inside of the foreachRDD call. After the input format runs, I want to do some directory cleanup and I want to block while I'm doing that. Is that something I can do inside of this function? If not, where would I accomplish this on every micro-batched itnerval?
- Blocking DStream.forEachRDD() Corey Nolet
- Re: Blocking DStream.forEachRDD() Corey Nolet