for proposal 2, we can borrow the idea from spark source code. In RecordReaderIterator class, it close the reader in hasNext function, this helps to release the resource early. I am not sure if I can remove context.addTaskCompletionListener from CarbonScanRDD without other problems.
-- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
