Github user dongjoon-hyun commented on a diff in the pull request:
    --- Diff: 
    @@ -188,6 +188,9 @@ class OrcFileFormat
             if (enableVectorizedReader) {
               val batchReader = new OrcColumnarBatchReader(
                 enableOffHeapColumnVector && taskContext.isDefined, 
copyToSpark, capacity)
    +          val iter = new RecordReaderIterator(batchReader)
    +          Option(TaskContext.get()).foreach(_.addTaskCompletionListener(_ 
=> iter.close()))
               batchReader.initialize(fileSplit, taskAttemptContext)
    --- End diff --
    According to the reported case, the ORC file is opened here. 
    But, it seems that the task is killed, `TaskKilled (Stage cancelled)`, 
before registering its listener during `initBatch`.


To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to