holdenk commented on a change in pull request #1526:
URL: https://github.com/apache/iceberg/pull/1526#discussion_r496307127
##########
File path:
mr/src/main/java/org/apache/iceberg/mr/mapreduce/IcebergInputFormat.java
##########
@@ -165,13 +166,15 @@ private static void checkResiduals(CombinedScanTask task)
{
private Iterator<FileScanTask> tasks;
private T currentRow;
private CloseableIterator<T> currentIterator;
+ private FileIO fileIO;
@Override
public void initialize(InputSplit split, TaskAttemptContext newContext) {
Configuration conf = newContext.getConfiguration();
// For now IcebergInputFormat does its own split planning and does not
accept FileSplit instances
CombinedScanTask task = ((IcebergSplit) split).task();
this.context = newContext;
+ this.fileIO = new HadoopFileIO(this.context.getConfiguration());
Review comment:
thanks, I'll keep that in mind :)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
