ZENOTME opened a new pull request, #199:
URL: https://github.com/apache/iceberg-rust/pull/199
This PR aims to complete #125. After #66, we prepared the plan
file(metadata) for the scan. This PR will uses these plan file to construct the
stream for read record batch.
This PR also changes the interface for scan:
Before it, our interface looks like this, the scan task will return directly
by `table_scan.plan_files()`.
```
let file_scan_task_stream = table_scan.plan_files();
for file_scan_task in file_scan_task_stream {
...
}
```
And now, our interface looks like, the `table_scan.plan_files()` will return
the metadata(PlanFile). And we can use the metadata to construct the scan task.
The benefit of this is the more flexible interface, e.g. user can plan once and
distribute these metadata to different node for scan.
```
let plan_files = table_scan.plan_files();
let file_scan_task = FileScanTask(plan_files);
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
