HyukjinKwon commented on a change in pull request #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator URL: https://github.com/apache/spark/pull/25515#discussion_r316938981
########## File path: examples/src/main/python/prefetch.py ########## @@ -0,0 +1,86 @@ +# Review comment: I think examples in this directory target to show how the feature or API is used rather than showing the perf results .. - I think it can be just shown in the PR description. Virtually the example seems it has to be just `.toLocalIterator(prefetchPartitions=False)` which I don't think worth as a separate example file. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
