Hannah-Jiang commented on pull request #11563: URL: https://github.com/apache/beam/pull/11563#issuecomment-620903180
I thought you meant caching the URLs between different runs, so my estimation of the workload was high and I didn't think I can deliver that approach by 2.21.0. Caching within the same run benefits running time as well. Thank you for improving it. As discussed currently in the thread, we may remove the check_url approach. Let's hold the memorize commit for now until we have a conclusion. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
