glasser opened a new pull request #6918: google-storage: retry on all GCS insert operations URL: https://github.com/apache/incubator-druid/pull/6918 PR #5750 by @drcrallen added retry to a variety of GCS operations. Notably, there was still no retry on GoogleTaskLogs.pushTaskLog, which we have found to occasionally fail in our cluster. This PR takes the retry that was added around storage.insert in GoogleDataSegmentPusher and moves it into GoogleStorage itself, which adds it to task log pushing as well as DataSegmentFinder descriptor.json uploads. I chose not to touch other operations because this was the operation that was causing trouble in my cluster in practice. Fixes #6912.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
