agresch commented on a change in pull request #3226: [STORM-3583] Handle
exceptions when AsyncLocalizer tries to get local resources
URL: https://github.com/apache/storm/pull/3226#discussion_r391731839
##########
File path:
storm-server/src/main/java/org/apache/storm/localizer/AsyncLocalizer.java
##########
@@ -457,17 +457,23 @@ public void releaseSlotFor(LocalAssignment assignment,
int port) throws IOExcept
topoConfBlob.removeReference(pna);
}
- List<LocalResource> localResources = null;
+
+ // ALERT: A possible race condition could be resolved by separating
the thread pools into downloadExecService and taskExecService
+ //
https://git.ouroath.com/storm/storm/commit/ebd52b37c7448d381d31451e46e8f19c6e51352d#diff-74535cb89e9e926ad424a8d1e2fa9586
+ // Will need further investigation if the race condition happens again
+ List<LocalResource> localResources;
try {
// Precondition1: Base blob stormconf.ser and stormcode.ser have
been localized
// Precondition2: Both these two blob files are fully downloaded
and proper permission been set
localResources = getLocalResources(pna);
} catch (FileNotFoundException fnfException) {
LOG.warn("Local base blobs have not been downloaded yet. "
+ "DownloadExecService is too busy", fnfException);
+ LOG.info("Port and assignment info: {}", pna);
Review comment:
If we're proceeding with this change, I think we should mark a meter so we
can add an alert and investigate that this is occurring and evaluate.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
