cxzl25 commented on PR #2655: URL: https://github.com/apache/celeborn/pull/2655#issuecomment-2265109103
> It seems Celeborn should also support throw FetchFailedException when `Data corruption detected` Because in celeborn we are using ZstdDecompressCtx, decompression fails and it throws ZstdException, which is not inherited from IOException. But in Spark, ZstdInputStreamNoFinalizer is used, which throws ZstdIOException and inherits IOException. So this exception is not caught in CelebornInputStreamImpl#fillBuffer, we can do this next. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
