abstractdog commented on pull request #130: URL: https://github.com/apache/tez/pull/130#issuecomment-857749102
@tprelle : could you please try the latest commit? https://github.com/apache/tez/pull/130/commits/7ffc7832af935449554537b52b03e37120ac5799#diff-7ae0f0c86feac929c1490f9938cad5c25d46435d6f80de2455e64f11a49da1c8R44 very interestingly, I reproduced the problem and I found that synchronization didn't solve the issue for me, and then I found that the problem is the default buffer size I choose regardless of codec type (128K), which led to errors in case of snappy with default 256K, everything worked fine could you please try this patch on your cluster to confirm if we're hitting the very same issue? https://github.com/apache/tez/commit/7ffc7832af935449554537b52b03e37120ac5799.patch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
