advancedxy commented on issue #476: URL: https://github.com/apache/incubator-uniffle/issues/476#issuecomment-1380199120
I believe Uniffle uses `org.apache.uniffle.common.compression.Codec.NOOP` to disable compress. But it's never used in production and may have other hidden issues. cc @zuston. I'm also in favor of respect compute engine's shuffle options. I just did a quick overview the codec' usage and seems that it's only used in client side. Maybe we should reconsider this part, just let the client(MR or Spark) delegates its compression codec to Spark's or MR's. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
