dongjoon-hyun edited a comment on pull request #30939: URL: https://github.com/apache/spark/pull/30939#issuecomment-751585923
No, @viirya . You may not notice the bug, because we detected the issues six month ago and made a Spark-side adaptation via SPARK-32436 on July 2020. Please see the discussion here for the technical details and Scala side bug IDs. AFAIK, the bug is in Scala 2.12.12 and we are waiting for 2.12.13 . - https://github.com/apache/spark/pull/29231 ([SPARK-32436][CORE] Initialize numNonEmptyBlocks in HighlyCompressedMapStatus.readExternal) - https://github.com/apache/spark/pull/29124 ([WIP][SPARK-31168][BUILD] Upgrade Scala to 2.12.12) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
