[GitHub] [spark] HeartSaVioR commented on pull request #29425: [SPARK-32350][FOLLOW-UP] Fix count update issue and partition the value list to a set of small batches for LevelDB writeAll

2020-09-25 Thread GitBox
HeartSaVioR commented on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-698303116 Sorry I still have several things in my plate and have been struggling with these things. You'd better ping @mridulm as he'd understand the patch well. @mridulm

[GitHub] [spark] HeartSaVioR commented on pull request #29425: [SPARK-32350][FOLLOW-UP] Fix count update issue and partition the value list to a set of small batches for LevelDB writeAll

2020-09-24 Thread GitBox
HeartSaVioR commented on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-698303116 Sorry I still have several things in my plate and have been struggling with these things. You'd better ping @mridulm as he'd understand the patch well. @mridulm

[GitHub] [spark] HeartSaVioR commented on pull request #29425: [SPARK-32350][FOLLOW-UP] Fix count update issue and partition the value list to a set of small batches for LevelDB writeAll

2020-09-03 Thread GitBox
HeartSaVioR commented on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-686342201 I'm not 100% sure I'm qualified to review this patch, as this touches the details of LevelDB KV store implementation. (My understanding is more likely regarding to SHS +