JingsongLi commented on PR #7877: URL: https://github.com/apache/paimon/pull/7877#issuecomment-4473892788
> > This looks very suitable to be solved using Variant, why not? > > Hi @JingsongLi here are two reason we considering to introduce the shredding to the map > > 1. The map type is widely used in the internal usage, the migration to variant involves a large number of downstream function changes. > 2. Regarding storage savings, the variant type does not offer a significant advantage. Based on the benchmark results, the actual reduction in storage usage with variant is very minimal compared to the dynamic column shredding of the map. Can you demonstrate some benchmarks? As you said, the difference in storage between map and variant? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
