mrdrivingduck commented on PR #205: URL: https://github.com/apache/paimon-cpp/pull/205#issuecomment-5295628575
Oh, here is a Paimon semantic-level benchmark supplement to the pure filesystem benchmark above. FYI. - `regular_wide_rg_64k`: regular append-only wide table with 64K-row Parquet row groups; used for first-batch, full, projected, and no-prebuffer scans. - `regular_wide_rg_1k`: the same style of table with 1K-row groups; used for the selective predicate scan. - `regular_wide_small_files`: regular table split into small data files. - `regular_partitioned`: partitioned regular table; used for partition and prefetch scans. | Scenario | OSS FS | Jindo FS | OSS/Jindo | |---|---:|---:|---:| | First batch | 121 ms | 114 ms | +6.1% | | Full scan | 232.7 ms | 257.8 ms | -9.7% | | Projected scan | 123.3 ms | 113.8 ms | +8.4% | | Predicate scan | 25 ms | 24 ms | +4.2% | | Small-files scan | 255.7 ms | 239.7 ms | +6.7% | | Partition scan | 65.3 ms | 64.4 ms | +1.4% | | Prefetch scan | 765 ms | 855 ms | -10.5% | | Scan without Parquet prebuffer | 489 ms | 485 ms | +0.8% | Overall, OSS FS and Jindo FS show broadly comparable performance under Paimon scan semantics. The observed differences are generally within a single-digit range and do not indicate a consistent performance disadvantage, but much more like noise. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
