wecharyu opened a new pull request, #4831: URL: https://github.com/apache/hive/pull/4831
### What changes were proposed in this pull request? 1. Add partition name filter for equals and not-equals in generating partition filter. 2. Add benchmark test `getPartitionsByFilter`. ### Why are the changes needed? Performance improvement. ### Does this PR introduce _any_ user-facing change? No. ### Is the change a dependency upgrade? No. ### How was this patch tested? 1. Passing existing partition filter related tests. 2. Add benchmark test ```bash java -jar ./hmsbench-jar-with-dependencies.jar -H localhost --savedata /tmp/benchdata --sanitize -N 10 -N 1000 -N 10000 -o bench_results_direct.csv -C -d testbench_http --params=100 -E 'drop.*' -E 'renameTable.*' -E 'getTableObjectsByName.*' -E 'listTables.*' -E 'listPartitions.*' -E 'getPartitionsByNames.*' -E 'getPartitionNames.*' -E 'listPartition' -E 'getPartition' -E 'getPartitions' -E 'getPartitions.10' -E 'getPartitions.1000' -E 'getPartitions.10000' -E 'getNid' -E 'listDatabases' -E 'getTable' -E 'createTable' -E 'addPartitions.*' -E 'addPartition.*' -E 'openTxn.*' ``` - Before this patch ```bash Operation Mean Med Min Max Err% getPartitionsByFilter 4.522 4.461 4.160 6.563 6.850 getPartitionsByFilter.10 4.371 4.305 4.035 6.364 6.456 getPartitionsByFilter.1000 4.403 4.376 4.118 5.145 3.958 getPartitionsByFilter.10000 6.044 6.006 5.663 9.304 6.237 ``` - After this patch ```bash Operation Mean Med Min Max Err% getPartitionsByFilter 4.886 4.864 4.271 6.641 7.648 getPartitionsByFilter.10 4.779 4.803 4.121 5.578 7.569 getPartitionsByFilter.1000 4.315 4.208 3.976 5.047 6.571 getPartitionsByFilter.10000 4.333 4.127 3.783 9.149 16.65 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
