kasakrisz opened a new pull request #2231: URL: https://github.com/apache/hive/pull/2231
### What changes were proposed in this pull request? When creating Reducer for bucketing 1. remove limitation for number of reducers when updating/deleting 2. Add ROWID to sort columns ### Why are the changes needed? Limiting number of reducers may leads to performance degradation. See Jira for details. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? ``` mvn test -Dtest=TestTxnCommands#testDeleteIn -pl ql -Drat.skip ``` ``` mvn test -DskipSparkTests -Dtest=TestMiniLlapLocalCliDriver -Dqfile=llap_acid.q -pl itests/qtest -Pitests ``` Search for log entries like ``` 2021-04-28T23:40:53,335 DEBUG [ec46860c-7238-4cbd-b14d-80b2e12fc54e main] parse.ParseDriver: Parsing command: update orc_llap_n1 set cbigint = 2 where cint = 1 ... 2021-04-28T23:40:53,394 INFO [ec46860c-7238-4cbd-b14d-80b2e12fc54e main] optimizer.SetReducerParallelism: Number of reducers determined to be: 2 ``` in `hive.log` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org For additional commands, e-mail: gitbox-h...@hive.apache.org
