This is an automated email from the ASF dual-hosted git repository.
zhangchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 787779e09a8 [Fix](group commit) Fix group commit wal back pressure
case (#37569)
787779e09a8 is described below
commit 787779e09a87047c29aebce355b3dd5a30bf936a
Author: abmdocrt <[email protected]>
AuthorDate: Fri Jul 12 10:22:00 2024 +0800
[Fix](group commit) Fix group commit wal back pressure case (#37569)
## Proposed changes
<!--Describe your changes.-->
Problem: The group commit WAL back pressure case failed.
Reason: Previously, the group commit was restructured from **regular
load** to **pipeline architecture load**, which improved the concurrency
and speed of load. Consequently, the loads in the test case were
completed much faster. The default batching time for a group commit is
10 seconds. Therefore, if all loads are finished in less than this
time(10 seconds), the group commit data is not yet committed to the disk
and visible, resulting in no data being returned by the final select
statement.
Solution: To resolve the issue, wait for one batching period (10
seconds) after completing all imports before executing the query.
Plus, due to the faster speed of load, we move this case from p2 to p0.
---
.../stream_load/test_group_commit_and_wal_back_pressure.groovy | 5 ++++-
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git
a/regression-test/suites/load_p0/stream_load/test_group_commit_and_wal_back_pressure.groovy
b/regression-test/suites/load_p0/stream_load/test_group_commit_and_wal_back_pressure.groovy
index 9a081aa2d59..5ec3cab11d0 100644
---
a/regression-test/suites/load_p0/stream_load/test_group_commit_and_wal_back_pressure.groovy
+++
b/regression-test/suites/load_p0/stream_load/test_group_commit_and_wal_back_pressure.groovy
@@ -15,7 +15,7 @@
// specific language governing permissions and limitations
// under the License.
-suite("test_group_commit_and_wal_back_pressure", "p2") {
+suite("test_group_commit_and_wal_back_pressure") {
def tableName = "test_group_commit_and_wal_back_pressure"
sql """ DROP TABLE IF EXISTS ${tableName}1 """
@@ -123,6 +123,9 @@ suite("test_group_commit_and_wal_back_pressure", "p2") {
th.join()
}
+ // wait for group commit
+ Thread.sleep(10000)
+
sql "sync"
qt_1 """ select count(*) from ${tableName}1;"""
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
