Quanlong Huang has posted comments on this change. ( http://gerrit.cloudera.org:8080/24822 )
Change subject: IMPALA-14598: Store HBO cache in Redis/Valkey ...................................................................... Patch Set 3: (4 comments) http://gerrit.cloudera.org:8080/#/c/24822/2/be/src/common/global-flags.cc File be/src/common/global-flags.cc: http://gerrit.cloudera.org:8080/#/c/24822/2/be/src/common/global-flags.cc@280 PS2, Line 280: // not introduce seeks. The literature seems to agree that with 8 MB reads, random > This untagged flag is printed by `LogCommandLineFlags()`, exposing the Redi Done http://gerrit.cloudera.org:8080/#/c/24822/2/fe/src/main/java/org/apache/impala/service/HistoricalStats.java File fe/src/main/java/org/apache/impala/service/HistoricalStats.java: http://gerrit.cloudera.org:8080/#/c/24822/2/fe/src/main/java/org/apache/impala/service/HistoricalStats.java@141 PS2, Line 141: (HistoricalStatsValue<TPlanNodeRun>) cacheBackend_.getIfPresent( > This GET-modify-SET is not atomic across coordinators, so concurrent writer I plan to handle this with the TODO on L133, also consider batch writes. http://gerrit.cloudera.org:8080/#/c/24822/2/fe/src/main/java/org/apache/impala/service/RedisCacheBackend.java File fe/src/main/java/org/apache/impala/service/RedisCacheBackend.java: http://gerrit.cloudera.org:8080/#/c/24822/2/fe/src/main/java/org/apache/impala/service/RedisCacheBackend.java@81 PS2, Line 81: */ > Redis GET runs in the planner path. A slow server can consume the timeout p Done http://gerrit.cloudera.org:8080/#/c/24822/2/fe/src/main/java/org/apache/impala/service/RedisCacheBackend.java@108 PS2, Line 108: return; > `hbo_max_runs_per_key` limits one value, but keys never expire, so total Re Done -- To view, visit http://gerrit.cloudera.org:8080/24822 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I43a171bcd436f57bcff14ceaaaa98c0f7dcec769 Gerrit-Change-Number: 24822 Gerrit-PatchSet: 3 Gerrit-Owner: Quanlong Huang <[email protected]> Gerrit-Reviewer: Aleksandr Efimov <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Comment-Date: Tue, 15 Sep 2026 02:54:37 +0000 Gerrit-HasComments: Yes
