Caideyipi opened a new pull request, #18865:
URL: https://github.com/apache/iotdb/pull/18865

   ## Description
   
   When TsFile parser admission becomes available, processor workers can remain 
asleep until their next polling interval, delaying pipes behind the fair 
admission queue. Wake the relevant worker immediately and retain notifications 
that arrive before the worker begins its idle wait.
   
   Backport of #18843, cherry-picked from 
`aec1ad6139cb4dd1450725f53418cf40c26efb4e` to `dev/1.3`.
   
   - Connect pending parser reservations to their processor worker's wake-up 
callback and signal the next eligible reservation while preserving fair queue 
ordering.
   - Reuse one memory-budget snapshot during admission checks and expose 
admission reject/yield counters, a wait timer, and in-flight/waiting gauges.
   - Preserve the 1.3 memory-accounting implementation when resolving 
`PipeMemoryManager` conflicts, and retain the existing disk-I/O counter when 
resolving `PipeResourceMetrics` conflicts.
   - Backport regression coverage for notification ordering, notifications 
before idle wait, 100 waiting pipes, and stop/start behavior.
   
   ## Validation
   
   - `mvn -B -nsu spotless:apply -pl 
iotdb-core/datanode,iotdb-core/node-commons` — passed; no formatting changes.
   - `mvn -B -nsu test-compile -DskipTests` — full reactor passed.
   - `mvn -B -nsu test-compile -P with-zh-locale -DskipTests` — full reactor 
passed with `MAVEN_OPTS="-Xmx2048m -XX:MaxMetaspaceSize=512m"`; the initial 
uncapped attempt exhausted local native memory after DataNode compiled 
successfully.
   - `mvn -B -nsu test -pl iotdb-core/datanode -am 
-Dtest=PipeProcessorSubtaskExecutionGuardTest,PipeProcessorSubtaskWorkerTest,PipeMemoryManagerTest
 -Dsurefire.failIfNoSpecifiedTests=false -DfailIfNoTests=false` — all 18 tests 
passed, with no failures, errors, or skipped tests.
   - `git diff --check` — passed.
   
   ## Checklist
   
   - [x] Self-reviewed, including notification ordering and concurrent 
admission/release.
   - [x] Backported unit tests for the changed behavior.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to