Caideyipi opened a new pull request, #18421:
URL: https://github.com/apache/iotdb/pull/18421

   ### What does this PR do?
   
   Adds resilient receiver-side handling for Pipe TsFile type-conversion 
failures.
   
   - Adds `connector.exception.data.convert-on-type-mismatch.tsfile.async-load` 
(and the `sink.*` alias), defaulting to `true`, and propagates the setting with 
a stable conversion task ID.
   - Deduplicates seal and retry requests by deterministic task ID. Retries 
reuse the existing task status and context instead of starting duplicate 
conversions.
   - On a type-mismatch conversion failure, atomically hands the TsFile and mod 
file to the receiver active-load async directory and marks the task 
receiver-owned.
   - Treats temporary unavailability and OOM as a pause of local conversion 
only; input files and parser progress remain retryable.
   - Reuses Pipe parser state and checkpoints across retries, including 
iterators, pending tablets, page and chunk metadata, file index, and pending 
statements.
   - When async takeover is disabled, sender retries return the current task 
status and never create a second conversion task.
   
   ### Tests
   
   - Added or updated parser, receiver, transfer-request, active-load path and 
scanner, load utility, and conversion-task-manager unit tests; 85 targeted 
tests passed.
   - DataNode compilation passed.
   - Spotless and `git diff --check` passed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to