Tan-JiaLiang commented on PR #683:
URL:
https://github.com/apache/doris-flink-connector/pull/683#issuecomment-5290230232
@JNSimba
When we cancel a job with savepoint, and start the job from savepoint, it
maybe throws the Exception from DorisCommitter.
```text
Caused by: org.apache.doris.flink.exception.DorisRuntimeException: commit
transaction failed {
"status": "ANALYSIS_ERROR",
"msg": "TStatus: errCode = 2, detailMessage = transaction [1204200202] not
found"
}
at
org.apache.doris.flink.sink.committer.DorisCommitter.commitTransaction(DorisCommitter.java:139)
```
I think it's this issue:
1. trigger a savepoint, `DorisWriter` will be flush and the transaction-id
will emit to the `DorisCommitter`.
2. the `DorisWriter#dorisStreamLoadMap` still keep the
`DorisStreamLoad#currentLabel`, which has been emit to the `DorisCommitter`.
3. cancel the job, it will trigger `DorisWriter#close`, and it maybe abort
the transaction-id which has been emit to the `DorisCommitter`.
So I think we should using the `DorisWriter#loadingMap` instead the
`DorisWriter#dorisStreamLoadMap` to abort transaction in `DorisWriter#close` .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
