1032851561 commented on issue #8087:
URL: https://github.com/apache/hudi/issues/8087#issuecomment-1487848948
> > processElement,snapshotState,processSplits are handle in same thread
>
> You are right, they are all executed in the task thread, how about we use
our own custom thread instead of the mailbox executor, the mailbox executor
does not really executes the task, instead it puts a new task mail into the
mailbox.
Yes, my first idea is to use a separate thread to process the splits, I am
trying to now. just like :
```
SplitProcessThread :
while (running) {
try {
processSplits();
} catch (IOException e) {
LOG.error("process splits wrong", e);
executor.execute(StreamReadOperator::splitProcessException,
"process splits wrong");
throw new RuntimeException(e);
}
}
StreamReadOperator：
splitProcessException(){
throw new Exception("split process thread exist.").
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
