xy720 opened a new pull request #4528: URL: https://github.com/apache/incubator-doris/pull/4528
## Proposed changes fix #4519 How to reproduce: **Restart when the state is ETL** 1. Submit a spark load job 2. Wait until the job state become `ETL` 3. Restart FE 4. Show load. And you can see the state of the job will always be stuck in ETL with progress 0%. 5. Open the web interface of the yarn cluster with browser, you can see that the spark job has been submitted successfully and is running well and normally. **Expected behavior** The job state should be ETL after FE restart. And the state will not stuck in ETL. **Bug Reson** This is because `SparkLoadAppHandle` in SparkLoadJob is not persisted, resulting in that an NPE error thrown in the ETL phase, making the job state stay in the ETL state all the time. ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes that apply_ - [x] Bugfix (non-breaking change which fixes an issue) ## Checklist _Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code._ - [x] I have create an issue on (Fix #4519), and have described the bug/feature there in detail ## Further comments If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc... ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
