loftiest commented on issue #18166: URL: https://github.com/apache/dolphinscheduler/issues/18166#issuecomment-4457801318
Hi, I'd like to work on this issue. Based on the discussion and the related commits, it's clear that this missing functionality was caused by the architecture evolution and the refactoring of `varPool`. My plan: 1. Restore the file transfer utility class. 2. Call the utility class in `PhysicalTaskExecutor#initializeTaskContext` to download upstream files. 3. Add a success hook in `PhysicalTaskExecutor` so that output files are uploaded after the physical task succeeds. 4. In `CuringParamsServiceImpl#parseLocalParamsMap`, map the input file parameter's value as the key to match the output file parameters in the workflow `varPool`, so the correct file path can be retrieved from `TaskExecutionContext#prepareParamsMap`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
