nanxiuzi opened a new pull request, #17685:
URL: https://github.com/apache/dolphinscheduler/pull/17685
… display
1. Add missing pfullName and relativePath fields in
transformCommonPrefixToStorageEntity()
- This fixes resource validation error when selecting OSS resources in
task editing page
- Align with transformOSSObjectToStorageEntity() method implementation
2. Add deduplication filters in listStorageEntity()
- Filter out the current directory itself to prevent self-reference
- Filter out directory marker objects that are already in CommonPrefixes
- This prevents duplicate folder entries in resource list
Root cause:
- Aliyun OSS creates directory marker objects (empty objects with key ending
with '/')
- OSS API returns the same directory in both CommonPrefixes and
ObjectSummaries
- Without deduplication, folders appear multiple times in the resource tree
<!--Thanks very much for contributing to Apache DolphinScheduler, we are
happy that you want to help us improve DolphinScheduler! -->
## Purpose of the pull request
<!--(For example: This pull request adds checkstyle plugin).-->
## Brief change log
<!--*(for example:)*
- *Add maven-checkstyle-plugin to root pom.xml*
-->
## Verify this pull request
<!--*(Please pick either of the following options)*-->
This pull request is code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please
describe tests)*.
(or)
This change added tests and can be verified as follows:
<!--*(example:)*
- *Added dolphinscheduler-dao tests for end-to-end.*
- *Added CronUtilsTest to verify the change.*
- *Manually verified the change by testing locally.* -->
(or)
## Pull Request Notice
[Pull Request
Notice](https://github.com/apache/dolphinscheduler/blob/dev/docs/docs/en/contribute/join/pull-request.md)
If your pull request contains incompatible change, you should also add it to
`docs/docs/en/guide/upgrade/incompatible.md`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
