liqiquan commented on issue #12259: URL: https://github.com/apache/dolphinscheduler/issues/12259#issuecomment-1277225371
@fuchanghai > In the common module, there is init **StoreConfiguration**. > If RESOURCE_STORAGE_TYPE=HDFS, hadoop-related packages are required: hadoop-common&hadoop-client; RESOURCE_STORAGE_TYPE=S3, the jar of aws-java-sdk-s3 is required.` > However, in the pom of the common module, hadoop-common&hadoop-client and aws-java-sdk-s3 have scope set to provided, thus losing transitionality. Therefore, if the packages that reference the common module need the hadoop and aws-java-sdk-s3 packages, they need to be added again separately. > May I ask which way will be used to solve this problem? > 1. The jars of hadoops-Common&Hadoop-Client and aws-java-sdk-s3 are added separately for modules such as master and alter. > > 2. common module pom, scope without provided > > 3. StoreConfiguration is no longer init in the master and alter modules ---- > 在common模块中，有init StoreConfiguration的操作。 > 如果RESOURCE_STORAGE_TYPE=HDFS，需要hadoop相关的包: hadoop-common&hadoop-client；RESOURCE_STORAGE_TYPE=S3，则需要aws-java-sdk-s3的jar。 > 但是在common模块的pom中，hadoop-common&hadoop-client和aws-java-sdk-s3的scope被设置为provided，失去了传递性，所以引用common模块的包如果需要hadoop和aws-java-sdk-s3包，需要单独再次添加。 请问针此问题，后面会采用那种方式解决： 1.master和alter等模块单独添加，hadoop-common&hadoop-client和aws-java-sdk-s3的jar。 2.common模块的pom中，scope去掉provided 3.master和alter等模块中不再init StoreConfiguration -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
