diqiu50 commented on PR #12414: URL: https://github.com/apache/gravitino/pull/12414#issuecomment-5251453899
Since we are going to refactor this part, I think the architecture should follow two principles: 1. spark-common should not depend on any specific Spark version. All the suported spark vertion can build it. 2. Each supported Spark version, including minor versions, should depend only on spark-common and should not depend on other version-specific modules. using sourceset dependency is better than binary jars The tests should follow the same structure as well. This will keep each Spark version independent and make it much easier to deprecate or remove old versions in the future. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
