wangxianghu edited a comment on pull request #3162: URL: https://github.com/apache/hudi/pull/3162#issuecomment-872170156
> @wangxianghu > > > As to the bundle jar, you can make a bundle package for each utility. > > that can be hudi-flink-utilities-bundle, hudi-spark-utilities-bundle, but this naming breaks the backward compatibility. > > I mean adding the newly created modules here in Hudi-utilities-bundle - https://github.com/apache/hudi/blob/master/packaging/hudi-utilities-bundle/pom.xml#L70 > This way it will not break anything as the only change in the hudi-utilities-bundle is to add Flink as well > > > I prefer using a unified parquet version, but I am not sure if the spark engine works ok with 1.11.1 > > May be we can use 1.10.x version for Flink as well ? 1. Yes, I agree with you on creating a new module , but let's not put it under the original `hudi-utilities-bundle`. I prefer this: ``` hudi-utilities-bundle ├── hudi-flink-utilities-bundle └── hudi-spark-utilities-bundle ``` or simply created a new module named `hudi-flink-utilities-bundle` under `packaging` WDYT? 2. I am not sure whether 1.10.x works with flink either ... @danny0405 any thought? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
