wangxianghu commented on pull request #3162: URL: https://github.com/apache/hudi/pull/3162#issuecomment-871974890
> The CI failed with > > ``` > Failed to execute goal on project hudi-utilities-bundle_2.11: Could not resolve dependencies for project org.apache.hudi:hudi-utilities-bundle_2.11:jar:0.9.0-SNAPSHOT: Failure to find org.apache.hudi:hudi-utilities_2.11:jar:0.9.0-SNAPSHOT in https://oss.sonatype.org/content/repositories/snapshots/ > ``` > > Should I only include `hudi-spark-utilities` here https://github.com/apache/hudi/blob/master/packaging/hudi-utilities-bundle/pom.xml#L70 or should we even added `hudi-flink-utilities` to the bundle ? > > Also, I think we should only maintain one parquet version for Flink and Spark, currently Flink is using 1.11.1 https://github.com/apache/hudi/blob/master/hudi-flink/pom.xml#L33 whereas other dependencies are using 1.10.x version > > thoughts ? @vinothchandar @danny0405 @veenaypatil 1. I agree with @danny0405, you should pay attention to the dependencies. 2. As to the bundle jar, you can make a bundle package for each utility. that can be `hudi-flink-utilities-bundle`, `hudi-spark-utilities-bundle`, but this naming breaks the backward compatibility. would like to hear from @vinothchandar 3. I prefer using a unified parquet version, but I am not sure if the spark engine works ok with 1.11.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
