[
https://issues.apache.org/jira/browse/HUDI-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372435#comment-17372435
]
ASF GitHub Bot commented on HUDI-1872:
--------------------------------------
wangxianghu commented on pull request #3162:
URL: https://github.com/apache/hudi/pull/3162#issuecomment-871974890
> The CI failed with
>
> ```
> Failed to execute goal on project hudi-utilities-bundle_2.11: Could not
resolve dependencies for project
org.apache.hudi:hudi-utilities-bundle_2.11:jar:0.9.0-SNAPSHOT: Failure to find
org.apache.hudi:hudi-utilities_2.11:jar:0.9.0-SNAPSHOT in
https://oss.sonatype.org/content/repositories/snapshots/
> ```
>
> Should I only include `hudi-spark-utilities` here
https://github.com/apache/hudi/blob/master/packaging/hudi-utilities-bundle/pom.xml#L70
or should we even added `hudi-flink-utilities` to the bundle ?
>
> Also, I think we should only maintain one parquet version for Flink and
Spark, currently Flink is using 1.11.1
https://github.com/apache/hudi/blob/master/hudi-flink/pom.xml#L33 whereas other
dependencies are using 1.10.x version
>
> thoughts ? @vinothchandar @danny0405
@veenaypatil
1. I agree with @danny0405, you should pay attention to the dependencies.
2. As to the bundle jar, you can make a bundle package for each utility.
that can be `hudi-flink-utilities-bundle`, `hudi-spark-utilities-bundle`,
but this naming breaks the backward compatibility.
would like to hear from @vinothchandar
3. I prefer using a unified parquet version, but I am not sure if the spark
engine works ok with 1.11.1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Move HoodieFlinkStreamer into hudi-utilities module
> ---------------------------------------------------
>
> Key: HUDI-1872
> URL: https://issues.apache.org/jira/browse/HUDI-1872
> Project: Apache Hudi
> Issue Type: Task
> Components: Flink Integration
> Reporter: Danny Chen
> Assignee: Vinay
> Priority: Major
> Labels: pull-request-available, sev:normal
> Fix For: 0.9.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
