[
https://issues.apache.org/jira/browse/HUDI-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372682#comment-17372682
]
ASF GitHub Bot commented on HUDI-1872:
--------------------------------------
wangxianghu edited a comment on pull request #3162:
URL: https://github.com/apache/hudi/pull/3162#issuecomment-872170156
> @wangxianghu
>
> > As to the bundle jar, you can make a bundle package for each utility.
> > that can be hudi-flink-utilities-bundle, hudi-spark-utilities-bundle,
but this naming breaks the backward compatibility.
>
> I mean adding the newly created modules here in Hudi-utilities-bundle -
https://github.com/apache/hudi/blob/master/packaging/hudi-utilities-bundle/pom.xml#L70
> This way it will not break anything as the only change in the
hudi-utilities-bundle is to add Flink as well
>
> > I prefer using a unified parquet version, but I am not sure if the spark
engine works ok with 1.11.1
>
> May be we can use 1.10.x version for Flink as well ?
1. Yes, I agree with you on creating a new module , but let's not put it
under the original `hudi-utilities-bundle`.
I prefer this:
```
hudi-utilities-bundle
├── hudi-flink-utilities-bundle
└── hudi-spark-utilities-bundle
```
or simply created a new module named `hudi-flink-utilities-bundle` under
`package`
WDYT?
2. I am not sure whether 1.10.x works with flink either ... @danny0405 any
thought?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Move HoodieFlinkStreamer into hudi-utilities module
> ---------------------------------------------------
>
> Key: HUDI-1872
> URL: https://issues.apache.org/jira/browse/HUDI-1872
> Project: Apache Hudi
> Issue Type: Task
> Components: Flink Integration
> Reporter: Danny Chen
> Assignee: Vinay
> Priority: Major
> Labels: pull-request-available, sev:normal
> Fix For: 0.9.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
