[
https://issues.apache.org/jira/browse/HUDI-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17480544#comment-17480544
]
sivabalan narayanan edited comment on HUDI-3262 at 1/23/22, 3:20 AM:
---------------------------------------------------------------------
Guess we need to fix the way our bundles are packaged. For eg, I tried to query
hudi table using hudi-utilities bundle and it succeeds w/ 0.10.1, but fails w/
master. Should be the same reason why integ test suite bundle fails to query
hudi table.
{code:java}
./bin/spark-shell \
--packages org.apache.spark:spark-avro_2.11:2.4.4 \
--conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' --jars
~/Documents/personal/projects/apache_hudi_dec/hudi/packaging/hudi-utilities-bundle/target/hudi-utilities-bundle_2.11-0.10.1-rc2.jar
scala> val df = spark.read.format("hudi").load("/tmp/hudi-deltastreamer-ny/")
scala> df.count
{code}
was (Author: shivnarayan):
Guess we need to fix the way our bundles are packaged. For eg, I tried to query
hudi table using hudi-utilities bundle and it succeeds w/ 0.10.1, but fails w/
master. Should be the same reason why integ test suite bundle fails to query
hudi table.
> Integration test suite failure
> ------------------------------
>
> Key: HUDI-3262
> URL: https://issues.apache.org/jira/browse/HUDI-3262
> Project: Apache Hudi
> Issue Type: Bug
> Components: tests-ci
> Reporter: Raymond Xu
> Assignee: sivabalan narayanan
> Priority: Critical
> Labels: sev:normal
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> detailed in https://github.com/apache/hudi/issues/4621
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
