BTW, I also encounter https://github.com/apache/hudi/issues/4229, and
don't find any related
upgrade/migration docs.

The example provided in the official docs[1] doesn't provide the
`uuid` column nor primary key.

[1] https://hudi.apache.org/docs/next/quick-start-guide/#create-table

Thanks,
Cheng Pan

On Tue, Dec 7, 2021 at 4:20 PM Cheng Pan <[email protected]> wrote:
>
> Hi,
>
> Does Hudi 0.10 drop support for Spark 3.0?
>
> From the website, Hudi claims to work with Spark-2.4.3+ & Spark 3.x 
> versions[1].
>
> The Apache Kyuubi (Incubating) has integration tests with Hudi, some tests
> works well with Hudi 0.9.0 but fails after bumping Hudi 0.10.0-rc3[2].
>
> I paste some stacktrace, and you can check the details on GitHub Actions[3].
>
> ```
> java.sql.SQLException: Error operating EXECUTE_STATEMENT:
> java.lang.NoSuchMethodError:
> 'org.apache.spark.sql.catalyst.expressions.AttributeSet
> org.apache.spark.sql.catalyst.plans.logical.Command.producedAttributes$(org.apache.spark.sql.catalyst.plans.logical.Command)'
> at 
> org.apache.spark.sql.hudi.command.CreateHoodieTableCommand.producedAttributes(CreateHoodieTableCommand.scala:48)
> at 
> org.apache.spark.sql.catalyst.plans.QueryPlan.references$lzycompute(QueryPlan.scala:72)
> at 
> org.apache.spark.sql.catalyst.plans.QueryPlan.references(QueryPlan.scala:72)
> ```
>
> [1] https://hudi.apache.org/docs/next/quick-start-guide#setup
> [2] https://github.com/apache/incubator-kyuubi/pull/1460
> [3] https://github.com/apache/incubator-kyuubi/runs/4440884713
>
> Thanks,
> Cheng Pan
>
> On Tue, Dec 7, 2021 at 2:18 PM Nishith <[email protected]> wrote:
> >
> > +1 (binding)
> >
> > - build successful
> > - QuickStart successful
> > - verified checksum
> >
> > Thanks,
> > Nishith
> >
> > > On Dec 6, 2021, at 6:40 AM, vino yang <[email protected]> wrote:
> > >
> > > +1 (binding)
> > >
> > > - build successfully
> > > - ran spark quickstart
> > > - verified checksum

Reply via email to