Hm it looks like there may be a bug in our gradle config, it doesn't seem to make a shaded jar for use with Spark (see this comment on the PR that added this to the website [1]). Maybe we need to add a shadowJar configuration to :sdks:java:testing:nexmark?
+dev <[email protected]> does anyone have context on this? [1] https://github.com/apache/beam/commit/2ae7950328cd27330befe0e64688230c83755137#r29690967 On Wed, May 12, 2021 at 4:06 PM Tao Li <[email protected]> wrote: > Hi Beam community, > > > > I have been following this nexmark doc: > https://beam.apache.org/documentation/sdks/java/testing/nexmark/ > > > > I ran into a problem with “Running query 0 on a Spark cluster with Apache > Hadoop YARN” section. > > > > I was following the instruction by running “./gradlew > :sdks:java:testing:nexmark:assemble” command, but did not find the uber jar > “build/libs/beam-sdks-java-nexmark-2.29.0-spark.jar” that was built locally > (the nexmark doc is referencing that jar). > > > > Can someone provide some guidance and help? Thanks. > > > > >
