scwhittle commented on PR #34873:
URL: https://github.com/apache/beam/pull/34873#issuecomment-2857731188
> @scwhittle this is a follow up to our discussion in #34749 and #34750. I
would like to run a test with real data in the dataflow runner, is there a way
to get a snapshot build for this PR?
I think that you should be able to run a pipeline with these changes by
publishing the jars to your local maven and then configuring your pipeline to
use them.
# In the repo with this PR
./gradlew sdks:java:io:google-cloud-platform:compileJava \
&& ./gradlew -Ppublishing -p sdks/java/io/google-cloud-platform
publishToMavenLocal
# find local maven path
mvn help:evaluate -Dexpression=settings.localRepository
# In the project with your pipeline, modify pom.xml to use local repo
<repositories>
<repository>
<id>example-repo</id>
<name>Example Repository</name>
<url>file:///complete/path/to/.m2/repository</url>
</repository>
...
</repositories>
# Also modify the BEAM version in the pom.xml to match the version published
above. ie (<beam.version>2.64.0</beam.version>) to the SNAPSHOT version
(<beam.version>2.65.0-SNAPSHOT</beam.version>)
Then if you launch the dataflow pipeline as normal from your pipeline it
should pull in the locally published sdk changes. Let me know if that works or
if you have problems with that
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
