Thanks Tomo, I'll check that out too as a good safeguard! Are you familiar with any process to build pre-release artifacts? I suppose that's really what I'm after is building a pre-release version of pubsubIO to validate in Dataflow.
- Evan On Thu, Jul 21, 2022 at 4:21 PM Tomo Suzuki via dev <dev@beam.apache.org> wrote: > I don't come up with a solution (I'm not familiar with the method > you're using). However I often use "getProtectionDomain()" > https://stackoverflow.com/a/56000383/975074 to find the JAR file from a > class. This ensures the class you modified is actually used. > > On Thu, Jul 21, 2022 at 3:35 PM Evan Galpin <egal...@apache.org> wrote: > >> Spoke too soon... still can't seem to get the new behaviour to appear in >> dataflow, possibly something is being overridden? >> >> On Thu, Jul 21, 2022 at 3:15 PM Evan Galpin <egal...@apache.org> wrote: >> >>> Making a shadowJar from "beam-sdks-java-io-google-cloud-platform" looks >>> to be working. Added ` id 'com.github.johnrengelman.shadow'` to >>> `build.gradle` for "beam-sdks-java-io-google-cloud-platform" in the beam >>> source and used the resulting jar as a dependency replacement when >>> deploying the job to dataflow. Looks ok. >>> >>> On Thu, Jul 21, 2022 at 3:02 PM Evan Galpin <egal...@apache.org> wrote: >>> >>>> I believe I have the dependencySubstitution working, but it seems as >>>> though the substitution is removing transitive deps of >>>> "beam-sdks-java-io-google-cloud-platform", hmm... >>>> >>>> On Thu, Jul 21, 2022 at 1:15 PM Evan Galpin <egal...@apache.org> wrote: >>>> >>>>> Hi all, >>>>> >>>>> I'm trying to test a change I've made locally, but by validating it on >>>>> Dataflow. It works locally, but I want to validate on Dataflow. I've >>>>> tried a few different attempts at module substitution in the build.gradle >>>>> config file for the pipeline I'm trying to deploy, but I haven't had any >>>>> success yet. >>>>> >>>>> How might I be able to replace the >>>>> beam-sdks-java-io-google-cloud-platform module usually installed from >>>>> maven >>>>> with a local jar generated from running: >>>>> >>>>> "./gradlew :sdk:java:io:google-cloud-platform:jar" >>>>> >>>>> Thanks, >>>>> Evan >>>>> >>>> > > -- > Regards, > Tomo >
