Spoke too soon... still can't seem to get the new behaviour to appear in dataflow, possibly something is being overridden?
On Thu, Jul 21, 2022 at 3:15 PM Evan Galpin <egal...@apache.org> wrote: > Making a shadowJar from "beam-sdks-java-io-google-cloud-platform" looks to > be working. Added ` id 'com.github.johnrengelman.shadow'` to > `build.gradle` for "beam-sdks-java-io-google-cloud-platform" in the beam > source and used the resulting jar as a dependency replacement when > deploying the job to dataflow. Looks ok. > > On Thu, Jul 21, 2022 at 3:02 PM Evan Galpin <egal...@apache.org> wrote: > >> I believe I have the dependencySubstitution working, but it seems as >> though the substitution is removing transitive deps of >> "beam-sdks-java-io-google-cloud-platform", hmm... >> >> On Thu, Jul 21, 2022 at 1:15 PM Evan Galpin <egal...@apache.org> wrote: >> >>> Hi all, >>> >>> I'm trying to test a change I've made locally, but by validating it on >>> Dataflow. It works locally, but I want to validate on Dataflow. I've >>> tried a few different attempts at module substitution in the build.gradle >>> config file for the pipeline I'm trying to deploy, but I haven't had any >>> success yet. >>> >>> How might I be able to replace the >>> beam-sdks-java-io-google-cloud-platform module usually installed from maven >>> with a local jar generated from running: >>> >>> "./gradlew :sdk:java:io:google-cloud-platform:jar" >>> >>> Thanks, >>> Evan >>> >>
