Hi Alan, Sorry this error message is so verbose. What are you passing for the server_name argument [1]? It looks like that's what the Java stacktrace is complaining about:
java.lang.IllegalArgumentException: serverName must be in format <account_name>.snowflakecomputing.com [1] https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/snowflake.py#L302 On Thu, Nov 19, 2020 at 10:16 AM Alan Krumholz <[email protected]> wrote: > I'm trying to replace my custom/problematic snowflake sink with the new: > https://beam.apache.org/documentation/io/built-in/snowflake/#writing-to-snowflake > > However when I try to run my pipeline (using python) I get this Java > error: > > RuntimeError: java.lang.RuntimeException: Failed to build transform >> beam:external:java:snowflake:write:v1 from spec urn: >> "beam:external:java:snowflake:write:v1" > > > It is hard to understand why it is failing from reading the partial java > error trace I get in the output: > >> at >> org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader.lambda$knownTransforms$0(ExpansionService.java:130) >> at >> org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:357) >> at >> org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:433) >> at >> org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:488) >> at >> org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:232) >> at >> org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:172) >> at >> org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331) >> at >> org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:817) >> at >> org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37) >> at >> org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) >> at java.base/java.lang.Thread.run(Thread.java:832) >> Caused by: java.lang.IllegalArgumentException: serverName must be in format >> <account_name>.snowflakecomputing.com >> at >> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:141) >> at >> org.apache.beam.sdk.io.snowflake.SnowflakeIO$DataSourceConfiguration.withServerName(SnowflakeIO.java:1700) >> at >> org.apache.beam.sdk.io.snowflake.crosslanguage.CrossLanguageConfiguration.getDataSourceConfiguration(CrossLanguageConfiguration.java:166) >> at >> org.apache.beam.sdk.io.snowflake.crosslanguage.WriteBuilder.buildExternal(WriteBuilder.java:78) >> at >> org.apache.beam.sdk.io.snowflake.crosslanguage.WriteBuilder.buildExternal(WriteBuilder.java:34) >> at >> org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader.lambda$knownTransforms$0(ExpansionService.java:125) >> ... 12 more > > > > any clue how I can debug/fix this using python? > > > >
