Hi All,
I am using pipeline code to read a file from Cloud storage.
Code :
DataflowPipelineOptions options =
PipelineOptionsFactory.create().as(DataflowPipelineOptions.class);
options.setRunner(BlockingDataflowPipelineRunner.class);
options.setProject("projectId");
options.setStagingLocation("StagingPath");
//PipelineOptions options = PipelineOptionsFactory.create();
// Then create the pipeline.
Pipeline p = Pipeline.create(options);
PCollection<String> lines =
p.apply(TextIO.Read.named("ReadDataFromStorage").from("source_Path"));
When am running from local eclipse am able to read a file.
But when i deployed to App engine i am getting below error.I am using
snappy-java-1.1.2.1.jar.Please see the error below and help me ASAP.
*Error for /dataflow org.xerial.snappy.SnappyError:
[FAILED_TO_LOAD_NATIVE_LIBRARY] null at
org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:159) at
org.xerial.snappy.Snappy.(Snappy.java:47) at
org.xerial.snappy.SnappyOutputStream.(SnappyOutputStream.java:97) at
org.xerial.snappy.SnappyOutputStream.(SnappyOutputStream.java:89) at
org.xerial.snappy.SnappyOutputStream.(SnappyOutputStream.java:79) at
com.google.cloud.dataflow.sdk.util.SerializableUtils.serializeToByteArray(SerializableUtils.java:49)
at
com.google.cloud.dataflow.sdk.util.SerializableUtils.ensureSerializable(SerializableUtils.java:84)
at com.google.cloud.dataflow.sdk.io.Read$Bounded.(Read.java:108) at
com.google.cloud.dataflow.sdk.io.Read$Bounded.(Read.java:103) at
com.google.cloud.dataflow.sdk.io.Read.from(Read.java:62) at
com.google.cloud.dataflow.sdk.io.TextIO$Read$Bound.apply(TextIO.java:319)*
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit
https://groups.google.com/d/msgid/google-appengine/faab0e56-50cb-4d46-8acc-5f3d36fe59ba%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
