Hi, Yes I have activated the Dataflow api and it is getting executed in the local. The problem is when I try to execute on the Cloud Dataflow service.
Thanks and Regards Anil On Apr 12, 2017 17:33, "Alexandre Crayssac" <[email protected]> wrote: > Hi, > > Have you activated the Dataflow API in the GCP console ? > > Regards, > > Alexandre > > On Wed, Apr 12, 2017 at 11:52 AM, Anil Srinivas < > [email protected]> wrote: > >> Hi, >> I have been trying to execute the example word-count on the cloud >> dataflow service as per the documentation in https://cloud.google.com/da >> taflow/docs/quickstarts/quickstart-java-maven. Even after following the >> exact same steps as mentioned in the document, I am getting the following >> error: >> >> Caused by: com.google.cloud.dataflow.sdk.util.UserCodeException: >> java.lang.RuntimeException: java.lang.RuntimeException: >> com.google.cloud.dataflow.sdk.util.UserCodeException: >> java.io.IOException: com.google.api.client.googleap >> is.json.GoogleJsonResponseException: 400 Bad Request >> { >> "code" : 400, >> "errors" : [ { >> "domain" : "global", >> "message" : "No object name", >> "reason" : "required" >> } ], >> "message" : "No object name" >> } >> at com.google.cloud.dataflow.sdk.util.UserCodeException.wrap(Us >> erCodeException.java:35) >> at com.google.cloud.dataflow.sdk.util.UserCodeException.wrapIf( >> UserCodeException.java:40) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.wrapUserCo >> deException(DoFnRunnerBase.java:369) >> at com.google.cloud.dataflow.sdk.util.SimpleDoFnRunner.invokePr >> ocessElement(SimpleDoFnRunner.java:51) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.processEle >> ment(DoFnRunnerBase.java:139) >> at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn.p >> rocessElement(SimpleParDoFn.java:188) >> at com.google.cloud.dataflow.sdk.runners.worker.ForwardingParDo >> Fn.processElement(ForwardingParDoFn.java:42) >> at com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkerL >> oggingParDoFn.processElement(DataflowWorkerLoggingParDoFn.java:47) >> at com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperat >> ion.process(ParDoOperation.java:55) >> at com.google.cloud.dataflow.sdk.util.common.worker.OutputRecei >> ver.process(OutputReceiver.java:52) >> at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn$1 >> .output(SimpleParDoFn.java:158) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnContex >> t.outputWindowedValue(DoFnRunnerBase.java:288) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnProces >> sContext.output(DoFnRunnerBase.java:450) >> at com.google.cloud.dataflow.sdk.runners.worker.CombineValuesFn >> Factory$ExtractOutputDoFn.processElement(CombineValuesFnFactory.java:270) >> at com.google.cloud.dataflow.sdk.util.SimpleDoFnRunner.invokePr >> ocessElement(SimpleDoFnRunner.java:49) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.processEle >> ment(DoFnRunnerBase.java:139) >> at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn.p >> rocessElement(SimpleParDoFn.java:188) >> at com.google.cloud.dataflow.sdk.runners.worker.ForwardingParDo >> Fn.processElement(ForwardingParDoFn.java:42) >> at com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkerL >> oggingParDoFn.processElement(DataflowWorkerLoggingParDoFn.java:47) >> at com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperat >> ion.process(ParDoOperation.java:55) >> at com.google.cloud.dataflow.sdk.util.common.worker.OutputRecei >> ver.process(OutputReceiver.java:52) >> at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn$1 >> .output(SimpleParDoFn.java:158) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnContex >> t.outputWindowedValue(DoFnRunnerBase.java:288) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnContex >> t.outputWindowedValue(DoFnRunnerBase.java:284) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnProces >> sContext$1.outputWindowedValue(DoFnRunnerBase.java:508) >> at com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowsAndComb >> ineDoFn.closeWindow(GroupAlsoByWindowsAndCombineDoFn.java:203) >> at com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowsAndComb >> ineDoFn.processElement(GroupAlsoByWindowsAndCombineDoFn.java:190) >> at com.google.cloud.dataflow.sdk.util.SimpleDoFnRunner.invokePr >> ocessElement(SimpleDoFnRunner.java:49) >> at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.processEle >> ment(DoFnRunnerBase.java:139) >> at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn.p >> rocessElement(SimpleParDoFn.java:188) >> at com.google.cloud.dataflow.sdk.runners.worker.ForwardingParDo >> Fn.processElement(ForwardingParDoFn.java:42) >> at com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkerL >> oggingParDoFn.processElement(DataflowWorkerLoggingParDoFn.java:47) >> at com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperat >> ion.process(ParDoOperation.java:55) >> at com.google.cloud.dataflow.sdk.util.common.worker.OutputRecei >> ver.process(OutputReceiver.java:52) >> at com.google.cloud.dataflow.sdk.util.common.worker.ReadOperati >> on.runReadLoop(ReadOperation.java:221) >> at com.google.cloud.dataflow.sdk.util.common.worker.ReadOperati >> on.start(ReadOperation.java:182) >> at com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExec >> utor.execute(MapTaskExecutor.java:69) >> at com.google.cloud.dataflow.sdk.runners.worker.Datafl >> 2017-04-12T09:30:48.972Z: Detail: (7323341af8d0122c): Cleaning up. >> 2017-04-12T09:30:48.978Z: Basic: (7323341af8d010f8): Stopping worker >> pool... >> 2017-04-12T09:31:53.989Z: Basic: (7323341af8d01811): Worker pool stopped. >> Apr 12, 2017 3:01:59 PM com.google.cloud.dataflow.sdk. >> runners.BlockingDataflowPipelineRunner run >> INFO: Job finished with status FAILED >> [WARNING] >> java.lang.reflect.InvocationTargetException >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAcce >> ssorImpl.java:62) >> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe >> thodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:498) >> at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: >> com.google.cloud.dataflow.sdk.runners.DataflowJobExecutionException: >> Job 2017-04-12_02_26_24-7430037228537323212 failed with status FAILED >> at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipeli >> neRunner.run(BlockingDataflowPipelineRunner.java:158) >> at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipeli >> neRunner.run(BlockingDataflowPipelineRunner.java:56) >> at com.google.cloud.dataflow.sdk.Pipeline.run(Pipeline.java:181) >> at com.example.WordCount.main(WordCount.java:202) >> ... 6 more >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] BUILD FAILURE >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] Total time: 06:14 min >> [INFO] Finished at: 2017-04-12T15:01:59+05:30 >> [INFO] Final Memory: 28M/367M >> [INFO] ------------------------------------------------------------ >> ------------ >> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.4.0:java >> (default-cli) on project first-dataflow: An exception occured while >> executing the Java class. null: InvocationTargetException: Job >> 2017-04-12_02_26_24-7430037228537323212 failed with status FAILED -> >> [Help 1] >> [ERROR] >> [ERROR] To see the full stack trace of the errors, re-run Maven with the >> -e switch. >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, >> please read the following articles: >> [ERROR] [Help 1] http://cwiki.apache.org/con >> fluence/display/MAVEN/MojoExecutionException >> >> Any help regarding this issue will be highly appreciated as there are not >> much documentations and discussions regarding the same. >> >> >> Thanks and Regards >> Anil >> > > > > -- > Alexandre Crayssac > CTO and Co-Founder > +33 6 78 00 24 77 > [email protected] > >
