Hi,
I have been trying to execute the example word-count on the cloud dataflow
service as per the documentation in https://cloud.google.com/
dataflow/docs/quickstarts/quickstart-java-maven. Even after following the
exact same steps as mentioned in the document, I am getting the following
error:
Caused by: com.google.cloud.dataflow.sdk.util.UserCodeException:
java.lang.RuntimeException: java.lang.RuntimeException:
com.google.cloud.dataflow.sdk.util.UserCodeException: java.io.IOException:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad
Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "No object name",
"reason" : "required"
} ],
"message" : "No object name"
}
at com.google.cloud.dataflow.sdk.util.UserCodeException.wrap(
UserCodeException.java:35)
at com.google.cloud.dataflow.sdk.util.UserCodeException.wrapIf(
UserCodeException.java:40)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.wrapUserCodeException(
DoFnRunnerBase.java:369)
at com.google.cloud.dataflow.sdk.util.SimpleDoFnRunner.invokeProcessElement(
SimpleDoFnRunner.java:51)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.
processElement(DoFnRunnerBase.java:139)
at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn.
processElement(SimpleParDoFn.java:188)
at com.google.cloud.dataflow.sdk.runners.worker.ForwardingParDoFn.
processElement(ForwardingParDoFn.java:42)
at com.google.cloud.dataflow.sdk.runners.worker.
DataflowWorkerLoggingParDoFn.processElement(DataflowWorkerLoggingParDoFn.
java:47)
at com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation.process(
ParDoOperation.java:55)
at com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver.process(
OutputReceiver.java:52)
at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn$
1.output(SimpleParDoFn.java:158)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnContext.
outputWindowedValue(DoFnRunnerBase.java:288)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$
DoFnProcessContext.output(DoFnRunnerBase.java:450)
at com.google.cloud.dataflow.sdk.runners.worker.CombineValuesFnFactory$
ExtractOutputDoFn.processElement(CombineValuesFnFactory.java:270)
at com.google.cloud.dataflow.sdk.util.SimpleDoFnRunner.invokeProcessElement(
SimpleDoFnRunner.java:49)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.
processElement(DoFnRunnerBase.java:139)
at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn.
processElement(SimpleParDoFn.java:188)
at com.google.cloud.dataflow.sdk.runners.worker.ForwardingParDoFn.
processElement(ForwardingParDoFn.java:42)
at com.google.cloud.dataflow.sdk.runners.worker.
DataflowWorkerLoggingParDoFn.processElement(DataflowWorkerLoggingParDoFn.
java:47)
at com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation.process(
ParDoOperation.java:55)
at com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver.process(
OutputReceiver.java:52)
at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn$
1.output(SimpleParDoFn.java:158)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnContext.
outputWindowedValue(DoFnRunnerBase.java:288)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnContext.
outputWindowedValue(DoFnRunnerBase.java:284)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase$DoFnProcessContext$1.
outputWindowedValue(DoFnRunnerBase.java:508)
at com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowsAndCombineDo
Fn.closeWindow(GroupAlsoByWindowsAndCombineDoFn.java:203)
at com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowsAndCombineDo
Fn.processElement(GroupAlsoByWindowsAndCombineDoFn.java:190)
at com.google.cloud.dataflow.sdk.util.SimpleDoFnRunner.invokeProcessElement(
SimpleDoFnRunner.java:49)
at com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.
processElement(DoFnRunnerBase.java:139)
at com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn.
processElement(SimpleParDoFn.java:188)
at com.google.cloud.dataflow.sdk.runners.worker.ForwardingParDoFn.
processElement(ForwardingParDoFn.java:42)
at com.google.cloud.dataflow.sdk.runners.worker.
DataflowWorkerLoggingParDoFn.processElement(DataflowWorkerLoggingParDoFn.
java:47)
at com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation.process(
ParDoOperation.java:55)
at com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver.process(
OutputReceiver.java:52)
at com.google.cloud.dataflow.sdk.util.common.worker.
ReadOperation.runReadLoop(ReadOperation.java:221)
at com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation.start(
ReadOperation.java:182)
at com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor.execute(
MapTaskExecutor.java:69)
at com.google.cloud.dataflow.sdk.runners.worker.Datafl
2017-04-12T09:30:48.972Z: Detail: (7323341af8d0122c): Cleaning up.
2017-04-12T09:30:48.978Z: Basic: (7323341af8d010f8): Stopping worker
pool...
2017-04-12T09:31:53.989Z: Basic: (7323341af8d01811): Worker pool stopped.
Apr 12, 2017 3:01:59 PM
com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
run
INFO: Job finished with status FAILED
[WARNING]
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.google.cloud.dataflow.sdk.runners.DataflowJobExecutionException:
Job 2017-04-12_02_26_24-7430037228537323212 failed with status FAILED
at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.run(
BlockingDataflowPipelineRunner.java:158)
at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.run(
BlockingDataflowPipelineRunner.java:56)
at com.google.cloud.dataflow.sdk.Pipeline.run(Pipeline.java:181)
at com.example.WordCount.main(WordCount.java:202)
... 6 more
[INFO] ------------------------------------------------------------
------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------
------------
[INFO] Total time: 06:14 min
[INFO] Finished at: 2017-04-12T15:01:59+05:30
[INFO] Final Memory: 28M/367M
[INFO] ------------------------------------------------------------
------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.4.0:java
(default-cli) on project first-dataflow: An exception occured while
executing the Java class. null: InvocationTargetException: Job
2017-04-12_02_26_24-7430037228537323212 failed with status FAILED -> [Help
1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
MojoExecutionException
Any help regarding this issue will be highly appreciated as there are not
much documentations and discussions regarding the same.
Thanks and Regards
Anil
