See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/967/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-9813] Replace outputs with respect to the correct tag.
[kamil.wasilewski] [BEAM-9761] Disable auto builds for tests that are currently
failing.
[tweise] [BEAM-9811] Copy pom for all publishMavenJavaPublication tasks
[github] add licenses and license types for zetasql packages (#11516)
[github] Added a batch example with covid tracking data for interactive
notebook.
------------------------------------------
[...truncated 3.10 MB...]
INFO: Successfully wrote temporary file
/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/bc705286-5cbf-4877-a88a-9b111fcf2444
Apr 25, 2020 7:29:17 PM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 8f7a50d0-54f2-44b3-a5c6-54c8c0c64161 for window
org.apache.beam.sdk.transforms.windowing.GlobalWindow@11bcc6d1 pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/8f7a50d0-54f2-44b3-a5c6-54c8c0c64161
Apr 25, 2020 7:29:17 PM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 3 file results
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
createMissingEmptyShards
INFO: Finalizing for destination null num shards 3.
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/bc705286-5cbf-4877-a88a-9b111fcf2444,
shard=2,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@11bcc6d1,
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/counts-00002-of-00003
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/3bad1c15-a153-4538-a056-9418e134a8c0,
shard=0,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@11bcc6d1,
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/counts-00000-of-00003
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/8f7a50d0-54f2-44b3-a5c6-54c8c0c64161,
shard=1,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@11bcc6d1,
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/counts-00001-of-00003
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/3bad1c15-a153-4538-a056-9418e134a8c0
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/8f7a50d0-54f2-44b3-a5c6-54c8c0c64161
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/bc705286-5cbf-4877-a88a-9b111fcf2444
Apr 25, 2020 7:29:17 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
WARNING: Failed to match temporary files under:
[/tmp/groovy-generated-2557347085329762123-tmpdir/word-count-beam/.temp-beam-9c916ec0-f801-472b-b702-e67e5af38823/].
grep Foundation counts*
counts-00002-of-00003:Foundation: 1
Verified Foundation: 1
[SUCCESS]
> Task :runners:google-cloud-dataflow-java:runQuickstartJavaDataflow
Apr 25, 2020 7:29:19 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ReadLines/Read as step s1
Apr 25, 2020 7:29:20 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern gs://apache-beam-samples/shakespeare/* matched 44 files with
total size 5443510
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WordCount.CountWords/ParDo(ExtractWords) as step s2
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WordCount.CountWords/Count.PerElement/Init/Map as step s3
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey as step
s4
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues
as step s5
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding MapElements/Map as step s6
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign as step s7
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
as step s8
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten as step
s9
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten as step
s10
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum as step s11
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections as
step s12
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
as step s13
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/CreateDataflowView as
step s14
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)
as step s15
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
as step s16
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
as step s17
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize as step s18
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key as step s19
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
as step s20
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey
as step s21
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
as step s22
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
as step s23
Apr 25, 2020 7:29:21 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/
Apr 25, 2020 7:29:21 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <67452 bytes, hash RR2qH00BmGcKvxbXbcOFUw> to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/pipeline-RR2qH00BmGcKvxbXbcOFUw.pb
Apr 25, 2020 7:29:21 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.22.0-SNAPSHOT
Apr 25, 2020 7:29:22 PM
org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler
handleResponse
WARNING: Request failed with code 403, performed 0 retries due to IOExceptions,
performed 0 retries due to unsuccessful status codes, HTTP framework says
request can be retried, (caller responsible for retrying):
https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/null/jobs.
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class. Failed to create a workflow job: Permission denied on
'locations/null' (or it may not exist). 403 Forbidden
[ERROR] {
[ERROR] "code" : 403,
[ERROR] "errors" : [ {
[ERROR] "domain" : "global",
[ERROR] "message" : "Permission denied on 'locations/null' (or it may not
exist).",
[ERROR] "reason" : "forbidden"
[ERROR] } ],
[ERROR] "message" : "Permission denied on 'locations/null' (or it may not
exist).",
[ERROR] "status" : "PERMISSION_DENIED"
[ERROR] }
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
Apr 25, 2020 7:29:10 PM
org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory
create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Apr 25, 2020 7:29:11 PM org.apache.beam.runners.dataflow.DataflowRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from
the classpath: will stage 202 files. Enable logging at DEBUG level to see which
files will be staged.
Apr 25, 2020 7:29:13 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Apr 25, 2020 7:29:13 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 202 files from PipelineOptions.filesToStage to staging location
to prepare for execution.
Apr 25, 2020 7:29:14 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/word-count-beam/target/classes
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/classes-ixonHSYMT4_RhGR-ixsu_w.jar
Apr 25, 2020 7:29:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-sdks-java-extensions-google-cloud-platform-core/2.22.0-SNAPSHOT/beam-sdks-java-extensions-google-cloud-platform-core-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.22.0-SNAPSHOT-Oy2ikoFK8i9yl9K5zDLJJw.jar
Apr 25, 2020 7:29:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-sdks-java-io-google-cloud-platform/2.22.0-SNAPSHOT/beam-sdks-java-io-google-cloud-platform-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-sdks-java-io-google-cloud-platform-2.22.0-SNAPSHOT-oKtc9qy5YFMKNLZpM8eaQw.jar
Apr 25, 2020 7:29:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-model-pipeline/2.22.0-SNAPSHOT/beam-model-pipeline-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-model-pipeline-2.22.0-SNAPSHOT-d1e6lQjOm18JTqKu34UBww.jar
Apr 25, 2020 7:29:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-model-job-management/2.22.0-SNAPSHOT/beam-model-job-management-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-model-job-management-2.22.0-SNAPSHOT-AW3fX-XSgxhz5nCOiPaBpw.jar
Apr 25, 2020 7:29:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-sdks-java-expansion-service/2.22.0-SNAPSHOT/beam-sdks-java-expansion-service-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-sdks-java-expansion-service-2.22.0-SNAPSHOT-H2GaNbM8NHfk-7cPaP_utw.jar
Apr 25, 2020 7:29:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-sdks-java-core/2.22.0-SNAPSHOT/beam-sdks-java-core-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-sdks-java-core-2.22.0-SNAPSHOT-_rAru-fCX9lmRqh5hoxxCg.jar
Apr 25, 2020 7:29:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-model-fn-execution/2.22.0-SNAPSHOT/beam-model-fn-execution-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-model-fn-execution-2.22.0-SNAPSHOT-8uMN5MziNJwV5u_rZbZ5vg.jar
Apr 25, 2020 7:29:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-sdks-java-extensions-protobuf/2.22.0-SNAPSHOT/beam-sdks-java-extensions-protobuf-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-sdks-java-extensions-protobuf-2.22.0-SNAPSHOT-2t_rJvcqA-pIBqILpPmXtQ.jar
Apr 25, 2020 7:29:17 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-runners-google-cloud-dataflow-java/2.22.0-SNAPSHOT/beam-runners-google-cloud-dataflow-java-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-runners-google-cloud-dataflow-java-2.22.0-SNAPSHOT-aO8-Rb3KhIx3rRv7rKkzjQ.jar
Apr 25, 2020 7:29:18 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/tmp/groovy-generated-7780208140953547568-tmpdir/.m2/repository/org/apache/beam/beam-runners-core-construction-java/2.22.0-SNAPSHOT/beam-runners-core-construction-java-2.22.0-SNAPSHOT.jar
to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-runners-core-construction-java-2.22.0-SNAPSHOT-OhX4axsC4dcpHe_FmY0dng.jar
Apr 25, 2020 7:29:18 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 191 files cached, 11 files newly uploaded in 5
seconds
Apr 25, 2020 7:29:19 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ReadLines/Read as step s1
Apr 25, 2020 7:29:20 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern gs://apache-beam-samples/shakespeare/* matched 44 files with
total size 5443510
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WordCount.CountWords/ParDo(ExtractWords) as step s2
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WordCount.CountWords/Count.PerElement/Init/Map as step s3
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey as step
s4
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues
as step s5
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding MapElements/Map as step s6
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign as step s7
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
as step s8
Apr 25, 2020 7:29:20 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten as step
s9
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten as step
s10
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum as step s11
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections as
step s12
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
as step s13
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/CreateDataflowView as
step s14
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)
as step s15
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
as step s16
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
as step s17
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize as step s18
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key as step s19
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
as step s20
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey
as step s21
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
as step s22
Apr 25, 2020 7:29:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
as step s23
Apr 25, 2020 7:29:21 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/
Apr 25, 2020 7:29:21 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <67452 bytes, hash RR2qH00BmGcKvxbXbcOFUw> to
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/pipeline-RR2qH00BmGcKvxbXbcOFUw.pb
Apr 25, 2020 7:29:21 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.22.0-SNAPSHOT
Apr 25, 2020 7:29:22 PM
org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler
handleResponse
WARNING: Request failed with code 403, performed 0 retries due to IOExceptions,
performed 0 retries due to unsuccessful status codes, HTTP framework says
request can be retried, (caller responsible for retrying):
https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/null/jobs.
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class. Failed to create a workflow job: Permission denied on
'locations/null' (or it may not exist). 403 Forbidden
[ERROR] {
[ERROR] "code" : 403,
[ERROR] "errors" : [ {
[ERROR] "domain" : "global",
[ERROR] "message" : "Permission denied on 'locations/null' (or it may not
exist).",
[ERROR] "reason" : "forbidden"
[ERROR] } ],
[ERROR] "message" : "Permission denied on 'locations/null' (or it may not
exist).",
[ERROR] "status" : "PERMISSION_DENIED"
[ERROR] }
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] Failed command
> Task :runners:google-cloud-dataflow-java:runQuickstartJavaDataflow FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runQuickstartJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 19s
8 actionable tasks: 7 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/rse4cktm7kssu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
