See
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/224/display/redirect?page=changes>
Changes:
[Pablo] StateSampler knows the execution thread it tracks.
------------------------------------------
[...truncated 10.41 MB...]
INFO: Adding
PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step
s20
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as
step s21
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step
s22
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as
step s25
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 09, 2018 5:50:14 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 09, 2018 5:50:14 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to
gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0509175005-cfb5289d/output/results/staging/
May 09, 2018 5:50:14 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <71843 bytes, hash mmyhbnUJUfXhBWI3Qi3_oQ> to
gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0509175005-cfb5289d/output/results/staging/pipeline-mmyhbnUJUfXhBWI3Qi3_oQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 09, 2018 5:50:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-09_10_50_15-12467983514705929716?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-09_10_50_15-12467983514705929716
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 09, 2018 5:50:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2018-05-09_10_50_15-12467983514705929716
May 09, 2018 5:50:16 PM org.apache.beam.runners.dataflow.TestDataflowRunner
run
INFO: Running Dataflow job 2018-05-09_10_50_15-12467983514705929716 with 1
expected assertions.
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:15.338Z: Autoscaling is enabled for job
2018-05-09_10_50_15-12467983514705929716. The number of workers will be between
1 and 1000.
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:15.375Z: Autoscaling was automatically enabled for
job 2018-05-09_10_50_15-12467983514705929716.
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:17.838Z: Checking required Cloud APIs are enabled.
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:18.020Z: Checking permissions granted to controller
Service Account.
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:23.566Z: Worker configuration: n1-standard-1 in
us-central1-b.
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.010Z: Expanding CoGroupByKey operations into
optimizable parts.
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.202Z: Expanding GroupByKey operations into
optimizable parts.
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.256Z: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.491Z: Fusing adjacent ParDo, Read, Write, and
Flatten operations
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.539Z: Elided trivial flatten
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.587Z: Elided trivial flatten
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.636Z: Elided trivial flatten
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.685Z: Unzipping flatten s24 for input
s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.733Z: Fusing unzipped copy of
PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten
PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer
PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.773Z: Fusing consumer
PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into
PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.819Z: Fusing consumer
PAssert$33/GroupGlobally/ParDo(Concat) into
PAssert$33/GroupGlobally/Values/Values/Map
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.862Z: Fusing consumer PAssert$33/GetPane/Map into
PAssert$33/GroupGlobally/ParDo(Concat)
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.911Z: Fusing consumer
PAssert$33/GroupGlobally/Values/Values/Map into
PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.950Z: Fusing consumer PAssert$33/RunChecks into
PAssert$33/GetPane/Map
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:24.998Z: Fusing consumer
PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.040Z: Unzipping flatten s24-u45 for input
s26-reify-value18-c43
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.089Z: Fusing unzipped copy of
PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45,
into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.139Z: Fusing consumer
PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into
PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.181Z: Fusing consumer
PAssert$33/GroupGlobally/GroupDummyAndContents/Write into
PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.230Z: Fusing consumer
PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into
PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.274Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.322Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.372Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into
PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.425Z: Fusing consumer OutputSideInputs into
Create123/Read(CreateSource)
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.464Z: Fusing consumer
PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.516Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.555Z: Fusing consumer
PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into
PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.605Z: Fusing consumer
PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into
PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.647Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.680Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.721Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into
PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.770Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.813Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.853Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.902Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Create47/Read(CreateSource)
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.933Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:25.976Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.017Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.064Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.109Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.161Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.643Z: Executing operation
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.688Z: Executing operation
PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.727Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.728Z: Starting 1 workers in us-central1-b...
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:26.765Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:27.018Z: Executing operation
PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 09, 2018 5:50:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:27.068Z: Executing operation
Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 09, 2018 5:50:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:34.311Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
May 09, 2018 5:50:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:44.942Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
May 09, 2018 5:50:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:50:44.992Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
May 09, 2018 5:51:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:11.233Z: Workers have started successfully.
May 09, 2018 5:51:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:32.412Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 09, 2018 5:51:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:32.502Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 09, 2018 5:51:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:41.796Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 09, 2018 5:51:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:41.896Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 09, 2018 5:51:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:53.206Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 09, 2018 5:51:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:53.411Z: Executing operation
Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 09, 2018 5:52:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:59.058Z: Executing operation
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 09, 2018 5:52:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:51:59.178Z: Executing operation
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 09, 2018 5:52:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:52:04.092Z: Executing operation
PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 09, 2018 5:52:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:52:04.184Z: Executing operation
PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 09, 2018 5:52:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:52:10.333Z: Cleaning up.
May 09, 2018 5:52:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:52:10.474Z: Stopping worker pool...
May 09, 2018 5:53:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:53:56.732Z: Autoscaling: Resized worker pool from 1 to
0.
May 09, 2018 5:53:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-09T17:53:56.772Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
May 09, 2018 5:54:07 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-09_10_50_15-12467983514705929716 finished with status
DONE.
May 09, 2018 5:54:07 PM org.apache.beam.runners.dataflow.TestDataflowRunner
checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-05-09_10_50_15-12467983514705929716. Found 1 success, 0 failures out of 1
expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
Finished generating test XML results (0.297 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.283 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
Packing task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task
worker for ':' Thread 15,5,main]) completed. Took 2 hrs 13 mins 10.316 secs.
:beam-runners-google-cloud-dataflow-java:validatesRunner (Thread[Task worker
for ':' Thread 15,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunner
Skipping task ':beam-runners-google-cloud-dataflow-java:validatesRunner' as it
has no actions.
:beam-runners-google-cloud-dataflow-java:validatesRunner (Thread[Task worker
for ':' Thread 15,5,main]) completed. Took 0.0 secs.
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 2h 14m 21s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/okvltw3akdune
Build step 'Invoke Gradle script' changed build result to SUCCESS
Recording test results
[Set GitHub commit status (universal)] SUCCESS on repos
[GHRepository@65cbba55[description=Apache
Beam,homepage=,name=beam,fork=false,size=58734,milestones={},language=Java,commits={},source=<null>,parent=<null>,responseHeaderFields={null=[HTTP/1.1
200 OK], Access-Control-Allow-Origin=[*], Access-Control-Expose-Headers=[ETag,
Link, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining,
X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval],
Cache-Control=[private, max-age=60, s-maxage=60], Content-Encoding=[gzip],
Content-Security-Policy=[default-src 'none'], Content-Type=[application/json;
charset=utf-8], Date=[Wed, 09 May 2018 17:54:13 GMT],
ETag=[W/"eed29a9a8cc8b0aa2a3d887e0b5cd81f"], Last-Modified=[Wed, 09 May 2018
16:51:10 GMT], OkHttp-Received-Millis=[1525888453316],
OkHttp-Response-Source=[NETWORK 200], OkHttp-Selected-Protocol=[http/1.1],
OkHttp-Sent-Millis=[1525888453139], Referrer-Policy=[origin-when-cross-origin,
strict-origin-when-cross-origin], Server=[GitHub.com], Status=[200 OK],
Strict-Transport-Security=[max-age=31536000; includeSubdomains; preload],
Transfer-Encoding=[chunked], Vary=[Accept, Authorization, Cookie,
X-GitHub-OTP], X-Accepted-OAuth-Scopes=[repo],
X-Content-Type-Options=[nosniff], X-Frame-Options=[deny],
X-GitHub-Media-Type=[github.v3; format=json],
X-GitHub-Request-Id=[D63A:4F42:1647DDB:2D66846:5AF335BB],
X-OAuth-Scopes=[admin:repo_hook, repo, repo:status], X-RateLimit-Limit=[5000],
X-RateLimit-Remaining=[4935], X-RateLimit-Reset=[1525889764],
X-Runtime-rack=[0.079030], X-XSS-Protection=[1;
mode=block]},url=https://api.github.com/repos/apache/beam,id=50904245]]
(sha:1e40357) with context:beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle
Setting commit status on GitHub for
https://github.com/apache/beam/commit/1e40357edf3e9940bb898bcd7b6c5516d685f908
ERROR: Build step failed with exception
java.io.FileNotFoundException:
https://api.github.com/repos/apache/beam/statuses/1e40357edf3e9940bb898bcd7b6c5516d685f908
at
com.squareup.okhttp.internal.huc.HttpURLConnectionImpl.getInputStream(HttpURLConnectionImpl.java:243)
at
com.squareup.okhttp.internal.huc.DelegatingHttpsURLConnection.getInputStream(DelegatingHttpsURLConnection.java:210)
at
com.squareup.okhttp.internal.huc.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:25)
at org.kohsuke.github.Requester.parse(Requester.java:612)
at org.kohsuke.github.Requester.parse(Requester.java:594)
at org.kohsuke.github.Requester._to(Requester.java:272)
Caused: org.kohsuke.github.GHFileNotFoundException: {"message":"Not
Found","documentation_url":"https://developer.github.com/v3/repos/statuses/#create-a-status"}
at org.kohsuke.github.Requester.handleApiError(Requester.java:686)
at org.kohsuke.github.Requester._to(Requester.java:293)
at org.kohsuke.github.Requester.to(Requester.java:234)
at
org.kohsuke.github.GHRepository.createCommitStatus(GHRepository.java:1075)
at
org.jenkinsci.plugins.github.status.GitHubCommitStatusSetter.perform(GitHubCommitStatusSetter.java:160)
Caused:
org.jenkinsci.plugins.github.common.CombineErrorHandler$ErrorHandlingException
at
org.jenkinsci.plugins.github.common.CombineErrorHandler.handle(CombineErrorHandler.java:74)
at
org.jenkinsci.plugins.github.status.GitHubCommitStatusSetter.perform(GitHubCommitStatusSetter.java:164)
at
com.cloudbees.jenkins.GitHubCommitNotifier.perform(GitHubCommitNotifier.java:151)
at
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
at
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
at hudson.model.Run.execute(Run.java:1749)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Build step 'Set build status on GitHub commit [deprecated]' marked build as
failure
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
