See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/4857/display/redirect>
------------------------------------------ [...truncated 23.49 MB...] [INFO] 2018-02-01T13:42:44.689Z: (710339aae0f9e798): Executing operation PAssert$362/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$362/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$362/GroupGlobally/GroupDummyAndContents/Reify+PAssert$362/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:42:44.722Z: (6cdafa3e6cdcef18): Executing operation PAssert$362/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$362/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$362/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$362/GroupGlobally/RewindowActuals/Window.Assign+PAssert$362/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$362/GroupGlobally/GroupDummyAndContents/Reify+PAssert$362/GroupGlobally/GroupDummyAndContents/Write [INFO] Success result for Dataflow job 2018-02-01_05_39_54-17662899275506557860. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2018-02-01T13:42:47.062Z: (96dc4a2934b7c58f): Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). [INFO] 2018-02-01T13:42:46.978Z: (5fea8bcf45b9a1bf): Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). [INFO] 2018-02-01T13:42:47.683Z: (bb97d6414ee6b08e): Workers have started successfully. [INFO] Job 2018-02-01_05_39_37-720619087247016162 finished with status DONE. [INFO] Success result for Dataflow job 2018-02-01_05_39_37-720619087247016162. Found 2 success, 0 failures out of 2 expected assertions. [INFO] Staging files complete: 0 files cached, 133 files newly uploaded [INFO] Adding Create.Values/Read(CreateSource) as step s1 [INFO] Adding Distinct.WithRepresentativeValues/KeyByRepresentativeValue/AddKeys/Map as step s2 [INFO] Adding Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey as step s3 [INFO] Adding Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues as step s4 [INFO] Adding Distinct.WithRepresentativeValues/KeepFirstPane as step s5 [INFO] Adding PAssert$364/GroupGlobally/Window.Into()/Window.Assign as step s6 [INFO] Adding PAssert$364/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s7 [INFO] Adding PAssert$364/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s8 [INFO] Adding PAssert$364/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s9 [INFO] Adding PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey as step s10 [INFO] Adding PAssert$364/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s11 [INFO] Adding PAssert$364/GroupGlobally/RewindowActuals/Window.Assign as step s12 [INFO] Adding PAssert$364/GroupGlobally/KeyForDummy/AddKeys/Map as step s13 [INFO] Adding PAssert$364/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s14 [INFO] Adding PAssert$364/GroupGlobally/Create.Values/Read(CreateSource) as step s15 [INFO] Adding PAssert$364/GroupGlobally/WindowIntoDummy/Window.Assign as step s16 [INFO] Adding PAssert$364/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s17 [INFO] Adding PAssert$364/GroupGlobally/FlattenDummyAndContents as step s18 [INFO] Adding PAssert$364/GroupGlobally/NeverTrigger/Flatten.PCollections as step s19 [INFO] Adding PAssert$364/GroupGlobally/GroupDummyAndContents as step s20 [INFO] Adding PAssert$364/GroupGlobally/Values/Values/Map as step s21 [INFO] Adding PAssert$364/GroupGlobally/ParDo(Concat) as step s22 [INFO] Adding PAssert$364/GetPane/Map as step s23 [INFO] Adding PAssert$364/RunChecks as step s24 [INFO] Adding PAssert$364/VerifyAssertions/ParDo(DefaultConclude) as step s25 [INFO] Staging pipeline description to gs://temp-storage-for-validates-runner-tests//distincttest0testdistinctwithrepresentativevalue-jenkins-0201134148-e74d9dd6/output/results/staging/ [INFO] Uploading <53139 bytes, hash knbWjK5qNfDLTz4tOSFvUQ> to gs://temp-storage-for-validates-runner-tests//distincttest0testdistinctwithrepresentativevalue-jenkins-0201134148-e74d9dd6/output/results/staging/pipeline-knbWjK5qNfDLTz4tOSFvUQ.pb [INFO] To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-02-01_05_42_52-18303468637152664280?project=apache-beam-testing [INFO] To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2018-02-01_05_42_52-18303468637152664280 [INFO] Running Dataflow job 2018-02-01_05_42_52-18303468637152664280 with 1 expected assertions. [INFO] 2018-02-01T13:42:54.872Z: (710339aae0f9e2ac): Executing operation PAssert$362/GroupGlobally/GroupDummyAndContents/Close [INFO] 2018-02-01T13:42:54.934Z: (6cdafa3e6cdce26a): Executing operation PAssert$362/GroupGlobally/GroupDummyAndContents/Read+PAssert$362/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$362/GroupGlobally/Values/Values/Map+PAssert$362/GroupGlobally/ParDo(Concat)+PAssert$362/GetPane/Map+PAssert$362/RunChecks+PAssert$362/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2018-02-01T13:42:52.893Z: (fe02fbbfe2fcd7b4): Autoscaling is enabled for job 2018-02-01_05_42_52-18303468637152664280. The number of workers will be between 1 and 15. [INFO] 2018-02-01T13:42:52.919Z: (fe02fbbfe2fcdaeb): Autoscaling was automatically enabled for job 2018-02-01_05_42_52-18303468637152664280. [INFO] 2018-02-01T13:42:55.299Z: (471b2db2d764f8bb): Checking required Cloud APIs are enabled. [INFO] 2018-02-01T13:42:58.828Z: (471b2db2d764f651): Expanding CoGroupByKey operations into optimizable parts. [INFO] 2018-02-01T13:42:58.865Z: (471b2db2d764f376): Expanding GroupByKey operations into optimizable parts. [INFO] 2018-02-01T13:42:58.886Z: (471b2db2d764f05c): Lifting ValueCombiningMappingFns into MergeBucketsMappingFns [INFO] 2018-02-01T13:42:58.972Z: (471b2db2d764fdc0): Fusing adjacent ParDo, Read, Write, and Flatten operations [INFO] 2018-02-01T13:42:59.002Z: (471b2db2d764faa6): Elided trivial flatten [INFO] 2018-02-01T13:42:59.020Z: (471b2db2d764f78c): Elided trivial flatten [INFO] 2018-02-01T13:42:59.049Z: (471b2db2d764f472): Elided trivial flatten [INFO] 2018-02-01T13:42:59.071Z: (471b2db2d764f158): Unzipping flatten s18 for input s13.org.apache.beam.sdk.values.PCollection.<init>:329#ee3a80a2534fda8a [INFO] 2018-02-01T13:42:59.095Z: (471b2db2d764fe3e): Fusing unzipped copy of PAssert$364/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$364/GroupGlobally/FlattenDummyAndContents, into producer PAssert$364/GroupGlobally/KeyForDummy/AddKeys/Map [INFO] 2018-02-01T13:42:59.125Z: (471b2db2d764fb24): Fusing consumer PAssert$364/GroupGlobally/Values/Values/Map into PAssert$364/GroupGlobally/GroupDummyAndContents/GroupByWindow [INFO] 2018-02-01T13:42:59.146Z: (471b2db2d764f80a): Fusing consumer PAssert$364/VerifyAssertions/ParDo(DefaultConclude) into PAssert$364/RunChecks [INFO] 2018-02-01T13:42:59.166Z: (471b2db2d764f4f0): Unzipping flatten s18-u40 for input s20-reify-value18-c38 [INFO] 2018-02-01T13:42:59.187Z: (471b2db2d764f1d6): Fusing unzipped copy of PAssert$364/GroupGlobally/GroupDummyAndContents/Write, through flatten s18-u40, into producer PAssert$364/GroupGlobally/GroupDummyAndContents/Reify [INFO] 2018-02-01T13:42:59.209Z: (471b2db2d764febc): Fusing consumer PAssert$364/GroupGlobally/ParDo(Concat) into PAssert$364/GroupGlobally/Values/Values/Map [INFO] 2018-02-01T13:42:59.236Z: (471b2db2d764fba2): Fusing consumer PAssert$364/GetPane/Map into PAssert$364/GroupGlobally/ParDo(Concat) [INFO] 2018-02-01T13:42:59.263Z: (471b2db2d764f888): Fusing consumer PAssert$364/RunChecks into PAssert$364/GetPane/Map [INFO] 2018-02-01T13:42:59.284Z: (471b2db2d764f56e): Fusing consumer PAssert$364/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$364/GroupGlobally/GroupDummyAndContents/Read [INFO] 2018-02-01T13:42:59.305Z: (471b2db2d764f254): Fusing consumer PAssert$364/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow [INFO] 2018-02-01T13:42:59.334Z: (471b2db2d764ff3a): Fusing consumer Distinct.WithRepresentativeValues/KeepFirstPane into Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues/Extract [INFO] 2018-02-01T13:42:59.361Z: (471b2db2d764fc20): Fusing consumer PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Read [INFO] 2018-02-01T13:42:59.389Z: (471b2db2d764f906): Fusing consumer Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues/Extract into Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues [INFO] 2018-02-01T13:42:59.412Z: (471b2db2d764f5ec): Fusing consumer PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$364/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign [INFO] 2018-02-01T13:42:59.433Z: (471b2db2d764f2d2): Fusing consumer PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Reify [INFO] 2018-02-01T13:42:59.457Z: (471b2db2d764ffb8): Fusing consumer Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Reify into Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey+Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues/Partial [INFO] 2018-02-01T13:42:59.485Z: (471b2db2d764fc9e): Fusing consumer PAssert$364/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$364/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map [INFO] 2018-02-01T13:42:59.506Z: (471b2db2d764f984): Fusing consumer PAssert$364/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$364/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) [INFO] 2018-02-01T13:42:59.534Z: (471b2db2d764f66a): Fusing consumer PAssert$364/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$364/GroupGlobally/RewindowActuals/Window.Assign [INFO] 2018-02-01T13:42:59.555Z: (471b2db2d764f350): Fusing consumer PAssert$364/GroupGlobally/RewindowActuals/Window.Assign into PAssert$364/GroupGlobally/GatherAllOutputs/Values/Values/Map [INFO] 2018-02-01T13:42:59.578Z: (471b2db2d764f036): Fusing consumer Distinct.WithRepresentativeValues/KeyByRepresentativeValue/AddKeys/Map into Create.Values/Read(CreateSource) [INFO] 2018-02-01T13:42:59.609Z: (471b2db2d764fd1c): Fusing consumer Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey+Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues/Partial into Distinct.WithRepresentativeValues/KeyByRepresentativeValue/AddKeys/Map [INFO] 2018-02-01T13:42:59.632Z: (471b2db2d764fa02): Fusing consumer Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues into Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Read [INFO] 2018-02-01T13:42:59.663Z: (471b2db2d764f6e8): Fusing consumer Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Write into Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Reify [INFO] 2018-02-01T13:42:59.677Z: (471b2db2d764f3ce): Fusing consumer PAssert$364/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$364/GroupGlobally/Window.Into()/Window.Assign [INFO] 2018-02-01T13:42:59.700Z: (471b2db2d764f0b4): Fusing consumer PAssert$364/GroupGlobally/Window.Into()/Window.Assign into Distinct.WithRepresentativeValues/KeepFirstPane [INFO] 2018-02-01T13:42:59.726Z: (471b2db2d764fd9a): Fusing consumer PAssert$364/GroupGlobally/GroupDummyAndContents/Reify into PAssert$364/GroupGlobally/WindowIntoDummy/Window.Assign [INFO] 2018-02-01T13:42:59.758Z: (471b2db2d764fa80): Fusing consumer PAssert$364/GroupGlobally/GroupDummyAndContents/Write into PAssert$364/GroupGlobally/GroupDummyAndContents/Reify [INFO] 2018-02-01T13:42:59.780Z: (471b2db2d764f766): Fusing consumer PAssert$364/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$364/GroupGlobally/Create.Values/Read(CreateSource) [INFO] 2018-02-01T13:43:00.076Z: (913bb8ca4a6176ff): Executing operation Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Create [INFO] 2018-02-01T13:43:00.222Z: (42e8a0042b79ce22): Executing operation Distinct/DropValues/GroupByKey/Close [INFO] 2018-02-01T13:43:00.291Z: (42e8a0042b79c91a): Executing operation PAssert$363/GroupGlobally/GatherAllOutputs/GroupByKey/Create [INFO] 2018-02-01T13:43:00.440Z: (b6854c69437673a1): Executing operation Distinct/DropValues/GroupByKey/Read+Distinct/DropValues/Combine.GroupedValues+Distinct/DropValues/Combine.GroupedValues/Extract+Distinct/ExtractFirstKey+PAssert$363/GroupGlobally/Window.Into()/Window.Assign+PAssert$363/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$363/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$363/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$363/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$363/GroupGlobally/GatherAllOutputs/GroupByKey/Write [INFO] 2018-02-01T13:43:00.145Z: (b7db508f039fbe0a): Starting 1 workers in us-central1-f... [INFO] 2018-02-01T13:43:00.278Z: (44de86edae49fb20): Executing operation Create.Values/Read(CreateSource)+Distinct.WithRepresentativeValues/KeyByRepresentativeValue/AddKeys/Map+Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey+Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues/Partial+Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Reify+Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Write [INFO] 2018-02-01T13:43:01.281Z: (a70e306161290a70): Workers have started successfully. [INFO] 2018-02-01T13:43:02.815Z: (5fea8bcf45b9a326): Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). [INFO] 2018-02-01T13:43:02.030Z: (ec3edc43171fce9c): Cleaning up. [INFO] 2018-02-01T13:43:02.104Z: (ec3edc43171fc786): Stopping worker pool... [INFO] 2018-02-01T13:43:03.875Z: (b6854c6943767c1f): Executing operation PAssert$363/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2018-02-01T13:43:03.943Z: (b6854c6943767c67): Executing operation PAssert$363/GroupGlobally/GroupDummyAndContents/Create [INFO] 2018-02-01T13:43:04.096Z: (42e8a0042b79cedd): Executing operation PAssert$363/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$363/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$363/GroupGlobally/GroupDummyAndContents/Reify+PAssert$363/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:43:04.137Z: (b6854c69437670ca): Executing operation PAssert$363/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$363/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$363/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$363/GroupGlobally/RewindowActuals/Window.Assign+PAssert$363/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$363/GroupGlobally/GroupDummyAndContents/Reify+PAssert$363/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:43:09.001Z: (d48c1161d8396a78): Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). [INFO] 2018-02-01T13:43:10.520Z: (b6854c6943767948): Executing operation PAssert$363/GroupGlobally/GroupDummyAndContents/Close [INFO] 2018-02-01T13:43:10.597Z: (b6854c6943767d87): Executing operation PAssert$363/GroupGlobally/GroupDummyAndContents/Read+PAssert$363/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$363/GroupGlobally/Values/Values/Map+PAssert$363/GroupGlobally/ParDo(Concat)+PAssert$363/GetPane/Map+PAssert$363/RunChecks+PAssert$363/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2018-02-01T13:43:18.527Z: (96dc4a2934b7c05a): Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). [INFO] 2018-02-01T13:43:21.945Z: (a20b11a505c3c89): Workers have started successfully. [INFO] 2018-02-01T13:43:21.734Z: (e9e785160c16653d): Cleaning up. [INFO] 2018-02-01T13:43:21.815Z: (e9e785160c1665db): Stopping worker pool... [INFO] 2018-02-01T13:43:24.863Z: (d48c1161d83960ad): Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). [INFO] 2018-02-01T13:43:24.302Z: (47fdbb747fede2a3): Executing operation Distinct/DropValues/GroupByKey/Close [INFO] 2018-02-01T13:43:24.344Z: (47fdbb747fede8bb): Executing operation PAssert$365/GroupGlobally/GatherAllOutputs/GroupByKey/Create [INFO] 2018-02-01T13:43:24.440Z: (b92ed2f109090fd3): Executing operation Distinct/DropValues/GroupByKey/Read+Distinct/DropValues/Combine.GroupedValues+Distinct/DropValues/Combine.GroupedValues/Extract+Distinct/ExtractFirstKey+PAssert$365/GroupGlobally/Window.Into()/Window.Assign+PAssert$365/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$365/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$365/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$365/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$365/GroupGlobally/GatherAllOutputs/GroupByKey/Write [INFO] 2018-02-01T13:43:33.421Z: (8fe6450958f8ba0): Executing operation PAssert$365/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2018-02-01T13:43:33.465Z: (b92ed2f109090fa1): Executing operation PAssert$365/GroupGlobally/GroupDummyAndContents/Create [INFO] 2018-02-01T13:43:33.561Z: (8fe6450958f8fb8): Executing operation PAssert$365/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$365/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$365/GroupGlobally/GroupDummyAndContents/Reify+PAssert$365/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:43:33.585Z: (b92ed2f109090635): Executing operation PAssert$365/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$365/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$365/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$365/GroupGlobally/RewindowActuals/Window.Assign+PAssert$365/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$365/GroupGlobally/GroupDummyAndContents/Reify+PAssert$365/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:43:35.809Z: (5b828e82abc25159): Autoscaling: Resized worker pool from 1 to 0. [INFO] 2018-02-01T13:43:35.834Z: (5b828e82abc25d2b): Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. [INFO] 2018-02-01T13:43:35.878Z: (3cca4884492aa3ea): Worker pool stopped. [INFO] 2018-02-01T13:43:39.554Z: (77277a5983cb84ab): Executing operation PAssert$366/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2018-02-01T13:43:39.605Z: (77277a5983cb8a13): Executing operation PAssert$366/GroupGlobally/GroupDummyAndContents/Create [INFO] 2018-02-01T13:43:39.701Z: (5fbdf66ee821e7fb): Executing operation PAssert$366/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$366/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$366/GroupGlobally/GroupDummyAndContents/Reify+PAssert$366/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:43:39.733Z: (77277a5983cb8d82): Executing operation PAssert$366/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$366/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$366/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$366/GroupGlobally/RewindowActuals/Window.Assign+PAssert$366/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$366/GroupGlobally/GroupDummyAndContents/Reify+PAssert$366/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:43:42.201Z: (668ae3446c5b6163): Workers have started successfully. [INFO] 2018-02-01T13:43:42.776Z: (1694a654a57a3303): Workers have started successfully. [INFO] Job 2018-02-01_05_40_58-16367106314622456221 finished with status DONE. [INFO] Success result for Dataflow job 2018-02-01_05_40_58-16367106314622456221. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2018-02-01T13:43:43.314Z: (b92ed2f109090603): Executing operation PAssert$365/GroupGlobally/GroupDummyAndContents/Close [INFO] 2018-02-01T13:43:43.370Z: (b92ed2f1090905ea): Executing operation PAssert$365/GroupGlobally/GroupDummyAndContents/Read+PAssert$365/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$365/GroupGlobally/Values/Values/Map+PAssert$365/GroupGlobally/ParDo(Concat)+PAssert$365/GetPane/Map+PAssert$365/RunChecks+PAssert$365/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2018-02-01T13:43:46.378Z: (77277a5983cb8ef8): Executing operation PAssert$366/GroupGlobally/GroupDummyAndContents/Close [INFO] 2018-02-01T13:43:46.420Z: (77277a5983cb8fb3): Executing operation PAssert$366/GroupGlobally/GroupDummyAndContents/Read+PAssert$366/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$366/GroupGlobally/Values/Values/Map+PAssert$366/GroupGlobally/ParDo(Concat)+PAssert$366/GetPane/Map+PAssert$366/RunChecks+PAssert$366/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2018-02-01T13:43:51.581Z: (16fb91e96597e14b): Cleaning up. [INFO] 2018-02-01T13:43:51.653Z: (16fb91e96597ee69): Stopping worker pool... [INFO] 2018-02-01T13:43:51.432Z: (c8569e25a3e5ee34): Cleaning up. [INFO] 2018-02-01T13:43:51.504Z: (c8569e25a3e5e54e): Stopping worker pool... [INFO] 2018-02-01T13:44:04.256Z: (44de86edae49f3f4): Executing operation Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Close [INFO] 2018-02-01T13:44:04.317Z: (44de86edae49ff2c): Executing operation PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Create [INFO] 2018-02-01T13:44:04.464Z: (44de86edae49f338): Executing operation Distinct.WithRepresentativeValues/OneValuePerKey/GroupByKey/Read+Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues+Distinct.WithRepresentativeValues/OneValuePerKey/Combine.GroupedValues/Extract+Distinct.WithRepresentativeValues/KeepFirstPane+PAssert$364/GroupGlobally/Window.Into()/Window.Assign+PAssert$364/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$364/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$364/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Write [INFO] 2018-02-01T13:44:06.861Z: (2200ca1024330976): Executing operation PAssert$367/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2018-02-01T13:44:06.919Z: (51d56740fd2d3689): Executing operation PAssert$367/GroupGlobally/GroupDummyAndContents/Create [INFO] 2018-02-01T13:44:07.067Z: (2200ca10243308bd): Executing operation PAssert$367/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$367/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$367/GroupGlobally/GroupDummyAndContents/Reify+PAssert$367/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:44:07.100Z: (51d56740fd2d3824): Executing operation PAssert$367/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$367/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$367/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$367/GroupGlobally/RewindowActuals/Window.Assign+PAssert$367/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$367/GroupGlobally/GroupDummyAndContents/Reify+PAssert$367/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:44:11.934Z: (44de86edae49fada): Executing operation PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2018-02-01T13:44:11.970Z: (44de86edae49f612): Executing operation PAssert$364/GroupGlobally/GroupDummyAndContents/Create [INFO] 2018-02-01T13:44:12.052Z: (44de86edae49fa1e): Executing operation PAssert$364/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$364/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$364/GroupGlobally/GroupDummyAndContents/Reify+PAssert$364/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:44:12.067Z: (2386dfbd7a9cc108): Executing operation PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$364/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$364/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$364/GroupGlobally/RewindowActuals/Window.Assign+PAssert$364/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$364/GroupGlobally/GroupDummyAndContents/Reify+PAssert$364/GroupGlobally/GroupDummyAndContents/Write [INFO] 2018-02-01T13:44:17.245Z: (51d56740fd2d35d2): Executing operation PAssert$367/GroupGlobally/GroupDummyAndContents/Close [INFO] 2018-02-01T13:44:17.278Z: (51d56740fd2d3ca9): Executing operation PAssert$367/GroupGlobally/GroupDummyAndContents/Read+PAssert$367/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$367/GroupGlobally/Values/Values/Map+PAssert$367/GroupGlobally/ParDo(Concat)+PAssert$367/GetPane/Map+PAssert$367/RunChecks+PAssert$367/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2018-02-01T13:44:20.148Z: (12bd3c6e912dd949): Autoscaling: Resized worker pool from 1 to 0. [INFO] 2018-02-01T13:44:20.156Z: (12bd3c6e912ddb43): Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. [INFO] 2018-02-01T13:44:22.224Z: (44de86edae49f2f2): Executing operation PAssert$364/GroupGlobally/GroupDummyAndContents/Close [INFO] 2018-02-01T13:44:22.252Z: (44de86edae49fec3): Executing operation PAssert$364/GroupGlobally/GroupDummyAndContents/Read+PAssert$364/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$364/GroupGlobally/Values/Values/Map+PAssert$364/GroupGlobally/ParDo(Concat)+PAssert$364/GetPane/Map+PAssert$364/RunChecks+PAssert$364/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2018-02-01T13:44:25.661Z: (fe73e493b1eaf1a): Cleaning up. [INFO] 2018-02-01T13:44:25.712Z: (fe73e493b1eae60): Stopping worker pool... [INFO] Job 2018-02-01_05_41_28-14448816520638297521 finished with status DONE. [INFO] Success result for Dataflow job 2018-02-01_05_41_28-14448816520638297521. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2018-02-01T13:44:28.947Z: (471b2db2d764f509): Cleaning up. [INFO] 2018-02-01T13:44:29.009Z: (471b2db2d764fbbb): Stopping worker pool... [INFO] 2018-02-01T13:44:37.994Z: (1e425dc8cc724e42): Autoscaling: Resized worker pool from 1 to 0. [INFO] 2018-02-01T13:44:38.025Z: (1e425dc8cc724dd0): Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. [INFO] Job 2018-02-01_05_41_55-16883239123544924454 finished with status DONE. [INFO] Success result for Dataflow job 2018-02-01_05_41_55-16883239123544924454. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2018-02-01T13:45:00.960Z: (f6a9c00f2ff2c707): Autoscaling: Resized worker pool from 1 to 0. [INFO] 2018-02-01T13:45:00.980Z: (f6a9c00f2ff2c459): Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. [INFO] Job 2018-02-01_05_42_11-12712303296856443795 finished with status DONE. [INFO] Success result for Dataflow job 2018-02-01_05_42_11-12712303296856443795. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2018-02-01T13:45:10.519Z: (5fea8bcf45b9a0b7): Autoscaling: Resized worker pool from 1 to 0. [INFO] 2018-02-01T13:45:10.541Z: (5fea8bcf45b9a719): Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. [INFO] Job 2018-02-01_05_42_31-8696038695719014576 finished with status DONE. [INFO] Success result for Dataflow job 2018-02-01_05_42_31-8696038695719014576. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2018-02-01T13:45:40.234Z: (d48c1161d8396090): Autoscaling: Resized worker pool from 1 to 0. [INFO] 2018-02-01T13:45:40.264Z: (d48c1161d8396fb6): Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. [INFO] 2018-02-01T13:45:40.298Z: (471b2db2d764ff53): Worker pool stopped. [INFO] 2018-02-01T13:45:40.287Z: (96dc4a2934b7c223): Autoscaling: Resized worker pool from 1 to 0. [INFO] 2018-02-01T13:45:40.309Z: (96dc4a2934b7c5c9): Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. [INFO] 2018-02-01T13:45:40.331Z: (fe73e493b1ead68): Worker pool stopped. [INFO] Job 2018-02-01_05_42_31-7483677273588226393 finished with status DONE. [INFO] Success result for Dataflow job 2018-02-01_05_42_31-7483677273588226393. Found 1 success, 0 failures out of 1 expected assertions. [INFO] Job 2018-02-01_05_42_52-18303468637152664280 finished with status DONE. [INFO] Success result for Dataflow job 2018-02-01_05_42_52-18303468637152664280. Found 1 success, 0 failures out of 1 expected assertions. 2018-02-01T13:45:48.968 [INFO] Running org.apache.beam.sdk.transforms.PartitionTest 2018-02-01T13:45:48.975 [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 196.945 s - in org.apache.beam.sdk.transforms.PartitionTest 2018-02-01T13:45:48.975 [INFO] Running org.apache.beam.sdk.transforms.DistinctTest 2018-02-01T13:45:48.981 [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 240.29 s - in org.apache.beam.sdk.transforms.DistinctTest 2018-02-01T13:45:48.982 [INFO] Running org.apache.beam.sdk.values.PDoneTest 2018-02-01T13:45:48.989 [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0 s - in org.apache.beam.sdk.values.PDoneTest 2018-02-01T13:45:48.989 [INFO] Running org.apache.beam.sdk.transforms.ReifyTimestampsTest 2018-02-01T13:45:48.995 [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 278.936 s - in org.apache.beam.sdk.transforms.ReifyTimestampsTest 2018-02-01T13:45:48.995 [INFO] Running org.apache.beam.sdk.transforms.KvSwapTest 2018-02-01T13:45:49.002 [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 203.403 s - in org.apache.beam.sdk.transforms.KvSwapTest 2018-02-01T13:45:49.002 [INFO] Running org.apache.beam.sdk.transforms.ValuesTest 2018-02-01T13:45:49.008 [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 200.911 s - in org.apache.beam.sdk.transforms.ValuesTest 2018-02-01T13:45:49.053 [INFO] 2018-02-01T13:45:49.053 [INFO] Results: 2018-02-01T13:45:49.053 [INFO] 2018-02-01T13:45:49.053 [WARNING] Tests run: 295, Failures: 0, Errors: 0, Skipped: 2 2018-02-01T13:45:49.053 [INFO] [JENKINS] Recording test results 2018-02-01T13:45:50.447 [INFO] 2018-02-01T13:45:50.447 [INFO] --- maven-dependency-plugin:3.0.2:analyze-only (default) @ beam-runners-google-cloud-dataflow-java --- 2018-02-01T13:45:50.620 [INFO] No dependency problems found [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled 2018-02-01T13:46:24.524 [INFO] ------------------------------------------------------------------------ 2018-02-01T13:46:24.524 [INFO] Reactor Summary: 2018-02-01T13:46:24.524 [INFO] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: Parent .............................. SUCCESS [ 5.705 s] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 5.730 s] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: Model ............................... SUCCESS [ 1.788 s] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 7.441 s] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 6.333 s] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 9.876 s] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: SDKs ................................ SUCCESS [ 2.637 s] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: SDKs :: Java ........................ SUCCESS [ 2.495 s] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: SDKs :: Java :: Core ................ SUCCESS [02:03 min] 2018-02-01T13:46:24.524 [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 3.925 s] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 13.493 s] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: Runners ............................. SUCCESS [ 3.248 s] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 13.739 s] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 23.372 s] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 2.402 s] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 5.496 s] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [05:59 min] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 54.943 s] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [02:11 min] 2018-02-01T13:46:24.525 [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 01:28 h] [JENKINS] Archiving disabled2018-02-01T13:46:24.525 [INFO] ------------------------------------------------------------------------ 2018-02-01T13:46:24.525 [INFO] BUILD SUCCESS 2018-02-01T13:46:24.525 [INFO] ------------------------------------------------------------------------ 2018-02-01T13:46:24.525 [INFO] Total time: 01:43 h 2018-02-01T13:46:24.525 [INFO] Finished at: 2018-02-01T13:46:24Z 2018-02-01T13:46:25.929 [INFO] Final Memory: 395M/2353M 2018-02-01T13:46:25.929 [INFO] ------------------------------------------------------------------------ Waiting for Jenkins to finish collecting data channel stopped
