See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/2931/display/redirect?page=changes>
Changes: [tgroh] Make Most StandardCoders CustomCoders [chamikara] [BEAM-1988] Add FileSystems Interface for accessing underlying FS ------------------------------------------ [...truncated 5.70 MB...] [INFO] 2017-04-26T01:19:39.930Z: (634e6dfeb8f444e5): Fusing consumer PAssert$287/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$287/GroupGlobally/GatherAllOutputs/GroupByKey/Read [INFO] 2017-04-26T01:19:39.932Z: (634e6dfeb8f4445b): Fusing consumer PAssert$287/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$287/GroupGlobally/Create.Values/Read(CreateSource) [INFO] 2017-04-26T01:19:40.012Z: (634e6dfeb8f44291): Adding StepResource setup and teardown to workflow graph. [INFO] 2017-04-26T01:19:40.064Z: (939064c2efda911e): Executing operation PAssert$287/GroupGlobally/GatherAllOutputs/GroupByKey/Create [INFO] 2017-04-26T01:19:40.270Z: (16bfbc93a3545d9): Starting 1 workers... [INFO] 2017-04-26T01:19:40.315Z: (939064c2efda9751): Executing operation Create.Values/Read(CreateSource)+PAssert$287/GroupGlobally/Window.Into()/Window.Assign+PAssert$287/GroupGlobally/GatherAllOutputs/ParDo(ReifyTimestampsAndWindows)+PAssert$287/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$287/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$287/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$287/GroupGlobally/GatherAllOutputs/GroupByKey/Write [INFO] Staging files complete: 0 files cached, 110 files newly uploaded [INFO] Staging files complete: 0 files cached, 110 files newly uploaded [INFO] To access the Dataflow monitoring console, please navigate to https://console.developers.google.com/project/apache-beam-testing/dataflow/job/2017-04-25_18_19_42-18049386336424926276 [INFO] To cancel the job using the 'gcloud' tool, run: > gcloud beta dataflow jobs --project=apache-beam-testing cancel > 2017-04-25_18_19_42-18049386336424926276 [INFO] Running Dataflow job 2017-04-25_18_19_42-18049386336424926276 with 1 expected assertions. [INFO] To access the Dataflow monitoring console, please navigate to https://console.developers.google.com/project/apache-beam-testing/dataflow/job/2017-04-25_18_19_43-2645401558949173805 [INFO] To cancel the job using the 'gcloud' tool, run: > gcloud beta dataflow jobs --project=apache-beam-testing cancel > 2017-04-25_18_19_43-2645401558949173805 [INFO] Running Dataflow job 2017-04-25_18_19_43-2645401558949173805 with 1 expected assertions. [INFO] 2017-04-26T01:19:42.750Z: (fa7c4d3e44659bf0): Autoscaling is enabled for job 2017-04-25_18_19_42-18049386336424926276. The number of workers will be between 1 and 15. [INFO] 2017-04-26T01:19:42.750Z: (fa7c4d3e446593c6): Autoscaling was automatically enabled for job 2017-04-25_18_19_42-18049386336424926276. [INFO] 2017-04-26T01:19:43.826Z: (1dafcdd59c6b21f9): Checking required Cloud APIs are enabled. [INFO] 2017-04-26T01:19:43.110Z: (24b65ab3b16e15d9): Autoscaling is enabled for job 2017-04-25_18_19_43-2645401558949173805. The number of workers will be between 1 and 15. [INFO] 2017-04-26T01:19:43.111Z: (24b65ab3b16e13af): Autoscaling was automatically enabled for job 2017-04-25_18_19_43-2645401558949173805. [INFO] 2017-04-26T01:19:44.051Z: (8858aa8dbd0a0356): Checking required Cloud APIs are enabled. [INFO] 2017-04-26T01:19:42.618Z: (cd21556f4c54b8f1): Cleaning up. [INFO] 2017-04-26T01:19:42.622Z: (cd21556f4c54b40d): Stopping worker pool... [INFO] 2017-04-26T01:19:47.484Z: (1dafcdd59c6b27ab): Expanding GroupByKey operations into optimizable parts. [INFO] 2017-04-26T01:19:47.488Z: (1dafcdd59c6b2579): Lifting ValueCombiningMappingFns into MergeBucketsMappingFns [INFO] 2017-04-26T01:19:47.506Z: (1dafcdd59c6b2a7f): Fusing adjacent ParDo, Read, Write, and Flatten operations [INFO] 2017-04-26T01:19:47.509Z: (1dafcdd59c6b284d): Elided trivial flatten [INFO] 2017-04-26T01:19:47.511Z: (1dafcdd59c6b261b): Elided trivial flatten [INFO] 2017-04-26T01:19:47.513Z: (1dafcdd59c6b23e9): Elided trivial flatten [INFO] 2017-04-26T01:19:47.519Z: (1dafcdd59c6b2d53): Unzipping flatten s14 for input s12.12 [INFO] 2017-04-26T01:19:47.521Z: (1dafcdd59c6b2b21): Fusing unzipped copy of PAssert$289/GroupGlobally/GroupDummyAndContents/Reify, through flatten , into producer PAssert$289/GroupGlobally/WindowIntoDummy/Window.Assign [INFO] 2017-04-26T01:19:47.524Z: (1dafcdd59c6b28ef): Fusing consumer PAssert$289/GroupGlobally/GroupDummyAndContents/Reify into PAssert$289/GroupGlobally/KeyForDummy/AddKeys/Map [INFO] 2017-04-26T01:19:47.578Z: (1dafcdd59c6b2671): Fusing consumer PAssert$289/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$289/GroupGlobally/Create.Values/Read(CreateSource) [INFO] 2017-04-26T01:19:47.704Z: (75b50c6949b07489): Executing operation PAssert$289/GroupGlobally/GatherAllOutputs/GroupByKey/Create [INFO] 2017-04-26T01:19:47.910Z: (71d700846d982c46): Starting 1 workers... [INFO] 2017-04-26T01:19:47.937Z: (75b50c6949b0710a): Executing operation Create.Values/Read(CreateSource)+PAssert$289/GroupGlobally/Window.Into()/Window.Assign+PAssert$289/GroupGlobally/GatherAllOutputs/ParDo(ReifyTimestampsAndWindows)+PAssert$289/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$289/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$289/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$289/GroupGlobally/GatherAllOutputs/GroupByKey/Write [INFO] 2017-04-26T01:19:48.373Z: (8858aa8dbd0a00b5): Expanding GroupByKey operations into optimizable parts. [INFO] 2017-04-26T01:19:48.375Z: (8858aa8dbd0a06f7): Lifting ValueCombiningMappingFns into MergeBucketsMappingFns [INFO] 2017-04-26T01:19:48.395Z: (8858aa8dbd0a0641): Fusing adjacent ParDo, Read, Write, and Flatten operations [INFO] 2017-04-26T01:19:48.398Z: (8858aa8dbd0a0c83): Elided trivial flatten [INFO] 2017-04-26T01:19:48.400Z: (8858aa8dbd0a02c5): Elided trivial flatten [INFO] 2017-04-26T01:19:48.402Z: (8858aa8dbd0a0907): Elided trivial flatten [INFO] 2017-04-26T01:19:48.404Z: (8858aa8dbd0a0f49): Fusing consumer AssertElementTimestamps into ParDo(ExtractTimestampedValue) [INFO] 2017-04-26T01:19:48.406Z: (8858aa8dbd0a058b): Fusing consumer PAssert$290/GroupGlobally/Window.Into()/Window.Assign into ParDo(ExtractTimestampedValue) [INFO] 2017-04-26T01:19:48.411Z: (8858aa8dbd0a0851): Unzipping flatten s15 for input s10.10 [INFO] 2017-04-26T01:19:48.416Z: (8858aa8dbd0a0e93): Fusing unzipped copy of PAssert$290/GroupGlobally/GroupDummyAndContents/Reify, through flatten , into producer PAssert$290/GroupGlobally/KeyForDummy/AddKeys/Map [INFO] 2017-04-26T01:19:48.427Z: (8858aa8dbd0a079b): Unzipping flatten s15-u22 for input s17-reify-value0-c20 [INFO] 2017-04-26T01:19:48.430Z: (8858aa8dbd0a0ddd): Fusing unzipped copy of PAssert$290/GroupGlobally/GroupDummyAndContents/Write, through flatten , into producer PAssert$290/GroupGlobally/GroupDummyAndContents/Reify [INFO] 2017-04-26T01:19:48.432Z: (8858aa8dbd0a041f): Fusing consumer PAssert$290/GetPane/Map into PAssert$290/GroupGlobally/ParDo(Concat) [INFO] 2017-04-26T01:19:48.434Z: (8858aa8dbd0a0a61): Fusing consumer PAssert$290/VerifyAssertions/ParDo(DefaultConclude) into PAssert$290/RunChecks [INFO] 2017-04-26T01:19:48.437Z: (8858aa8dbd0a00a3): Fusing consumer PAssert$290/RunChecks into PAssert$290/GetPane/Map [INFO] 2017-04-26T01:19:48.439Z: (8858aa8dbd0a06e5): Fusing consumer PAssert$290/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$290/GroupGlobally/GroupDummyAndContents/Read [INFO] 2017-04-26T01:19:48.441Z: (8858aa8dbd0a0d27): Fusing consumer PAssert$290/GroupGlobally/Values/Values/Map into PAssert$290/GroupGlobally/GroupDummyAndContents/GroupByWindow [INFO] 2017-04-26T01:19:48.443Z: (8858aa8dbd0a0369): Fusing consumer PAssert$290/GroupGlobally/ParDo(Concat) into PAssert$290/GroupGlobally/Values/Values/Map [INFO] 2017-04-26T01:19:48.445Z: (8858aa8dbd0a09ab): Fusing consumer PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Reify [INFO] 2017-04-26T01:19:48.447Z: (8858aa8dbd0a0fed): Fusing consumer PAssert$290/GroupGlobally/GatherAllOutputs/ParDo(ReifyTimestampsAndWindows) into PAssert$290/GroupGlobally/Window.Into()/Window.Assign [INFO] 2017-04-26T01:19:48.449Z: (8858aa8dbd0a062f): Fusing consumer PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$290/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign [INFO] 2017-04-26T01:19:48.451Z: (8858aa8dbd0a0c71): Fusing consumer PAssert$290/GroupGlobally/RewindowActuals/Window.Assign into PAssert$290/GroupGlobally/GatherAllOutputs/Values/Values/Map [INFO] 2017-04-26T01:19:48.455Z: (8858aa8dbd0a02b3): Fusing consumer PAssert$290/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$290/GroupGlobally/GatherAllOutputs/ParDo(ReifyTimestampsAndWindows) [INFO] 2017-04-26T01:19:48.457Z: (8858aa8dbd0a08f5): Fusing consumer PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Read [INFO] 2017-04-26T01:19:48.459Z: (8858aa8dbd0a0f37): Fusing consumer PAssert$290/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$290/GroupGlobally/RewindowActuals/Window.Assign [INFO] 2017-04-26T01:19:48.461Z: (8858aa8dbd0a0579): Fusing consumer PAssert$290/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$290/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map [INFO] 2017-04-26T01:19:48.463Z: (8858aa8dbd0a0bbb): Fusing consumer PAssert$290/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow [INFO] 2017-04-26T01:19:48.465Z: (8858aa8dbd0a01fd): Fusing consumer ParDo(ExtractTimestampedValue) into Create.Values/Read(CreateSource) [INFO] 2017-04-26T01:19:48.468Z: (8858aa8dbd0a083f): Fusing consumer PAssert$290/GroupGlobally/GroupDummyAndContents/Write into PAssert$290/GroupGlobally/GroupDummyAndContents/Reify [INFO] 2017-04-26T01:19:48.470Z: (8858aa8dbd0a0e81): Fusing consumer PAssert$290/GroupGlobally/GroupDummyAndContents/Reify into PAssert$290/GroupGlobally/WindowIntoDummy/Window.Assign [INFO] 2017-04-26T01:19:48.473Z: (8858aa8dbd0a04c3): Fusing consumer PAssert$290/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$290/GroupGlobally/Create.Values/Read(CreateSource) [INFO] 2017-04-26T01:19:48.562Z: (8858aa8dbd0a0fc9): Adding StepResource setup and teardown to workflow graph. [INFO] 2017-04-26T01:19:48.613Z: (446e26514e008349): Executing operation PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Create [INFO] 2017-04-26T01:19:48.818Z: (468a2ad747adc054): Starting 1 workers... [INFO] 2017-04-26T01:19:48.845Z: (446e26514e00845e): Executing operation Create.Values/Read(CreateSource)+ParDo(ExtractTimestampedValue)+AssertElementTimestamps+PAssert$290/GroupGlobally/Window.Into()/Window.Assign+PAssert$290/GroupGlobally/GatherAllOutputs/ParDo(ReifyTimestampsAndWindows)+PAssert$290/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$290/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Write [INFO] Job 2017-04-25_18_16_37-5303199226690327770 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_16_37-5303199226690327770. Found 1 success, 0 failures out of 1 expected assertions. [INFO] PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 110 files. Enable logging at DEBUG level to see which files will be staged. [INFO] Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. [INFO] Uploading 110 files from PipelineOptions.filesToStage to staging location to prepare for execution. [INFO] Staging files complete: 0 files cached, 110 files newly uploaded [INFO] To access the Dataflow monitoring console, please navigate to https://console.developers.google.com/project/apache-beam-testing/dataflow/job/2017-04-25_18_19_56-6996221550328770104 [INFO] To cancel the job using the 'gcloud' tool, run: > gcloud beta dataflow jobs --project=apache-beam-testing cancel > 2017-04-25_18_19_56-6996221550328770104 [INFO] Running Dataflow job 2017-04-25_18_19_56-6996221550328770104 with 1 expected assertions. [INFO] 2017-04-26T01:19:56.745Z: (6117926eb5476b84): Autoscaling is enabled for job 2017-04-25_18_19_56-6996221550328770104. The number of workers will be between 1 and 15. [INFO] 2017-04-26T01:19:56.745Z: (6117926eb547622a): Autoscaling was automatically enabled for job 2017-04-25_18_19_56-6996221550328770104. [INFO] 2017-04-26T01:19:57.973Z: (67fff29b9aedf02): Worker pool stopped. [INFO] 2017-04-26T01:19:59.722Z: (5a4afa77607e27a0): Checking required Cloud APIs are enabled. [INFO] Job 2017-04-25_18_17_04-14082119172209228072 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_17_04-14082119172209228072. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2017-04-26T01:20:03.846Z: (5a4afa77607e256d): Fusing consumer PAssert$291/GroupGlobally/GroupDummyAndContents/Reify into PAssert$291/GroupGlobally/WindowIntoDummy/Window.Assign [INFO] 2017-04-26T01:20:03.848Z: (5a4afa77607e2b37): Fusing consumer PAssert$291/GroupGlobally/GroupDummyAndContents/Write into PAssert$291/GroupGlobally/GroupDummyAndContents/Reify [INFO] 2017-04-26T01:20:03.850Z: (5a4afa77607e2101): Fusing consumer PAssert$291/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$291/GroupGlobally/Create.Values/Read(CreateSource) [INFO] 2017-04-26T01:20:04.204Z: (fc540476f9839e0e): Starting 1 workers... [INFO] 2017-04-26T01:20:04.236Z: (50101b2bb4cb783e): Executing operation Create.Values/Read(CreateSource)+WithTimestamps/AddTimestamps+ParDo(ReifyValueTimestamp)+PAssert$291/GroupGlobally/Window.Into()/Window.Assign+PAssert$291/GroupGlobally/GatherAllOutputs/ParDo(ReifyTimestampsAndWindows)+PAssert$291/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$291/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$291/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$291/GroupGlobally/GatherAllOutputs/GroupByKey/Write [INFO] 2017-04-26T01:20:10.648Z: (f375090864f7f24c): Worker pool stopped. [INFO] 2017-04-26T01:20:11.025Z: (599fcf8c8a01cb05): Worker pool stopped. [INFO] Job 2017-04-25_18_17_06-1154501324611423118 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_17_06-1154501324611423118. Found 1 success, 0 failures out of 1 expected assertions. [INFO] Job 2017-04-25_18_17_04-1915336008601930983 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_17_04-1915336008601930983. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2017-04-26T01:20:17.488Z: (d73d62a5a107428a): Workers have started successfully. [INFO] 2017-04-26T01:20:17.172Z: (e34991e53cc2be24): Workers have started successfully. [INFO] 2017-04-26T01:20:27.920Z: (387fc82a17ffbd): Worker pool stopped. [INFO] Job 2017-04-25_18_16_48-17777534131998128897 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_16_48-17777534131998128897. Found 4 success, 0 failures out of 4 expected assertions. [INFO] 2017-04-26T01:20:34.949Z: (de3267dc55804bee): Executing operation PAssert$288/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2017-04-26T01:20:34.976Z: (de3267dc55804b71): Executing operation PAssert$288/GroupGlobally/GroupDummyAndContents/Create [INFO] 2017-04-26T01:20:35.162Z: (de3267dc55804366): Executing operation PAssert$288/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$288/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$288/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$288/GroupGlobally/RewindowActuals/Window.Assign+PAssert$288/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$288/GroupGlobally/GroupDummyAndContents/Reify+PAssert$288/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:20:35.167Z: (3866a6b8fd3ec44d): Executing operation PAssert$288/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$288/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$288/GroupGlobally/GroupDummyAndContents/Reify+PAssert$288/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:20:37.255Z: (80552a93fd9b591d): Executing operation PAssert$286/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2017-04-26T01:20:37.271Z: (80552a93fd9b5d96): Executing operation PAssert$286/GroupGlobally/GroupDummyAndContents/Create [INFO] 2017-04-26T01:20:37.463Z: (80552a93fd9b5d05): Executing operation PAssert$286/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$286/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$286/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$286/GroupGlobally/RewindowActuals/Window.Assign+PAssert$286/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$286/GroupGlobally/GroupDummyAndContents/Reify+PAssert$286/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:20:37.467Z: (c75c640f346d680): Executing operation PAssert$286/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$286/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$286/GroupGlobally/GroupDummyAndContents/Reify+PAssert$286/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:20:40.760Z: (367e65768fda8c14): Workers have started successfully. [INFO] 2017-04-26T01:20:43.329Z: (d153b9ecb1ad2501): Worker pool stopped. [INFO] 2017-04-26T01:20:45.890Z: (3866a6b8fd3ec176): Executing operation PAssert$288/GroupGlobally/GroupDummyAndContents/Close [INFO] 2017-04-26T01:20:45.908Z: (3866a6b8fd3eca18): Executing operation PAssert$288/GroupGlobally/GroupDummyAndContents/Read+PAssert$288/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$288/GroupGlobally/Values/Values/Map+PAssert$288/GroupGlobally/ParDo(Concat)+PAssert$288/GetPane/Map+PAssert$288/RunChecks+PAssert$288/VerifyAssertions/ParDo(DefaultConclude) [INFO] Job 2017-04-25_18_16_47-3132839385632582504 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_16_47-3132839385632582504. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2017-04-26T01:20:48.538Z: (80552a93fd9b5d76): Executing operation PAssert$286/GroupGlobally/GroupDummyAndContents/Close [INFO] 2017-04-26T01:20:48.556Z: (80552a93fd9b5a70): Executing operation PAssert$286/GroupGlobally/GroupDummyAndContents/Read+PAssert$286/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$286/GroupGlobally/Values/Values/Map+PAssert$286/GroupGlobally/ParDo(Concat)+PAssert$286/GetPane/Map+PAssert$286/RunChecks+PAssert$286/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2017-04-26T01:20:52.554Z: (3149c5e3910bfdb3): Cleaning up. [INFO] 2017-04-26T01:20:52.653Z: (3149c5e3910bfd3f): Stopping worker pool... [INFO] 2017-04-26T01:20:55.958Z: (f02e69498117551): Workers have started successfully. [INFO] 2017-04-26T01:21:00.466Z: (c689646f446b8636): Cleaning up. [INFO] 2017-04-26T01:21:00.471Z: (c689646f446b8eea): Stopping worker pool... [INFO] 2017-04-26T01:21:02.630Z: (cd21556f4c54b862): Worker pool stopped. [INFO] 2017-04-26T01:21:02.666Z: (f3d0892f60cf7bcc): Workers have started successfully. [INFO] Job 2017-04-25_18_17_48-5724706500414494199 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_17_48-5724706500414494199. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2017-04-26T01:21:17.727Z: (939064c2efda9972): Executing operation PAssert$287/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2017-04-26T01:21:17.742Z: (939064c2efda9387): Executing operation PAssert$287/GroupGlobally/GroupDummyAndContents/Create [INFO] 2017-04-26T01:21:17.940Z: (939064c2efda99ba): Executing operation PAssert$287/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$287/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$287/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$287/GroupGlobally/RewindowActuals/Window.Assign+PAssert$287/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$287/GroupGlobally/GroupDummyAndContents/Reify+PAssert$287/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:21:17.945Z: (e629f56b559d5af4): Executing operation PAssert$287/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$287/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$287/GroupGlobally/GroupDummyAndContents/Reify+PAssert$287/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:21:23.446Z: (446e26514e0088d5): Executing operation PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2017-04-26T01:21:23.459Z: (446e26514e008a38): Executing operation PAssert$290/GroupGlobally/GroupDummyAndContents/Create [INFO] 2017-04-26T01:21:23.652Z: (446e26514e008b4d): Executing operation PAssert$290/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$290/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$290/GroupGlobally/GroupDummyAndContents/Reify+PAssert$290/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:21:23.655Z: (49d35d68adf73407): Executing operation PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$290/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$290/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$290/GroupGlobally/RewindowActuals/Window.Assign+PAssert$290/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$290/GroupGlobally/GroupDummyAndContents/Reify+PAssert$290/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:21:28.497Z: (34938616dd94c1f4): Workers have started successfully. [INFO] 2017-04-26T01:21:28.939Z: (939064c2efda93e7): Executing operation PAssert$287/GroupGlobally/GroupDummyAndContents/Close [INFO] 2017-04-26T01:21:28.960Z: (939064c2efda97f9): Executing operation PAssert$287/GroupGlobally/GroupDummyAndContents/Read+PAssert$287/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$287/GroupGlobally/Values/Values/Map+PAssert$287/GroupGlobally/ParDo(Concat)+PAssert$287/GetPane/Map+PAssert$287/RunChecks+PAssert$287/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2017-04-26T01:21:33.433Z: (49d35d68adf73eb6): Executing operation PAssert$290/GroupGlobally/GroupDummyAndContents/Close [INFO] 2017-04-26T01:21:33.453Z: (49d35d68adf732fc): Executing operation PAssert$290/GroupGlobally/GroupDummyAndContents/Read+PAssert$290/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$290/GroupGlobally/Values/Values/Map+PAssert$290/GroupGlobally/ParDo(Concat)+PAssert$290/GetPane/Map+PAssert$290/RunChecks+PAssert$290/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2017-04-26T01:21:35.939Z: (634e6dfeb8f44686): Cleaning up. [INFO] 2017-04-26T01:21:36.009Z: (634e6dfeb8f44572): Stopping worker pool... [INFO] 2017-04-26T01:21:37.663Z: (50101b2bb4cb7667): Executing operation PAssert$291/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2017-04-26T01:21:37.680Z: (50101b2bb4cb7824): Executing operation PAssert$291/GroupGlobally/GroupDummyAndContents/Create [INFO] 2017-04-26T01:21:37.869Z: (50101b2bb4cb70ef): Executing operation PAssert$291/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$291/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$291/GroupGlobally/GroupDummyAndContents/Reify+PAssert$291/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:21:37.875Z: (cab87824060350aa): Executing operation PAssert$291/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$291/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$291/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$291/GroupGlobally/RewindowActuals/Window.Assign+PAssert$291/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$291/GroupGlobally/GroupDummyAndContents/Reify+PAssert$291/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:21:39.303Z: (8858aa8dbd0a0eb8): Cleaning up. [INFO] 2017-04-26T01:21:39.308Z: (8858aa8dbd0a0b3c): Stopping worker pool... [INFO] 2017-04-26T01:21:48.945Z: (50101b2bb4cb7f18): Executing operation PAssert$291/GroupGlobally/GroupDummyAndContents/Close [INFO] 2017-04-26T01:21:48.965Z: (50101b2bb4cb79ba): Executing operation PAssert$291/GroupGlobally/GroupDummyAndContents/Read+PAssert$291/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$291/GroupGlobally/Values/Values/Map+PAssert$291/GroupGlobally/ParDo(Concat)+PAssert$291/GetPane/Map+PAssert$291/RunChecks+PAssert$291/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2017-04-26T01:21:55.315Z: (75b50c6949b07ce5): Executing operation PAssert$289/GroupGlobally/GatherAllOutputs/GroupByKey/Close [INFO] 2017-04-26T01:21:55.334Z: (75b50c6949b072fc): Executing operation PAssert$289/GroupGlobally/GroupDummyAndContents/Create [INFO] 2017-04-26T01:21:55.523Z: (75b50c6949b07f7d): Executing operation PAssert$289/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$289/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$289/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$289/GroupGlobally/RewindowActuals/Window.Assign+PAssert$289/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$289/GroupGlobally/GroupDummyAndContents/Reify+PAssert$289/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:21:55.526Z: (769b72b985a3b523): Executing operation PAssert$289/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$289/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$289/GroupGlobally/GroupDummyAndContents/Reify+PAssert$289/GroupGlobally/GroupDummyAndContents/Write [INFO] 2017-04-26T01:21:55.959Z: (5a4afa77607e2f0a): Cleaning up. [INFO] 2017-04-26T01:21:55.965Z: (5a4afa77607e2a9e): Stopping worker pool... [INFO] 2017-04-26T01:22:06.602Z: (769b72b985a3b828): Executing operation PAssert$289/GroupGlobally/GroupDummyAndContents/Close [INFO] 2017-04-26T01:22:06.624Z: (769b72b985a3bb42): Executing operation PAssert$289/GroupGlobally/GroupDummyAndContents/Read+PAssert$289/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$289/GroupGlobally/Values/Values/Map+PAssert$289/GroupGlobally/ParDo(Concat)+PAssert$289/GetPane/Map+PAssert$289/RunChecks+PAssert$289/VerifyAssertions/ParDo(DefaultConclude) [INFO] 2017-04-26T01:22:13.831Z: (1dafcdd59c6b2d88): Cleaning up. [INFO] 2017-04-26T01:22:14.010Z: (1dafcdd59c6b2924): Stopping worker pool... [INFO] 2017-04-26T01:22:22.663Z: (3149c5e3910bf8e8): Worker pool stopped. [INFO] 2017-04-26T01:22:25.478Z: (c689646f446b8971): Worker pool stopped. [INFO] Job 2017-04-25_18_19_10-17801583297848957682 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_19_10-17801583297848957682. Found 1 success, 0 failures out of 1 expected assertions. [INFO] Job 2017-04-25_18_18_24-18237279102789527880 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_18_24-18237279102789527880. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2017-04-26T01:23:04.315Z: (8858aa8dbd0a049f): Worker pool stopped. [INFO] Job 2017-04-25_18_19_43-2645401558949173805 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_19_43-2645401558949173805. Found 1 success, 0 failures out of 1 expected assertions. [INFO] Job 2017-04-25_18_19_34-16834823568734284188 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_19_34-16834823568734284188. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2017-04-26T01:23:20.973Z: (5a4afa77607e2b4d): Worker pool stopped. [INFO] Job 2017-04-25_18_19_56-6996221550328770104 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_19_56-6996221550328770104. Found 1 success, 0 failures out of 1 expected assertions. [INFO] 2017-04-26T01:23:39.018Z: (1dafcdd59c6b25d9): Worker pool stopped. [INFO] Job 2017-04-25_18_19_42-18049386336424926276 finished with status DONE. [INFO] Found result while running Dataflow job 2017-04-25_18_19_42-18049386336424926276. Found 1 success, 0 failures out of 1 expected assertions. Running org.apache.beam.sdk.transforms.ParDoTest Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 860.275 sec - in org.apache.beam.sdk.transforms.ParDoTest Running org.apache.beam.sdk.transforms.CreateTest Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 408.898 sec - in org.apache.beam.sdk.transforms.CreateTest Running org.apache.beam.sdk.util.ReifyTimestampsTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 231.556 sec - in org.apache.beam.sdk.util.ReifyTimestampsTest Running org.apache.beam.sdk.values.PDoneTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0 sec - in org.apache.beam.sdk.values.PDoneTest Running org.apache.beam.sdk.transforms.windowing.WindowTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 236.244 sec - in org.apache.beam.sdk.transforms.windowing.WindowTest Running org.apache.beam.sdk.io.CountingSourceTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 374.991 sec - in org.apache.beam.sdk.io.CountingSourceTest Results : Tests run: 233, Failures: 0, Errors: 0, Skipped: 3 [JENKINS] Recording test results 2017-04-26T01:23:48.591 [INFO] 2017-04-26T01:23:48.592 [INFO] --- maven-dependency-plugin:3.0.0:analyze-only (default) @ beam-runners-google-cloud-dataflow-java --- 2017-04-26T01:23:48.719 [INFO] No dependency problems found [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled 2017-04-26T01:23:54.953 [INFO] ------------------------------------------------------------------------ 2017-04-26T01:23:54.953 [INFO] Reactor Summary: 2017-04-26T01:23:54.953 [INFO] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: Parent .............................. SUCCESS [ 18.947 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 9.906 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs ................................ SUCCESS [ 1.064 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Common ...................... SUCCESS [ 1.205 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Common :: Fn API ............ SUCCESS [ 10.068 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Common :: Runner API ........ SUCCESS [ 3.157 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Java ........................ SUCCESS [ 0.942 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Java :: Core ................ SUCCESS [01:25 min] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 1.127 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: Runners ............................. SUCCESS [ 1.205 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 10.242 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 24.129 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [02:40 min] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 1.509 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 15.479 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 14.299 s] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [01:11 min] 2017-04-26T01:23:54.953 [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 01:23 h] 2017-04-26T01:23:54.953 [INFO] ------------------------------------------------------------------------ 2017-04-26T01:23:54.953 [INFO] BUILD SUCCESS 2017-04-26T01:23:54.953 [INFO] ------------------------------------------------------------------------ 2017-04-26T01:23:54.954 [INFO] Total time: 01:31 h 2017-04-26T01:23:54.954 [INFO] Finished at: 2017-04-26T01:23:54+00:00 2017-04-26T01:23:55.822 [INFO] Final Memory: 264M/2123M 2017-04-26T01:23:55.826 [INFO] ------------------------------------------------------------------------ Waiting for Jenkins to finish collecting data channel stopped
