See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/545/display/redirect?page=changes>
Changes: [michal.walenia] [BEAM-6627] Added Metrics API processing time reporting to TextIOIT [michal.walenia] [BEAM-6627] Moved ByteMonitor, TimeMonitor and ConsoleResultPublisher to [robertwb] [BEAM-6655] Initial support for progress reporting over the FnAPI. [markliu] Update ValidatesContainer test run scripts. [michal.walenia] [BEAM-6627] Refactored publishing records to BQ, added an option to [robertwb] fixup: reviewer comments [ttanay100] Fix very minor typo [lukasz.gajowy] [BEAM-6627] Enabled metric reporting on all TextIOIT tests [juta_staes] [BEAM-6619] [BEAM-6593] Add gcsio integration tests to postcommit [ryan.blake.williams] fix DataflowRunnerTest expected error msg [michal.walenia] [BEAM-6627] Added run_time metric reporting ------------------------------------------ [...truncated 3.97 MB...] [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/archetype/archetype-descriptor/3.0.1/archetype-descriptor-3.0.1.jar [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/archetype/archetype-common/3.0.1/archetype-common-3.0.1.jar [INFO] Downloading from central: https://repo.maven.apache.org/maven2/net/sourceforge/jchardet/jchardet/1.0/jchardet-1.0.jar [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.6/plexus-component-annotations-1.6.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/archetype/archetype-catalog/3.0.1/archetype-catalog-3.0.1.jar (19 kB at 656 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/dom4j/dom4j/1.6.1/dom4j-1.6.1.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/archetype/archetype-descriptor/3.0.1/archetype-descriptor-3.0.1.jar (24 kB at 767 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.0.b2/xml-apis-1.0.b2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.6/plexus-component-annotations-1.6.jar (4.3 kB at 78 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/jdom/jdom/1.0/jdom-1.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.0.b2/xml-apis-1.0.b2.jar (109 kB at 2.0 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.0/maven-artifact-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/net/sourceforge/jchardet/jchardet/1.0/jchardet-1.0.jar (27 kB at 409 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.0/maven-settings-builder-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/dom4j/dom4j/1.6.1/dom4j-1.6.1.jar (314 kB at 4.3 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.2/commons-io-2.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.0/maven-artifact-3.0.jar (52 kB at 633 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-velocity/1.1.8/plexus-velocity-1.1.8.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.0/maven-settings-builder-3.0.jar (38 kB at 411 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/velocity/velocity/1.7/velocity-1.7.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/archetype/archetype-common/3.0.1/archetype-common-3.0.1.jar (331 kB at 2.9 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.4/commons-lang-2.4.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/jdom/jdom/1.0/jdom-1.0.jar (153 kB at 1.3 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/wagon/wagon-provider-api/2.8/wagon-provider-api-2.8.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-velocity/1.1.8/plexus-velocity-1.1.8.jar (7.9 kB at 65 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/groovy/groovy/1.8.3/groovy-1.8.3.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.2/commons-io-2.2.jar (174 kB at 1.4 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/antlr/antlr/2.7.7/antlr-2.7.7.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/wagon/wagon-provider-api/2.8/wagon-provider-api-2.8.jar (53 kB at 363 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/asm/asm/3.2/asm-3.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.4/commons-lang-2.4.jar (262 kB at 1.7 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/asm/asm-commons/3.2/asm-commons-3.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/velocity/velocity/1.7/velocity-1.7.jar (450 kB at 2.9 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/asm/asm-util/3.2/asm-util-3.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/asm/asm/3.2/asm-3.2.jar (43 kB at 251 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/asm/asm-analysis/3.2/asm-analysis-3.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/antlr/antlr/2.7.7/antlr-2.7.7.jar (445 kB at 2.5 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/asm/asm-tree/3.2/asm-tree-3.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/asm/asm-commons/3.2/asm-commons-3.2.jar (33 kB at 185 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0.21/plexus-utils-3.0.21.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/asm/asm-util/3.2/asm-util-3.2.jar (37 kB at 203 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interactivity-api/1.0-alpha-6/plexus-interactivity-api-1.0-alpha-6.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/asm/asm-analysis/3.2/asm-analysis-3.2.jar (18 kB at 90 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.0/maven-plugin-api-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/asm/asm-tree/3.2/asm-tree-3.2.jar (22 kB at 109 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-inject-plexus/1.4.2/sisu-inject-plexus-1.4.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interactivity-api/1.0-alpha-6/plexus-interactivity-api-1.0-alpha-6.jar (12 kB at 58 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-inject-bean/1.4.2/sisu-inject-bean-1.4.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0.21/plexus-utils-3.0.21.jar (245 kB at 1.1 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/2.1.7/sisu-guice-2.1.7-noaop.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.0/maven-plugin-api-3.0.jar (49 kB at 215 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.0/maven-core-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-inject-bean/1.4.2/sisu-inject-bean-1.4.2.jar (153 kB at 648 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.0/maven-repository-metadata-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-inject-plexus/1.4.2/sisu-inject-plexus-1.4.2.jar (202 kB at 851 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.0/maven-model-builder-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/2.1.7/sisu-guice-2.1.7-noaop.jar (472 kB at 1.8 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.0/maven-aether-provider-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.0/maven-repository-metadata-3.0.jar (30 kB at 115 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-impl/1.7/aether-impl-1.7.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.0/maven-model-builder-3.0.jar (148 kB at 532 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-spi/1.7/aether-spi-1.7.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.0/maven-core-3.0.jar (527 kB at 1.9 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-api/1.7/aether-api-1.7.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.0/maven-aether-provider-3.0.jar (51 kB at 178 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-util/1.7/aether-util-1.7.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-impl/1.7/aether-impl-1.7.jar (106 kB at 365 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.14/plexus-interpolation-1.14.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-spi/1.7/aether-spi-1.7.jar (14 kB at 45 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.2.3/plexus-classworlds-2.2.3.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-api/1.7/aether-api-1.7.jar (74 kB at 239 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-util/1.7/aether-util-1.7.jar (108 kB at 343 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.14/plexus-interpolation-1.14.jar (61 kB at 193 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model/3.0/maven-model-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.2.3/plexus-classworlds-2.2.3.jar (46 kB at 138 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.0/maven-settings-3.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.jar (29 kB at 85 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-invoker/2.2/maven-invoker-2.2.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.jar (13 kB at 40 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-artifact-transfer/0.9.0/maven-artifact-transfer-0.9.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model/3.0/maven-model-3.0.jar (165 kB at 471 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.0.0/maven-common-artifact-filters-3.0.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.0/maven-settings-3.0.jar (47 kB at 129 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.0.0/maven-shared-utils-3.0.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-invoker/2.2/maven-invoker-2.2.jar (30 kB at 82 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-artifact-transfer/0.9.0/maven-artifact-transfer-0.9.0.jar (123 kB at 333 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.6/commons-codec-1.6.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.0.0/maven-common-artifact-filters-3.0.0.jar (57 kB at 152 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar (32 kB at 81 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.0.0/maven-shared-utils-3.0.0.jar (155 kB at 392 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-script-interpreter/1.0/maven-script-interpreter-1.0.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar (26 kB at 65 kB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.6/commons-codec-1.6.jar (233 kB at 575 kB/s) [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/groovy/groovy/1.8.3/groovy-1.8.3.jar (5.5 MB at 14 MB/s) [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/ant/ant/1.8.1/ant-1.8.1.jar [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-script-interpreter/1.0/maven-script-interpreter-1.0.jar (21 kB at 49 kB/s) [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar (282 kB at 633 kB/s) [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar (575 kB at 1.3 MB/s) [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/ant/ant/1.8.1/ant-1.8.1.jar (1.5 MB at 3.0 MB/s) [INFO] Generating project in Batch mode [INFO] Archetype repository not defined. Using the one from [org.apache.beam:beam-sdks-java-maven-archetypes-examples:2.11.0] found in catalog remote [INFO] Downloading from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.12.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.12.0-SNAPSHOT/maven-metadata.xml (1.7 kB at 4.9 kB/s) [INFO] Downloading from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.12.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.12.0-20190224.091202-8.pom [INFO] Downloaded from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.12.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.12.0-20190224.091202-8.pom (4.1 kB at 13 kB/s) [INFO] Downloading from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.12.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.12.0-20190224.091202-8.jar [INFO] Downloaded from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.12.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.12.0-20190224.091202-8.jar (3.0 MB at 5.0 MB/s) [INFO] ---------------------------------------------------------------------------- [INFO] Using following parameters for creating project from Archetype: beam-sdks-java-maven-archetypes-examples:2.12.0-SNAPSHOT [INFO] ---------------------------------------------------------------------------- [INFO] Parameter: groupId, Value: org.example [INFO] Parameter: artifactId, Value: word-count-beam [INFO] Parameter: version, Value: 0.1 [INFO] Parameter: package, Value: org.apache.beam.examples [INFO] Parameter: packageInPathFormat, Value: org/apache/beam/examples [INFO] Parameter: package, Value: org.apache.beam.examples [INFO] Parameter: version, Value: 0.1 [INFO] Parameter: groupId, Value: org.example [INFO] Parameter: targetPlatform, Value: 1.8 [INFO] Parameter: artifactId, Value: word-count-beam [INFO] Project created from Archetype in dir: /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 9.044 s [INFO] Finished at: 2019-03-08T11:34:40Z [INFO] Final Memory: 28M/1261M [INFO] ------------------------------------------------------------------------ Verified [INFO] BUILD SUCCESS cd word-count-beam ls pom.xml src Verified pom.xml Verified src ls src/main/java/org/apache/beam/examples/ common complete DebuggingWordCount.java MinimalWordCount.java subprocess WindowedWordCount.java WordCount.java Verified WordCount.java ls src/main/java/org/apache/beam/examples/complete/game/ GameStats.java HourlyTeamScore.java injector LeaderBoard.java StatefulTeamScore.java UserScore.java utils Verified UserScore.java ************************************** * Test: Runs the WordCount Code with Direct runner ************************************** mvn compile exec:java -q -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--inputFile=pom.xml --output=counts" -Pdirect-runner Using maven /home/jenkins/tools/maven/apache-maven-3.5.2 Mar 08, 2019 11:36:06 AM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeBytes INFO: Filepattern pom.xml matched 1 files with total size 17300 Mar 08, 2019 11:36:06 AM org.apache.beam.sdk.io.FileBasedSource split INFO: Splitting filepattern pom.xml into bundles of size 1081 took 1 ms and produced 1 files and 16 bundles Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement INFO: Opening writer 32177fe5-2cc2-440d-9833-5a0938dc1d11 for window org.apache.beam.sdk.transforms.windowing.GlobalWindow@6f9a07a1 pane PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0} destination null Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement INFO: Opening writer f6168099-c10e-418e-aeea-0149b1c83812 for window org.apache.beam.sdk.transforms.windowing.GlobalWindow@6f9a07a1 pane PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0} destination null Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement INFO: Opening writer 8b82d277-674d-4094-a65f-4c1e82909359 for window org.apache.beam.sdk.transforms.windowing.GlobalWindow@6f9a07a1 pane PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0} destination null Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement INFO: Opening writer fa2dbb63-5776-4ffd-a3ff-3e0b20f61179 for window org.apache.beam.sdk.transforms.windowing.GlobalWindow@6f9a07a1 pane PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0} destination null Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$Writer close INFO: Successfully wrote temporary file /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/32177fe5-2cc2-440d-9833-5a0938dc1d11 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$Writer close INFO: Successfully wrote temporary file /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/fa2dbb63-5776-4ffd-a3ff-3e0b20f61179 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$Writer close INFO: Successfully wrote temporary file /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/f6168099-c10e-418e-aeea-0149b1c83812 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$Writer close INFO: Successfully wrote temporary file /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/8b82d277-674d-4094-a65f-4c1e82909359 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process INFO: Finalizing 4 file results Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation createMissingEmptyShards INFO: Finalizing for destination null num shards 4. Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/f6168099-c10e-418e-aeea-0149b1c83812, shard=0, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@6f9a07a1, paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}} to final location /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/counts-00000-of-00004 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/32177fe5-2cc2-440d-9833-5a0938dc1d11, shard=1, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@6f9a07a1, paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}} to final location /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/counts-00001-of-00004 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/fa2dbb63-5776-4ffd-a3ff-3e0b20f61179, shard=3, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@6f9a07a1, paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}} to final location /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/counts-00003-of-00004 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/8b82d277-674d-4094-a65f-4c1e82909359, shard=2, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@6f9a07a1, paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}} to final location /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/counts-00002-of-00004 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles INFO: Will remove known temporary file /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/fa2dbb63-5776-4ffd-a3ff-3e0b20f61179 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles INFO: Will remove known temporary file /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/f6168099-c10e-418e-aeea-0149b1c83812 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles INFO: Will remove known temporary file /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/8b82d277-674d-4094-a65f-4c1e82909359 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles INFO: Will remove known temporary file /tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/32177fe5-2cc2-440d-9833-5a0938dc1d11 Mar 08, 2019 11:36:10 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles WARNING: Failed to match temporary files under: [/tmp/groovy-generated-9119618401126610935-tmpdir/word-count-beam/.temp-beam-2019-03-08_11-36-06-1/]. grep Foundation counts* counts-00001-of-00004:Foundation: 1 Verified Foundation: 1 [SUCCESS] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':beam-runners-google-cloud-dataflow-java:runMobileGamingJavaDataflow'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':beam-runners-google-cloud-dataflow-java:runQuickstartJavaDataflow'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 16m 51s 8 actionable tasks: 7 executed, 1 from cache Publishing build scan... https://gradle.com/s/nuwvhb7wvwqyw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
