See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1327/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Refactor Dataflow V2 sickbay lists to prepare for portable job
[Kenneth Knowles] Produce portable pipeline proto before applying Dataflow V1
replacements
[Kenneth Knowles] Re-enable portable job submission by default
[noreply] [BEAM-12069] Make mock a test-only dependency (#14328)
[Ismaël Mejía] [BEAM-7093] Add Spark 3 and Java 11 info into the CHANGES file
[noreply] Update dependencies
[noreply] Update dependencies
[noreply] Merge pull request #13985 from [BEAM-11810] A trigger manager for
[noreply] [BEAM-10943] Enable SqlTransform::registerUdf in ZetaSQL. (#14263)
[noreply] [BEAM-11797] Fix wrong assertion usage (#14377)
[noreply] [BEAM-12071] Don't re-use WriteToPandasSink instances across windows
[noreply] Merge pull request #13995 from [BEAM-11322] Apache Beam Example to
------------------------------------------
[...truncated 4.59 MB...]
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (33s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (34s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (35s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (36s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (37s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (38s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (39s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (40s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (41s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (42s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (43s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (44s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (45s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (46s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (47s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (48s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (49s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (50s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (51s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (52s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (53s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (54s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (55s) Current status:
PENDING
Waiting on bqjob_r2e00485dcf624957_0000017888165f23_1 ... (56s) Current status:
PENDING
....................................................................[WARNING]
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0 (Native Method)
at java.lang.Thread.start (Thread.java:717)
at org.apache.beam.examples.complete.game.injector.Injector.main
(Injector.java:439)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
at java.lang.Thread.run (Thread.java:748)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:53 min
[INFO] Finished at: 2021-03-31T11:42:10Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class. unable to create new native thread -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[INFO] Scanning for projects...
[INFO]
[INFO] --------------------< org.example:word-count-beam >---------------------
[INFO] Building word-count-beam 0.1
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] Downloading from apache.snapshots:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-portability-java/2.30.0-SNAPSHOT/maven-metadata.xml
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-portability-java/2.30.0-SNAPSHOT/maven-metadata.xml
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-portability-java/2.30.0-SNAPSHOT/maven-metadata.xml
(1.7 kB at 975 B/s)
[INFO] Downloaded from apache.snapshots:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-portability-java/2.30.0-SNAPSHOT/maven-metadata.xml
(1.7 kB at 981 B/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-portability-java/2.30.0-SNAPSHOT/beam-runners-portability-java-2.30.0-20210331.070353-14.pom
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-portability-java/2.30.0-SNAPSHOT/beam-runners-portability-java-2.30.0-20210331.070353-14.pom
(17 kB at 47 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-java-job-service/2.30.0-SNAPSHOT/maven-metadata.xml
[INFO] Downloading from apache.snapshots:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-java-job-service/2.30.0-SNAPSHOT/maven-metadata.xml
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-java-job-service/2.30.0-SNAPSHOT/maven-metadata.xml
(1.7 kB at 6.9 kB/s)
[INFO] Downloaded from apache.snapshots:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-java-job-service/2.30.0-SNAPSHOT/maven-metadata.xml
(1.7 kB at 6.9 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-java-job-service/2.30.0-SNAPSHOT/beam-runners-java-job-service-2.30.0-20210331.070353-14.pom
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-java-job-service/2.30.0-SNAPSHOT/beam-runners-java-job-service-2.30.0-20210331.070353-14.pom
(17 kB at 49 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/commons/commons-compress/1.20/commons-compress-1.20.pom
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.20/commons-compress-1.20.pom
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.20/commons-compress-1.20.pom
(18 kB at 126 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/args4j/args4j/2.33/args4j-2.33.pom
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/args4j/args4j/2.33/args4j-2.33.pom
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/args4j/args4j/2.33/args4j-2.33.pom (1.3 kB
at 43 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/args4j/args4j-site/2.33/args4j-site-2.33.pom
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/args4j/args4j-site/2.33/args4j-site-2.33.pom
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/args4j/args4j-site/2.33/args4j-site-2.33.pom
(4.4 kB at 143 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/kohsuke/pom/14/pom-14.pom
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/kohsuke/pom/14/pom-14.pom
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/kohsuke/pom/14/pom-14.pom (5.5 kB at
166 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-harness/2.30.0-SNAPSHOT/maven-metadata.xml
[INFO] Downloading from apache.snapshots:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-harness/2.30.0-SNAPSHOT/maven-metadata.xml
[INFO] Downloaded from apache.snapshots:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-harness/2.30.0-SNAPSHOT/maven-metadata.xml
(1.7 kB at 2.8 kB/s)
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-harness/2.30.0-SNAPSHOT/maven-metadata.xml
(1.7 kB at 2.8 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-harness/2.30.0-SNAPSHOT/beam-sdks-java-harness-2.30.0-20210331.070353-14.pom
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-harness/2.30.0-SNAPSHOT/beam-sdks-java-harness-2.30.0-20210331.070353-14.pom
(4.1 kB at 17 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-portability-java/2.30.0-SNAPSHOT/beam-runners-portability-java-2.30.0-20210331.070353-14.jar
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-java-job-service/2.30.0-SNAPSHOT/beam-runners-java-job-service-2.30.0-20210331.070353-14.jar
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/args4j/args4j/2.33/args4j-2.33.jar
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-harness/2.30.0-SNAPSHOT/beam-sdks-java-harness-2.30.0-20210331.070353-14.jar
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-portability-java/2.30.0-SNAPSHOT/beam-runners-portability-java-2.30.0-20210331.070353-14.jar
(49 kB at 105 kB/s)
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-runners-java-job-service/2.30.0-SNAPSHOT/beam-runners-java-job-service-2.30.0-20210331.070353-14.jar
(58 kB at 124 kB/s)
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-harness/2.30.0-SNAPSHOT/beam-sdks-java-harness-2.30.0-20210331.070353-14.jar
(71 MB at 14 MB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/args4j/args4j/2.33/args4j-2.33.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/args4j/args4j/2.33/args4j-2.33.jar (155 kB
at 2.3 MB/s)
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-8510949146236401197-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
fullTopicName projects/apache-beam-testing/topics/java_mobile_gaming_topic
Injecting to topic: projects/apache-beam-testing/topics/java_mobile_gaming_topic
Starting Injector
[+(FuchsiaWallaby, num members: 8, starting at: 1617189990727, expires in: 24,
robot: null)]
[+(AmaranthCaneToad, num members: 13, starting at: 1617189990727, expires in:
21, robot: Robot-1)]
[+(AmethystMarmot, num members: 5, starting at: 1617189990728, expires in: 29,
robot: Robot-14)]
[+(AsparagusAntechinus, num members: 17, starting at: 1617189990728, expires
in: 20, robot: null)]
[+(BananaPossum, num members: 18, starting at: 1617189990728, expires in: 30,
robot: null)]
[+(AmberKangaroo, num members: 13, starting at: 1617189990728, expires in: 38,
robot: null)]
[+(AzureCockatoo, num members: 18, starting at: 1617189990729, expires in: 21,
robot: null)]
[+(AmberBilby, num members: 5, starting at: 1617189990729, expires in: 29,
robot: Robot-19)]
[+(AntiqueBrassWombat, num members: 9, starting at: 1617189990729, expires in:
31, robot: Robot-7)]
[+(BisqueWombat, num members: 18, starting at: 1617189990729, expires in: 32,
robot: Robot-8)]
[+(AntiqueBrassAntechinus, num members: 19, starting at: 1617189990729, expires
in: 31, robot: null)]
[+(AuburnCassowary, num members: 7, starting at: 1617189990730, expires in: 22,
robot: Robot-2)]
[+(AquaPossum, num members: 5, starting at: 1617189990730, expires in: 26,
robot: Robot-15)]
[+(BisqueCaneToad, num members: 11, starting at: 1617189990730, expires in: 25,
robot: null)]
[+(AuburnNumbat, num members: 5, starting at: 1617189990730, expires in: 35,
robot: null)]
DELAY(376604, 1)
{timestamp_ms=1617189614000}
late data for:
user6_AntiqueBrassWombat,AntiqueBrassWombat,0,1617189614000,2021-03-31
04:26:30.734
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(569875,
1)
{timestamp_ms=1617189722000}
late data for: user16_BananaPossum,BananaPossum,2,1617189722000,2021-03-31
04:31:32.868
..........................................................................................................................................................................................................................................................................................................................................................................................Introducing
a parse error.
.............................................................................................................................................................................................................................DELAY(388893,
1)
{timestamp_ms=1617190205000}
late data for: user3_AmberBilby,AmberBilby,13,1617190205000,2021-03-31
04:36:34.753
..........................................................................................................................................................................................................Introducing
a parse error.
.......................................................................................................................................................................................................................................................................................................................................................................................................Introducing
a parse error.
......DELAY(443442, 1)
{timestamp_ms=1617190452000}
late data for: Robot-19,AmberBilby,9,1617190452000,2021-03-31 04:41:36.202
....................................................................[WARNING]
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0 (Native Method)
at java.lang.Thread.start (Thread.java:717)
at org.apache.beam.examples.complete.game.injector.Injector.main
(Injector.java:439)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
at java.lang.Thread.run (Thread.java:748)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:53 min
[INFO] Finished at: 2021-03-31T11:42:10Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class. unable to create new native thread -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] Failed command
> Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflowBom FAILED
> Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow
Repository URL: https://repository.apache.org/content/repositories/snapshots
Version: 2.30.0-SNAPSHOT
GCS Project: apache-beam-testing
GCS Region: us-central1
GCS Storage bucket:
temp-storage-for-release-validation-tests/nightly-snapshot-validation
BigQuery Dataset: beam_postrelease_mobile_gaming
PubSub Topic: java_mobile_gaming_topic
**************************************
* Scenario: Run Apache Beam Java SDK Mobile Gaming Examples - Dataflow
**************************************
mvn archetype:generate --update-snapshots
-DarchetypeGroupId=org.apache.beam
-DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples
-DarchetypeVersion=2.30.0-SNAPSHOT -DgroupId=org.example
-DartifactId=word-count-beam -Dversion="0.1"
-Dpackage=org.apache.beam.examples -DinteractiveMode=false
Using maven /home/jenkins/tools/maven/apache-maven-3.5.4
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Cannot create GC thread. Out of system resources.
# An error report file with more information is saved as:
# /tmp/groovy-generated-8338542721712069233-tmpdir/hs_err_pid11417.log
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Cannot create GC thread. Out of system resources.
# An error report file with more information is saved as:
# /tmp/groovy-generated-8338542721712069233-tmpdir/hs_err_pid11417.log
[ERROR] Failed command
> Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflowBom'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 41m 40s
9 actionable tasks: 8 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/n65tqupkdx4bi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
