See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/81/display/redirect>
------------------------------------------
[...truncated 75.41 KB...]
*****
*****
* Test: Running: LeaderBoard example on DirectRunner
*****
bq rm -f -t beam_postrelease_mobile_gaming.leaderboard_user
bq rm -f -t beam_postrelease_mobile_gaming.leaderboard_team
sleep 20
mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.complete.game.injector.Injector
-Dexec.args="apache-beam-testing java_mobile_gaming_topic none"
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-7083741585172379783-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
Injecting to topic: projects/apache-beam-testing/topics/java_mobile_gaming_topic
Starting Injector
[+(FuchsiaWallaby, num members: 10, starting at: 1520303771634, expires in: 21,
robot: Robot-18)]
[+(ArmyGreenMarmot, num members: 11, starting at: 1520303771635, expires in:
33, robot: null)]
[+(AzureCassowary, num members: 15, starting at: 1520303771635, expires in: 24,
robot: null)]
[+(BisqueWallaby, num members: 18, starting at: 1520303771636, expires in: 39,
robot: null)]
[+(BananaMarmot, num members: 9, starting at: 1520303771642, expires in: 20,
robot: null)]
[+(AliceBlueCassowary, num members: 13, starting at: 1520303771643, expires in:
28, robot: null)]
[+(AuburnWallaby, num members: 15, starting at: 1520303771643, expires in: 34,
robot: Robot-5)]
[+(BattleshipGreyQuokka, num members: 8, starting at: 1520303771643, expires
in: 33, robot: null)]
[+(AmaranthMarmot, num members: 8, starting at: 1520303771644, expires in: 26,
robot: null)]
[+(BattleshipGreyNumbat, num members: 13, starting at: 1520303771644, expires
in: 38, robot: null)]
[+(AliceBluePlatypus, num members: 6, starting at: 1520303771644, expires in:
29, robot: null)]
[+(BattleshipGreyBilby, num members: 12, starting at: 1520303771644, expires
in: 33, robot: Robot-15)]
[+(AlmondQuokka, num members: 14, starting at: 1520303771645, expires in: 22,
robot: null)]
[+(BisqueEchidna, num members: 17, starting at: 1520303771646, expires in: 31,
robot: Robot-9)]
[+(BananaBandicoot, num members: 12, starting at: 1520303771646, expires in:
35, robot: null)]
DELAY(547052, 1)
{timestamp_ms=1520303224000}
late data for: user0_BananaBandicoot,BananaBandicoot,3,1520303224000,2018-03-05
18:36:11.652
sleep 660
mvn compile exec:java -q
-Dexec.mainClass=org.apache.beam.examples.complete.game.LeaderBoard
-Dexec.args="--project=apache-beam-testing
--tempLocation=gs://temp-storage-for-release-validation-tests/mobile-gaming/tmp
--dataset=beam_postrelease_mobile_gaming
--topic=projects/apache-beam-testing/topics/java_mobile_gaming_topic
--output=gs://temp-storage-for-release-validation-tests/mobile-gaming/java-leaderboard-result.txt"
-Pdirect-runner
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
Mar 06, 2018 2:36:36 AM org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource
createRandomSubscription
WARNING: Created subscription
projects/apache-beam-testing/subscriptions/java_mobile_gaming_topic_beam_6897384566422245564
to topic projects/apache-beam-testing/topics/java_mobile_gaming_topic. Note
this subscription WILL NOT be deleted when the pipeline terminates
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(428888,
1)
{timestamp_ms=1520303644000}
late data for:
user2_BattleshipGreyQuokka,BattleshipGreyQuokka,19,1520303644000,2018-03-05
18:41:13.150
.....Introducing a parse error.
Mar 06, 2018 2:41:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl
createTable
INFO: Trying to create BigQuery table:
apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_team
..........................................................................................................................................................................Introducing
a parse error.
..................................................................................................................................................................................................................................................................Introducing
a parse error.
......................................................................................................................................................................DELAY(323170,
1)
{timestamp_ms=1520304051000}
late data for: user10_AlmondQuokka,AlmondQuokka,10,1520304051000,2018-03-05
18:46:14.205
Mar 06, 2018 2:46:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl
createTable
INFO: Trying to create BigQuery table:
apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_user
Exception in thread "main" groovy.lang.MissingPropertyException: No such
property: LeaderBoardThread for class: mobile_gaming-java-direct
at
org.codehaus.groovy.runtime.ScriptBytecodeAdapter.unwrap(ScriptBytecodeAdapter.java:53)
at
org.codehaus.groovy.runtime.callsite.PogoGetPropertySite.getProperty(PogoGetPropertySite.java:52)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callGroovyObjectGetProperty(AbstractCallSite.java:307)
at mobile_gaming-java-direct.run(mobile_gaming-java-direct.groovy:102)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1213)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1022)
at
org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:925)
at
org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:908)
at
org.codehaus.groovy.runtime.InvokerHelper.runScript(InvokerHelper.java:412)
at org.codehaus.groovy.runtime.InvokerHelper$runScript.call(Unknown
Source)
at
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:133)
at mobile_gaming-java-direct.main(mobile_gaming-java-direct.groovy)
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(300174,
1)
{timestamp_ms=1520304375000}
late data for:
user0_BattleshipGreyQuokka,BattleshipGreyQuokka,10,1520304375000,2018-03-05
18:51:16.129
Mar 06, 2018 2:53:36 AM
org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS LINE REPRESENTS CORRUPT DATA AND WILL CAUSE A PARSE
ERROR,1520304075000,2018-03-05 18:41:15.665, For input string: "2018-03-05
18:41:15.665"
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................Introducing
a parse error.
...................................
team (BananaMarmot, num members: 9, starting at: 1520303771642, expires in: 20,
robot: null) is too old; replacing.
start time: 1520303771642, end time: 1520304971642, current time:1520304972040
[-(BananaMarmot, num members: 9, starting at: 1520303771642, expires in: 20,
robot: null)]
[+(ArmyGreenCockatoo, num members: 14, starting at: 1520304972041, expires in:
26, robot: null)]
.............DELAY(327780, 1)
{timestamp_ms=1520304651000}
late data for:
user4_AliceBluePlatypus,AliceBluePlatypus,4,1520304651000,2018-03-05
18:56:19.112
.........................................................................................................
team (FuchsiaWallaby, num members: 10, starting at: 1520303771634, expires in:
21, robot: Robot-18) is too old; replacing.
start time: 1520303771634, end time: 1520305031634, current time:1520305032008
[-(FuchsiaWallaby, num members: 10, starting at: 1520303771634, expires in: 21,
robot: Robot-18)]
[+(AliceBluePlatypus, num members: 11, starting at: 1520305032009, expires in:
31, robot: null)]
.......................................................................................................................
team (AlmondQuokka, num members: 14, starting at: 1520303771645, expires in:
22, robot: null) is too old; replacing.
start time: 1520303771645, end time: 1520305091645, current time:1520305091989
[-(AlmondQuokka, num members: 14, starting at: 1520303771645, expires in: 22,
robot: null)]
[+(BananaBilby, num members: 15, starting at: 1520305091989, expires in: 21,
robot: Robot-0)]
..............................................................................................................................................................................................................................................
team (AzureCassowary, num members: 15, starting at: 1520303771635, expires in:
24, robot: null) is too old; replacing.
start time: 1520303771635, end time: 1520305211635, current time:1520305212022
[-(AzureCassowary, num members: 15, starting at: 1520303771635, expires in: 24,
robot: null)]
[+(AmberEchidna, num members: 15, starting at: 1520305212023, expires in: 39,
robot: null)]
.........................................................................................................................................DELAY(484992,
1)
{timestamp_ms=1520304796000}
late data for:
user7_AliceBlueCassowary,AliceBlueCassowary,9,1520304796000,2018-03-05
19:01:21.419
....................................................................................................
team (AmaranthMarmot, num members: 8, starting at: 1520303771644, expires in:
26, robot: null) is too old; replacing.
start time: 1520303771644, end time: 1520305331644, current time:1520305331756
[-(AmaranthMarmot, num members: 8, starting at: 1520303771644, expires in: 26,
robot: null)]
[+(BarnRedKangaroo, num members: 12, starting at: 1520305331757, expires in:
38, robot: Robot-5)]
...............................................................................................................................................................................................................................................
team (AliceBlueCassowary, num members: 13, starting at: 1520303771643, expires
in: 28, robot: null) is too old; replacing.
start time: 1520303771643, end time: 1520305451643, current time:1520305452084
[-(AliceBlueCassowary, num members: 13, starting at: 1520303771643, expires in:
28, robot: null)]
[+(RubyQuokka, num members: 8, starting at: 1520305452084, expires in: 38,
robot: null)]
.......................................................................................................................
team (AliceBluePlatypus, num members: 6, starting at: 1520303771644, expires
in: 29, robot: null) is too old; replacing.
start time: 1520303771644, end time: 1520305511644, current time:1520305512033
[-(AliceBluePlatypus, num members: 6, starting at: 1520303771644, expires in:
29, robot: null)]
[+(BisqueCaneToad, num members: 5, starting at: 1520305512033, expires in: 35,
robot: Robot-17)]
.............................................................................................................................................DELAY(517564,
1)
{timestamp_ms=1520305065000}
late data for:
user7_BattleshipGreyNumbat,BattleshipGreyNumbat,8,1520305065000,2018-03-05
19:06:23.549
................................................................................................
team (BisqueEchidna, num members: 17, starting at: 1520303771646, expires in:
31, robot: Robot-9) is too old; replacing.
start time: 1520303771646, end time: 1520305631646, current time:1520305631783
[-(BisqueEchidna, num members: 17, starting at: 1520303771646, expires in: 31,
robot: Robot-9)]
[+(AuburnPlatypus, num members: 11, starting at: 1520305631784, expires in: 28,
robot: null)]
..............................................................................................................................................................................................................................................
team (BattleshipGreyBilby, num members: 12, starting at: 1520303771644, expires
in: 33, robot: Robot-15) is too old; replacing.
start time: 1520303771644, end time: 1520305751644, current time:1520305751730
[-(BattleshipGreyBilby, num members: 12, starting at: 1520303771644, expires
in: 33, robot: Robot-15)]
[+(AquaBandicoot, num members: 15, starting at: 1520305751730, expires in: 32,
robot: null)]
team (BattleshipGreyQuokka, num members: 8, starting at: 1520303771643, expires
in: 33, robot: null) is too old; replacing.
start time: 1520303771643, end time: 1520305751643, current time:1520305751731
[-(BattleshipGreyQuokka, num members: 8, starting at: 1520303771643, expires
in: 33, robot: null)]
[+(BattleshipGreyWallaby, num members: 18, starting at: 1520305751731, expires
in: 30, robot: Robot-4)]
team (ArmyGreenMarmot, num members: 11, starting at: 1520303771635, expires in:
33, robot: null) is too old; replacing.
start time: 1520303771635, end time: 1520305751635, current time:1520305751731
[-(ArmyGreenMarmot, num members: 11, starting at: 1520303771635, expires in:
33, robot: null)]
[+(AsparagusWallaby, num members: 18, starting at: 1520305751731, expires in:
33, robot: Robot-12)]
......................Introducing a parse error.
.................................................................................................
team (AuburnWallaby, num members: 15, starting at: 1520303771643, expires in:
34, robot: Robot-5) is too old; replacing.
start time: 1520303771643, end time: 1520305811643, current time:1520305811656
[-(AuburnWallaby, num members: 15, starting at: 1520303771643, expires in: 34,
robot: Robot-5)]
[+(AsparagusBandicoot, num members: 11, starting at: 1520305811658, expires in:
28, robot: null)]
Mar 06, 2018 3:10:17 AM
org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS LINE REPRESENTS CORRUPT DATA AND WILL CAUSE A PARSE
ERROR,1520304160000,2018-03-05 18:42:40.918, For input string: "2018-03-05
18:42:40.918"
........................................................................................................................
team (BananaBandicoot, num members: 12, starting at: 1520303771646, expires in:
35, robot: null) is too old; replacing.
start time: 1520303771646, end time: 1520305871646, current time:1520305872085
[-(BananaBandicoot, num members: 12, starting at: 1520303771646, expires in:
35, robot: null)]
[+(AppleGreenEmu, num members: 8, starting at: 1520305872085, expires in: 39,
robot: Robot-3)]
..........................DELAY(485769, 1)
{timestamp_ms=1520305399000}
late data for:
user3_AliceBluePlatypus,AliceBluePlatypus,19,1520305399000,2018-03-05
19:11:25.663
.............................................................................................................................................................................................................................Introducing
a parse error.
.............................................................................................................
team (BattleshipGreyNumbat, num members: 13, starting at: 1520303771644,
expires in: 38, robot: null) is too old; replacing.
start time: 1520303771644, end time: 1520306051644, current time:1520306051766
[-(BattleshipGreyNumbat, num members: 13, starting at: 1520303771644, expires
in: 38, robot: null)]
[+(ArmyGreenMarmot, num members: 7, starting at: 1520306051766, expires in: 28,
robot: null)]
.......................................................................................................................
team (BisqueWallaby, num members: 18, starting at: 1520303771636, expires in:
39, robot: null) is too old; replacing.
start time: 1520303771636, end time: 1520306111636, current time:1520306111639
[-(BisqueWallaby, num members: 18, starting at: 1520303771636, expires in: 39,
robot: null)]
[+(ApricotCockatoo, num members: 13, starting at: 1520306111639, expires in:
31, robot: null)]
......................................................................................................................................................DELAY(322521,
1)
{timestamp_ms=1520305865000}
late data for:
user4_BattleshipGreyWallaby,BattleshipGreyWallaby,8,1520305865000,2018-03-05
19:16:27.721
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class.
com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
[ERROR] {
[ERROR] "code" : 404,
[ERROR] "errors" : [ {
[ERROR] "domain" : "global",
[ERROR] "message" : "Resource not found
(resource=java_mobile_gaming_topic_beam_6897384566422245564).",
[ERROR] "reason" : "notFound"
[ERROR] } ],
[ERROR] "message" : "Resource not found
(resource=java_mobile_gaming_topic_beam_6897384566422245564).",
[ERROR] "status" : "NOT_FOUND"
[ERROR] }
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
Mar 06, 2018 2:36:36 AM org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource
createRandomSubscription
WARNING: Created subscription
projects/apache-beam-testing/subscriptions/java_mobile_gaming_topic_beam_6897384566422245564
to topic projects/apache-beam-testing/topics/java_mobile_gaming_topic. Note
this subscription WILL NOT be deleted when the pipeline terminates
Mar 06, 2018 2:41:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl
createTable
INFO: Trying to create BigQuery table:
apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_team
Mar 06, 2018 2:46:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl
createTable
INFO: Trying to create BigQuery table:
apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_user
Mar 06, 2018 2:53:36 AM
org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS LINE REPRESENTS CORRUPT DATA AND WILL CAUSE A PARSE
ERROR,1520304075000,2018-03-05 18:41:15.665, For input string: "2018-03-05
18:41:15.665"
Mar 06, 2018 3:10:17 AM
org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS LINE REPRESENTS CORRUPT DATA AND WILL CAUSE A PARSE
ERROR,1520304160000,2018-03-05 18:42:40.918, For input string: "2018-03-05
18:42:40.918"
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class.
com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
[ERROR] {
[ERROR] "code" : 404,
[ERROR] "errors" : [ {
[ERROR] "domain" : "global",
[ERROR] "message" : "Resource not found
(resource=java_mobile_gaming_topic_beam_6897384566422245564).",
[ERROR] "reason" : "notFound"
[ERROR] } ],
[ERROR] "message" : "Resource not found
(resource=java_mobile_gaming_topic_beam_6897384566422245564).",
[ERROR] "status" : "NOT_FOUND"
[ERROR] }
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] Failed command
:runners:direct-java:runMobileGamingJavaDirect FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 44m 26s
2 actionable tasks: 2 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
