See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/74/display/redirect>
------------------------------------------
[...truncated 312.79 KB...]
*****
* Test: Running: HourlyTeamScore example on DirectRunner
*****
mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.complete.game.HourlyTeamScore
-Dexec.args="--tempLocation=gs://temp-storage-for-release-validation-tests/mobile-gaming/tmp
--output=java-hourlyteamscore-result.txt
--input=gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv"
-Pdirect-runner
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
Mar 05, 2018 10:09:46 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv
matched 1 files with total size 386400
Mar 05, 2018 10:09:46 PM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern
gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv
into bundles of size 96600 took 55 ms and produced 1 files and 4 bundles
Mar 05, 2018 10:09:52 PM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer a0b9659c-2417-42d5-baf9-d4054fd3d399 for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 05, 2018 10:09:52 PM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 150d8cc6-1125-466e-a801-774fdea492f2 for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 05, 2018 10:09:52 PM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 66386efb-f0ad-40fe-a4c9-0102f11f8a28 for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/150d8cc6-1125-466e-a801-774fdea492f2
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/66386efb-f0ad-40fe-a4c9-0102f11f8a28
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/a0b9659c-2417-42d5-baf9-d4054fd3d399
Mar 05, 2018 10:09:52 PM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/66386efb-f0ad-40fe-a4c9-0102f11f8a28,
shard=2, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-2-of-3
Mar 05, 2018 10:09:52 PM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/a0b9659c-2417-42d5-baf9-d4054fd3d399,
shard=1, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-1-of-3
Mar 05, 2018 10:09:52 PM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/150d8cc6-1125-466e-a801-774fdea492f2,
shard=0, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-0-of-3
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/150d8cc6-1125-466e-a801-774fdea492f2
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/a0b9659c-2417-42d5-baf9-d4054fd3d399
Mar 05, 2018 10:09:52 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-6182009802695043464-tmpdir/word-count-beam/.temp-beam-2018-03-05_22-09-43-0/66386efb-f0ad-40fe-a4c9-0102f11f8a28
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 13.516 s
[INFO] Finished at: 2018-03-05T22:09:52Z
[INFO] Final Memory: 31M/615M
[INFO] ------------------------------------------------------------------------
grep AzureBilby java-hourlyteamscore-result.txt*
java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-2-of-3:window_start:
2015-11-16 16:00:00.000, total_score: 2788, team: AzureBilby
Verified total_score: 2788, team: AzureBilby
*****
* Test: SUCCEED: HourlyTeamScore successfully run on DirectRunners.
*****
*****
* Test: Running: LeaderBoard example on DirectRunner
*****
bq rm -f -t python_leader_board_test.leaderboard_user
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
bq rm -f -t python_leader_board_test.leaderboard_team
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
gcloud pubsub topics create --project=null java_mobile_gaming_topic
Usage: gcloud [optional flags] <group | command>
group may be auth | components | compute | config | container |
dataproc | deployment-manager | dns | iam | preview |
projects | source | sql | topic
command may be docker | feedback | help | info | init | version
The *gcloud* CLI manages authentication, local configuration, developer
workflow, and interactions with the Google Cloud Platform APIs.
commonly used flags:
--account ACCOUNT Google Cloud Platform user account to use for
invocation.
--configuration CONFIGURATION
The configuration to use for this command invocation.
--format FORMAT The format for printing command output resources.
--help Display detailed help.
--project PROJECT_ID Google Cloud Platform project ID to use for this
invocation.
--quiet, -q Disable all interactive prompts.
--verbosity VERBOSITY Override the default verbosity for this command. This
must be a standard logging verbosity level: [debug,
info, warning, error, critical, none] (Default:
[warning]).
-h Print a summary help and exit.
-v, --version Print version information and exit. This flag is only
available at the global level.
other flags:
Run `gcloud --help`
for the full list of available flags for this command.
command groups:
auth Manage oauth2 credentials for the Google Cloud SDK.
components List, install, update, or remove Google Cloud SDK
components.
compute Read and manipulate Google Compute Engine resources.
config View and edit Cloud SDK properties.
container Deploy and manage clusters of machines for running
containers.
dataproc Create and manage Google Cloud Dataproc clusters and
jobs.
deployment-manager Manage deployments of cloud resources.
dns Manage your Cloud DNS managed-zones and record-sets.
iam Manage IAM service accounts and keys.
preview Manage Preview CLI command groups.
projects Manage your projects.
source Cloud git repository commands.
sql Manage Cloud SQL databases.
topic gcloud supplementary help.
commands:
docker Provides the docker CLI access to the Google Container
Registry.
feedback Provide feedback to the Google Cloud SDK team.
help Prints detailed help messages for the specified
commands.
info Display information about the current gcloud
environment.
init Initialize or reinitialize gcloud.
version Print version information for Cloud SDK components.
For more detailed information on this command and its flags, run:
gcloud --help
ERROR: (gcloud) Invalid choice: 'pubsub'.
Valid choices are [auth, components, compute, config, container, dataproc,
deployment-manager, dns, docker, feedback, help, iam, info, init, meta,
preview, projects, source, sql, topic, version].
Usage: gcloud [optional flags] <group | command>
group may be auth | components | compute | config | container |
dataproc | deployment-manager | dns | iam | preview |
projects | source | sql | topic
command may be docker | feedback | help | info | init | version
The *gcloud* CLI manages authentication, local configuration, developer
workflow, and interactions with the Google Cloud Platform APIs.
commonly used flags:
--account ACCOUNT Google Cloud Platform user account to use for
invocation.
--configuration CONFIGURATION
The configuration to use for this command invocation.
--format FORMAT The format for printing command output resources.
--help Display detailed help.
--project PROJECT_ID Google Cloud Platform project ID to use for this
invocation.
--quiet, -q Disable all interactive prompts.
--verbosity VERBOSITY Override the default verbosity for this command. This
must be a standard logging verbosity level: [debug,
info, warning, error, critical, none] (Default:
[warning]).
-h Print a summary help and exit.
-v, --version Print version information and exit. This flag is only
available at the global level.
other flags:
Run `gcloud --help`
for the full list of available flags for this command.
command groups:
auth Manage oauth2 credentials for the Google Cloud SDK.
components List, install, update, or remove Google Cloud SDK
components.
compute Read and manipulate Google Compute Engine resources.
config View and edit Cloud SDK properties.
container Deploy and manage clusters of machines for running
containers.
dataproc Create and manage Google Cloud Dataproc clusters and
jobs.
deployment-manager Manage deployments of cloud resources.
dns Manage your Cloud DNS managed-zones and record-sets.
iam Manage IAM service accounts and keys.
preview Manage Preview CLI command groups.
projects Manage your projects.
source Cloud git repository commands.
sql Manage Cloud SQL databases.
topic gcloud supplementary help.
commands:
docker Provides the docker CLI access to the Google Container
Registry.
feedback Provide feedback to the Google Cloud SDK team.
help Prints detailed help messages for the specified
commands.
info Display information about the current gcloud
environment.
init Initialize or reinitialize gcloud.
version Print version information for Cloud SDK components.
For more detailed information on this command and its flags, run:
gcloud --help
ERROR: (gcloud) Invalid choice: 'pubsub'.
Valid choices are [auth, components, compute, config, container, dataproc,
deployment-manager, dns, docker, feedback, help, iam, info, init, meta,
preview, projects, source, sql, topic, version].
[ERROR] Failed command
:runners:direct-java:runMobileGamingJavaDirect FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 12s
2 actionable tasks: 2 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure