Luke, Thank you for checking. Then I'll wait a day or two before retrying. On Thu, Jan 30, 2020 at 1:54 PM Luke Cwik <[email protected]> wrote: > > Logs don't provide any insight. There has been an issue with streaming engine > that has been impacting availability over the past few days which might be > the cause. > > This is the entirety of the logs: > I 2020-01-28T18:12:05.491Z Loading pipeline options from > /var/opt/google/dataflow/pipeline_options.json > I 2020-01-28T18:12:05.522Z Worker harness starting with: > {"display_data":[{"key":"enableStreamingEngine","namespace":"org.apache.beam.sdk.extensions.gcp.options.GcpOptions","type":"BOOLEAN","value":true},{"key":"filesToStage","namespace":"org.apache.beam.sdk.options.PortablePipelineOptions","type":"STRING","value":"[dataflow-worker.jar=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/runners/google-cloud-dataflow-java/worker/legacy-worker/build/libs/beam-runners-google-cloud-dataflow-java-legacy-worker-2.20.0-SNAPSHOT.jar, > /home/jenkins/.gradle/caches/5.2.1/workerMain/gradle-worker.jar, > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/examples/java/build/libs/beam-examples-java-2.20.0-SNAPSHOT.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/examples/java/build/libs/beam-examples-java-2.20.0-SNAPSHOT-tests.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.20.0-SNAPSHOT.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.20.0-SNAPSHOT.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.20.0-SNAPSHOT.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/runners/direct-java/build/libs/beam-runners-direct-java-2.20.0-SNAPSHOT.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/runners/core-construction-java/build/libs/beam-runners-core-construction-java-2.20.0-SNAPSHOT.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/sdks/java/extensions/protobuf/build/libs/beam-sdks-java-extensions-protobuf-2.20.0-SNAPSHOT.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/sdks/java/core/build/libs/beam-sdks-java-core-2.20.0-SNAPSHOT.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.beam/beam-vendor-guava-26_0-jre/0.1/f309c3047ca99428e567afa42d233fb3e839bde1/beam-vendor-guava-26_0-jre-0.1.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.avro/avro/1.8.2/91e3146dfff4bd510181032c8276a3a0130c0697/avro-1.8.2.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud.bigdataoss/gcsio/1.9.16/7efb0484bcdfb23038d651704b02a5a1cdb2eab0/gcsio-1.9.16.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud.bigdataoss/util/1.9.16/cd2a3a7236444b0b4b613dde06f28c0828d56df0/util-1.9.16.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-bigquery/v2-rev20181221-1.28.0/b66bc2321b4f10280a01cda97d22fd727bd85fec/google-api-services-bigquery-v2-rev20181221-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-pubsub/v1-rev20191111-1.28.0/78c876165bb915a5b8c1cadeb95733dad373ca04/google-api-services-pubsub-v1-rev20191111-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud.datastore/datastore-v1-proto-client/1.6.3/b0ffaeb68af9cb99772aa9933aa9baa0521568dc/datastore-v1-proto-client-1.6.3.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-clouddebugger/v2-rev20181114-1.28.0/18e3bcedceb100f9cd89d7cd74f75e1c801e7593/google-api-services-clouddebugger-v2-rev20181114-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-dataflow/v1b3-rev20190927-1.28.0/3c304fabaf838526e1706336b6755c0d95e44acb/google-api-services-dataflow-v1b3-rev20190927-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-storage/v1-rev20181109-1.28.0/ccbb726bd6635bdcf8af8a497c6dd1876c838352/google-api-services-storage-v1-rev20181109-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-cloudresourcemanager/v1-rev20181015-1.28.0/ec27d81a63b330021b5a50cc84b9d3b8c4935fff/google-api-services-cloudresourcemanager-v1-rev20181015-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api-client/google-api-client-java6/1.28.0/cf6dce2d709cf3796c034ff91c5dbb2622a7626b/google-api-client-java6-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api-client/google-api-client-jackson2/1.28.0/45c71063b3366a65c8997dbbcdc530390105593d/google-api-client-jackson2-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud.bigtable/bigtable-client-core/1.8.0/4aa5411c0bbef7da4648b6d0f4ee38e0b973ba84/bigtable-client-core-1.8.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/google-cloud-core-http/1.55.0/f26862445efffd8cb3a7f4b1f2a91b7c5143ee1f/google-cloud-core-http-1.55.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api-client/google-api-client/1.28.0/8fe155d766ed22480939e3a9db428151e0264d9e/google-api-client-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/google-cloud-bigquerystorage/0.79.0-alpha/b90df982391db2d31658c594297bb4374b18bf71/google-cloud-bigquerystorage-0.79.0-alpha.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/google-cloud-spanner/1.6.0/ddc9fdb7ae6ec41ca8a192c35f2de652bbd1457d/google-cloud-spanner-1.6.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/google-cloud-bigtable/0.73.0-alpha/4e7f6b1c48d50596d671fabc0ec8a4d0ff4a99ee/google-cloud-bigtable-0.73.0-alpha.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/google-cloud-bigtable-admin/0.73.0-alpha/1264779d56cb41bfe62e9efe4087acaa034f40da/google-cloud-bigtable-admin-0.73.0-alpha.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/google-cloud-core-grpc/1.61.0/c3ce1e4bcea8721387abff989a1e1ef696b2ddb9/google-cloud-core-grpc-1.61.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api/gax-grpc/1.52.0/fbf8a14d7d45e1f578418368adda769bb911a747/gax-grpc-1.52.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/google-cloud-core/1.61.0/4b1cd5a15a6677c7f706a20aa360ebfb0a394916/google-cloud-core-1.61.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api/gax-httpjson/0.52.0/4d6244c39755abc766010d696af215e15660cb3b/gax-httpjson-0.52.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api/gax/1.52.0/f386e4e022bb0eb415cbbf8ce927d473b002d101/gax-1.52.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-alts/1.25.0/21fb2e850b8b83c2f676177d6b6aa0a638b7c6c2/grpc-alts-1.25.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.auth/google-auth-library-oauth2-http/0.19.0/284f264012d80bb0f882a667f88b74a5972d6a68/google-auth-library-oauth2-http-0.19.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-all/1.25.0/12a5b0b6ce6ff9bd9b9372986844f9e440f2e765/grpc-all-1.25.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-auth/1.25.0/abaddb5ca4379bf8b2c7d2c207b4243fe36ac8d1/grpc-auth-1.25.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.auth/google-auth-library-credentials/0.19.0/f58b35cb48e695bc840d1b2441b3cfd9ead26ee2/google-auth-library-credentials-0.19.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.http-client/google-http-client-jackson2/1.34.0/417e7f7e88376fbca6073264da97d201611acf1f/google-http-client-jackson2-1.34.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.oauth-client/google-oauth-client-java6/1.28.0/30c46cec6206ec82d00607fe301c96d118e8156e/google-oauth-client-java6-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.oauth-client/google-oauth-client/1.28.0/9a9e5d0c33b663d6475c96ce79b2949545a113af/google-oauth-client-1.28.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.http-client/google-http-client-apache/2.0.0/e5c56c91a458ed20c20bd3049352ffbb70ecccd/google-http-client-apache-2.0.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.http-client/google-http-client-protobuf/1.34.0/ed786bd3e877e57cf776de4c3103e26b19261704/google-http-client-protobuf-1.34.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.http-client/google-http-client-appengine/1.27.0/c892123da632a28d413739e3f9fb6ae733467fde/google-http-client-appengine-1.27.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.http-client/google-http-client/1.34.0/263190d4ea87727af0d632d40ee4dc40716b1597/google-http-client-1.34.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/joda-time/joda-time/2.10.3/2e5366cf1f77ca3bafffecf6e87d30e1d504e959/joda-time-2.10.3.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-datastore-v1/0.44.0/1e15374d8b08ceb63a8852abdf580ee0e531f996/proto-google-cloud-datastore-v1-0.44.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.25/bccda40ebc8067491b32a88f49615a747d20082d/slf4j-jdk14-1.7.25.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/model/pipeline/build/libs/beam-model-pipeline-2.20.0-SNAPSHOT.jar, > > /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Examples_Dataflow_Commit/src/model/job-management/build/libs/beam-model-job-management-2.20.0-SNAPSHOT.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.beam/beam-vendor-grpc-1_26_0/0.1/da5d64b51784f6b7dd91d43f0a64c63b42f1cb5c/beam-vendor-grpc-1_26_0-0.1.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/io.dropwizard.metrics/metrics-core/3.1.2/224f03afd2521c6c94632f566beb1bb5ee32cf07/metrics-core-3.1.2.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.25/da76ca59f6a57ee3102f8f9bd9cee742973efa8a/slf4j-api-1.7.25.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.hamcrest/hamcrest-library/2.1/42edeb45e615925992d79263e9e744a857cfbcd0/hamcrest-library-2.1.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-testing/1.25.0/2d402385c88c95716e8dc51e30cd735819acd27a/grpc-testing-1.25.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/junit/junit/4.13-beta-3/24e695de7450859f58dcfb2d818af908aee93e36/junit-4.13-beta-3.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.hamcrest/hamcrest-core/2.1/70dd49dea4507315b1fa3bc1aa59b1442d55957a/hamcrest-core-2.1.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.mockito/mockito-core/3.0.0/15fd0225cb1858f6922f44776b1577ac26739279/mockito-core-3.0.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.9.10/e201bb70b7469ba18dd58ed8268aa44e702fa2f0/jackson-databind-2.9.10.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.9.10/53ab2f0f92e87ea4874c8c6997335c211d81e636/jackson-annotations-2.9.10.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.9.10/66b715dec9dd8b0f39f3296e67e05913bf422d0c/jackson-core-2.9.10.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.beam/beam-vendor-bytebuddy-1_9_3/0.1/83add786c852ba6b80aeb59c7739c3b91f70c1c1/beam-vendor-bytebuddy-1_9_3-0.1.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/io.opencensus/opencensus-contrib-http-util/0.24.0/6d96406c272d884038eb63b262458df75b5445/opencensus-contrib-http-util-0.24.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-bigquerystorage-v1beta1/0.44.0/ab8ac5718067a74a49b9c60b8bec43e7feb9a8c1/grpc-google-cloud-bigquerystorage-v1beta1-0.44.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-bigquerystorage-v1beta1/0.83.0/96b8cc222bd1b0f1af5cfd32be01f43bf792b36b/proto-google-cloud-bigquerystorage-v1beta1-0.83.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-bigtable-v2/0.38.0/a20f6589a0159fc16b6802da08a10651f71da32f/grpc-google-cloud-bigtable-v2-0.38.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-bigtable-v2/0.44.0/f80d2580e2326dc8e9c8d8ca108b248aa08edb3a/proto-google-cloud-bigtable-v2-0.44.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-pubsub-v1/1.83.0/8271cf2ba1093be1d42dacaf151a3b293ae37a2d/grpc-google-cloud-pubsub-v1-1.83.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-pubsub-v1/1.83.0/31aafb122ff8f1ba0b745ce88e748a14b25f0948/proto-google-cloud-pubsub-v1-1.83.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-spanner-admin-database-v1/1.6.0/8b145becb1a464aea4b37fb970e851b4899d422/grpc-google-cloud-spanner-admin-database-v1-1.6.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-spanner-admin-database-v1/1.6.0/135c9c799e8a37d5620c1f4e283a0b0222aae893/proto-google-cloud-spanner-admin-database-v1-1.6.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-bigtable-admin-v2/0.38.0/f37df3b0c9f82602cbcbfacd0af9b489c0253833/grpc-google-cloud-bigtable-admin-v2-0.38.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-bigtable-admin-v2/0.38.0/90e68bed64c819e36b729d8c80a2b8f868aeb2ad/proto-google-cloud-bigtable-admin-v2-0.38.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-spanner-v1/1.6.0/68ed47008a07f93c1b12d9df83ae026b5f4a6ecd/grpc-google-cloud-spanner-v1-1.6.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-spanner-v1/1.6.0/2f13df6e1c26bf1c23343c41cf46639824ab2d08/proto-google-cloud-spanner-v1-1.6.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-spanner-admin-instance-v1/1.6.0/4473eb42d774e8b5a392f111fdb36a05e8132dc4/grpc-google-cloud-spanner-admin-instance-v1-1.6.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-spanner-admin-instance-v1/1.6.0/679d26046fadb8a0e6ca87da173a337241526aa7/proto-google-cloud-spanner-admin-instance-v1-1.6.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-iam-v1/0.13.0/ed3d62b64aa23a3decf324c8988eb4aae9f36e94/proto-google-iam-v1-0.13.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api/api-common/1.8.1/e89befb19b08ad84b262b2f226ab79aefcaa9d7f/api-common-1.8.1.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-common-protos/1.12.0/6d8ff32d4e9817f3a5d6ffbe66347b2716b6239/grpc-google-common-protos-1.12.0.jar, > > /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-grpclb/1.25.0/20cc26de663108931b036a92d3b > [...] > jackson-annotations-2.9.10.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.9.10/66b715dec9dd8b0f39f3296e67e05913bf422d0c/jackson-core-2.9.10.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.beam/beam-vendor-bytebuddy-1_9_3/0.1/83add786c852ba6b80aeb59c7739c3b91f70c1c1/beam-vendor-bytebuddy-1_9_3-0.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.opencensus/opencensus-contrib-http-util/0.24.0/6d96406c272d884038eb63b262458df75b5445/opencensus-contrib-http-util-0.24.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-bigquerystorage-v1beta1/0.44.0/ab8ac5718067a74a49b9c60b8bec43e7feb9a8c1/grpc-google-cloud-bigquerystorage-v1beta1-0.44.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-bigquerystorage-v1beta1/0.83.0/96b8cc222bd1b0f1af5cfd32be01f43bf792b36b/proto-google-cloud-bigquerystorage-v1beta1-0.83.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-bigtable-v2/0.38.0/a20f6589a0159fc16b6802da08a10651f71da32f/grpc-google-cloud-bigtable-v2-0.38.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-bigtable-v2/0.44.0/f80d2580e2326dc8e9c8d8ca108b248aa08edb3a/proto-google-cloud-bigtable-v2-0.44.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-pubsub-v1/1.83.0/8271cf2ba1093be1d42dacaf151a3b293ae37a2d/grpc-google-cloud-pubsub-v1-1.83.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-pubsub-v1/1.83.0/31aafb122ff8f1ba0b745ce88e748a14b25f0948/proto-google-cloud-pubsub-v1-1.83.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-spanner-admin-database-v1/1.6.0/8b145becb1a464aea4b37fb970e851b4899d422/grpc-google-cloud-spanner-admin-database-v1-1.6.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-spanner-admin-database-v1/1.6.0/135c9c799e8a37d5620c1f4e283a0b0222aae893/proto-google-cloud-spanner-admin-database-v1-1.6.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-bigtable-admin-v2/0.38.0/f37df3b0c9f82602cbcbfacd0af9b489c0253833/grpc-google-cloud-bigtable-admin-v2-0.38.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-bigtable-admin-v2/0.38.0/90e68bed64c819e36b729d8c80a2b8f868aeb2ad/proto-google-cloud-bigtable-admin-v2-0.38.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-spanner-v1/1.6.0/68ed47008a07f93c1b12d9df83ae026b5f4a6ecd/grpc-google-cloud-spanner-v1-1.6.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-spanner-v1/1.6.0/2f13df6e1c26bf1c23343c41cf46639824ab2d08/proto-google-cloud-spanner-v1-1.6.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-spanner-admin-instance-v1/1.6.0/4473eb42d774e8b5a392f111fdb36a05e8132dc4/grpc-google-cloud-spanner-admin-instance-v1-1.6.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-spanner-admin-instance-v1/1.6.0/679d26046fadb8a0e6ca87da173a337241526aa7/proto-google-cloud-spanner-admin-instance-v1-1.6.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-iam-v1/0.13.0/ed3d62b64aa23a3decf324c8988eb4aae9f36e94/proto-google-iam-v1-0.13.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api/api-common/1.8.1/e89befb19b08ad84b262b2f226ab79aefcaa9d7f/api-common-1.8.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-common-protos/1.12.0/6d8ff32d4e9817f3a5d6ffbe66347b2716b6239/grpc-google-common-protos-1.12.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-grpclb/1.25.0/20cc26de663108931b036a92d3b1bbf598cbf089/grpc-grpclb-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-protobuf/1.25.0/43ef1166fd0025025fb19135b602db9837a3d1d0/grpc-protobuf-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.protobuf/protobuf-java-util/3.11.1/60044bdc3b6621a5fd39c4e393d0cc894c2dbf36/protobuf-java-util-3.11.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-netty/1.25.0/71097cf355c5b3e37f32e621e56ee5062d0e95cf/grpc-netty-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-netty-shaded/1.25.0/624a78dfc19d9d5a17d80af6242fdbb2e510c787/grpc-netty-shaded-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.opencensus/opencensus-contrib-grpc-util/0.17.0/cf4503818662a18c801e52d8988055d8401978ea/opencensus-contrib-grpc-util-0.17.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-okhttp/1.25.0/6332dbf381b4683f14cd3649d3425a979d677e67/grpc-okhttp-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-core/1.25.0/651fcf1a6702483ac7321b3ae983001beb3a1ddb/grpc-core-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-stub/1.25.0/83685dceca042f2ca1d50f17f7eb280e751ecc4/grpc-stub-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-protobuf-lite/1.25.0/6d010a8561443bcdb7ee26528440b8b8562ff1b3/grpc-protobuf-lite-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-api/1.25.0/414be0ed1690f3594fa2659d1ffedfc16d4b83ab/grpc-api-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.guava/guava/25.1-jre/6c57e4b22b44e89e548b5c9f70f0c45fe10fb0b4/guava-25.1-jre.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.flogger/google-extensions/0.3.1/9c206a35c2b1a6108f6a61cf82c00314a878b792/google-extensions-0.3.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.flogger/flogger-system-backend/0.3.1/287b569d76abcd82f9de87fe41829fbc7ebd8ac9/flogger-system-backend-0.3.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.perfmark/perfmark-api/0.19.0/2bfc352777fa6e27ad1e11d11ea55651ba93236b/perfmark-api-0.19.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.flogger/flogger/0.3.1/585030fe1ec709760cbef997a459729fb965df0e/flogger-0.3.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.code.findbugs/jsr305/3.0.2/25ea2e8b0c338a877313bd4672d3fe056ea78f0d/jsr305-3.0.2.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.xerial.snappy/snappy-java/1.1.4/d94ae6d7d27242eaa4b6c323f881edbb98e48da6/snappy-java-1.1.4.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.tukaani/xz/1.8/c4f7d054303948eb6a4066194253886c8af07128/xz-1.8.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.opencensus/opencensus-contrib-grpc-metrics/0.21.0/f07d3a325f1fe69ee40d6b409086964edfef4e69/opencensus-contrib-grpc-metrics-0.21.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.opencensus/opencensus-api/0.24.0/f974451b19007ce820f433311ce8adb88e2b7d2c/opencensus-api-0.24.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-context/1.25.0/eebabd88cab3bb27ecd309eb244faa143385efc0/grpc-context-1.25.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.42.Final/819e7b5f2005770cf7558c04276fff080331c6df/netty-codec-http2-4.1.42.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.42.Final/7b816d9f37ddcb68f6c1b9b0d7b5a98bfac40911/netty-handler-proxy-4.1.42.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.42.Final/5f71267aa784d0e6c5ec09fb988339d244b205a0/netty-codec-http-4.1.42.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.30.Final/ecc076332ed103411347f4806a44ee32d9d9cb5f/netty-handler-4.1.30.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.17.Final/b1e5acbde8c444c656131238ac6ab9e73f694300/netty-tcnative-boringssl-static-2.0.17.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-common-protos/1.17.0/40471bf2045151c17da555889b5550fcfd5224a8/proto-google-common-protos-1.17.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.protobuf/protobuf-java/3.11.1/1752390841a56e112b01990c9b523e6978abb24f/protobuf-java-3.11.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-mapper-asl/1.9.13/1ee2f2bed0e5dd29d1cb155a166e6f8d50bbddb7/jackson-mapper-asl-1.9.13.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-core-asl/1.9.13/3c304d70f42f832e0a86d45bd437f692129299a4/jackson-core-asl-1.9.13.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.thoughtworks.paranamer/paranamer/2.7/3ed64c69e882a324a75e890024c32a28aff0ade8/paranamer-2.7.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-compress/1.19/7e65777fb451ddab6a9c054beb879e521b7eab78/commons-compress-1.19.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.auto.value/auto-value-annotations/1.7/5be124948ebdc7807df68207f35a0f23ce427f29/auto-value-annotations-1.7.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.httpcomponents/httpclient/4.5.10/7ca2e4276f4ef95e4db725a8cd4a1d1e7585b9e5/httpclient-4.5.10.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.httpcomponents/httpcore/4.4.12/21ebaf6d532bc350ba95bd81938fa5f0e511c132/httpcore-4.4.12.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.j2objc/j2objc-annotations/1.3/ba035118bc8bac37d7eff77700720999acd9986d/j2objc-annotations-1.3.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/javax.annotation/javax.annotation-api/1.3.2/934c04d3cfef185a8008e7bf34331b79730a9d43/javax.annotation-api-1.3.2.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/args4j/args4j/2.33/bd87a75374a6d6523de82fef51fc3cfe9baf9fc9/args4j-2.33.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.hamcrest/hamcrest/2.1/9420ba32c29217b54eebd26ff7f9234d31c3fbb2/hamcrest-2.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/net.bytebuddy/byte-buddy/1.9.10/211a2b4d3df1eeef2a6cacf78d74a1f725e7a840/byte-buddy-1.9.10.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/net.bytebuddy/byte-buddy-agent/1.9.10/9674aba5ee793e54b864952b001166848da0f26b/byte-buddy-agent-1.9.10.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.objenesis/objenesis/2.6/639033469776fd37c08358c6b92a4761feb2af4b/objenesis-2.6.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/error_prone_annotations/2.0.15/822652ed7196d119b35d2e22eb9cd4ffda11e640/error_prone_annotations-2.0.15.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/commons-logging/commons-logging/1.2/4bfc12adfe4842bf07b657f0369c4cb522955686/commons-logging-1.2.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.6.2/bd1b74a5d170686362091c7cf596bbc3adf5c09b/log4j-api-2.6.2.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.github.classgraph/classgraph/4.8.56/c65ae26a9e573b430b287a69d9cd1b51fcd6b599/classgraph-4.8.56.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.threeten/threetenbp/1.3.3/3ea31c96676ff12ab56be0b1af6fff61d1a4f1f2/threetenbp-1.3.3.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.code.gson/gson/2.8.6/9180733b7df8542621dc12e21e87557e8c99b8cb/gson-2.8.6.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.android/annotations/4.1.1.4/a1678ba907bf92691d879fef34e1a187038f9259/annotations-4.1.1.4.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.checkerframework/checker-qual/2.0.0/518929596ee3249127502a8573b2e008e2d51ed3/checker-qual-2.0.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.codehaus.mojo/animal-sniffer-annotations/1.17/f97ce6decaea32b36101e37979f8b647f00681fb/animal-sniffer-annotations-1.17.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.42.Final/dd355f01dc00f93aaebe805b05026d7cf57c60ec/netty-codec-socks-4.1.42.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.42.Final/b1d5ed85a558fbbadc2783f869fbd0adcd32b07b/netty-codec-4.1.42.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.42.Final/857502e863c02c829fdafea61c3fda6bda01d0af/netty-transport-4.1.42.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.42.Final/6e6fc9178d1f1401aa0d6b843341efb91720f2cd/netty-buffer-4.1.42.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/commons-codec/commons-codec/1.14/3cb1181b2141a7e752f5bdc998b7ef1849f726cf/commons-codec-1.14.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-lang3/3.9/122c7cee69b53ed4a7681c03d4ee4c0e2765da5/commons-lang3-3.9.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/org.conscrypt/conscrypt-openjdk-uber/2.2.1/59a346d64c0ddca750c5c877e274d5e6278e53ce/conscrypt-openjdk-uber-2.2.1.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.squareup.okio/okio/1.13.0/a9283170b7305c8d92d25aff02a6ab7e45d06cbe/okio-1.13.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/com.squareup.okhttp/okhttp/2.5.0/4de2b4ed3445c37ec1720a7d214712e845a24636/okhttp-2.5.0.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.42.Final/ccaacf418a9e486b65e82c47bed66439119c5fdb/netty-resolver-4.1.42.Final.jar","/home/jenkins/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.42.Final/e02700b574d3a0e2100308f971f0753ac8700e7c/netty-common-4.1.42.Final.jar"],"gcpTempLocation":"gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0128181056-28c844f3/output/results","gcsPerformanceMetrics":false,"gcsUploadBufferSizeBytes":1048576,"inputFile":"gs://apache-beam-samples/shakespeare/winterstale-personae","jobName":"testpipeline-jenkins-0128181056-28c844f3","maxNumWorkers":0,"numWorkers":1,"numberOfWorkerHarnessThreads":0,"optionsId":0,"output":"gs://temp-storage-for-end-to-end-tests/WordCountIT-2020-01-28-18-10-56-846/output/results","pathValidatorClass":"org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator","pipelineUrl":"gs://temp-storage-for-end-to-end-tests//testpipeline-jenkins-0128181056-28c844f3/output/results/staging/pipeline--O-4jZ6_m4-7kbkqc1gcAw.pb","project":"apache-beam-testing","runner":"org.apache.beam.runners.dataflow.TestDataflowRunner","stableUniqueNames":"ERROR","stagerClass":"org.apache.beam.runners.dataflow.util.GcsStager","stagingLocation":"gs://temp-storage-for-end-to-end-tests//testpipeline-jenkins-0128181056-28c844f3/output/results/staging/","streaming":true,"tempLocation":"gs://temp-storage-for-end-to-end-tests//testpipeline-jenkins-0128181056-28c844f3/output/results","tempRoot":"gs://temp-storage-for-end-to-end-tests/","userAgent":"Apache_Beam_SDK_for_Java/2.20.0-SNAPSHOT(JRE_8_environment)","workerHarnessContainerImage":""}} > I 2020-01-28T18:12:07.231Z Not using conscrypt SSL. Note this is the default > Java behavior, but may have reduced performance. To use conscrypt SSL pass > pipeline option --experiments=enable_conscrypt_security_provider > I 2020-01-28T18:12:08.112Z Logging initialized @4180ms > W 2020-01-28T18:12:08.186Z Region will default to us-central1. Future > releases of Beam will require the user to set the region explicitly. > https://cloud.google.com/compute/docs/regions-zones/regions-zones > I 2020-01-28T18:12:08.250Z jetty-9.2.z-SNAPSHOT > I 2020-01-28T18:12:08.345Z Started > ServerConnector@52960f75{HTTP/1.1}{0.0.0.0:8081} > I 2020-01-28T18:12:08.346Z Started @4414ms > I 2020-01-28T18:12:08.346Z Status server started on http://10.128.0.32:8081/ > I 2020-01-28T18:12:08.347Z Sending request to get global configuration for > this worker > I 2020-01-28T18:12:09.660Z Setting maxWorkItemCommitBytes to 188743680 > I 2020-01-28T18:12:09.672Z Creating a new windmill stub, endpoints: > [us-central1-dataflowstreaming-pa.googleapis.com:443] > I 2020-01-28T18:12:09.672Z Previous windmill stub endpoints: [] > I 2020-01-28T18:12:09.673Z Initializing Streaming Engine GRPC client for > endpoints: [us-central1-dataflowstreaming-pa.googleapis.com:443] > I 2020-01-28T18:12:10.090Z windmillServerStub is now ready > I 2020-01-28T18:12:10.101Z Dispatch starting > I 2020-01-28T18:12:25.114Z Memory is used/total/max = 189/312/5052 MB, GC > last/max = 1.45/1.45 %, #pushbacks=0, gc thrashing=false > I 2020-01-28T18:17:25.118Z Memory is used/total/max = 134/442/5052 MB, GC > last/max = 0.00/1.45 %, #pushbacks=0, gc thrashing=false > > On Wed, Jan 29, 2020 at 8:18 PM Tomo Suzuki <[email protected]> wrote: >> >> Hi Beam developers, >> >> I filed a ticket BEAM-9224 "flaky WordCountIT.testE2EWordCount in >> Jenkins Java_Examples_Dataflow Job". The trend [1] shows the flakiness >> started around Jan 28 13:00 ET (Build #6538 [2]). >> >> Example job failure is in [3]. This Jenkins log does not provide why it >> failed: >> java.lang.RuntimeException: Dataflow job >> 2020-01-28_10_11_07-12281678733591188188 terminated in state >> UNRECOGNIZED but did not return a failure reason. >> >> I appreciate if someone with entitlement can check the Stackdriver >> logs for the failed E2E tests. >> >> [1]: >> https://builds.apache.org/job/beam_PreCommit_Java_Examples_Dataflow_Commit/ >> [2]: >> https://builds.apache.org/job/beam_PreCommit_Java_Examples_Dataflow_Commit/6538/ >> [3]: >> https://builds.apache.org/job/beam_PreCommit_Java_Examples_Dataflow_Commit/6554/testReport/junit/org.apache.beam.examples/WordCountIT/ >> >> -- >> Regards, >> Tomo
-- Regards, Tomo
