See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/793/display/redirect?page=changes>
Changes:
[noreply] Fix small error message typo
------------------------------------------
[...truncated 7.52 MB...]
Oct 08, 2022 4:02:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74/1a919853-b8c5-43e7-a78c-5491d0bf536f.
Oct 08, 2022 4:02:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74/a36a67ab-f7f3-4561-85ea-da5bb3c1324e.
Oct 08, 2022 4:04:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:04:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:04:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:04:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
pending. retrying.
Oct 08, 2022 4:04:07 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665201402523,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 4:04:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:04:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
started
Oct 08, 2022 4:04:08 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:04:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:04:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:04:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:04:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:04:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:04:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:04:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:05:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:05:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:05:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 08, 2022 4:06:00 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee/
before loading them.
Oct 08, 2022 4:06:00 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee/dc9a245d-9b22-4780-929a-eec139874cb9.
Oct 08, 2022 4:06:00 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:06:00 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:06:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:06:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
pending. retrying.
Oct 08, 2022 4:06:02 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665201959518_29,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 4:06:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
Oct 08, 2022 4:06:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
started
Oct 08, 2022 4:06:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
Oct 08, 2022 4:06:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
Oct 08, 2022 4:06:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
Oct 08, 2022 4:06:08 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
Oct 08, 2022 4:06:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 4:06:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665201962424","endTime":"1665201969374","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"937","totalSlotMs":"216","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"6774","totalSlotMs":"216","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"216"}],"reservation_id":"default-pipeline","startTime":"1665201962565","totalSlotMs":"216","finalExecutionDurationMs":"745"}
Oct 08, 2022 4:06:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008040600563adb09_7850ec26d33448818389e1aee183e5ee_c2d5a02b6e97a0a3d4b57a814be00032_00001_00000-0
completed successfully.
Oct 08, 2022 4:06:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0
Oct 08, 2022 4:06:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0
Oct 08, 2022 4:06:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0
Oct 08, 2022 4:06:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0
Oct 08, 2022 4:06:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 4:06:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080406156257466f_f56dae92025a4f60b00e0abe8b04dcf0
Oct 08, 2022 4:06:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 08, 2022 4:06:19 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/f56dae92025a4f60b00e0abe8b04dcf0/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1008035352-cd8e86e7
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1008035352-cd8e86e7
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1008035352-cd8e86e7
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1008035352-cd8e86e7
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 08, 2022 4:06:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
Oct 08, 2022 4:07:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 4:07:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665201847406","endTime":"1665202036055","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"184359","totalSlotMs":"305390","pendingUnits":"4956","completedUnits":"3089","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"185362","totalSlotMs":"792162","pendingUnits":"501","completedUnits":"8045","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"186529","totalSlotMs":"885815","pendingUnits":"1","completedUnits":"8545","activeUnits":"435","estimatedRunnableUnits":"0"},{"elapsedMs":"188070","totalSlotMs":"886091","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"1"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"886091"}],"reservation_id":"default-pipeline","startTime":"1665201847794","totalSlotMs":"886091","finalExecutionDurationMs":"3649"}
Oct 08, 2022 4:07:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008035646fc844ff3_153f9eb4931940b086c6f2b247a42f74_7717849c462449d65940680103f267e9_00001_00000-0
completed successfully.
Oct 08, 2022 4:07:39 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 08, 2022 4:07:40 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665201402523
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 08, 2022 4:07:40 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665202060064
Oct 08, 2022 4:07:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1008040741eced8669_9e0eaeb79e4e400ba868e1a77fcf1de1
Oct 08, 2022 4:07:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1008040741eced8669_9e0eaeb79e4e400ba868e1a77fcf1de1,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1008040741eced8669_9e0eaeb79e4e400ba868e1a77fcf1de1
Oct 08, 2022 4:07:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1008040741eced8669_9e0eaeb79e4e400ba868e1a77fcf1de1,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1008040741eced8669_9e0eaeb79e4e400ba868e1a77fcf1de1
Oct 08, 2022 4:07:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1008040741eced8669_9e0eaeb79e4e400ba868e1a77fcf1de1,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 4:07:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1008040741eced8669_9e0eaeb79e4e400ba868e1a77fcf1de1
Oct 08, 2022 4:07:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 08, 2022 4:07:42 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/9e0eaeb79e4e400ba868e1a77fcf1de1/000000000000.avro
Oct 08, 2022 4:07:42 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/
before loading them.
Oct 08, 2022 4:07:43 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/9e0eaeb79e4e400ba868e1a77fcf1de1/000000000000.avro
matched 1 files with total size 119755
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/149adf50-68c5-4166-b2a9-44f2b221bdf4.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/83a7fd47-1e1f-437f-95b5-91324b562c72.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/2022af94-def0-46fe-b93d-81771dda9de5.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/52693689-4fec-4023-a829-27590c035035.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/9e763786-2b34-4945-a66f-49d6a1fb3b74.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/dc67bfd5-37a4-4b71-b70b-d0dfb58d7e05.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/a43c42ff-612b-44c1-ae4a-bad08bbd9337.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/3f861706-f69b-4e37-ad88-d4e52399c448.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/fbbdcb8a-e14f-4499-b2d6-7b31d921f448.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/5d1dbdda-ac46-4873-9b01-e81810d65162.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/8b8b75cc-9207-48ea-96d4-cf5a44acf0e9.
Oct 08, 2022 4:07:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488/5d60e2b6-9c2f-46af-b3a2-4287996f19ae.
Oct 08, 2022 4:07:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:07:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:07:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 4:07:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0
pending. retrying.
Oct 08, 2022 4:07:45 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665202060064,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 4:07:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0
Oct 08, 2022 4:07:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0
started
Oct 08, 2022 4:07:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0
Oct 08, 2022 4:07:47 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0
Oct 08, 2022 4:07:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 4:07:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665202065516","endTime":"1665202067648","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1111","totalSlotMs":"233","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"1944","totalSlotMs":"378","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"378"}],"reservation_id":"default-pipeline","startTime":"1665202065677","totalSlotMs":"378","finalExecutionDurationMs":"1051"}
Oct 08, 2022 4:07:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008040741eced8669_1b24173fc3c54a38a754b0cd263ac488_c7c6a849ffea9b202d729377f81c162f_00001_00000-0
completed successfully.
Oct 08, 2022 4:07:49 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 08, 2022 4:07:50 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665202060064
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 14m 52s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2runqir2at7js
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
