See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/795/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #23547: update bom to the latest one.
------------------------------------------
[...truncated 7.73 MB...]
Oct 08, 2022 3:51:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6/b8691f04-ddfa-4507-a6aa-82243cd1dcd6.
Oct 08, 2022 3:51:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6/774671c0-5d30-42e6-9a3e-0962428c828b.
Oct 08, 2022 3:51:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6/b5362821-0a43-41c9-b140-2b9297e7adcc.
Oct 08, 2022 3:51:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6/271caac7-d645-414f-9913-bac2e2ee767c.
Oct 08, 2022 3:51:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6/aa659181-f915-490b-8a3f-6fdd4c71613b.
Oct 08, 2022 3:51:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6/27203aec-181c-47d0-b8b2-7ed370eb3f76.
Oct 08, 2022 3:51:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6/efc46f8b-f81a-458c-9b61-5553fda8f113.
Oct 08, 2022 3:51:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6/00996e77-1c57-4204-8b4c-c6cc2aa590d6.
Oct 08, 2022 3:53:09 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:53:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:53:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:53:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
pending. retrying.
Oct 08, 2022 3:53:11 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665244047609,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 3:53:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:53:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
started
Oct 08, 2022 3:53:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:53:14 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:53:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:53:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:53:20 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:53:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:53:30 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:53:37 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:54:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:54:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
Oct 08, 2022 3:54:58 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 08, 2022 3:55:02 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61/
before loading them.
Oct 08, 2022 3:55:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61/7e4f2af8-8795-4d66-b8ae-cdc7403a4b41.
Oct 08, 2022 3:55:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:55:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:55:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:55:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0
pending. retrying.
Oct 08, 2022 3:55:04 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665244502015_0,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 3:55:05 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0
Oct 08, 2022 3:55:05 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0
started
Oct 08, 2022 3:55:05 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0
Oct 08, 2022 3:55:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0
Oct 08, 2022 3:55:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 3:55:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665244505116","endTime":"1665244506706","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"916","totalSlotMs":"295","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1413","totalSlotMs":"295","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"295"}],"reservation_id":"default-pipeline","startTime":"1665244505269","totalSlotMs":"295","finalExecutionDurationMs":"754"}
Oct 08, 2022 3:55:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10081555026c195f6d_0566fed4243446e799dc47c41ced1f61_87e67065abacf9c2b1dde1c334b0bbb7_00001_00000-0
completed successfully.
Oct 08, 2022 3:55:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1008155510f4ca9a53_d750fa34cbab4876922448eaed682e56
Oct 08, 2022 3:55:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1008155510f4ca9a53_d750fa34cbab4876922448eaed682e56,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1008155510f4ca9a53_d750fa34cbab4876922448eaed682e56
Oct 08, 2022 3:55:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1008155510f4ca9a53_d750fa34cbab4876922448eaed682e56,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1008155510f4ca9a53_d750fa34cbab4876922448eaed682e56
Oct 08, 2022 3:55:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1008155510f4ca9a53_d750fa34cbab4876922448eaed682e56,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 3:55:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1008155510f4ca9a53_d750fa34cbab4876922448eaed682e56
Oct 08, 2022 3:55:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 08, 2022 3:55:12 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/d750fa34cbab4876922448eaed682e56/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1008154533-e26071ee
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1008154533-e26071ee
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1008154533-e26071ee
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1008154533-e26071ee
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 08, 2022 3:56:05 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 3:56:05 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665244392100","endTime":"1665244565586","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"165162","totalSlotMs":"440713","pendingUnits":"4235","completedUnits":"3810","activeUnits":"998","estimatedRunnableUnits":"0"},{"elapsedMs":"165662","totalSlotMs":"930288","pendingUnits":"1","completedUnits":"8044","activeUnits":"998","estimatedRunnableUnits":"0"},{"elapsedMs":"166165","totalSlotMs":"930320","pendingUnits":"501","completedUnits":"8045","activeUnits":"0","estimatedRunnableUnits":"0"},{"elapsedMs":"167689","totalSlotMs":"1090608","pendingUnits":"1","completedUnits":"8545","activeUnits":"29","estimatedRunnableUnits":"0"},{"elapsedMs":"168465","totalSlotMs":"1091481","pendingUnits":"1","completedUnits":"8545","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"172918","totalSlotMs":"1091891","pendingUnits":"0","completedUnits":"8546","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"1091891"}],"reservation_id":"default-pipeline","startTime":"1665244392503","totalSlotMs":"1091891","finalExecutionDurationMs":"5140"}
Oct 08, 2022 3:56:05 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10081547302a1b0a00_6dd40e64c09744d394c4f51ed4102da6_3b77646b3f0cd46480725b250edfc904_00001_00000-0
completed successfully.
Oct 08, 2022 3:56:10 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 08, 2022 3:56:11 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665244047609
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 08, 2022 3:56:11 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665244571058
Oct 08, 2022 3:56:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins100815561229bf4dae_e729bc7f3d48484f9266ee3cb31ac6d5
Oct 08, 2022 3:56:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins100815561229bf4dae_e729bc7f3d48484f9266ee3cb31ac6d5,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins100815561229bf4dae_e729bc7f3d48484f9266ee3cb31ac6d5
Oct 08, 2022 3:56:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins100815561229bf4dae_e729bc7f3d48484f9266ee3cb31ac6d5,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins100815561229bf4dae_e729bc7f3d48484f9266ee3cb31ac6d5
Oct 08, 2022 3:56:14 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins100815561229bf4dae_e729bc7f3d48484f9266ee3cb31ac6d5,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 3:56:14 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins100815561229bf4dae_e729bc7f3d48484f9266ee3cb31ac6d5
Oct 08, 2022 3:56:14 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 08, 2022 3:56:14 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/e729bc7f3d48484f9266ee3cb31ac6d5/000000000000.avro
Oct 08, 2022 3:56:14 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/
before loading them.
Oct 08, 2022 3:56:14 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/e729bc7f3d48484f9266ee3cb31ac6d5/000000000000.avro
matched 1 files with total size 119755
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/8078aa2c-760f-4120-b83a-e8818de7b74b.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/bd2d69bc-4254-4161-b5b2-f12a01986e0e.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/d463b06f-801b-46f7-a1a0-e6c8b9c6ec79.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/02fe7ac2-2bfb-41e1-a9a4-3eee12374eae.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/fb24aad4-0c35-4bdb-90bc-10aa73c2c01d.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/c2d7e6bb-913f-48a4-9ab5-96fd1de1a5e7.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/6e39ac59-fd13-46ed-a140-dfd989fc2b0b.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/f0e7deac-7fb0-4c05-99c9-b604357149c9.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/335b17f1-1787-448a-9c02-212518cd5973.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/fbbf5b07-ba32-4a2e-b0ca-bcac28f810a5.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/e513d349-d925-48b3-9e83-e04813305ca3.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8/8b80f962-5d7d-4c6b-96a7-0d236d61d1bb.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0
pending. retrying.
Oct 08, 2022 3:56:16 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665244571058,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 3:56:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0
Oct 08, 2022 3:56:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0
started
Oct 08, 2022 3:56:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0
Oct 08, 2022 3:56:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0
Oct 08, 2022 3:56:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 3:56:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665244577019","endTime":"1665244579186","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1113","totalSlotMs":"113","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"1956","totalSlotMs":"555","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"555"}],"reservation_id":"default-pipeline","startTime":"1665244577194","totalSlotMs":"555","finalExecutionDurationMs":"1064"}
Oct 08, 2022 3:56:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins100815561229bf4dae_b6fb67a029b34dcfbe555a51d58776c8_661d06382916cc1db1d8d9f2499527a4_00001_00000-0
completed successfully.
Oct 08, 2022 3:56:20 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 08, 2022 3:56:20 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665244571058
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 49s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/geclgg7h6p6f6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
