See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/801/display/redirect>
Changes:
------------------------------------------
[...truncated 7.51 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a/308e0963-27ef-47e0-8a71-c3f3da96aaa2.
Oct 10, 2022 3:51:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a/05f737e7-f80d-459f-be49-2f0c9ed094b8.
Oct 10, 2022 3:51:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a/0a22cbd4-0667-424c-92e1-a90c923f0f9a.
Oct 10, 2022 3:51:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a/a08176d3-cac8-4386-b3d1-7c6ed7ab7cd9.
Oct 10, 2022 3:51:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a/94e6427d-2cfb-457d-89f4-ff8fc08dbbd7.
Oct 10, 2022 3:51:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a/6b5deef4-71d9-41a7-9adc-f8a311b9edaa.
Oct 10, 2022 3:51:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a/6334839d-8f22-4faa-b110-fee591c7b672.
Oct 10, 2022 3:52:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:52:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:52:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:52:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
pending. retrying.
Oct 10, 2022 3:52:57 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665373650410,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 10, 2022 3:52:58 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:52:58 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
started
Oct 10, 2022 3:52:58 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:52:59 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:53:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:53:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:53:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:53:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:53:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:53:23 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:53:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:54:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
Oct 10, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 3:55:16 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5/
before loading them.
Oct 10, 2022 3:55:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5/2736b6d3-c2a1-4576-a3d7-283f295e12b5.
Oct 10, 2022 3:55:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:55:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:55:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:55:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0
pending. retrying.
Oct 10, 2022 3:55:17 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665374115162_16,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 10, 2022 3:55:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0
Oct 10, 2022 3:55:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0
started
Oct 10, 2022 3:55:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0
Oct 10, 2022 3:55:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0
Oct 10, 2022 3:55:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:55:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0
succeeded. Statistics:
{"creationTime":"1665374117716","endTime":"1665374119224","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"1312","totalSlotMs":"103","pendingUnits":"0","completedUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"103"}],"reservation_id":"default-pipeline","startTime":"1665374117888","totalSlotMs":"103","finalExecutionDurationMs":"674"}
Oct 10, 2022 3:55:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10100355165e433044_2a4095d887d241cc9633e0e53693d2c5_9978bd663472218538a60e3e2fc746db_00001_00000-0
completed successfully.
Oct 10, 2022 3:55:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010035522b29f4a7_55be6efe146b43ddbe568a9422560631
Oct 10, 2022 3:55:23 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010035522b29f4a7_55be6efe146b43ddbe568a9422560631,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010035522b29f4a7_55be6efe146b43ddbe568a9422560631
Oct 10, 2022 3:55:23 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010035522b29f4a7_55be6efe146b43ddbe568a9422560631,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010035522b29f4a7_55be6efe146b43ddbe568a9422560631
Oct 10, 2022 3:55:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010035522b29f4a7_55be6efe146b43ddbe568a9422560631,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:55:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010035522b29f4a7_55be6efe146b43ddbe568a9422560631
Oct 10, 2022 3:55:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 10, 2022 3:55:24 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/55be6efe146b43ddbe568a9422560631/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1010034535-ef2b8b3a
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1010034535-ef2b8b3a
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1010034535-ef2b8b3a
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1010034535-ef2b8b3a
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 10, 2022 3:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665373977916","endTime":"1665374128134","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"147455","totalSlotMs":"339482","pendingUnits":"3549","completedUnits":"4496","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"147963","totalSlotMs":"591486","pendingUnits":"501","completedUnits":"8045","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"148527","totalSlotMs":"698848","pendingUnits":"1","completedUnits":"8545","activeUnits":"1","estimatedRunnableUnits":"1000"},{"elapsedMs":"149566","totalSlotMs":"699185","pendingUnits":"0","completedUnits":"8546","activeUnits":"1","estimatedRunnableUnits":"1000"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"699185"}],"reservation_id":"default-pipeline","startTime":"1665373978368","totalSlotMs":"699185","finalExecutionDurationMs":"2803"}
Oct 10, 2022 3:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10100347333467e18_b406d8d157f44b48aaf30e6da2ace19a_cda4558646032d77aa23a3c4b1d4f8d9_00001_00000-0
completed successfully.
Oct 10, 2022 3:56:41 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 10, 2022 3:56:41 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665373650410
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 3:56:42 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665374201955
Oct 10, 2022 3:56:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins101003564363c7aba0_8952476717394dcfaa4f4d344770d61d
Oct 10, 2022 3:56:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins101003564363c7aba0_8952476717394dcfaa4f4d344770d61d,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins101003564363c7aba0_8952476717394dcfaa4f4d344770d61d
Oct 10, 2022 3:56:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins101003564363c7aba0_8952476717394dcfaa4f4d344770d61d,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins101003564363c7aba0_8952476717394dcfaa4f4d344770d61d
Oct 10, 2022 3:56:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins101003564363c7aba0_8952476717394dcfaa4f4d344770d61d,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:56:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins101003564363c7aba0_8952476717394dcfaa4f4d344770d61d
Oct 10, 2022 3:56:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 10, 2022 3:56:44 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/8952476717394dcfaa4f4d344770d61d/000000000000.avro
Oct 10, 2022 3:56:44 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/
before loading them.
Oct 10, 2022 3:56:45 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/8952476717394dcfaa4f4d344770d61d/000000000000.avro
matched 1 files with total size 119755
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/0bf985d2-c1c3-4aa8-9bfd-af3b438bf755.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/8e71bbe0-04c4-4a73-929d-bdac1b158b56.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/8c86c8bd-bf74-45a2-9716-c1d8bec47e5f.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/1ef90337-3603-45aa-b74e-0432a80525f1.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/125428f7-ec91-4dde-b0d7-dbf45477736c.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/db9135fc-11eb-4b1f-9c77-8ac0c9b6d837.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/b67d8c3e-0667-44e5-be9d-3bf7cfd7f6db.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/bbafe0aa-02c3-4767-9398-75cc1b731788.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/d23c3dd1-2e00-4aa7-a531-ec1d43f151d2.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/5a64514e-61f3-485b-b1c6-5e10020cf4f8.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/40e3be1b-5c0b-43ce-9c2a-4ce44256ef17.
Oct 10, 2022 3:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4/e5a73542-0648-4214-8fe4-8760e3e9580a.
Oct 10, 2022 3:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0
pending. retrying.
Oct 10, 2022 3:56:47 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665374201955,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 10, 2022 3:56:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0
Oct 10, 2022 3:56:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0
started
Oct 10, 2022 3:56:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0
Oct 10, 2022 3:56:49 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0
Oct 10, 2022 3:56:50 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0
Oct 10, 2022 3:56:53 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:56:53 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665374208215","endTime":"1665374210682","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1197","totalSlotMs":"138","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2281","totalSlotMs":"473","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"473"}],"reservation_id":"default-pipeline","startTime":"1665374208369","totalSlotMs":"473","finalExecutionDurationMs":"1289"}
Oct 10, 2022 3:56:53 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101003564363c7aba0_9c27ae7e6f524158adfcf0a8d1a26cf4_ad7e0ec264f962c7ebcc18885f60c0ca_00001_00000-0
completed successfully.
Oct 10, 2022 3:56:55 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 10, 2022 3:56:55 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665374201955
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 22s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zift7mvm44crw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
