See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/790/display/redirect?page=changes>
Changes:
[toran.sahu] fix typo - s/befrehand/beforehand
------------------------------------------
[...truncated 7.74 MB...]
Oct 07, 2022 9:53:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402/5a2ea224-905a-44c1-8498-0a92766b4217.
Oct 07, 2022 9:53:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402/a938901c-5159-4b1b-990e-616d57be4073.
Oct 07, 2022 9:53:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402/d874e5c8-c46f-4afb-8002-ebc9327a67b2.
Oct 07, 2022 9:53:26 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402/dc4ce8ca-920a-40d8-a852-94b733ae941e.
Oct 07, 2022 9:53:26 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402/865259dd-8eb4-4fc3-b15d-c4c7f19e31fc.
Oct 07, 2022 9:53:26 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402/3b4e3b41-6339-4a24-830b-76d0e228a123.
Oct 07, 2022 9:53:26 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402/caf4cd09-5ad4-4154-8ab3-61c7bd01d873.
Oct 07, 2022 9:53:26 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402/575cf6d6-87ec-4722-9174-5c54c05d0675.
Oct 07, 2022 9:54:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:54:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:54:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:54:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
pending. retrying.
Oct 07, 2022 9:54:41 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665136048900,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 07, 2022 9:54:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:54:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
started
Oct 07, 2022 9:54:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:54:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:54:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:54:49 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:54:52 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:54:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:55:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:55:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:55:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:55:58 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
Oct 07, 2022 9:56:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 07, 2022 9:56:23 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855/
before loading them.
Oct 07, 2022 9:56:23 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855/bb1bd09c-bfbd-4f69-861c-6a9a00fce92c.
Oct 07, 2022 9:56:23 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:56:23 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:56:23 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:56:23 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0
pending. retrying.
Oct 07, 2022 9:56:24 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665136582494_13,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 07, 2022 9:56:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0
Oct 07, 2022 9:56:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0
started
Oct 07, 2022 9:56:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0
Oct 07, 2022 9:56:26 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0
Oct 07, 2022 9:56:27 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:56:27 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665136585321","endTime":"1665136587170","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"910","totalSlotMs":"407","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1674","totalSlotMs":"407","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"407"}],"reservation_id":"default-pipeline","startTime":"1665136585473","totalSlotMs":"407","finalExecutionDurationMs":"777"}
Oct 07, 2022 9:56:27 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007095623155d29b3_4047ff115393460b883b23c48342a855_91a01685f933fc137a548d8a88f66943_00001_00000-0
completed successfully.
Oct 07, 2022 9:56:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10070956295b5aeb77_3712ba59222f48d5aaecdb1a9754ed64
Oct 07, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10070956295b5aeb77_3712ba59222f48d5aaecdb1a9754ed64,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10070956295b5aeb77_3712ba59222f48d5aaecdb1a9754ed64
Oct 07, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10070956295b5aeb77_3712ba59222f48d5aaecdb1a9754ed64,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10070956295b5aeb77_3712ba59222f48d5aaecdb1a9754ed64
Oct 07, 2022 9:56:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10070956295b5aeb77_3712ba59222f48d5aaecdb1a9754ed64,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:56:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10070956295b5aeb77_3712ba59222f48d5aaecdb1a9754ed64
Oct 07, 2022 9:56:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 07, 2022 9:56:31 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/3712ba59222f48d5aaecdb1a9754ed64/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1007094539-8ffb7754
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1007094539-8ffb7754
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1007094539-8ffb7754
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1007094539-8ffb7754
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 07, 2022 9:57:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:57:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665136481450","endTime":"1665136613882","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"129444","totalSlotMs":"457526","pendingUnits":"3204","completedUnits":"4841","activeUnits":"999","estimatedRunnableUnits":"0"},{"elapsedMs":"129950","totalSlotMs":"761886","pendingUnits":"501","completedUnits":"8045","activeUnits":"999","estimatedRunnableUnits":"0"},{"elapsedMs":"131497","totalSlotMs":"907255","pendingUnits":"2","completedUnits":"8544","activeUnits":"3","estimatedRunnableUnits":"0"},{"elapsedMs":"131511","totalSlotMs":"907973","pendingUnits":"0","completedUnits":"8546","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"907973"}],"reservation_id":"default-pipeline","startTime":"1665136482161","totalSlotMs":"907973","finalExecutionDurationMs":"2564"}
Oct 07, 2022 9:57:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1007094731939a733_35b6f7925d5b4c1f90dc1bd5f68d4402_e3ab19dd1f2a536b33525462cd9c31d2_00001_00000-0
completed successfully.
Oct 07, 2022 9:57:36 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 07, 2022 9:57:36 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665136048900
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 07, 2022 9:57:36 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665136656457
Oct 07, 2022 9:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1007095737be9900ec_c27eb433a53743a49c3b0f25d20e5333
Oct 07, 2022 9:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1007095737be9900ec_c27eb433a53743a49c3b0f25d20e5333,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1007095737be9900ec_c27eb433a53743a49c3b0f25d20e5333
Oct 07, 2022 9:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1007095737be9900ec_c27eb433a53743a49c3b0f25d20e5333,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1007095737be9900ec_c27eb433a53743a49c3b0f25d20e5333
Oct 07, 2022 9:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1007095737be9900ec_c27eb433a53743a49c3b0f25d20e5333,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1007095737be9900ec_c27eb433a53743a49c3b0f25d20e5333
Oct 07, 2022 9:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 07, 2022 9:57:39 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/c27eb433a53743a49c3b0f25d20e5333/000000000000.avro
Oct 07, 2022 9:57:39 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/
before loading them.
Oct 07, 2022 9:57:39 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/c27eb433a53743a49c3b0f25d20e5333/000000000000.avro
matched 1 files with total size 119755
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/f654db4c-2cd2-4758-8cd3-3bfdd66bf3ff.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/75cf93a4-410a-49f6-9db8-2324899bce02.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/9f074ba2-0286-487d-a2fc-bfd2f294fe30.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/d1516f53-7867-48d6-ba24-5c854d512cc8.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/6cb9ef05-0efd-4976-bf24-6c82c3b151fe.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/7d0b0e39-9808-4248-8acd-093823e420e5.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/4207d9c8-6365-42c8-b65d-1de7dcf5ec18.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/879e655c-8300-478c-b9e2-55ebba74fbbd.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/7ec0642c-e0d5-4a9f-8170-5a4b4311deed.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/eaf644d7-4635-436c-90b1-5ac88acdc665.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/804f9a98-b0e8-49c3-bd14-a402e9f6393e.
Oct 07, 2022 9:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e/3675a2c6-7caf-4eee-abf6-ad4e2b11d75d.
Oct 07, 2022 9:57:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:57:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:57:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:57:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0
pending. retrying.
Oct 07, 2022 9:57:41 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665136656457,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 07, 2022 9:57:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0
Oct 07, 2022 9:57:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0
started
Oct 07, 2022 9:57:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0
Oct 07, 2022 9:57:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0
Oct 07, 2022 9:57:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:57:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665136661920","endTime":"1665136664124","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1107","totalSlotMs":"490","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2030","totalSlotMs":"1158","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"1158"}],"reservation_id":"default-pipeline","startTime":"1665136662070","totalSlotMs":"1158","finalExecutionDurationMs":"1168"}
Oct 07, 2022 9:57:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1007095737be9900ec_73ab3bacf83747eca7d4c76b505ab55e_b1b79c5ff7d21a7877be221bb8d7e36e_00001_00000-0
completed successfully.
Oct 07, 2022 9:57:45 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 07, 2022 9:57:46 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665136656457
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 14s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/t74iafx4ysc4u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
