See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/798/display/redirect>
Changes:
------------------------------------------
[...truncated 7.56 MB...]
Oct 09, 2022 9:52:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3/5c841d3b-15b9-4ee0-93d1-52045136e8a8.
Oct 09, 2022 9:52:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3/f55bae0e-04e3-439d-a8ef-932690c25801.
Oct 09, 2022 9:52:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3/ace234de-68c2-49ba-a6ab-d71fd2ebb5b6.
Oct 09, 2022 9:52:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3/140874fe-1894-4ecb-a28c-d5aae9341b99.
Oct 09, 2022 9:52:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3/9ca5b237-3cb6-4bcb-a527-67088d8937a4.
Oct 09, 2022 9:52:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3/f5fb4444-b259-44c9-ba61-78c7dba6a2d3.
Oct 09, 2022 9:52:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3/f04f9b3e-d4b6-4fbd-b273-998c031b65c7.
Oct 09, 2022 9:52:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3/c8b7e9cd-13ea-414f-8d10-8053d2ce498f.
Oct 09, 2022 9:53:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:53:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:53:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:53:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
pending. retrying.
Oct 09, 2022 9:53:38 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665308879964,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 9:53:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:53:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
started
Oct 09, 2022 9:53:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:53:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:53:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:53:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:53:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:53:49 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:53:55 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:54:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:54:27 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:54:58 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
Oct 09, 2022 9:55:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 09, 2022 9:56:38 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389/
before loading them.
Oct 09, 2022 9:56:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389/addede86-f642-4954-ae7f-d1e4d2169dc8.
Oct 09, 2022 9:56:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0
pending. retrying.
Oct 09, 2022 9:56:40 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665309397401_16,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 9:56:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0
Oct 09, 2022 9:56:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0
started
Oct 09, 2022 9:56:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0
Oct 09, 2022 9:56:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0
Oct 09, 2022 9:56:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:56:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0
succeeded. Statistics:
{"creationTime":"1665309400625","endTime":"1665309402248","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"1420","totalSlotMs":"183","pendingUnits":"0","completedUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"183"}],"reservation_id":"default-pipeline","startTime":"1665309400795","totalSlotMs":"183","finalExecutionDurationMs":"730"}
Oct 09, 2022 9:56:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10090956387507c6c8_8a61ea86d40f43398df3bc4e54b12389_d83964daf7f2d8e393c21ddf5ed778a4_00001_00000-0
completed successfully.
Oct 09, 2022 9:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090956448a5997e0_fe50442c07954a72b35b91c7713037c1
Oct 09, 2022 9:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090956448a5997e0_fe50442c07954a72b35b91c7713037c1,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090956448a5997e0_fe50442c07954a72b35b91c7713037c1
Oct 09, 2022 9:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090956448a5997e0_fe50442c07954a72b35b91c7713037c1,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090956448a5997e0_fe50442c07954a72b35b91c7713037c1
Oct 09, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090956448a5997e0_fe50442c07954a72b35b91c7713037c1,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090956448a5997e0_fe50442c07954a72b35b91c7713037c1
Oct 09, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 09, 2022 9:56:46 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/fe50442c07954a72b35b91c7713037c1/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1009094623-ba348d8b
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1009094623-ba348d8b
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1009094623-ba348d8b
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1009094623-ba348d8b
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 09, 2022 9:56:55 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:56:55 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665309218456","endTime":"1665309376731","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"155334","totalSlotMs":"290922","pendingUnits":"3825","completedUnits":"4220","activeUnits":"999","estimatedRunnableUnits":"0"},{"elapsedMs":"155835","totalSlotMs":"554063","pendingUnits":"501","completedUnits":"8045","activeUnits":"999","estimatedRunnableUnits":"0"},{"elapsedMs":"156895","totalSlotMs":"680402","pendingUnits":"0","completedUnits":"8546","activeUnits":"86","estimatedRunnableUnits":"0"},{"elapsedMs":"157638","totalSlotMs":"680402","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"680402"}],"reservation_id":"default-pipeline","startTime":"1665309218882","totalSlotMs":"680402","finalExecutionDurationMs":"2923"}
Oct 09, 2022 9:56:55 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10090948038faa3bf4_3ef9bc8c26784ecb90b7612f1724e4f3_ad701b02630e7d1770ae00f05a21eb5f_00001_00000-0
completed successfully.
Oct 09, 2022 9:57:00 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 09, 2022 9:57:00 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665308879964
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 09, 2022 9:57:01 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665309420952
Oct 09, 2022 9:57:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1009095702440fcd2f_9044707c2bca43de9cb93de1c973baf8
Oct 09, 2022 9:57:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1009095702440fcd2f_9044707c2bca43de9cb93de1c973baf8,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1009095702440fcd2f_9044707c2bca43de9cb93de1c973baf8
Oct 09, 2022 9:57:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1009095702440fcd2f_9044707c2bca43de9cb93de1c973baf8,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1009095702440fcd2f_9044707c2bca43de9cb93de1c973baf8
Oct 09, 2022 9:57:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1009095702440fcd2f_9044707c2bca43de9cb93de1c973baf8,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:57:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1009095702440fcd2f_9044707c2bca43de9cb93de1c973baf8
Oct 09, 2022 9:57:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 09, 2022 9:57:04 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/9044707c2bca43de9cb93de1c973baf8/000000000000.avro
Oct 09, 2022 9:57:04 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/
before loading them.
Oct 09, 2022 9:57:04 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/9044707c2bca43de9cb93de1c973baf8/000000000000.avro
matched 1 files with total size 119755
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/468d3aab-ba94-4152-b8fa-3aca14247fb6.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/8d23d2e2-2afe-4da1-bff7-f25b63d20236.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/c6686d89-4b54-4d00-a1da-7712e2a18e12.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/df1ca568-dca0-4fbc-ac3f-00796b7485e4.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/75138ccf-6a14-4402-8645-c49d798f0b7f.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/0addd096-777a-4fbe-8329-e69c7eff2fa9.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/9e923236-dace-469a-9a85-ff462087d2a4.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/cc1e98c6-6f52-4048-aa36-d205776264a7.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/a127bb68-6903-4112-bd81-68a48b0e9748.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/4fb8e989-d30b-4bb8-a0d8-d1b6cdf33c91.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/b3386c17-bc96-4d9d-af8d-d0e5b5c7f246.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba/f0803f51-a4c7-4ac6-83c0-aa5e945123ff.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:57:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:57:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:57:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0
pending. retrying.
Oct 09, 2022 9:57:07 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665309420952,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 9:57:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0
Oct 09, 2022 9:57:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0
started
Oct 09, 2022 9:57:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0
Oct 09, 2022 9:57:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0
Oct 09, 2022 9:57:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:57:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665309427623","endTime":"1665309430085","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1230","totalSlotMs":"386","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2229","totalSlotMs":"731","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"731"}],"reservation_id":"default-pipeline","startTime":"1665309427815","totalSlotMs":"731","finalExecutionDurationMs":"1303"}
Oct 09, 2022 9:57:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009095702440fcd2f_60c7a8cee92b4561a6d3f7fdd7dea1ba_a86f22776e21c076700739b8c6835660_00001_00000-0
completed successfully.
Oct 09, 2022 9:57:12 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 09, 2022 9:57:12 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665309420952
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 37s
89 actionable tasks: 57 executed, 30 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/g3nhnrg2syfei
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
