See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/800/display/redirect>
Changes:
------------------------------------------
[...truncated 7.76 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc/5ec3d6de-4b68-4108-891e-dbc999890206.
Oct 09, 2022 9:52:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc/cd9ca875-0858-4bec-a31e-7dd2c1306f93.
Oct 09, 2022 9:52:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc/57fa4c82-2140-482a-9e24-f9da28acc281.
Oct 09, 2022 9:52:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc/d29ce057-e1c2-4043-92fb-1cee424f7fb7.
Oct 09, 2022 9:52:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc/dd711ddf-6d21-4e5d-bea4-ef21bcd1df3a.
Oct 09, 2022 9:52:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc/fe4bbedf-6140-44f9-9ef0-26df12b092c5.
Oct 09, 2022 9:52:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc/91e5b49f-e7ff-49d6-86d2-734613f5fa41.
Oct 09, 2022 9:52:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc/973f0d18-6cb1-4d82-9b24-03e83c27dc19.
Oct 09, 2022 9:53:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:53:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:53:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:53:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
pending. retrying.
Oct 09, 2022 9:53:26 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665352042271,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 9:53:26 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:53:26 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
started
Oct 09, 2022 9:53:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:53:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:53:28 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:53:32 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:53:37 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:53:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:53:50 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:53:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:54:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:54:32 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
Oct 09, 2022 9:55:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 09, 2022 9:56:10 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd/
before loading them.
Oct 09, 2022 9:56:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd/314d2ad9-bea6-4429-8c13-1888dffb3f19.
Oct 09, 2022 9:56:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0
pending. retrying.
Oct 09, 2022 9:56:11 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665352569593_13,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 9:56:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0
Oct 09, 2022 9:56:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0
started
Oct 09, 2022 9:56:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0
Oct 09, 2022 9:56:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:56:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0
succeeded. Statistics:
{"creationTime":"1665352572019","endTime":"1665352573622","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"1399","totalSlotMs":"367","pendingUnits":"0","completedUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"367"}],"reservation_id":"default-pipeline","startTime":"1665352572193","totalSlotMs":"367","finalExecutionDurationMs":"724"}
Oct 09, 2022 9:56:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100921561061a7f57f_7b8cec98f4fa41aa9bb9ac3495bd94dd_d4458c5149e4b8c167c5fd0f545e0368_00001_00000-0
completed successfully.
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 09, 2022 9:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665352406333","endTime":"1665352571911","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"156261","totalSlotMs":"575","pendingUnits":"8038","completedUnits":"7","activeUnits":"3","estimatedRunnableUnits":"0"},{"elapsedMs":"157299","totalSlotMs":"10828","pendingUnits":"7940","completedUnits":"105","activeUnits":"8","estimatedRunnableUnits":"0"},{"elapsedMs":"158336","totalSlotMs":"24456","pendingUnits":"7815","completedUnits":"230","activeUnits":"8","estimatedRunnableUnits":"1000"},{"elapsedMs":"159361","totalSlotMs":"33246","pendingUnits":"7733","completedUnits":"312","activeUnits":"5","estimatedRunnableUnits":"1000"},{"elapsedMs":"160765","totalSlotMs":"98381","pendingUnits":"6791","completedUnits":"1254","activeUnits":"197","estimatedRunnableUnits":"1000"},{"elapsedMs":"161774","totalSlotMs":"423282","pendingUnits":"3","completedUnits":"8042","activeUnits":"502","estimatedRunnableUnits":"1000"},{"elapsedMs":"163263","totalSlotMs":"436047","pendingUnits":"263","completedUnits":"8283","activeUnits":"33","estimatedRunnableUnits":"1000"},{"elapsedMs":"164407","totalSlotMs":"451373","pendingUnits":"0","completedUnits":"8546","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"164987","totalSlotMs":"451373","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"451373"}],"reservation_id":"default-pipeline","startTime":"1665352406715","totalSlotMs":"451373","finalExecutionDurationMs":"9362"}
Oct 09, 2022 9:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009214725cd21528a_f43b517b8a014d0998aaa27c4cddcafc_27ab33cb2fead7eca5a5f12a26ea2d79_00001_00000-0
completed successfully.
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 09, 2022 9:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009215615afc66390_6db2c66f64604534b59eb4a84901805b
Oct 09, 2022 9:56:16 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009215615afc66390_6db2c66f64604534b59eb4a84901805b,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009215615afc66390_6db2c66f64604534b59eb4a84901805b
Oct 09, 2022 9:56:16 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009215615afc66390_6db2c66f64604534b59eb4a84901805b,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009215615afc66390_6db2c66f64604534b59eb4a84901805b
Oct 09, 2022 9:56:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009215615afc66390_6db2c66f64604534b59eb4a84901805b,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:56:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009215615afc66390_6db2c66f64604534b59eb4a84901805b
Oct 09, 2022 9:56:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 09, 2022 9:56:17 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/6db2c66f64604534b59eb4a84901805b/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1009214531-ec1b5c81
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1009214531-ec1b5c81
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1009214531-ec1b5c81
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1009214531-ec1b5c81
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 09, 2022 9:56:20 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 09, 2022 9:56:20 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665352042271
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 09, 2022 9:56:20 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665352580459
Oct 09, 2022 9:56:22 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1009215621e41d6c3d_517bb4454a374b56ae86b22aa89e93e0
Oct 09, 2022 9:56:22 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1009215621e41d6c3d_517bb4454a374b56ae86b22aa89e93e0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1009215621e41d6c3d_517bb4454a374b56ae86b22aa89e93e0
Oct 09, 2022 9:56:22 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1009215621e41d6c3d_517bb4454a374b56ae86b22aa89e93e0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1009215621e41d6c3d_517bb4454a374b56ae86b22aa89e93e0
Oct 09, 2022 9:56:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1009215621e41d6c3d_517bb4454a374b56ae86b22aa89e93e0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:56:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1009215621e41d6c3d_517bb4454a374b56ae86b22aa89e93e0
Oct 09, 2022 9:56:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 09, 2022 9:56:24 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/517bb4454a374b56ae86b22aa89e93e0/000000000000.avro
Oct 09, 2022 9:56:24 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/
before loading them.
Oct 09, 2022 9:56:24 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/517bb4454a374b56ae86b22aa89e93e0/000000000000.avro
matched 1 files with total size 119755
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/26debb49-33fe-4a45-966d-1629ca94b51b.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/f318047c-b461-4d86-8938-7749c5479f14.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/f563a68b-f084-4235-ab90-536066cba7c0.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/a18e1171-acac-46c3-bb23-6b5e5f4fda8a.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/12d361b0-eefa-4a34-8040-af5a4c5360db.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/f2581b5e-172f-4016-885f-124465c7c264.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/db7a9f5d-6dff-4e6c-ab1f-4a67e4d73159.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/8d66c42d-0e57-40a3-8b84-35898e17fa11.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/3e9eb341-2ba9-4b22-82bd-e755a1476f87.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/63d3a589-ed01-487a-965b-c04c33e9476e.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/a32765d2-01f8-4b2c-b2aa-3109e76cb393.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef/2e9e405c-18da-4b80-8790-ed92735a51cd.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 9:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0
pending. retrying.
Oct 09, 2022 9:56:27 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665352580459,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 9:56:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0
Oct 09, 2022 9:56:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0
started
Oct 09, 2022 9:56:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0
Oct 09, 2022 9:56:28 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0
Oct 09, 2022 9:56:30 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 9:56:30 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665352587516","endTime":"1665352589783","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1108","totalSlotMs":"369","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2089","totalSlotMs":"842","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"842"}],"reservation_id":"default-pipeline","startTime":"1665352587667","totalSlotMs":"842","finalExecutionDurationMs":"1152"}
Oct 09, 2022 9:56:30 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009215621e41d6c3d_936c37c9e3ba463cbe448d3a504b6eef_b3fce6665b72cff93a36013c380a0f7f_00001_00000-0
completed successfully.
Oct 09, 2022 9:56:31 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 09, 2022 9:56:32 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665352580459
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 6s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ldfet6nqb4uam
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
