See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/811/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [website][adhoc] Fix spellcheck errors and typos
------------------------------------------
[...truncated 7.72 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/9fa18eb0-992c-41fa-bbfb-04502ed95f50.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/861d7fdd-002d-4ddb-9bcf-0336a481e10c.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/73b4309d-9c5d-4051-8861-4339560e5f3d.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/36c51ecc-7202-467d-948f-66a5625f5009.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/081ecef8-8042-4899-ad1e-eaf870d7eb57.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/4b175e0c-e9d1-4ab9-82cb-47813c494677.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/e048986f-22a0-4698-8893-1ae6921374bc.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/63442e0c-7914-435f-8783-597493765045.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/ba9b5114-834a-40a6-8872-ae5336192f2a.
Oct 12, 2022 3:51:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe/b824c75c-36f1-4668-948b-c817e378ad38.
Oct 12, 2022 3:53:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:53:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:53:07 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:53:07 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
pending. retrying.
Oct 12, 2022 3:53:08 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665589634867,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 3:53:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:53:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
started
Oct 12, 2022 3:53:09 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:53:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:53:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:53:16 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:53:18 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:53:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:53:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:53:51 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:54:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:54:37 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
Oct 12, 2022 3:55:05 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 12, 2022 3:55:31 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a/
before loading them.
Oct 12, 2022 3:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a/207449e5-500f-4eda-a6cd-084ffd39d919.
Oct 12, 2022 3:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0
pending. retrying.
Oct 12, 2022 3:55:33 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665590130255_13,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 3:55:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0
Oct 12, 2022 3:55:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0
started
Oct 12, 2022 3:55:34 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0
Oct 12, 2022 3:55:35 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:55:35 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665590133713","endTime":"1665590135354","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"895","totalSlotMs":"286","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1462","totalSlotMs":"286","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"286"}],"reservation_id":"default-pipeline","startTime":"1665590133864","totalSlotMs":"286","finalExecutionDurationMs":"770"}
Oct 12, 2022 3:55:35 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012155531be0d00fa_1760901e349a424cb8b5b335b7d0aa7a_9c4d10ca9226c7afea7a6d271bf9b91e_00001_00000-0
completed successfully.
Oct 12, 2022 3:55:37 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins101215553739b3157e_c9aa6f3c78ae4d4898805697b3ec7513
Oct 12, 2022 3:55:37 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins101215553739b3157e_c9aa6f3c78ae4d4898805697b3ec7513,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins101215553739b3157e_c9aa6f3c78ae4d4898805697b3ec7513
Oct 12, 2022 3:55:37 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins101215553739b3157e_c9aa6f3c78ae4d4898805697b3ec7513,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins101215553739b3157e_c9aa6f3c78ae4d4898805697b3ec7513
Oct 12, 2022 3:55:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins101215553739b3157e_c9aa6f3c78ae4d4898805697b3ec7513,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:55:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins101215553739b3157e_c9aa6f3c78ae4d4898805697b3ec7513
Oct 12, 2022 3:55:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 12, 2022 3:55:39 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/c9aa6f3c78ae4d4898805697b3ec7513/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1012154528-c67fa78e
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1012154528-c67fa78e
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1012154528-c67fa78e
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1012154528-c67fa78e
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 12, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665589988338","endTime":"1665590169437","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"175304","totalSlotMs":"519394","pendingUnits":"4649","completedUnits":"3396","activeUnits":"999","estimatedRunnableUnits":"0"},{"elapsedMs":"175814","totalSlotMs":"1194084","pendingUnits":"758","completedUnits":"7287","activeUnits":"999","estimatedRunnableUnits":"0"},{"elapsedMs":"177305","totalSlotMs":"1507382","pendingUnits":"32","completedUnits":"8514","activeUnits":"63","estimatedRunnableUnits":"501"},{"elapsedMs":"178489","totalSlotMs":"1516231","pendingUnits":"1","completedUnits":"8545","activeUnits":"1","estimatedRunnableUnits":"501"},{"elapsedMs":"180481","totalSlotMs":"1516663","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"0"},{"elapsedMs":"180511","totalSlotMs":"1516663","pendingUnits":"0","completedUnits":"8546","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"1516663"}],"reservation_id":"default-pipeline","startTime":"1665589988730","totalSlotMs":"1516663","finalExecutionDurationMs":"5906"}
Oct 12, 2022 3:56:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10121547178a67fc16_d89be0b1f9cb44b896a9d402adffd4fe_c035b3a9c48eb9bbb6eccd76a65e76f0_00001_00000-0
completed successfully.
Oct 12, 2022 3:56:20 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 12, 2022 3:56:21 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665589634867
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 12, 2022 3:56:21 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665590181252
Oct 12, 2022 3:56:23 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1012155623fe0d4f5b_e4e96c346cca42fe821bbb57797c7f3c
Oct 12, 2022 3:56:23 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1012155623fe0d4f5b_e4e96c346cca42fe821bbb57797c7f3c,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1012155623fe0d4f5b_e4e96c346cca42fe821bbb57797c7f3c
Oct 12, 2022 3:56:23 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1012155623fe0d4f5b_e4e96c346cca42fe821bbb57797c7f3c,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1012155623fe0d4f5b_e4e96c346cca42fe821bbb57797c7f3c
Oct 12, 2022 3:56:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1012155623fe0d4f5b_e4e96c346cca42fe821bbb57797c7f3c,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:56:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1012155623fe0d4f5b_e4e96c346cca42fe821bbb57797c7f3c
Oct 12, 2022 3:56:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 12, 2022 3:56:25 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/e4e96c346cca42fe821bbb57797c7f3c/000000000000.avro
Oct 12, 2022 3:56:25 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/
before loading them.
Oct 12, 2022 3:56:25 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/e4e96c346cca42fe821bbb57797c7f3c/000000000000.avro
matched 1 files with total size 119755
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/02fa50d6-c8ae-4c51-8bff-c2025a3449fb.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/5a63c860-508f-4dab-a17f-ad763e106cbe.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/a3fb63ab-21be-48ce-a1c2-ef3b911c7136.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/1034ab48-b64d-4d0f-a4e5-31834b48b877.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/26198c8b-88fc-4c48-aee6-fac3b929521e.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/73ae3fd8-3096-4632-8492-9a1f1cbc0b85.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/b8b2f2e7-cf8c-4578-8d7d-7759061fbc91.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/0d81019f-2469-43c0-87bc-8e384e3358e1.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/5229ef4a-40e7-4805-acbf-196b9780f188.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/d991d844-cd21-4e28-a450-bd7b272b9690.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/61142c0b-bff6-4a84-859e-2431c75473fe.
Oct 12, 2022 3:56:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee/4339a33f-e9ab-4ffe-985f-effece75712b.
Oct 12, 2022 3:56:26 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:56:26 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:56:26 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:56:26 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0
pending. retrying.
Oct 12, 2022 3:56:27 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665590181252,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 3:56:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0
Oct 12, 2022 3:56:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0
started
Oct 12, 2022 3:56:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0
Oct 12, 2022 3:56:29 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0
Oct 12, 2022 3:56:30 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:56:30 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665590187715","endTime":"1665590190331","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1096","totalSlotMs":"56","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2456","totalSlotMs":"851","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"851"}],"reservation_id":"default-pipeline","startTime":"1665590187849","totalSlotMs":"851","finalExecutionDurationMs":"1587"}
Oct 12, 2022 3:56:30 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1012155623fe0d4f5b_90b8805c6b8f49068da0fe034c2fb8ee_e2133f636e7012564628b9c1424c7117_00001_00000-0
completed successfully.
Oct 12, 2022 3:56:32 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 12, 2022 3:56:32 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665590181252
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 7s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7asifhwxljkag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
