See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/807/display/redirect?page=changes>
Changes:
[git] BEAM-13592 Add getOrderingKey in
[git] Add CHANGES entry
[git] Rename transform name according to review comment
[git] Update to pass ordering key
[egalpin] Adds ordering key to OutgoingMessage builder, adds new coders to
pubsub
[egalpin] Fixes pubsub bounded writer allowing for orderingKey
[egalpin] Alters order of pubsub message support in registrar
[egalpin] Removed publishTime and messageId in grpc pubsub client publish
[egalpin] Attempts to allow different pubsub root url for PubsubIO.Write
[egalpin] Fixes pubsub tests root url
[egalpin] Puts PubsubMessageCoder last in registrar
[egalpin] Uses MoreObjects over Objects
[egalpin] Renames PubsubMessageCoder to
[noreply] fix distribution example in golang guide (#23567)
------------------------------------------
[...truncated 7.74 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da/8e69d8e9-d01c-4840-9453-426ddda00a7f.
Oct 11, 2022 3:51:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da/fa74004b-b67c-4bf3-a82c-986e59eac6a5.
Oct 11, 2022 3:51:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da/7584ab6c-4e2c-4ed2-90af-fb81868d5d45.
Oct 11, 2022 3:51:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da/260a4d8c-485e-4e47-8736-45255aba9e47.
Oct 11, 2022 3:51:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da/a4b438fe-bd66-4f3f-8edc-44c5a0f3d09b.
Oct 11, 2022 3:51:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da/3262d527-4bd8-40f4-bdb9-f6feea4f1c9d.
Oct 11, 2022 3:51:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da/b17ec6dc-70fd-444c-aed8-50c973393c9a.
Oct 11, 2022 3:52:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:52:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:52:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:52:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
pending. retrying.
Oct 11, 2022 3:52:57 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665503232205,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 3:52:58 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:52:58 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
started
Oct 11, 2022 3:52:58 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:52:59 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:53:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:53:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:53:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:53:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:53:21 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:53:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:53:46 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:54:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:54:55 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
Oct 11, 2022 3:55:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 11, 2022 3:55:37 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371/
before loading them.
Oct 11, 2022 3:55:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371/f654a894-4b0e-4d76-8046-2edc6832aa08.
Oct 11, 2022 3:55:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:55:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:55:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:55:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0
pending. retrying.
Oct 11, 2022 3:55:39 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665503736974_9,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 3:55:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0
Oct 11, 2022 3:55:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0
started
Oct 11, 2022 3:55:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0
Oct 11, 2022 3:55:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0
Oct 11, 2022 3:55:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:55:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665503740017","endTime":"1665503741723","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"971","totalSlotMs":"137","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1483","totalSlotMs":"137","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"137"}],"reservation_id":"default-pipeline","startTime":"1665503740206","totalSlotMs":"137","finalExecutionDurationMs":"742"}
Oct 11, 2022 3:55:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10111555372cb8d31d_0411c5086f1f4df0a465a605ffe8c371_7e99dc8063d45153be090c469a325d19_00001_00000-0
completed successfully.
Oct 11, 2022 3:55:45 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1011155544eb50d180_13ed5b52824a47f1b1db20f8d9b3f8b1
Oct 11, 2022 3:55:45 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1011155544eb50d180_13ed5b52824a47f1b1db20f8d9b3f8b1,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1011155544eb50d180_13ed5b52824a47f1b1db20f8d9b3f8b1
Oct 11, 2022 3:55:45 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1011155544eb50d180_13ed5b52824a47f1b1db20f8d9b3f8b1,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1011155544eb50d180_13ed5b52824a47f1b1db20f8d9b3f8b1
Oct 11, 2022 3:55:46 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1011155544eb50d180_13ed5b52824a47f1b1db20f8d9b3f8b1,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:55:46 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1011155544eb50d180_13ed5b52824a47f1b1db20f8d9b3f8b1
Oct 11, 2022 3:55:46 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 11, 2022 3:55:46 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/13ed5b52824a47f1b1db20f8d9b3f8b1/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1011154520-8e4d1a3c
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1011154520-8e4d1a3c
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1011154520-8e4d1a3c
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1011154520-8e4d1a3c
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 11, 2022 3:57:00 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:57:00 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665503578206","endTime":"1665503742290","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"160342","totalSlotMs":"312498","pendingUnits":"4399","completedUnits":"3646","activeUnits":"998","estimatedRunnableUnits":"0"},{"elapsedMs":"160843","totalSlotMs":"728694","pendingUnits":"5","completedUnits":"8040","activeUnits":"998","estimatedRunnableUnits":"0"},{"elapsedMs":"162342","totalSlotMs":"821003","pendingUnits":"1","completedUnits":"8545","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"163402","totalSlotMs":"821310","pendingUnits":"0","completedUnits":"8546","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"821310"}],"reservation_id":"default-pipeline","startTime":"1665503578675","totalSlotMs":"821310","finalExecutionDurationMs":"3641"}
Oct 11, 2022 3:57:00 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10111547146a275b96_7263229957e54812b3f187183e57f0da_caad74ed3f5fcc198ec364c80a270f0e_00001_00000-0
completed successfully.
Oct 11, 2022 3:57:07 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 11, 2022 3:57:07 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665503232205
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 11, 2022 3:57:08 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665503827559
Oct 11, 2022 3:57:09 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins101115570986af5035_679cfb62248940a188860c645753d441
Oct 11, 2022 3:57:09 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins101115570986af5035_679cfb62248940a188860c645753d441,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins101115570986af5035_679cfb62248940a188860c645753d441
Oct 11, 2022 3:57:09 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins101115570986af5035_679cfb62248940a188860c645753d441,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins101115570986af5035_679cfb62248940a188860c645753d441
Oct 11, 2022 3:57:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins101115570986af5035_679cfb62248940a188860c645753d441,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:57:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins101115570986af5035_679cfb62248940a188860c645753d441
Oct 11, 2022 3:57:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 11, 2022 3:57:11 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/679cfb62248940a188860c645753d441/000000000000.avro
Oct 11, 2022 3:57:11 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/
before loading them.
Oct 11, 2022 3:57:11 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/679cfb62248940a188860c645753d441/000000000000.avro
matched 1 files with total size 119755
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/af381c1b-e5ac-4831-8a27-21fbc15be7f2.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/9d318844-97b1-4834-a81d-7b7fc92d08db.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/293f1ade-6a83-415f-9eee-af4762e13fd6.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/564a3402-41ba-47f7-a917-6c12b80c1cc7.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/c0d7161d-ecd1-4b91-b6ef-d6ed1c0f23b8.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/41c4ca4e-8320-4e86-b1dd-5c0dd55d06df.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/89af5109-9639-4acc-a71f-130be20991c8.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/1c35be4e-3cf7-4d57-b493-88f6b31041bb.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/26d9988a-c837-4069-87e3-050f62f90fcd.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/391911fc-bb88-4e07-8aa6-4a147c1b9e1d.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/1dc91a1b-4e25-46d8-9825-898b27d6aa3d.
Oct 11, 2022 3:57:12 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd/6ca2a9e7-1299-492f-8129-e78f8e56deb4.
Oct 11, 2022 3:57:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:57:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:57:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:57:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0
pending. retrying.
Oct 11, 2022 3:57:14 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665503827559,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 3:57:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0
Oct 11, 2022 3:57:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0
started
Oct 11, 2022 3:57:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0
Oct 11, 2022 3:57:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0
Oct 11, 2022 3:57:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:57:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665503834915","endTime":"1665503837398","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1158","totalSlotMs":"36","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2285","totalSlotMs":"616","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"616"}],"reservation_id":"default-pipeline","startTime":"1665503835084","totalSlotMs":"616","finalExecutionDurationMs":"1339"}
Oct 11, 2022 3:57:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101115570986af5035_a5815535e3354e5bbfccbe2b0063e7fd_711c80f219c13e9cb15c5c349269c47e_00001_00000-0
completed successfully.
Oct 11, 2022 3:57:19 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 11, 2022 3:57:19 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665503827559
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 56s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qgdsf46xte35e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
