See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/796/display/redirect>
Changes:
------------------------------------------
[...truncated 7.54 MB...]
Oct 08, 2022 9:52:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341/8cdbd856-60b6-4ef1-8b18-81ccbbcc8282.
Oct 08, 2022 9:52:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341/7ef58039-7fe6-4afc-9bac-75238d3b6d62.
Oct 08, 2022 9:52:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341/2f97cd13-0432-4673-acb3-7795c68bc0ba.
Oct 08, 2022 9:52:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341/25a25bc1-7254-4720-bf1d-dcb28a0595f0.
Oct 08, 2022 9:52:24 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341/2f0726f3-db21-4e5a-8732-697092ef011d.
Oct 08, 2022 9:53:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:53:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:53:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:53:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
pending. retrying.
Oct 08, 2022 9:53:39 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665265645649,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 9:53:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:53:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
started
Oct 08, 2022 9:53:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:53:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:53:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:53:45 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:53:51 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:53:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:54:07 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:54:22 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:54:46 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:55:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 08, 2022 9:55:31 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74/
before loading them.
Oct 08, 2022 9:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74/d1f6a5eb-3736-4923-887c-383ced1942b0.
Oct 08, 2022 9:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:55:31 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0
pending. retrying.
Oct 08, 2022 9:55:32 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665266130452_14,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 9:55:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0
Oct 08, 2022 9:55:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0
started
Oct 08, 2022 9:55:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0
Oct 08, 2022 9:55:34 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0
Oct 08, 2022 9:55:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:55:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665266133323","endTime":"1665266135090","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"940","totalSlotMs":"375","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1597","totalSlotMs":"375","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"375"}],"reservation_id":"default-pipeline","startTime":"1665266133466","totalSlotMs":"375","finalExecutionDurationMs":"975"}
Oct 08, 2022 9:55:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1008215531fa384290_0440508ab66d42e29badadd2431abc74_7ccb89acc021b38b68236fcfdced2f07_00001_00000-0
completed successfully.
Oct 08, 2022 9:55:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6
Oct 08, 2022 9:55:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6
Oct 08, 2022 9:55:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6
Oct 08, 2022 9:55:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6
Oct 08, 2022 9:55:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:55:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins100821553761dcfe84_2069225a90534d2ba76bdb0f5eeae9e6
Oct 08, 2022 9:55:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 08, 2022 9:55:41 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/2069225a90534d2ba76bdb0f5eeae9e6/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1008214531-7c7afbb2
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1008214531-7c7afbb2
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1008214531-7c7afbb2
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1008214531-7c7afbb2
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 08, 2022 9:55:54 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
Oct 08, 2022 9:56:32 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:56:32 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665266020060","endTime":"1665266182478","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"157400","totalSlotMs":"2274","pendingUnits":"8017","completedUnits":"28","activeUnits":"14","estimatedRunnableUnits":"0"},{"elapsedMs":"158404","totalSlotMs":"45488","pendingUnits":"7373","completedUnits":"672","activeUnits":"111","estimatedRunnableUnits":"0"},{"elapsedMs":"159408","totalSlotMs":"384205","pendingUnits":"501","completedUnits":"8045","activeUnits":"1077","estimatedRunnableUnits":"1000"},{"elapsedMs":"160925","totalSlotMs":"452611","pendingUnits":"0","completedUnits":"8546","activeUnits":"15","estimatedRunnableUnits":"870"},{"elapsedMs":"161789","totalSlotMs":"452611","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"870"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"452611"}],"reservation_id":"default-pipeline","startTime":"1665266020505","totalSlotMs":"452611","finalExecutionDurationMs":"5234"}
Oct 08, 2022 9:56:32 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008214728370d50cb_387778ed0af849b884354605310ad341_5ee23ae5fdf61ddd3d4ff4ac753ce16c_00001_00000-0
completed successfully.
Oct 08, 2022 9:56:37 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 08, 2022 9:56:37 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665265645649
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 08, 2022 9:56:38 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665266197960
Oct 08, 2022 9:56:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins10082156397b52238c_deac59179dea4791aa908297bf003fb3
Oct 08, 2022 9:56:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins10082156397b52238c_deac59179dea4791aa908297bf003fb3,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins10082156397b52238c_deac59179dea4791aa908297bf003fb3
Oct 08, 2022 9:56:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins10082156397b52238c_deac59179dea4791aa908297bf003fb3,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins10082156397b52238c_deac59179dea4791aa908297bf003fb3
Oct 08, 2022 9:56:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins10082156397b52238c_deac59179dea4791aa908297bf003fb3,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:56:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins10082156397b52238c_deac59179dea4791aa908297bf003fb3
Oct 08, 2022 9:56:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 08, 2022 9:56:41 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/deac59179dea4791aa908297bf003fb3/000000000000.avro
Oct 08, 2022 9:56:41 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/
before loading them.
Oct 08, 2022 9:56:42 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/deac59179dea4791aa908297bf003fb3/000000000000.avro
matched 1 files with total size 119755
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/4965eee8-5ca4-4329-ad95-1d30be98bfe1.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/0b5fe7d5-1b80-47bb-be6d-46212c8b3cbc.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/81846e4f-a1c5-4ad2-ab10-a5dba5ef5895.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/669be395-24f7-454c-a57f-2416039e6e25.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/7e926071-66b6-4f16-95a7-91a9a409908b.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/7c29e615-4c7d-4ec9-a312-439ca3f04b69.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/2ef03f38-048b-4f7c-8eb9-d8758c0e2f8a.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/7ee37c67-9bc7-4f33-a179-c744ea097642.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/512d022d-a604-4c97-aa7f-ed9f41f6ec77.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/4d1e0e3a-d437-4db8-80fe-10f3542ec414.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/85fc1676-d1c7-42da-93c4-e30c80be147a.
Oct 08, 2022 9:56:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865/8ef1dd1a-d6ee-4537-9db5-cfe785804802.
Oct 08, 2022 9:56:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:56:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:56:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:56:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0
pending. retrying.
Oct 08, 2022 9:56:44 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665266197960,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 9:56:44 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0
Oct 08, 2022 9:56:44 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0
started
Oct 08, 2022 9:56:44 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0
Oct 08, 2022 9:56:45 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0
Oct 08, 2022 9:56:46 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0
Oct 08, 2022 9:56:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:56:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665266204620","endTime":"1665266206963","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1090","totalSlotMs":"121","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2127","totalSlotMs":"309","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"309"}],"reservation_id":"default-pipeline","startTime":"1665266204800","totalSlotMs":"309","finalExecutionDurationMs":"1195"}
Oct 08, 2022 9:56:49 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10082156397b52238c_8c4cdeafc01b4e8dabadff79c5e84865_737141c7937690520be7b8f28d81d77a_00001_00000-0
completed successfully.
Oct 08, 2022 9:56:50 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 08, 2022 9:56:50 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665266197960
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 21s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dqyavh6h3bxqi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
