See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/806/display/redirect?page=changes>
Changes:
[Moritz Mack] Downgrade Scala version in Spark job-server to prevent Scala
------------------------------------------
[...truncated 7.53 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4/47b4ea6f-2cc9-4ab4-ab5a-56d2c6ad4fe7.
Oct 11, 2022 9:51:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4/edc192fb-1845-43aa-964a-5e54dedb9e58.
Oct 11, 2022 9:51:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4/f1b7a016-28f0-4c05-9173-db9cd45dd19d.
Oct 11, 2022 9:51:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4/3eeca28d-33cf-498d-9933-e14d8b3872cc.
Oct 11, 2022 9:51:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4/10f4a001-6125-4dff-ad9c-fa4e35c8065e.
Oct 11, 2022 9:51:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4/f90cd0c4-9d25-4185-9b67-7668a785390d.
Oct 11, 2022 9:51:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4/6f06578c-ba02-4814-a447-1ddba07b5701.
Oct 11, 2022 9:52:58 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:52:58 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:52:59 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:52:59 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
pending. retrying.
Oct 11, 2022 9:53:00 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665481631848,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 9:53:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
started
Oct 11, 2022 9:53:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:26 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:53:57 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:54:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
Oct 11, 2022 9:55:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 11, 2022 9:55:48 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7/
before loading them.
Oct 11, 2022 9:55:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7/05627adb-b61a-47b2-90f5-d1f213fd078b.
Oct 11, 2022 9:55:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:55:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:55:49 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:55:49 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0
pending. retrying.
Oct 11, 2022 9:55:50 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665482147620_4,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 9:55:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0
Oct 11, 2022 9:55:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0
started
Oct 11, 2022 9:55:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0
Oct 11, 2022 9:55:52 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0
Oct 11, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665482150916","endTime":"1665482152760","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"975","totalSlotMs":"193","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"},{"elapsedMs":"1608","totalSlotMs":"193","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"193"}],"reservation_id":"default-pipeline","startTime":"1665482151118","totalSlotMs":"193","finalExecutionDurationMs":"812"}
Oct 11, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101109554877187242_eb04ae5c63904b3e9c933dce8530bbe7_fdb770b9091a98542b2fc2dc43fcb087_00001_00000-0
completed successfully.
Oct 11, 2022 9:55:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110955567930e54_79445e6f6e7340948e789bb6705b7d02
Oct 11, 2022 9:55:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110955567930e54_79445e6f6e7340948e789bb6705b7d02,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110955567930e54_79445e6f6e7340948e789bb6705b7d02
Oct 11, 2022 9:55:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110955567930e54_79445e6f6e7340948e789bb6705b7d02,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110955567930e54_79445e6f6e7340948e789bb6705b7d02
Oct 11, 2022 9:55:57 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110955567930e54_79445e6f6e7340948e789bb6705b7d02,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 9:55:57 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110955567930e54_79445e6f6e7340948e789bb6705b7d02
Oct 11, 2022 9:55:57 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 11, 2022 9:55:57 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/79445e6f6e7340948e789bb6705b7d02/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1011094528-e6668c47
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1011094528-e6668c47
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1011094528-e6668c47
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1011094528-e6668c47
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 11, 2022 9:56:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 9:56:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665481981030","endTime":"1665482127288","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"143396","totalSlotMs":"347125","pendingUnits":"3856","completedUnits":"4189","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"144483","totalSlotMs":"817516","pendingUnits":"1","completedUnits":"8545","activeUnits":"500","estimatedRunnableUnits":"0"},{"elapsedMs":"145574","totalSlotMs":"817911","pendingUnits":"0","completedUnits":"8546","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"817911"}],"reservation_id":"default-pipeline","startTime":"1665481981494","totalSlotMs":"817911","finalExecutionDurationMs":"2500"}
Oct 11, 2022 9:56:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1011094715e3b1391e_c8fdec49c6584243a3b590c5b78981d4_e828094c942aaa1d3744bec0b9c7846f_00001_00000-0
completed successfully.
Oct 11, 2022 9:56:25 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 11, 2022 9:56:25 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665481631848
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 11, 2022 9:56:26 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665482185853
Oct 11, 2022 9:56:27 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1011095627830085ae_7aad4e45a289488dbed3a65e8e4ef0ea
Oct 11, 2022 9:56:28 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1011095627830085ae_7aad4e45a289488dbed3a65e8e4ef0ea,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1011095627830085ae_7aad4e45a289488dbed3a65e8e4ef0ea
Oct 11, 2022 9:56:28 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1011095627830085ae_7aad4e45a289488dbed3a65e8e4ef0ea,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1011095627830085ae_7aad4e45a289488dbed3a65e8e4ef0ea
Oct 11, 2022 9:56:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1011095627830085ae_7aad4e45a289488dbed3a65e8e4ef0ea,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 9:56:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1011095627830085ae_7aad4e45a289488dbed3a65e8e4ef0ea
Oct 11, 2022 9:56:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 11, 2022 9:56:29 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/7aad4e45a289488dbed3a65e8e4ef0ea/000000000000.avro
Oct 11, 2022 9:56:29 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/
before loading them.
Oct 11, 2022 9:56:29 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/7aad4e45a289488dbed3a65e8e4ef0ea/000000000000.avro
matched 1 files with total size 119755
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/455981e6-9aa8-44d2-99a5-fb36d4094cc2.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/17a5bf48-b0b3-4e6d-bf43-9e2f01c82867.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/bdea27b4-9536-4dc3-9400-958c0e4ad307.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/6eebc54c-844f-4939-a6df-02978dc7d1eb.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/9e2d6e1b-b316-42ec-afbb-6d1d005f1015.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/8acd0852-4582-4daa-a3e0-63939677e6a6.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/91c4d01f-4814-4676-9692-f20452f6b64c.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/5b161a78-297c-40fe-9bf6-9a93fed75fa7.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/2ab91d75-5b97-4981-ac26-1909991590df.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/2129b93c-0a50-492a-8b4f-35b95a35f2cb.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/bbd419c2-c028-421d-8ee0-15fe913da2fa.
Oct 11, 2022 9:56:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd/252d4f3f-f9b5-40f1-a2fb-4435512b66b7.
Oct 11, 2022 9:56:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:56:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:56:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 9:56:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0
pending. retrying.
Oct 11, 2022 9:56:32 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665482185853,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 9:56:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0
Oct 11, 2022 9:56:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0
started
Oct 11, 2022 9:56:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0
Oct 11, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0
Oct 11, 2022 9:56:35 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0
Oct 11, 2022 9:56:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 9:56:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665482193118","endTime":"1665482195589","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1237","totalSlotMs":"40","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2256","totalSlotMs":"440","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"440"}],"reservation_id":"default-pipeline","startTime":"1665482193304","totalSlotMs":"440","finalExecutionDurationMs":"1270"}
Oct 11, 2022 9:56:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1011095627830085ae_0757fe4785314daf9f55d5cac33980cd_349f3cd7c0e0f60e1e19e2cdd28ee67e_00001_00000-0
completed successfully.
Oct 11, 2022 9:56:39 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 11, 2022 9:56:39 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665482185853
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 13s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xc5oycrwwmqw4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
