See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/809/display/redirect?page=changes>
Changes:
[noreply] Feature/name all java threads (#23387)
[noreply] [Go SDK] Don't construct plans in lock section. (#23583)
------------------------------------------
[...truncated 7.74 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f/48af7c37-1eec-40e0-85c0-be612d196b93.
Oct 12, 2022 3:51:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f/ba7ae140-1a54-426e-9e97-53a6d8bb442b.
Oct 12, 2022 3:51:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f/4f60f69a-6844-4d72-a141-7f58f4127d60.
Oct 12, 2022 3:51:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f/df4882fe-db47-4acd-a203-0c249c63db6c.
Oct 12, 2022 3:51:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f/6016ec57-549a-474c-8fb4-68f6d3d33066.
Oct 12, 2022 3:51:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f/b3592c25-4955-4805-85df-979c6ea91ad9.
Oct 12, 2022 3:51:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f/b4e6ffdf-7af3-4df9-9f9c-188f16a3ab2b.
Oct 12, 2022 3:53:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:53:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:53:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:53:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
pending. retrying.
Oct 12, 2022 3:53:04 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665546430869,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 3:53:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:53:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
started
Oct 12, 2022 3:53:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:53:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:53:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:53:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:53:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:53:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:53:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:53:43 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:54:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:54:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:54:52 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 12, 2022 3:55:15 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d/
before loading them.
Oct 12, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d/c86bc9cc-0903-4e71-89ac-afd3f888ddf8.
Oct 12, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0
pending. retrying.
Oct 12, 2022 3:55:16 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665546914172_17,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 3:55:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0
Oct 12, 2022 3:55:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0
started
Oct 12, 2022 3:55:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0
Oct 12, 2022 3:55:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0
Oct 12, 2022 3:55:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:55:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665546917016","endTime":"1665546918629","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"898","totalSlotMs":"148","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1430","totalSlotMs":"148","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"148"}],"reservation_id":"default-pipeline","startTime":"1665546917166","totalSlotMs":"148","finalExecutionDurationMs":"720"}
Oct 12, 2022 3:55:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101203551515aec285_31ab69738bc14ac1addb7f70da99577d_7305dda09c59f164498725c7d620f98d_00001_00000-0
completed successfully.
Oct 12, 2022 3:55:21 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012035521e3ebbe7f_c89fa3af1c494dcda68512e0feeacb41
Oct 12, 2022 3:55:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012035521e3ebbe7f_c89fa3af1c494dcda68512e0feeacb41,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012035521e3ebbe7f_c89fa3af1c494dcda68512e0feeacb41
Oct 12, 2022 3:55:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012035521e3ebbe7f_c89fa3af1c494dcda68512e0feeacb41,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012035521e3ebbe7f_c89fa3af1c494dcda68512e0feeacb41
Oct 12, 2022 3:55:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012035521e3ebbe7f_c89fa3af1c494dcda68512e0feeacb41,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:55:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012035521e3ebbe7f_c89fa3af1c494dcda68512e0feeacb41
Oct 12, 2022 3:55:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 12, 2022 3:55:22 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/c89fa3af1c494dcda68512e0feeacb41/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1012034521-6fe4d89e
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1012034521-6fe4d89e
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1012034521-6fe4d89e
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1012034521-6fe4d89e
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 12, 2022 3:55:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
Oct 12, 2022 3:56:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:56:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665546784852","endTime":"1665546956335","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"162187","totalSlotMs":"0","pendingUnits":"8045","completedUnits":"0","activeUnits":"0","estimatedRunnableUnits":"0"},{"elapsedMs":"164187","totalSlotMs":"0","pendingUnits":"8045","completedUnits":"0","activeUnits":"0","estimatedRunnableUnits":"1000"},{"elapsedMs":"165188","totalSlotMs":"0","pendingUnits":"8045","completedUnits":"0","activeUnits":"0","estimatedRunnableUnits":"1000"},{"elapsedMs":"166731","totalSlotMs":"1640","pendingUnits":"8029","completedUnits":"16","activeUnits":"5","estimatedRunnableUnits":"1000"},{"elapsedMs":"167744","totalSlotMs":"85237","pendingUnits":"5337","completedUnits":"2708","activeUnits":"998","estimatedRunnableUnits":"999"},{"elapsedMs":"168745","totalSlotMs":"282029","pendingUnits":"501","completedUnits":"8045","activeUnits":"98","estimatedRunnableUnits":"999"},{"elapsedMs":"169803","totalSlotMs":"321905","pendingUnits":"1","completedUnits":"8545","activeUnits":"10","estimatedRunnableUnits":"619"},{"elapsedMs":"170786","totalSlotMs":"322890","pendingUnits":"0","completedUnits":"8546","activeUnits":"1","estimatedRunnableUnits":"619"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"322890"}],"reservation_id":"default-pipeline","startTime":"1665546785287","totalSlotMs":"322890","finalExecutionDurationMs":"9531"}
Oct 12, 2022 3:56:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1012034713d152c28f_3e8b9506d832483ab92af5ed66e19a3f_f2617b83db80fc096ce89a65ae3b253f_00001_00000-0
completed successfully.
Oct 12, 2022 3:56:13 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 12, 2022 3:56:13 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665546430869
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 12, 2022 3:56:14 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665546973562
Oct 12, 2022 3:56:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins101203561546679bc3_5d713104cc544de8841196ffed26304c
Oct 12, 2022 3:56:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins101203561546679bc3_5d713104cc544de8841196ffed26304c,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins101203561546679bc3_5d713104cc544de8841196ffed26304c
Oct 12, 2022 3:56:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins101203561546679bc3_5d713104cc544de8841196ffed26304c,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins101203561546679bc3_5d713104cc544de8841196ffed26304c
Oct 12, 2022 3:56:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins101203561546679bc3_5d713104cc544de8841196ffed26304c,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:56:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins101203561546679bc3_5d713104cc544de8841196ffed26304c
Oct 12, 2022 3:56:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 12, 2022 3:56:16 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/5d713104cc544de8841196ffed26304c/000000000000.avro
Oct 12, 2022 3:56:16 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/
before loading them.
Oct 12, 2022 3:56:16 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/5d713104cc544de8841196ffed26304c/000000000000.avro
matched 1 files with total size 119755
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/634c0588-fb5e-41fb-8172-e584013ec935.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/6669c7b0-6cea-43cb-b409-08c297df280d.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/7ee4b5c1-26ff-48d7-8947-7e0c78e2dd34.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/c467fe7b-98ba-45ab-91b9-8e7e28489d97.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/6cdc995c-1284-480a-836f-13a6dac4e34d.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/2690644b-a48a-433f-869e-5a45b9d404bd.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/fcd6d291-a89c-43b6-97fb-3612680ec5f5.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/887ba61b-50e7-40d2-a12a-9e4b60b35e43.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/60486fbf-2b08-44bd-a867-f7f8295b5660.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/aae7817c-088f-45bb-8d73-cc5ab7bb0b76.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/6c461978-7517-490b-8a72-cdd547de250c.
Oct 12, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72/e8e75de3-5fef-458e-932f-461099d0ca03.
Oct 12, 2022 3:56:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:56:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:56:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 3:56:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0
pending. retrying.
Oct 12, 2022 3:56:19 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665546973562,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 3:56:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0
Oct 12, 2022 3:56:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0
started
Oct 12, 2022 3:56:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0
Oct 12, 2022 3:56:21 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0
Oct 12, 2022 3:56:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 3:56:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665546980121","endTime":"1665546982809","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1455","totalSlotMs":"260","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2467","totalSlotMs":"712","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"712"}],"reservation_id":"default-pipeline","startTime":"1665546980316","totalSlotMs":"712","finalExecutionDurationMs":"1235"}
Oct 12, 2022 3:56:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101203561546679bc3_273296c199b14a688bb812cbcb83bc72_e5e5f4edf31a8583e66c268bb03dca71_00001_00000-0
completed successfully.
Oct 12, 2022 3:56:25 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 12, 2022 3:56:25 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665546973562
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 51s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pn245zflaawfy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
