See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/810/display/redirect?page=changes>
Changes:
[noreply] Remove obsolete and deprecated bigquery native write. #23557 (#23558)
[noreply] Increase Python PostCommit timeout. (#23595)
------------------------------------------
[...truncated 7.74 MB...]
Oct 12, 2022 9:51:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0/748ab0e6-6565-443c-b48d-acc9f196dc93.
Oct 12, 2022 9:51:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0/5e3d1212-cff1-440a-8682-9391da2c366a.
Oct 12, 2022 9:51:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0/72ae20e9-7578-4c62-a956-dd571486ef18.
Oct 12, 2022 9:51:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0/c7ec472a-1f41-46c3-a904-19b6bc5d8738.
Oct 12, 2022 9:51:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0/bbefb8d8-b4f8-4263-aea3-8ebf0adb6a18.
Oct 12, 2022 9:51:18 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0/c85177d4-e50a-4257-a6bc-ece8daa3b81a.
Oct 12, 2022 9:52:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:52:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:52:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:52:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
pending. retrying.
Oct 12, 2022 9:52:35 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665568020706,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 9:52:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:52:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
started
Oct 12, 2022 9:52:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:52:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:52:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:52:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:52:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:52:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:52:56 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:53:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:53:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
Oct 12, 2022 9:54:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 12, 2022 9:54:34 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548/
before loading them.
Oct 12, 2022 9:54:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548/63c094c3-a185-4386-b904-993f23a3a2e6.
Oct 12, 2022 9:54:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:54:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:54:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:54:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0
pending. retrying.
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 12, 2022 9:54:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 12, 2022 9:54:35 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665568473299_23,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 9:54:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0
Oct 12, 2022 9:54:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0
started
Oct 12, 2022 9:54:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0
Oct 12, 2022 9:54:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0
Oct 12, 2022 9:54:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 9:54:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665568475815","endTime":"1665568477413","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"873","totalSlotMs":"223","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1423","totalSlotMs":"223","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"223"}],"reservation_id":"default-pipeline","startTime":"1665568475966","totalSlotMs":"223","finalExecutionDurationMs":"723"}
Oct 12, 2022 9:54:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1012095434a7eab82d_665d2a630c6440b1b9971620ac661548_f89cc196957559a98863288143e350cd_00001_00000-0
completed successfully.
Oct 12, 2022 9:54:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012095440e048346e_b9dd18e1236e4d49b7d738ed8188b234
Oct 12, 2022 9:54:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012095440e048346e_b9dd18e1236e4d49b7d738ed8188b234,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012095440e048346e_b9dd18e1236e4d49b7d738ed8188b234
Oct 12, 2022 9:54:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012095440e048346e_b9dd18e1236e4d49b7d738ed8188b234,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012095440e048346e_b9dd18e1236e4d49b7d738ed8188b234
Oct 12, 2022 9:54:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012095440e048346e_b9dd18e1236e4d49b7d738ed8188b234,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 9:54:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1012095440e048346e_b9dd18e1236e4d49b7d738ed8188b234
Oct 12, 2022 9:54:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 12, 2022 9:54:41 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/b9dd18e1236e4d49b7d738ed8188b234/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1012094512-4515564b
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1012094512-4515564b
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1012094512-4515564b
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1012094512-4515564b
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 12, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665568356089","endTime":"1665568498294","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"139287","totalSlotMs":"289492","pendingUnits":"3794","completedUnits":"4251","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"139795","totalSlotMs":"561378","pendingUnits":"501","completedUnits":"8045","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"140854","totalSlotMs":"683007","pendingUnits":"0","completedUnits":"8546","activeUnits":"11","estimatedRunnableUnits":"0"},{"elapsedMs":"141604","totalSlotMs":"683007","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"683007"}],"reservation_id":"default-pipeline","startTime":"1665568356496","totalSlotMs":"683007","finalExecutionDurationMs":"2744"}
Oct 12, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10120947036572261c_b15fc7de76e74b32affeadfdc1bc80e0_28674cddb73a950e96f97d4afe19fcef_00001_00000-0
completed successfully.
Oct 12, 2022 9:55:59 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 12, 2022 9:55:59 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665568020706
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 12, 2022 9:56:00 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665568559998
Oct 12, 2022 9:56:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins101209560137a9a029_6061cc70d49f4c7f85b3ed038f365d63
Oct 12, 2022 9:56:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins101209560137a9a029_6061cc70d49f4c7f85b3ed038f365d63,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins101209560137a9a029_6061cc70d49f4c7f85b3ed038f365d63
Oct 12, 2022 9:56:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins101209560137a9a029_6061cc70d49f4c7f85b3ed038f365d63,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins101209560137a9a029_6061cc70d49f4c7f85b3ed038f365d63
Oct 12, 2022 9:56:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins101209560137a9a029_6061cc70d49f4c7f85b3ed038f365d63,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 9:56:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins101209560137a9a029_6061cc70d49f4c7f85b3ed038f365d63
Oct 12, 2022 9:56:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 12, 2022 9:56:03 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/6061cc70d49f4c7f85b3ed038f365d63/000000000000.avro
Oct 12, 2022 9:56:03 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/
before loading them.
Oct 12, 2022 9:56:03 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/6061cc70d49f4c7f85b3ed038f365d63/000000000000.avro
matched 1 files with total size 119755
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/1df2c778-f278-47a9-8f57-0a796423358c.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/609dc9a1-8670-4460-8d72-6f6d89aa9ffb.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/52711db1-7eed-454c-8e71-b8173014da53.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/90e05b41-a24f-4431-8c6c-7cd7a5d40311.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/5fcaa9cd-e7fa-4821-aaae-dbe37019ff0f.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/924597e9-6894-433b-925c-8b391e32eb0e.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/46d35035-e7eb-4148-a3ce-bcdbd21afa68.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/6d5e5f46-5b53-4ade-ac69-9c133e364069.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/80514cd1-36ca-426c-bae0-6bf9ae5367d9.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/4aa51d18-61d5-43c0-ae0f-94ccc6e3d83a.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/d42664fd-df37-47f1-8928-167a8843819d.
Oct 12, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33/257b9475-78c5-400a-bdfc-f0bf83c75933.
Oct 12, 2022 9:56:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:56:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:56:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 12, 2022 9:56:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0
pending. retrying.
Oct 12, 2022 9:56:06 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665568559998,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 12, 2022 9:56:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0
Oct 12, 2022 9:56:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0
started
Oct 12, 2022 9:56:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0
Oct 12, 2022 9:56:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0
Oct 12, 2022 9:56:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 12, 2022 9:56:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665568566423","endTime":"1665568568836","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1200","totalSlotMs":"713","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2223","totalSlotMs":"1747","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"1747"}],"reservation_id":"default-pipeline","startTime":"1665568566586","totalSlotMs":"1747","finalExecutionDurationMs":"1241"}
Oct 12, 2022 9:56:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101209560137a9a029_4dae8692c3b34ce3bf60b9db65570f33_1f8cce951c44481c6a8e491e2a2fd6ed_00001_00000-0
completed successfully.
Oct 12, 2022 9:56:10 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 12, 2022 9:56:11 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665568559998
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 45s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xffjgstt5hh3e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
