See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/794/display/redirect>
Changes:
------------------------------------------
[...truncated 7.76 MB...]
Oct 08, 2022 9:51:52 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02/081a75d4-3929-4c11-a0d7-b46c4efc4689.
Oct 08, 2022 9:51:52 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02/20adad04-a9a9-4219-a4ab-7eaaadce500e.
Oct 08, 2022 9:53:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:53:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:53:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:53:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
pending. retrying.
Oct 08, 2022 9:53:13 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665222431440,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 9:53:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
started
Oct 08, 2022 9:53:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:29 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:53:59 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:54:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
Oct 08, 2022 9:55:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 08, 2022 9:55:52 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923/
before loading them.
Oct 08, 2022 9:55:52 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923/ac99d93c-9c24-4005-a5fb-8172dd526232.
Oct 08, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:55:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
pending. retrying.
Oct 08, 2022 9:55:54 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665222951214_26,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 9:55:55 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
Oct 08, 2022 9:55:55 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
started
Oct 08, 2022 9:55:55 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
Oct 08, 2022 9:55:57 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
Oct 08, 2022 9:55:59 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
Oct 08, 2022 9:56:01 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
Oct 08, 2022 9:56:04 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
Oct 08, 2022 9:56:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:56:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
succeeded. Statistics:
{"creationTime":"1665222955325","endTime":"1665222967037","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"11511","totalSlotMs":"200","pendingUnits":"0","completedUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"200"}],"reservation_id":"default-pipeline","startTime":"1665222955493","totalSlotMs":"200","finalExecutionDurationMs":"695"}
Oct 08, 2022 9:56:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10080955522560b65c_7b8a295bc6fe4d8b9390c831dea16923_8cf78fae11b87eafb03b03abaa77d1aa_00001_00000-0
completed successfully.
Oct 08, 2022 9:56:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080956124b43dae2_2b3bc1982f7d4a7b919c6cf8f90a49b0
Oct 08, 2022 9:56:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080956124b43dae2_2b3bc1982f7d4a7b919c6cf8f90a49b0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080956124b43dae2_2b3bc1982f7d4a7b919c6cf8f90a49b0
Oct 08, 2022 9:56:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080956124b43dae2_2b3bc1982f7d4a7b919c6cf8f90a49b0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080956124b43dae2_2b3bc1982f7d4a7b919c6cf8f90a49b0
Oct 08, 2022 9:56:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080956124b43dae2_2b3bc1982f7d4a7b919c6cf8f90a49b0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:56:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10080956124b43dae2_2b3bc1982f7d4a7b919c6cf8f90a49b0
Oct 08, 2022 9:56:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 08, 2022 9:56:14 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/2b3bc1982f7d4a7b919c6cf8f90a49b0/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1008094517-aaf38e61
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1008094517-aaf38e61
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1008094517-aaf38e61
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1008094517-aaf38e61
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 08, 2022 9:56:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:56:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665222793892","endTime":"1665222941165","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"141377","totalSlotMs":"13923","pendingUnits":"7853","completedUnits":"192","activeUnits":"61","estimatedRunnableUnits":"0"},{"elapsedMs":"142378","totalSlotMs":"80328","pendingUnits":"6743","completedUnits":"1302","activeUnits":"94","estimatedRunnableUnits":"0"},{"elapsedMs":"143383","totalSlotMs":"263384","pendingUnits":"2691","completedUnits":"5354","activeUnits":"874","estimatedRunnableUnits":"0"},{"elapsedMs":"144386","totalSlotMs":"415125","pendingUnits":"2","completedUnits":"8544","activeUnits":"3","estimatedRunnableUnits":"930"},{"elapsedMs":"144893","totalSlotMs":"415485","pendingUnits":"0","completedUnits":"8546","activeUnits":"0"},{"elapsedMs":"146499","totalSlotMs":"415485","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"930"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"415485"}],"reservation_id":"default-pipeline","startTime":"1665222794418","totalSlotMs":"415485","finalExecutionDurationMs":"4559"}
Oct 08, 2022 9:56:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008094714180c7f20_0ea9259007404e82b42640f678184c02_9d4da00cc482ac229d1df3ecbc96186a_00001_00000-0
completed successfully.
Oct 08, 2022 9:56:30 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 08, 2022 9:56:30 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665222431440
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 08, 2022 9:56:30 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665222990453
Oct 08, 2022 9:56:32 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1008095632d3525c0d_1e958983f5004c87a4e2670339e465c3
Oct 08, 2022 9:56:32 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1008095632d3525c0d_1e958983f5004c87a4e2670339e465c3,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1008095632d3525c0d_1e958983f5004c87a4e2670339e465c3
Oct 08, 2022 9:56:32 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1008095632d3525c0d_1e958983f5004c87a4e2670339e465c3,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1008095632d3525c0d_1e958983f5004c87a4e2670339e465c3
Oct 08, 2022 9:56:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1008095632d3525c0d_1e958983f5004c87a4e2670339e465c3,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:56:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1008095632d3525c0d_1e958983f5004c87a4e2670339e465c3
Oct 08, 2022 9:56:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 08, 2022 9:56:33 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/1e958983f5004c87a4e2670339e465c3/000000000000.avro
Oct 08, 2022 9:56:33 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/
before loading them.
Oct 08, 2022 9:56:33 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/1e958983f5004c87a4e2670339e465c3/000000000000.avro
matched 1 files with total size 119755
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/de6fc04b-d5de-4a96-bb6b-03e2eff88068.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/e38727ae-dc57-4996-add1-4c1338d2e428.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/0806f3bc-868f-409c-9769-00035252c00e.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/2a7498e3-daef-4845-b85e-5e4df80bbf84.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/eaebd738-dc26-4929-b91e-83b4a577fbd3.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/2eab9229-a956-4604-a2d8-5ac2fa30d74f.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/9e474a3d-ad98-47ac-9e92-0cdf007bf348.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/861c892d-ea79-4df8-bd3b-e8334f01936d.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/8aa77f74-3bd5-4956-9082-7bb4c4e61967.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/2bff5d13-f862-4e24-9739-420968c67d2d.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/de930133-314e-4e8d-8f4b-cf69a3acaac4.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09/47a83f8d-5705-4a69-b36e-cd120ea9e273.
Oct 08, 2022 9:56:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:56:35 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:56:35 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 08, 2022 9:56:35 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0
pending. retrying.
Oct 08, 2022 9:56:35 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665222990453,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 08, 2022 9:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0
Oct 08, 2022 9:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0
started
Oct 08, 2022 9:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0
Oct 08, 2022 9:56:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0
Oct 08, 2022 9:56:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0
Oct 08, 2022 9:56:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 08, 2022 9:56:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665222996222","endTime":"1665222998620","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1189","totalSlotMs":"214","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2192","totalSlotMs":"487","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"487"}],"reservation_id":"default-pipeline","startTime":"1665222996395","totalSlotMs":"487","finalExecutionDurationMs":"1203"}
Oct 08, 2022 9:56:41 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1008095632d3525c0d_0a8692f811334202bd51cb78f9619a09_734a0ea55dd3f6ca426eef7990b8943c_00001_00000-0
completed successfully.
Oct 08, 2022 9:56:42 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 08, 2022 9:56:43 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665222990453
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 13s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qn3yr3cnxcldk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
