See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/799/display/redirect>
Changes:
------------------------------------------
[...truncated 7.73 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5/4ee1dbdb-1ee2-4be9-bb09-92b86c0f1093.
Oct 09, 2022 3:51:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5/d0c1aa7d-473a-4db7-bc84-3b25225481d4.
Oct 09, 2022 3:51:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5/c92a1f6b-ee02-4024-a968-350e7490ad1b.
Oct 09, 2022 3:51:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5/dd45efa3-be6a-4ba9-8938-45bce51fdc6b.
Oct 09, 2022 3:51:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5/ac326186-5c75-4fd9-b952-34e5314e1046.
Oct 09, 2022 3:51:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5/387b5203-0dc2-4ae5-beb4-ff5cfbee274d.
Oct 09, 2022 3:51:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5/c6d582ac-bb69-4bc6-a722-bb95f0ae6226.
Oct 09, 2022 3:53:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:53:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:53:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:53:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
pending. retrying.
Oct 09, 2022 3:53:14 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665330442770,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 3:53:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:53:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
started
Oct 09, 2022 3:53:15 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:53:16 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:53:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:53:20 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:53:25 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:53:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:53:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:54:00 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:54:21 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:54:37 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 09, 2022 3:55:10 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094/
before loading them.
Oct 09, 2022 3:55:10 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094/890cca16-24f2-4c50-a986-cdfe0d326dfb.
Oct 09, 2022 3:55:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:55:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:55:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:55:11 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0
pending. retrying.
Oct 09, 2022 3:55:12 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665330909658_17,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 3:55:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0
Oct 09, 2022 3:55:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0
started
Oct 09, 2022 3:55:13 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0
Oct 09, 2022 3:55:14 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0
Oct 09, 2022 3:55:16 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:55:16 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0
succeeded. Statistics:
{"creationTime":"1665330913116","endTime":"1665330914605","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"1319","totalSlotMs":"377","pendingUnits":"0","completedUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"377"}],"reservation_id":"default-pipeline","startTime":"1665330913253","totalSlotMs":"377","finalExecutionDurationMs":"639"}
Oct 09, 2022 3:55:16 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1009155510c75cb9e9_a25baf5102c34ac8a8773dcd1399a094_803407f1aae3fa9abeebd48c1136a346_00001_00000-0
completed successfully.
Oct 09, 2022 3:55:18 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009155518f4bded29_2dc15e53ebae4c91b37c446d671e6328
Oct 09, 2022 3:55:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009155518f4bded29_2dc15e53ebae4c91b37c446d671e6328,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009155518f4bded29_2dc15e53ebae4c91b37c446d671e6328
Oct 09, 2022 3:55:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009155518f4bded29_2dc15e53ebae4c91b37c446d671e6328,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009155518f4bded29_2dc15e53ebae4c91b37c446d671e6328
Oct 09, 2022 3:55:20 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009155518f4bded29_2dc15e53ebae4c91b37c446d671e6328,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:55:20 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1009155518f4bded29_2dc15e53ebae4c91b37c446d671e6328
Oct 09, 2022 3:55:20 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 09, 2022 3:55:20 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/2dc15e53ebae4c91b37c446d671e6328/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1009154532-9de3a4ce
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1009154532-9de3a4ce
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1009154532-9de3a4ce
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1009154532-9de3a4ce
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 09, 2022 3:55:30 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:56:21 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
Oct 09, 2022 3:56:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:56:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665330794727","endTime":"1665330989135","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"190377","totalSlotMs":"267676","pendingUnits":"4665","completedUnits":"3380","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"190880","totalSlotMs":"617072","pendingUnits":"469","completedUnits":"7576","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"192125","totalSlotMs":"674679","pendingUnits":"415","completedUnits":"8131","activeUnits":"415","estimatedRunnableUnits":"0"},{"elapsedMs":"192626","totalSlotMs":"753116","pendingUnits":"1","completedUnits":"8545","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"193793","totalSlotMs":"753461","pendingUnits":"0","completedUnits":"8546","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"753461"}],"reservation_id":"default-pipeline","startTime":"1665330795121","totalSlotMs":"753461","finalExecutionDurationMs":"3648"}
Oct 09, 2022 3:56:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10091547259da70cdf_1a231b968473453fa7e804895499a3f5_67237968de9574d7d2de303fe0cf8e05_00001_00000-0
completed successfully.
Oct 09, 2022 3:56:59 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 09, 2022 3:56:59 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665330442770
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 09, 2022 3:56:59 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665331019460
Oct 09, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1009155701b2b6d16b_47e85fae75044fc6b46aaacda583ccea
Oct 09, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1009155701b2b6d16b_47e85fae75044fc6b46aaacda583ccea,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1009155701b2b6d16b_47e85fae75044fc6b46aaacda583ccea
Oct 09, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1009155701b2b6d16b_47e85fae75044fc6b46aaacda583ccea,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1009155701b2b6d16b_47e85fae75044fc6b46aaacda583ccea
Oct 09, 2022 3:57:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1009155701b2b6d16b_47e85fae75044fc6b46aaacda583ccea,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:57:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1009155701b2b6d16b_47e85fae75044fc6b46aaacda583ccea
Oct 09, 2022 3:57:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 09, 2022 3:57:02 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/47e85fae75044fc6b46aaacda583ccea/000000000000.avro
Oct 09, 2022 3:57:02 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/
before loading them.
Oct 09, 2022 3:57:03 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/47e85fae75044fc6b46aaacda583ccea/000000000000.avro
matched 1 files with total size 119755
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/bde6d837-a97b-479a-a898-b2cc3ed962d5.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/fb888a36-fcd5-4a73-8c01-b00173c2b519.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/1b69d988-3dc2-4998-9c3a-da025fb18fd5.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/2c9ba1bc-1057-415d-85ee-f26074f119a6.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/e43754d4-0a01-4822-ae1b-8fa8387c1eed.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/a7d51bf1-52d2-4712-a87a-e50054c656d6.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/1354c22e-3c4b-4c81-b2f0-5ab3f67ed167.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/3cd768dd-b21e-46ec-b52a-9ab3e310ce9a.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/7248ab99-bdd0-4944-b1fe-ba4b7a43e4b9.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/50385fab-ec6b-44f0-9a1b-0f6cb07c2611.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/bb8795b2-d6f0-47be-9ea7-c9f9b12fb3d6.
Oct 09, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be/5475a65c-61aa-428c-a5bd-d51b087df345.
Oct 09, 2022 3:57:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:57:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:57:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:57:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0
pending. retrying.
Oct 09, 2022 3:57:05 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665331019460,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0
Oct 09, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0
started
Oct 09, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0
Oct 09, 2022 3:57:07 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0
Oct 09, 2022 3:57:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:57:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665331025821","endTime":"1665331028158","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1149","totalSlotMs":"48","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2134","totalSlotMs":"501","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"501"}],"reservation_id":"default-pipeline","startTime":"1665331025995","totalSlotMs":"501","finalExecutionDurationMs":"1209"}
Oct 09, 2022 3:57:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009155701b2b6d16b_6f0694ee75784bc2ace1bba1753609be_a48ce8b9e69a06cc18cb357b255a5ef8_00001_00000-0
completed successfully.
Oct 09, 2022 3:57:10 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 09, 2022 3:57:10 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665331019460
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 43s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6d2lzgqpnrrbu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
