See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/792/display/redirect?page=changes>
Changes:
[Moritz Mack] Correctly detect retryable TransientKinesisExceptions (fixes
#23517)
[noreply] Fixing right nav on Get Started page (#23543)
[noreply] Bump google.golang.org/grpc from 1.49.0 to 1.50.0 in /sdks (#23533)
------------------------------------------
[...truncated 7.75 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10/cdbc8144-750d-42bb-98af-b84764d61202.
Oct 07, 2022 9:53:47 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10/102a50f9-0567-42ac-9417-872962160d3b.
Oct 07, 2022 9:53:47 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10/5cb32619-ec56-4994-bba4-75b9f91e7e66.
Oct 07, 2022 9:53:47 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10/ff659805-dd3f-4ecc-a48c-50bec4407ff3.
Oct 07, 2022 9:53:47 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10/a8fd903b-6993-4b7b-9cbc-1e9fee5233d8.
Oct 07, 2022 9:53:47 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10/7b24697e-6164-4efb-86da-9bdad3ec31ce.
Oct 07, 2022 9:53:47 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10/14634365-f476-4d31-941a-2925d9b3ca44.
Oct 07, 2022 9:55:32 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:55:32 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:55:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:55:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
pending. retrying.
Oct 07, 2022 9:55:34 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665179286228,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 07, 2022 9:55:35 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:55:35 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
started
Oct 07, 2022 9:55:35 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:55:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:55:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:55:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:55:44 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:55:51 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:56:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:56:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:56:27 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:56:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
Oct 07, 2022 9:57:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 07, 2022 9:57:32 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182/
before loading them.
Oct 07, 2022 9:57:32 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182/d765748a-7832-4d78-bb15-a55eb41bc82a.
Oct 07, 2022 9:57:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:57:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:57:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:57:33 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0
pending. retrying.
Oct 07, 2022 9:57:34 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665179851770_2,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 07, 2022 9:57:34 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0
Oct 07, 2022 9:57:34 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0
started
Oct 07, 2022 9:57:34 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0
Oct 07, 2022 9:57:35 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0
Oct 07, 2022 9:57:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:57:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665179854523","endTime":"1665179856241","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"918","totalSlotMs":"118","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1471","totalSlotMs":"118","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"118"}],"reservation_id":"default-pipeline","startTime":"1665179854732","totalSlotMs":"118","finalExecutionDurationMs":"709"}
Oct 07, 2022 9:57:36 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins1007215732bb5d186d_31443e8a98fc4ff9818a2dab5a567182_0e17a25465344d20539a7ca5d78f9072_00001_00000-0
completed successfully.
Oct 07, 2022 9:57:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1007215738396051a6_d512d03da7194f5da44d8448822e082e
Oct 07, 2022 9:57:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1007215738396051a6_d512d03da7194f5da44d8448822e082e,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1007215738396051a6_d512d03da7194f5da44d8448822e082e
Oct 07, 2022 9:57:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1007215738396051a6_d512d03da7194f5da44d8448822e082e,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1007215738396051a6_d512d03da7194f5da44d8448822e082e
Oct 07, 2022 9:57:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1007215738396051a6_d512d03da7194f5da44d8448822e082e,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:57:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1007215738396051a6_d512d03da7194f5da44d8448822e082e
Oct 07, 2022 9:57:39 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 07, 2022 9:57:40 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/d512d03da7194f5da44d8448822e082e/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1007214544-1db598de
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1007214544-1db598de
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1007214544-1db598de
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1007214544-1db598de
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 07, 2022 9:58:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:58:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665179734738","endTime":"1665179893623","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"153406","totalSlotMs":"152100","pendingUnits":"6520","completedUnits":"1525","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"153944","totalSlotMs":"488839","pendingUnits":"4526","completedUnits":"3519","activeUnits":"1657","estimatedRunnableUnits":"0"},{"elapsedMs":"154961","totalSlotMs":"1249708","pendingUnits":"2012","completedUnits":"6033","activeUnits":"2034","estimatedRunnableUnits":"0"},{"elapsedMs":"155983","totalSlotMs":"1497159","pendingUnits":"501","completedUnits":"8045","activeUnits":"501","estimatedRunnableUnits":"0"},{"elapsedMs":"157061","totalSlotMs":"1574500","pendingUnits":"0","completedUnits":"8546","activeUnits":"3","estimatedRunnableUnits":"0"},{"elapsedMs":"157983","totalSlotMs":"1574500","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"1574500"}],"reservation_id":"default-pipeline","startTime":"1665179735427","totalSlotMs":"1574500","finalExecutionDurationMs":"4991"}
Oct 07, 2022 9:58:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1007214809c32cd643_ccd85d4f052e4bd29bc18d5e93a59d10_a54d448a933001cb7bf65afe9dcced2f_00001_00000-0
completed successfully.
Oct 07, 2022 9:58:47 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 07, 2022 9:58:48 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665179286228
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 07, 2022 9:58:49 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665179928154
Oct 07, 2022 9:58:50 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins100721585091a9bd9d_4dcf88015cec4e329fffbb6d514de855
Oct 07, 2022 9:58:51 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins100721585091a9bd9d_4dcf88015cec4e329fffbb6d514de855,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins100721585091a9bd9d_4dcf88015cec4e329fffbb6d514de855
Oct 07, 2022 9:58:51 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins100721585091a9bd9d_4dcf88015cec4e329fffbb6d514de855,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins100721585091a9bd9d_4dcf88015cec4e329fffbb6d514de855
Oct 07, 2022 9:58:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins100721585091a9bd9d_4dcf88015cec4e329fffbb6d514de855,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:58:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins100721585091a9bd9d_4dcf88015cec4e329fffbb6d514de855
Oct 07, 2022 9:58:52 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 07, 2022 9:58:52 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/4dcf88015cec4e329fffbb6d514de855/000000000000.avro
Oct 07, 2022 9:58:52 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/
before loading them.
Oct 07, 2022 9:58:52 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/4dcf88015cec4e329fffbb6d514de855/000000000000.avro
matched 1 files with total size 119755
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/a7c663bb-f48e-4bbd-ad75-09c177455514.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/42a78f44-5c40-4f6d-b1d6-b07ecab91624.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/47ddc6c5-f66a-4f32-ba1a-ffeb8d29b425.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/fecac590-d169-4689-b344-0a5221b3d2cf.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/0c88dc4d-f682-4703-a490-9a0246e741a5.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/84ab0db6-8843-4b28-a00d-072d8542d053.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/4a4d1d49-c5a8-449e-89cd-94f3e55027de.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/65ff320e-9f08-4915-a5da-8b966d04345c.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/9ee81f42-d85a-4809-bab8-9bdf15fbc390.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/ec757934-4c25-4f67-aaf0-7a9edb441227.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/21995d84-7e93-480d-bcf6-e82ea0a3e832.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af/a7a7df24-9c82-4201-a26f-e097f5899eab.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 07, 2022 9:58:53 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0
pending. retrying.
Oct 07, 2022 9:58:54 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665179928154,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 07, 2022 9:58:55 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0
Oct 07, 2022 9:58:55 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0
started
Oct 07, 2022 9:58:55 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0
Oct 07, 2022 9:58:56 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0
Oct 07, 2022 9:58:57 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0
Oct 07, 2022 9:58:59 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 07, 2022 9:58:59 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665179935332","endTime":"1665179938165","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1268","totalSlotMs":"135","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2573","totalSlotMs":"298","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"298"}],"reservation_id":"default-pipeline","startTime":"1665179935552","totalSlotMs":"298","finalExecutionDurationMs":"1300"}
Oct 07, 2022 9:58:59 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins100721585091a9bd9d_0a544d122f0a459aa8edd00187e406af_e1ca5d3e057d06f46d6c2faa1359cb01_00001_00000-0
completed successfully.
Oct 07, 2022 9:59:00 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 07, 2022 9:59:01 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665179928154
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 14m 27s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dm4t2qjrvwgyu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
