See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/802/display/redirect>
Changes:
------------------------------------------
[...truncated 7.52 MB...]
Oct 10, 2022 9:51:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867/94daf6aa-c2e0-4755-8e62-e42ceaea05ba.
Oct 10, 2022 9:51:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867/d07a6e71-8267-4d0e-8e1a-3e49fac32e0e.
Oct 10, 2022 9:51:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867/0907f68a-1846-4a61-af42-87f2a7984464.
Oct 10, 2022 9:51:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867/e2451b9c-b60c-4153-bc82-77505a153b6e.
Oct 10, 2022 9:51:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867/267dcc42-12b8-43e1-abb1-4ecb6d94f974.
Oct 10, 2022 9:51:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867/345ba449-9287-4dd9-ba2f-91bab1949f08.
Oct 10, 2022 9:51:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867/94bfb84d-0b25-41f1-b8af-e1c12c7a69bd.
Oct 10, 2022 9:51:57 AM org.apache.beam.sdk.metrics.MetricsEnvironment
getCurrentContainer
SEVERE: Unable to update metrics on the current thread. Most likely caused
by using metrics outside the managed work-execution thread.
Oct 10, 2022 9:52:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:52:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:52:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:52:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
pending. retrying.
Oct 10, 2022 9:52:53 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665395239842,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 10, 2022 9:52:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:52:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
started
Oct 10, 2022 9:52:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:52:55 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:52:57 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:53:00 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:53:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:53:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:53:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:53:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:53:53 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:54:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 9:55:05 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8/
before loading them.
Oct 10, 2022 9:55:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8/47d24f60-6b59-4c3e-98e9-d92d33dcb82b.
Oct 10, 2022 9:55:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:55:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:55:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:55:05 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0
pending. retrying.
Oct 10, 2022 9:55:06 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665395704187_1,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 10, 2022 9:55:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0
Oct 10, 2022 9:55:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0
started
Oct 10, 2022 9:55:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0
Oct 10, 2022 9:55:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0
Oct 10, 2022 9:55:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 9:55:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0
succeeded. Statistics:
{"creationTime":"1665395706523","endTime":"1665395708085","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"1366","totalSlotMs":"122","pendingUnits":"0","completedUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"122"}],"reservation_id":"default-pipeline","startTime":"1665395706693","totalSlotMs":"122","finalExecutionDurationMs":"734"}
Oct 10, 2022 9:55:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101009550559cee702_cefed3c54f9a4823be836a4d8b74a9d8_99c574f30d1be9efa19b1cb90f56e0e1_00001_00000-0
completed successfully.
Oct 10, 2022 9:55:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010095510cabb1ef8_b10fbfdebf334a35ac09d801424ea2ec
Oct 10, 2022 9:55:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010095510cabb1ef8_b10fbfdebf334a35ac09d801424ea2ec,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010095510cabb1ef8_b10fbfdebf334a35ac09d801424ea2ec
Oct 10, 2022 9:55:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010095510cabb1ef8_b10fbfdebf334a35ac09d801424ea2ec,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010095510cabb1ef8_b10fbfdebf334a35ac09d801424ea2ec
Oct 10, 2022 9:55:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010095510cabb1ef8_b10fbfdebf334a35ac09d801424ea2ec,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 9:55:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins1010095510cabb1ef8_b10fbfdebf334a35ac09d801424ea2ec
Oct 10, 2022 9:55:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 10, 2022 9:55:12 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/b10fbfdebf334a35ac09d801424ea2ec/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1010094530-c5668032
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1010094530-c5668032
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1010094530-c5668032
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1010094530-c5668032
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 10, 2022 9:55:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
Oct 10, 2022 9:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 9:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665395573396","endTime":"1665395718377","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"142257","totalSlotMs":"345821","pendingUnits":"2555","completedUnits":"5490","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"142768","totalSlotMs":"500331","pendingUnits":"501","completedUnits":"8045","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"143297","totalSlotMs":"593145","pendingUnits":"1","completedUnits":"8545","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"144383","totalSlotMs":"593416","pendingUnits":"0","completedUnits":"8546","activeUnits":"1","estimatedRunnableUnits":"1000"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"593416"}],"reservation_id":"default-pipeline","startTime":"1665395573818","totalSlotMs":"593416","finalExecutionDurationMs":"3014"}
Oct 10, 2022 9:56:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101009472270a57935_902184b7a85644f2b1a05143b998e867_a11b2f7181112aa10b3c884f1bb4859c_00001_00000-0
completed successfully.
Oct 10, 2022 9:56:42 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 10, 2022 9:56:42 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665395239842
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 9:56:43 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665395802570
Oct 10, 2022 9:56:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1010095644edd3db2b_b1744dd676af45988c164b9fbc701596
Oct 10, 2022 9:56:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1010095644edd3db2b_b1744dd676af45988c164b9fbc701596,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1010095644edd3db2b_b1744dd676af45988c164b9fbc701596
Oct 10, 2022 9:56:44 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1010095644edd3db2b_b1744dd676af45988c164b9fbc701596,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1010095644edd3db2b_b1744dd676af45988c164b9fbc701596
Oct 10, 2022 9:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1010095644edd3db2b_b1744dd676af45988c164b9fbc701596,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 9:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1010095644edd3db2b_b1744dd676af45988c164b9fbc701596
Oct 10, 2022 9:56:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 10, 2022 9:56:45 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/b1744dd676af45988c164b9fbc701596/000000000000.avro
Oct 10, 2022 9:56:45 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/
before loading them.
Oct 10, 2022 9:56:45 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/b1744dd676af45988c164b9fbc701596/000000000000.avro
matched 1 files with total size 119755
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/4ef8b32d-7280-49c9-bbcd-79108d80a5c7.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/1ea86ab2-5241-45ec-a51e-4fad4919ef6c.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/569a4add-4378-43e0-99f5-d23d32ec2fed.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/8869d32a-aeef-4423-b3fd-7314fcfd5544.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/cb479ad8-bffd-4e09-98a4-94b39df41edc.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/4c560a31-2d13-4ada-afc1-af85c01285a9.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/49166f4d-094a-42df-aa8d-125f5f45fe97.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/ffe052bd-4b1b-4c52-9771-ac856e67748c.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/df19c7a9-e90e-488e-ae2b-eb61a6688543.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/8381ab9e-6cc3-4d8a-b3d2-54617773db1c.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/45f2cc38-0533-449e-a957-fff7357246a3.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632/69bca10f-a903-4afb-aea1-03004a733cf7.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:56:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:56:47 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 9:56:47 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0
pending. retrying.
Oct 10, 2022 9:56:48 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665395802570,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 10, 2022 9:56:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0
Oct 10, 2022 9:56:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0
started
Oct 10, 2022 9:56:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0
Oct 10, 2022 9:56:50 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0
Oct 10, 2022 9:56:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 9:56:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665395808616","endTime":"1665395810880","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1151","totalSlotMs":"62","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2081","totalSlotMs":"341","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"341"}],"reservation_id":"default-pipeline","startTime":"1665395808769","totalSlotMs":"341","finalExecutionDurationMs":"1177"}
Oct 10, 2022 9:56:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1010095644edd3db2b_d22e54eb71c14d5b9d23c7b5fbb94632_c6a7f4cab53c38c6b944c19b4c36ec30_00001_00000-0
completed successfully.
Oct 10, 2022 9:56:52 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 10, 2022 9:56:52 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665395802570
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 26s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/padnawa5b4ats
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
