See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/797/display/redirect>
Changes:
------------------------------------------
[...truncated 7.75 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b/3a5a834e-643e-4134-8a7f-da382141873c.
Oct 09, 2022 3:52:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b/b488033a-e1e4-459d-80c1-218f6c1226ab.
Oct 09, 2022 3:52:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b/86452cee-dfe3-4b17-90af-b4e1d263c6ed.
Oct 09, 2022 3:52:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b/f3ff8251-269c-41ae-be32-e9af1884be8d.
Oct 09, 2022 3:52:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b/38f5b421-be03-440b-9a60-a68dfad0896c.
Oct 09, 2022 3:52:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b/12cffbaa-bafc-4dfa-aa5d-4b929441f559.
Oct 09, 2022 3:52:24 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b/b26038e5-34a3-4c4e-baec-f97d96e8e464.
Oct 09, 2022 3:54:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:54:06 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:54:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:54:07 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
pending. retrying.
Oct 09, 2022 3:54:08 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665287253067,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 3:54:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:54:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
started
Oct 09, 2022 3:54:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:54:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:54:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:54:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:54:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:54:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:54:31 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:54:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:55:00 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:55:26 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:55:50 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 09, 2022 3:56:14 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a/
before loading them.
Oct 09, 2022 3:56:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a/0b1083b6-9f1e-4919-bd16-d61fa4ca6254.
Oct 09, 2022 3:56:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:56:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:56:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:56:14 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0
pending. retrying.
Oct 09, 2022 3:56:15 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665287773210_25,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 3:56:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0
Oct 09, 2022 3:56:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0
started
Oct 09, 2022 3:56:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0
Oct 09, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0
succeeded. Statistics:
{"creationTime":"1665287775824","endTime":"1665287777340","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"1329","totalSlotMs":"166","pendingUnits":"0","completedUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"166"}],"reservation_id":"default-pipeline","startTime":"1665287775984","totalSlotMs":"166","finalExecutionDurationMs":"696"}
Oct 09, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins100903561457fcd49d_ae4bfe327ed04a5780f5261d399d879a_96cc27acf9d3d02fbe5fe6ce2df0ca16_00001_00000-0
completed successfully.
Oct 09, 2022 3:56:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd
Oct 09, 2022 3:56:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd
Oct 09, 2022 3:56:19 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd
Oct 09, 2022 3:56:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd
Oct 09, 2022 3:56:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:56:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10090356195867499c_74a347a7a32f473393eb453e45588ebd
Oct 09, 2022 3:56:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 09, 2022 3:56:22 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/74a347a7a32f473393eb453e45588ebd/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1009034529-324b5801
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1009034529-324b5801
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1009034529-324b5801
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1009034529-324b5801
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 09, 2022 3:56:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
Oct 09, 2022 3:57:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:57:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665287648656","endTime":"1665287819912","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"168371","totalSlotMs":"326826","pendingUnits":"3762","completedUnits":"4283","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"168879","totalSlotMs":"589129","pendingUnits":"501","completedUnits":"8045","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"169937","totalSlotMs":"704115","pendingUnits":"0","completedUnits":"8546","activeUnits":"7","estimatedRunnableUnits":"0"},{"elapsedMs":"170558","totalSlotMs":"704115","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"704115"}],"reservation_id":"default-pipeline","startTime":"1665287649121","totalSlotMs":"704115","finalExecutionDurationMs":"2341"}
Oct 09, 2022 3:57:25 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1009034736d5b8a542_c38ef35648684d2288f5bddeb463f68b_17bda88cbbd37849085fd006c41d9adf_00001_00000-0
completed successfully.
Oct 09, 2022 3:57:31 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 09, 2022 3:57:31 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665287253067
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 09, 2022 3:57:32 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665287851569
Oct 09, 2022 3:57:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins100903573377ce0737_ac1d7194493149fea8dbc6360265161e
Oct 09, 2022 3:57:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins100903573377ce0737_ac1d7194493149fea8dbc6360265161e,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins100903573377ce0737_ac1d7194493149fea8dbc6360265161e
Oct 09, 2022 3:57:33 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins100903573377ce0737_ac1d7194493149fea8dbc6360265161e,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins100903573377ce0737_ac1d7194493149fea8dbc6360265161e
Oct 09, 2022 3:57:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins100903573377ce0737_ac1d7194493149fea8dbc6360265161e,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:57:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins100903573377ce0737_ac1d7194493149fea8dbc6360265161e
Oct 09, 2022 3:57:34 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 09, 2022 3:57:34 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/ac1d7194493149fea8dbc6360265161e/000000000000.avro
Oct 09, 2022 3:57:34 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/
before loading them.
Oct 09, 2022 3:57:35 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/ac1d7194493149fea8dbc6360265161e/000000000000.avro
matched 1 files with total size 119755
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/2997a0bb-f8ad-4f60-b810-e7616f9e16ce.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/ff8989db-f479-4379-a142-e711db616b26.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/5d9111cf-f7c5-498e-80f9-d166052539d8.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/0c6d5277-bc50-4fe9-a496-700eea5f11bf.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/778ddfcb-b447-4546-9f71-34ebd1c1c8fc.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/07d968da-90c5-4ce1-b74d-3452a474b74f.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/f83461a6-4fff-4d57-8fd4-aeac96bf2285.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/ca654dae-048d-4dd2-a26e-006e6aefed71.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/7ba68097-3bbb-4135-bbc1-e4eaf214c052.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/b8d365ca-74b3-4164-9988-b8c71e416467.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/1139032b-4968-4256-bbb4-d63cf788cf3f.
Oct 09, 2022 3:57:36 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df/50a88722-1099-49be-bfc7-11cf766c19e0.
Oct 09, 2022 3:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 09, 2022 3:57:38 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0
pending. retrying.
Oct 09, 2022 3:57:38 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665287851569,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 09, 2022 3:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0
Oct 09, 2022 3:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0
started
Oct 09, 2022 3:57:39 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0
Oct 09, 2022 3:57:40 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0
Oct 09, 2022 3:57:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 09, 2022 3:57:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665287859413","endTime":"1665287861610","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1078","totalSlotMs":"138","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2014","totalSlotMs":"685","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"685"}],"reservation_id":"default-pipeline","startTime":"1665287859567","totalSlotMs":"685","finalExecutionDurationMs":"1147"}
Oct 09, 2022 3:57:42 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins100903573377ce0737_725bd9ae9a3b4641985b9b54819f18df_9280a8ad58cea48a7794af56848ba9f0_00001_00000-0
completed successfully.
Oct 09, 2022 3:57:43 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 09, 2022 3:57:43 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665287851569
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 17s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hk4pedp4ygnnw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
