See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/805/display/redirect?page=changes>
Changes:
[noreply] [Playground] complexity indicator (#23477)
[noreply] Reolling forward property-based tests for coders (#23425)
[noreply] Updated README for jupyterlab-sidepanel
------------------------------------------
[...truncated 7.52 MB...]
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c/8d3eb524-a5ff-4f22-9ed3-cfe4381b475b.
Oct 11, 2022 3:51:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c/d22d7efb-c2ed-48f0-9d4c-d207424cbad1.
Oct 11, 2022 3:51:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c/a7550367-6ff1-4f75-9b06-fe25fb1ace7f.
Oct 11, 2022 3:51:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c/e6d5d27d-949a-439b-b64d-1f30676f24a0.
Oct 11, 2022 3:51:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c/61ab2897-2e67-43cb-9b97-46ef92bcfef2.
Oct 11, 2022 3:51:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c/5205bbcc-a716-4852-861c-e45e85c01692.
Oct 11, 2022 3:51:30 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c/753e1e5b-2bbf-45d2-8741-27a5ff3401ad.
Oct 11, 2022 3:52:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:52:45 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:52:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:52:46 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
pending. retrying.
Oct 11, 2022 3:52:47 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665460030735,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 3:52:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:52:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
started
Oct 11, 2022 3:52:48 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:52:49 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:52:51 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:52:54 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:52:59 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:53:02 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:53:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:53:22 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:53:47 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:54:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
Oct 11, 2022 3:55:08 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 11, 2022 3:55:09 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae/
before loading them.
Oct 11, 2022 3:55:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae/910ea3b5-0922-474c-990f-377aa681f1e2.
Oct 11, 2022 3:55:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:55:09 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:55:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:55:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0
pending. retrying.
Oct 11, 2022 3:55:10 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665460508750_19,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 3:55:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0
Oct 11, 2022 3:55:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0
started
Oct 11, 2022 3:55:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0
Oct 11, 2022 3:55:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0
Oct 11, 2022 3:55:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:55:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0
succeeded. Statistics:
{"creationTime":"1665460511325","endTime":"1665460512868","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"1384","totalSlotMs":"161","pendingUnits":"0","completedUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"161"}],"reservation_id":"default-pipeline","startTime":"1665460511456","totalSlotMs":"161","finalExecutionDurationMs":"710"}
Oct 11, 2022 3:55:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins10110355096f7b2691_ce63888a2fc341318f13ecfed61751ae_027ef7d0136a34c90a24f511ba4e9f6d_00001_00000-0
completed successfully.
Oct 11, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110355148bc63bb8_28d89120c8be4df2880cacd8150de03f
Oct 11, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110355148bc63bb8_28d89120c8be4df2880cacd8150de03f,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110355148bc63bb8_28d89120c8be4df2880cacd8150de03f
Oct 11, 2022 3:55:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110355148bc63bb8_28d89120c8be4df2880cacd8150de03f,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110355148bc63bb8_28d89120c8be4df2880cacd8150de03f
Oct 11, 2022 3:55:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110355148bc63bb8_28d89120c8be4df2880cacd8150de03f,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:55:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10110355148bc63bb8_28d89120c8be4df2880cacd8150de03f
Oct 11, 2022 3:55:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 11, 2022 3:55:16 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/28d89120c8be4df2880cacd8150de03f/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1011034523-17385c97
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1011034523-17385c97
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1011034523-17385c97
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1011034523-17385c97
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT >
testE2ECombinePerKey STANDARD_ERROR
Oct 11, 2022 3:56:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:56:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665460367694","endTime":"1665460510680","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"139160","totalSlotMs":"356244","pendingUnits":"3943","completedUnits":"4102","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"139666","totalSlotMs":"739621","pendingUnits":"0","completedUnits":"8045","activeUnits":"1000","estimatedRunnableUnits":"0"},{"elapsedMs":"141159","totalSlotMs":"859633","pendingUnits":"2","completedUnits":"8544","activeUnits":"3","estimatedRunnableUnits":"0"},{"elapsedMs":"142456","totalSlotMs":"860059","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"860059"}],"reservation_id":"default-pipeline","startTime":"1665460368064","totalSlotMs":"860059","finalExecutionDurationMs":"4139"}
Oct 11, 2022 3:56:03 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins101103471333640a8c_b702b2b3f3c44fa1b54500450e29334c_53afe63d91daa95f543a4f8bdd0b19eb_00001_00000-0
completed successfully.
Oct 11, 2022 3:56:08 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 11, 2022 3:56:08 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665460030735
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 11, 2022 3:56:09 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665460568854
Oct 11, 2022 3:56:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1011035610c38cd60e_7cb2e93cb4ec48c08b1c56f84d122a6d
Oct 11, 2022 3:56:10 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1011035610c38cd60e_7cb2e93cb4ec48c08b1c56f84d122a6d,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1011035610c38cd60e_7cb2e93cb4ec48c08b1c56f84d122a6d
Oct 11, 2022 3:56:11 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1011035610c38cd60e_7cb2e93cb4ec48c08b1c56f84d122a6d,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1011035610c38cd60e_7cb2e93cb4ec48c08b1c56f84d122a6d
Oct 11, 2022 3:56:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1011035610c38cd60e_7cb2e93cb4ec48c08b1c56f84d122a6d,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:56:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1011035610c38cd60e_7cb2e93cb4ec48c08b1c56f84d122a6d
Oct 11, 2022 3:56:12 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 11, 2022 3:56:12 AM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/7cb2e93cb4ec48c08b1c56f84d122a6d/000000000000.avro
Oct 11, 2022 3:56:12 AM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/
before loading them.
Oct 11, 2022 3:56:12 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/7cb2e93cb4ec48c08b1c56f84d122a6d/000000000000.avro
matched 1 files with total size 119755
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/73c7978b-21b4-4811-ac14-2e41d693b29f.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/e14eca04-8224-406a-9672-d9957c0c2cbd.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/d1d53b2d-2489-4cbc-a41e-ee387a8167c9.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/db512241-1c0d-49d9-bd0c-ecdaffb4e9cd.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/e25b3bc4-d89c-40d1-b0a8-a774322f78fd.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/c0137e63-0fc5-490c-844f-6763684d04e1.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/0fe6ecac-35aa-4bf1-ae6c-c8575cbba835.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/2b767d3f-cf3b-411b-a07b-11b34ea9f70a.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/a12da087-92fc-45ed-aae8-89aea15933d4.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/3dda65b3-ac42-4cc1-ab12-f485a5d76a04.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/81ebc212-46d2-47d4-941e-e6f192f287c8.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd/deb19309-fd4e-4fc9-9939-1075f7708f00.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 11, 2022 3:56:13 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0
pending. retrying.
Oct 11, 2022 3:56:15 AM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665460568854,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 11, 2022 3:56:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0
Oct 11, 2022 3:56:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0
started
Oct 11, 2022 3:56:15 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0
Oct 11, 2022 3:56:16 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0
Oct 11, 2022 3:56:17 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0
Oct 11, 2022 3:56:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 11, 2022 3:56:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665460575415","endTime":"1665460577722","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1177","totalSlotMs":"25","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"2130","totalSlotMs":"380","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"380"}],"reservation_id":"default-pipeline","startTime":"1665460575565","totalSlotMs":"380","finalExecutionDurationMs":"1226"}
Oct 11, 2022 3:56:20 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1011035610c38cd60e_01559d477252406487f2c08d5c39cfbd_e664b84429a86bbb2ccf23e635caa348_00001_00000-0
completed successfully.
Oct 11, 2022 3:56:21 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 11, 2022 3:56:22 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665460568854
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 59s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4iyk5wtqjd2fu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
