See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/803/display/redirect>
Changes:
------------------------------------------
[...truncated 7.77 MB...]
Oct 10, 2022 3:53:38 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
pending. retrying.
Oct 10, 2022 3:53:40 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 8045 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=combine_per_key_examples1665416844181,
projectId=apache-beam-testing, tableId=combine_per_key_examples_table}} using
job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
Oct 10, 2022 3:53:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:53:40 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
started
Oct 10, 2022 3:53:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:53:42 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:53:43 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:53:46 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:53:51 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:53:57 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:54:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:54:19 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:54:41 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:55:17 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:56:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
Oct 10, 2022 3:56:50 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:56:50 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665417220354","endTime":"1665417406238","load":{"badRecords":"0","inputFileBytes":"586637","inputFiles":"8045","outputBytes":"401602","outputRows":"8045","timeline":[{"elapsedMs":"182209","totalSlotMs":"357842","pendingUnits":"4804","completedUnits":"3241","activeUnits":"995","estimatedRunnableUnits":"0"},{"elapsedMs":"183220","totalSlotMs":"957499","pendingUnits":"501","completedUnits":"8045","activeUnits":"995","estimatedRunnableUnits":"0"},{"elapsedMs":"184743","totalSlotMs":"1101428","pendingUnits":"0","completedUnits":"8546","activeUnits":"5","estimatedRunnableUnits":"0"},{"elapsedMs":"185297","totalSlotMs":"1101428","pendingUnits":"0","completedUnits":"8546","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"1101428"}],"reservation_id":"default-pipeline","startTime":"1665417220744","totalSlotMs":"1101428","finalExecutionDurationMs":"3926"}
Oct 10, 2022 3:56:50 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins10101547279f07b4f7_7ea9a8e2f3cb4d1eb5dfb9b911a7f125_d4ab56ffe06b3d5637df9c0aba711b73_00001_00000-0
completed successfully.
Oct 10, 2022 3:56:56 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: combine_per_key_examples_table
Oct 10, 2022 3:56:56 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: combine_per_key_examples1665416844181
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 3:56:57 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
createNewDataset
INFO: Successfully created new dataset :
apache-beam-testing:max_per_key_examples1665417416951
Oct 10, 2022 3:56:58 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_testpipelinejenkins1010155658fc7d3524_f0e4aa56870d44b3a18970a436d0654d
Oct 10, 2022 3:56:59 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1010155658fc7d3524_f0e4aa56870d44b3a18970a436d0654d,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1010155658fc7d3524_f0e4aa56870d44b3a18970a436d0654d
Oct 10, 2022 3:56:59 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_testpipelinejenkins1010155658fc7d3524_f0e4aa56870d44b3a18970a436d0654d,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_testpipelinejenkins1010155658fc7d3524_f0e4aa56870d44b3a18970a436d0654d
Oct 10, 2022 3:57:00 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_testpipelinejenkins1010155658fc7d3524_f0e4aa56870d44b3a18970a436d0654d,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:57:00 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_testpipelinejenkins1010155658fc7d3524_f0e4aa56870d44b3a18970a436d0654d
Oct 10, 2022 3:57:00 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 10, 2022 3:57:00 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/
before loading them.
Oct 10, 2022 3:57:00 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/f0e4aa56870d44b3a18970a436d0654d/000000000000.avro
Oct 10, 2022 3:57:00 PM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/f0e4aa56870d44b3a18970a436d0654d/000000000000.avro
matched 1 files with total size 119755
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/4abe7924-9851-41f6-93c9-01b523e5f2d2.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/50fc5c48-bee2-46c7-ab43-c2453de3a8a9.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/60fb55c4-d661-471e-849e-12408d9fc74a.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/8d9c1391-8dda-4f0b-b618-6f33b8ebece3.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/c9434715-0465-467a-ad09-0fbf7233ffe1.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/b304e9de-bd29-44a6-8982-14e4f91045e6.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/8377d746-5b83-4ddd-aa0f-76fef0fc7bef.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/0386d6df-514a-490c-b631-b53ed659ee57.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/db44731d-32f9-4748-b7b9-74373c37d7a4.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/98f6a8bf-543f-4d30-b9ce-fdf5862fea4a.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/bcb08423-d64e-4025-9980-e5644d26368d.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07/b35e3b4d-8436-473f-b543-7fd3f6c17f95.
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 3:57:01 PM org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$4
getTempFilePrefix
INFO: Writing BigQuery temporary files to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17/
before loading them.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryRowWriter <init>
INFO: Opening TableRowWriter to
gs://temp-storage-for-end-to-end-tests/BigQueryWriteTemp/beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17/a4f3d506-c4a1-4d11-941d-75e228581804.
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0
pending. retrying.
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:57:01 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:57:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Waiting for jobs to complete.
Oct 10, 2022 3:57:02 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0
pending. retrying.
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 3:57:02 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 12 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=max_per_key_examples1665417416951,
projectId=apache-beam-testing, tableId=max_per_key_examples_table}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 3:57:02 PM org.apache.beam.sdk.io.gcp.bigquery.WriteTables
lambda$startLoad$79287d2b$1
INFO: Loading 1 files into GenericData{classInfo=[datasetId, projectId,
tableId], {datasetId=beam_bigquery_samples_1665417420665_1,
projectId=apache-beam-testing, tableId=testTableIO}} using job
GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0,
location=US, projectId=apache-beam-testing}}, job id iteration 0
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0
Oct 10, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0
started
Oct 10, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0
Oct 10, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob runJob
INFO: job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0
started
Oct 10, 2022 3:57:03 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 3:57:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 3:57:04 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665417423034","endTime":"1665417425204","load":{"badRecords":"0","inputFileBytes":"522","inputFiles":"12","outputBytes":"192","outputRows":"12","timeline":[{"elapsedMs":"1139","totalSlotMs":"29","pendingUnits":"1","completedUnits":"0","activeUnits":"1","estimatedRunnableUnits":"0"},{"elapsedMs":"1953","totalSlotMs":"427","pendingUnits":"0","completedUnits":"1","activeUnits":"1","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"427"}],"reservation_id":"default-pipeline","startTime":"1665417423215","totalSlotMs":"427","finalExecutionDurationMs":"1043"}
Oct 10, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_testpipelinejenkins1010155658fc7d3524_a2d3cd1948de4f90a6af120b5b60bc07_428fcbfe001fadb583a07094b9b193d3_00001_00000-0
completed successfully.
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJob pollJob
INFO: Load job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0
succeeded. Statistics:
{"completionRatio":1.0,"creationTime":"1665417423217","endTime":"1665417424801","load":{"badRecords":"0","inputFileBytes":"484","inputFiles":"1","outputBytes":"239","outputRows":"1","timeline":[{"elapsedMs":"955","totalSlotMs":"159","pendingUnits":"0","completedUnits":"1","activeUnits":"0"},{"elapsedMs":"1395","totalSlotMs":"159","pendingUnits":"0","completedUnits":"1","activeUnits":"0","estimatedRunnableUnits":"0"}]},"reservationUsage":[{"name":"default-pipeline","slotMs":"159"}],"reservation_id":"default-pipeline","startTime":"1665417423379","totalSlotMs":"159","finalExecutionDurationMs":"714"}
Oct 10, 2022 3:57:06 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers$PendingJobManager
waitForDone
INFO: Job
beam_bq_job_LOAD_bigquerysamplesit0testtableiojenkins101015570176b9a18f_628a2955a2cd4691994f75fbc571ea17_a2c0ff98a161bc940950f6021a43805f_00001_00000-0
completed successfully.
org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT >
testE2EMaxPerKeyExamples STANDARD_ERROR
Oct 10, 2022 3:57:07 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: max_per_key_examples_table
Oct 10, 2022 3:57:07 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: max_per_key_examples1665417416951
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO STANDARD_ERROR
Oct 10, 2022 3:57:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: Starting BigQuery extract job:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10101557087e07a60b_f3a0dd43a68c4d8480e358de05d41933
Oct 10, 2022 3:57:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Started BigQuery job: GenericData{classInfo=[jobId, location,
projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10101557087e07a60b_f3a0dd43a68c4d8480e358de05d41933,
location=US, projectId=apache-beam-testing}}.
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10101557087e07a60b_f3a0dd43a68c4d8480e358de05d41933
Oct 10, 2022 3:57:08 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: Still waiting for BigQuery job
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10101557087e07a60b_f3a0dd43a68c4d8480e358de05d41933,
currently in status {"state":"RUNNING"}
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10101557087e07a60b_f3a0dd43a68c4d8480e358de05d41933
Oct 10, 2022 3:57:09 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl pollJob
INFO: BigQuery job GenericData{classInfo=[jobId, location, projectId],
{jobId=beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10101557087e07a60b_f3a0dd43a68c4d8480e358de05d41933,
location=US, projectId=apache-beam-testing}} completed in state DONE
Oct 10, 2022 3:57:09 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase executeExtract
INFO: BigQuery extract job completed:
beam_bq_job_EXPORT_bigquerysamplesit0testtableiojenkins10101557087e07a60b_f3a0dd43a68c4d8480e358de05d41933
Oct 10, 2022 3:57:09 PM
org.apache.beam.sdk.io.gcp.bigquery.BigQuerySourceBase split
INFO: Extract job produced 1 files
Oct 10, 2022 3:57:10 PM org.apache.beam.sdk.io.FileBasedSource createReader
INFO: Matched 1 files for pattern
gs://temp-storage-for-end-to-end-tests/BigQueryExtractTemp/f3a0dd43a68c4d8480e358de05d41933/000000000000.avro
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.VerifyException
at Verify.java:124
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1010154530-d57e5ecd
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1010154530-d57e5ecd
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1010154530-d57e5ecd
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1010154530-d57e5ecd
***********************************************************
***********************************************************
17 tests completed, 1 failed
> Task :runners:direct-java:examplesIntegrationTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:examplesIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Direct/ws/src/runners/direct-java/build/reports/tests/examplesIntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 47s
89 actionable tasks: 54 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7ssdr5zkliwhw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
