See <https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1674/display/redirect?page=changes>
Changes: [hengfeng] [BEAM-12164]: display the metadata table's name on UI [noreply] Revert "[BEAM-13993] [BEAM-10039] Import beam plugins before starting [noreply] Merge pull request #17036 from [BEAM-12164] Convert all static instances [noreply] fix variable reference (#16991) [noreply] Merge pull request #16844 from [BEAM-12164]: allow for nanosecond [noreply] [BEAM-13904] Increase unit testing in the reflectx package (#17024) ------------------------------------------ [...truncated 2.29 MB...] POST https://bigquery.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/beam_postrelease_mobile_gaming/tables/leaderboard_DataflowRunner_team/insertAll?prettyPrint=false { "code" : 404, "errors" : [ { "domain" : "global", "message" : "Table 844138762903:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team not found.", "reason" : "notFound" } ], "message" : "Table 844138762903:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team not found.", "status" : "NOT_FOUND" } org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:1101) org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:1154) org.apache.beam.sdk.io.gcp.bigquery.BatchedStreamingWrite.flushRows(BatchedStreamingWrite.java:374) org.apache.beam.sdk.io.gcp.bigquery.BatchedStreamingWrite.access$900(BatchedStreamingWrite.java:69) org.apache.beam.sdk.io.gcp.bigquery.BatchedStreamingWrite$BatchAndInsertElements.finishBundle(BatchedStreamingWrite.java:263) Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found POST https://bigquery.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/beam_postrelease_mobile_gaming/tables/leaderboard_DataflowRunner_team/insertAll?prettyPrint=false { "code" : 404, "errors" : [ { "domain" : "global", "message" : "Table 844138762903:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team not found.", "reason" : "notFound" } ], "message" : "Table 844138762903:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team not found.", "status" : "NOT_FOUND" } com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146) com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:118) com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:37) com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:428) com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1111) com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:514) com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:455) com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565) org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl$InsertBatchofRowsCallable.call(BigQueryServicesImpl.java:867) org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl$InsertBatchofRowsCallable.call(BigQueryServicesImpl.java:818) org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$BoundedExecutorService$SemaphoreCallable.call(BigQueryServicesImpl.java:1697) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(470109, 1) {timestamp_ms=1646912662000} late data for: user4_MagentaCockatoo,MagentaCockatoo,8,1646912662000,2022-03-10 03:52:12.297 bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r6f2ebcf323947e80_0000017f73ac591d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6f2ebcf323947e80_0000017f73ac591d_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | hourly_team_score_python_dataflow | | hourly_team_score_python_direct | | leaderboard_DataflowRunner_team | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ Waiting for pipeline to produce more results... bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r290606a85f0412f1_0000017f73ad51f8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r290606a85f0412f1_0000017f73ad51f8_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | hourly_team_score_python_dataflow | | hourly_team_score_python_direct | | leaderboard_DataflowRunner_team | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ Waiting for pipeline to produce more results... bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r456990ebf26f205b_0000017f73ae4a9f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r456990ebf26f205b_0000017f73ae4a9f_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | hourly_team_score_python_dataflow | | hourly_team_score_python_direct | | leaderboard_DataflowRunner_team | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ Waiting for pipeline to produce more results... bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r679cfe8f35c2aa87_0000017f73af44a5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r679cfe8f35c2aa87_0000017f73af44a5_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | hourly_team_score_python_dataflow | | hourly_team_score_python_direct | | leaderboard_DataflowRunner_team | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ Waiting for pipeline to produce more results... bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r46deb8cd38c310eb_0000017f73b03c76_1 ... (0s) Current status: RUNNING Waiting on bqjob_r46deb8cd38c310eb_0000017f73b03c76_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | hourly_team_score_python_dataflow | | hourly_team_score_python_direct | | leaderboard_DataflowRunner_team | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ Waiting for pipeline to produce more results... .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(545123, 1) {timestamp_ms=1646912887000} late data for: user10_AsparagusCassowary,AsparagusCassowary,0,1646912887000,2022-03-10 03:57:13.001 bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r33e1194acdb38789_0000017f73b134d0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r33e1194acdb38789_0000017f73b134d0_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | hourly_team_score_python_dataflow | | hourly_team_score_python_direct | | leaderboard_DataflowRunner_team | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ Waiting for pipeline to produce more results... bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r2d3b4cb04ba7987d_0000017f73b22ce7_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2d3b4cb04ba7987d_0000017f73b22ce7_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | hourly_team_score_python_dataflow | | hourly_team_score_python_direct | | leaderboard_DataflowRunner_team | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ Waiting for pipeline to produce more results... bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r5c3e609b79ba5d7d_0000017f73b324e5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5c3e609b79ba5d7d_0000017f73b324e5_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | hourly_team_score_python_dataflow | | hourly_team_score_python_direct | | leaderboard_DataflowRunner_team | | leaderboard_DataflowRunner_user | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ bq query --batch "SELECT user FROM [apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_user] LIMIT 10" Waiting on bqjob_r74c7d95dae374ee9_0000017f73b33354_1 ... (0s) Current status: RUNNING Waiting on bqjob_r74c7d95dae374ee9_0000017f73b33354_1 ... (0s) Current status: DONE +-------------------------+ | user | +-------------------------+ | user9_ArmyGreenQuokka | | user10_AquaBilby | | user9_AmaranthWallaby | | user7_AmaranthDingo | | user12_AmaranthDingo | | user9_BeigeAntechinus | | user8_AmethystKoala | | user4_BarnRedKookaburra | | user4_RubyKangaroo | | user1_AmaranthWallaby | +-------------------------+ Verified Amaranth RUNNING_JOB=`gcloud dataflow jobs list | grep leaderboard-validation-1646912823621-633 | grep Running | cut -d' ' -f1` if [ ! -z "${RUNNING_JOB}" ] then gcloud dataflow jobs cancel ${RUNNING_JOB} else echo "Job 'leaderboard-validation-1646912823621-633' is not running." fi `--region` not set; getting jobs from all available regions. Some jobs may be missing in the event of an outage. https://cloud.google.com/dataflow/docs/concepts/regional-endpoints WARNING: `--region` not set; defaulting to 'us-central1'. In an upcoming release, users must specify a region explicitly. See https://cloud.google.com/dataflow/docs/concepts/regional-endpoints for additional details. Cancelled job [2022-03-10_03_47_25-12982372883843530922] ************************************** * SUCCESS: LeaderBoard successfully run on DataflowRunner. with Streaming Engine ************************************** [SUCCESS] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflowBom'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:spark:2:runQuickstartJavaSpark'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 59m 44s 19 actionable tasks: 12 executed, 5 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/7am4ryjxbg5ok Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
