See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1125/display/redirect?page=changes>
Changes: [Jozef Vilcek] Re-use serializable pipeline options when already available (#24192) [noreply] Fix Python PostCommit Example CustomPTransformIT on portable (#24159) [noreply] revert upgrade to go 1.19 for action unit tests (#24189) ------------------------------------------ [...truncated 57.48 MB...] INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-15 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-36 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-27 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-31 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-40 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-21 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-34 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Beam Fn Data client connected. INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-23 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint. INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient close INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Error cleaning up servers urn: "beam:env:external:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n\021\n\017localhost:43721" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v0" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:worker_status:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:combinefn:packed_python:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.44.0.dev" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1" INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.InterruptedException INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.lang.Object.wait(Native Method) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.lang.Object.wait(Object.java:460) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.TimeUnit.timedWait(TimeUnit.java:348) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl.awaitTermination(ServerImpl.java:310) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.sdk.fn.server.GrpcFnServer.close(GrpcFnServer.java:157) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:334) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:217) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:193) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:182) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:213) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:374) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:533) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.lang.Thread.run(Thread.java:750) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1116155105-db33fe70_53e96bbb-76fc-4975-9f40-a66f2b835afe. INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed. INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141) ERROR root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'. INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47) --------------------------- Captured stdout teardown --------------------------- FAILED [ 91%] =============================== warnings summary =============================== ../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported is_streaming_pipeline = p.options.view_as(StandardOptions).streaming apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported experiments = p.options.view_as(DebugOptions).experiments or [] apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = p.options.view_as(GoogleCloudOptions).temp_location apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME') apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported | _PassThroughThenCleanup(files_to_remove_pcoll)) apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self.table_reference.projectId = pcoll.pipeline.options.view_as( apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self.project = self.project or p.options.view_as(GoogleCloudOptions).project apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction. return airline_df[at_top_airports].mean() apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental. sink=lambda _: _WriteToPandasFileSink( apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).temp_location or -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> - =========================== short test summary info ============================ FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1116154428-70a6ef2a_128bf9c9-0416-44f6-bd7f-ed123548c893 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'. FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1116155034-b7d8d646_f384d22a-c4fb-467c-97dd-a49c48a11419 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'. FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1116155105-db33fe70_53e96bbb-76fc-4975-9f40-a66f2b835afe failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'. = 3 failed, 19 passed, 6 skipped, 6715 deselected, 41 warnings in 630.39s (0:10:30) = > Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 14m 30s 133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/jcx6ay7zja4s4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
