See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/2878/display/redirect?page=changes>
Changes: [Maximilian Michels] Revert "Merge pull request #12408: [BEAM-10602] Display Python streaming [kcweaver] [BEAM-10681] Set metrics supported in Spark portable runner. [noreply] [BEAM-7705] Add BigQuery Java samples (#12118) [Maximilian Michels] [BEAM-10602] Add latency/checkpoint duration as separate panels in ParDo [tobiasz.kedzierski] [BEAM-10686] Simplify names for GCP variables check in GA [noreply] Fix format string in PipelineValidator (#12522) [noreply] Fix some typos (#12539) [noreply] Linkage Checker 1.5.0 (#12545) ------------------------------------------ [...truncated 1.22 MB...] --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/sql_test.py";,> line 177, in test_windowing_before_sql assert_that(out, equal_to([(1, ), (1, ), (1, )])) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,> line 555, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/testing/test_pipeline.py";,> line 114, in run state = result.wait_until_finish() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 547, in wait_until_finish raise self._runtime_exception RuntimeError: Pipeline BeamApp-jenkins-0812182910-910b2b49_8270c56e-3abf-4ea8-ad78-8fc2b640f382 failed in state FAILED: java.lang.NullPointerException: Cannot find compatible factory for specified execution.target (=local) -------------------- >> begin captured logging << -------------------- apache_beam.utils.subprocess_server: INFO: Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.24.0-SNAPSHOT.jar> apache_beam.utils.subprocess_server: INFO: Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.24.0-SNAPSHOT.jar'> '36541'] root: DEBUG: Waiting for grpc channel to be ready at localhost:36541. apache_beam.utils.subprocess_server: INFO: Starting expansion service at localhost:36541 root: DEBUG: Waiting for grpc channel to be ready at localhost:36541. apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:00 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms apache_beam.utils.subprocess_server: INFO: INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1] apache_beam.utils.subprocess_server: INFO: beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$1/2121744517@626b2d4a apache_beam.utils.subprocess_server: INFO: beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$1/2121744517@5e91993f root: DEBUG: Waiting for grpc channel to be ready at localhost:36541. root: DEBUG: Waiting for grpc channel to be ready at localhost:36541. root: DEBUG: Waiting for grpc channel to be ready at localhost:36541. root: DEBUG: Waiting for grpc channel to be ready at localhost:36541. apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:01 PM org.apache.beam.sdk.expansion.service.ExpansionService expand apache_beam.utils.subprocess_server: INFO: INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1' apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:02 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig apache_beam.utils.subprocess_server: INFO: WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach. apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:04 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel apache_beam.utils.subprocess_server: INFO: INFO: SQL: apache_beam.utils.subprocess_server: INFO: SELECT COUNT(*) AS `count` apache_beam.utils.subprocess_server: INFO: FROM `beam`.`PCOLLECTION` AS `PCOLLECTION` apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:04 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel apache_beam.utils.subprocess_server: INFO: INFO: SQLPlan> apache_beam.utils.subprocess_server: INFO: LogicalAggregate(group=[{}], count=[COUNT()]) apache_beam.utils.subprocess_server: INFO: LogicalProject($f0=[0]) apache_beam.utils.subprocess_server: INFO: BeamIOSourceRel(table=[[beam, PCOLLECTION]]) apache_beam.utils.subprocess_server: INFO: apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:04 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel apache_beam.utils.subprocess_server: INFO: INFO: BEAMPlan> apache_beam.utils.subprocess_server: INFO: BeamAggregationRel(group=[{}], count=[COUNT()]) apache_beam.utils.subprocess_server: INFO: BeamIOSourceRel(table=[[beam, PCOLLECTION]]) apache_beam.utils.subprocess_server: INFO: root: DEBUG: Sending SIGINT to job_server root: WARNING: Make sure that locally built Python SDK docker image has Python 2.7 interpreter. root: INFO: Using Python SDK docker image: apache/beam_python2.7_sdk:2.24.0.dev. If the image is not available at local, we will try to pull from hub.docker.com root: WARNING: Make sure that locally built Python SDK docker image has Python 2.7 interpreter. root: INFO: Using Python SDK docker image: apache/beam_python2.7_sdk:2.24.0.dev. If the image is not available at local, we will try to pull from hub.docker.com apache_beam.runners.portability.fn_api_runner.translations: INFO: ==================== <function lift_combiners at 0x7fbb63631ed8> ==================== apache_beam.runners.portability.fn_api_runner.translations: DEBUG: 29 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] apache_beam.runners.portability.fn_api_runner.translations: DEBUG: Stages: ['ref_AppliedPTransform_Create/Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2826>)_4\n Create/FlatMap(<lambda at core.py:2826>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/Map(decode)_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map(<lambda at sql_test.py:172>)_14\n Map(<lambda at sql_test.py:172>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto(WindowIntoFn)_15\n WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8SqlTransform(beam:external:java:sql:v1)/BeamIOSourceRel_3/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous)\n SqlTransform(beam:external:java:sql:v1)/BeamIOSourceRel_3/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/toRow/ParDo(Anonymous)/ParMultiDo(Anonymous)\n SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/toRow/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous)\n SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey\n SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous)\n SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous)\n SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous)\n SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Impulse_19\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2826>)_20\n assert_that/Create/FlatMap(<lambda at core.py:2826>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Map(decode)_22\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_23\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/ToVoidKey_24\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_0_26\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_1_27\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Flatten_28\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/GroupByKey_29\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_30\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Unkey_31\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Match_32\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'flink_master' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'job_name' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'runner' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'temp_location' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'streaming' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'dataflow_kms_key' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'enable_streaming_engine' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'project' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'worker_region' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'worker_zone' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'zone' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'environment_cache_millis' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'files_to_stage' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'job_endpoint' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'output_executable_path' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'sdk_worker_parallelism' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'experiments' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'pubsub_root_url' was already added apache_beam.runners.portability.portable_runner: INFO: Job state changed to STOPPED apache_beam.runners.portability.portable_runner: INFO: Job state changed to STARTING apache_beam.runners.portability.portable_runner: INFO: Job state changed to RUNNING root: DEBUG: java.lang.NullPointerException: Cannot find compatible factory for specified execution.target (=local) at org.apache.flink.util.Preconditions.checkNotNull(Preconditions.java:104) at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:937) at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:860) at org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator$BatchTranslationContext.execute(FlinkBatchPortablePipelineTranslator.java:194) at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:116) at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:83) at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) root: ERROR: java.lang.NullPointerException: Cannot find compatible factory for specified execution.target (=local) apache_beam.runners.portability.portable_runner: INFO: Job state changed to FAILED --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: test_zetasql_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/sql_test.py";,> line 162, in test_zetasql_generate_data assert_that(out, equal_to([(1, "foo", 3.14)])) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,> line 555, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/testing/test_pipeline.py";,> line 112, in run False if self.not_use_test_runner_api else test_runner_api)) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,> line 534, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 390, in run_pipeline job_service_handle.submit(proto_pipeline) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 111, in submit prepare_response.staging_session_token) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 206, in stage staging_session_token) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py";,> line 238, in offer_artifacts for request in requests: File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,> line 413, in next return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,> line 706, in _next raise self _MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.UNAVAILABLE details = "Socket closed" debug_error_string = "{"created":"@1597256963.398914564","description":"Error received from peer ipv4:127.0.0.1:18090","file":"src/core/lib/surface/call.cc","file_line":1062,"grpc_message":"Socket closed","grpc_status":14}" > -------------------- >> begin captured logging << -------------------- apache_beam.utils.subprocess_server: INFO: Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.24.0-SNAPSHOT.jar> apache_beam.utils.subprocess_server: INFO: Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.24.0-SNAPSHOT.jar'> '52587'] root: DEBUG: Waiting for grpc channel to be ready at localhost:52587. apache_beam.utils.subprocess_server: INFO: Starting expansion service at localhost:52587 root: DEBUG: Waiting for grpc channel to be ready at localhost:52587. apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:11 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms apache_beam.utils.subprocess_server: INFO: INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1] apache_beam.utils.subprocess_server: INFO: beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$1/2121744517@626b2d4a apache_beam.utils.subprocess_server: INFO: beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$1/2121744517@5e91993f root: DEBUG: Waiting for grpc channel to be ready at localhost:52587. root: DEBUG: Waiting for grpc channel to be ready at localhost:52587. root: DEBUG: Waiting for grpc channel to be ready at localhost:52587. root: DEBUG: Waiting for grpc channel to be ready at localhost:52587. apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:12 PM org.apache.beam.sdk.expansion.service.ExpansionService expand apache_beam.utils.subprocess_server: INFO: INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1' apache_beam.utils.subprocess_server: INFO: Aug 12, 2020 6:29:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig apache_beam.utils.subprocess_server: INFO: WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach. root: DEBUG: Sending SIGINT to job_server root: WARNING: Make sure that locally built Python SDK docker image has Python 2.7 interpreter. root: INFO: Using Python SDK docker image: apache/beam_python2.7_sdk:2.24.0.dev. If the image is not available at local, we will try to pull from hub.docker.com root: WARNING: Make sure that locally built Python SDK docker image has Python 2.7 interpreter. root: INFO: Using Python SDK docker image: apache/beam_python2.7_sdk:2.24.0.dev. If the image is not available at local, we will try to pull from hub.docker.com apache_beam.runners.portability.fn_api_runner.translations: INFO: ==================== <function lift_combiners at 0x7fbb63631ed8> ==================== apache_beam.runners.portability.fn_api_runner.translations: DEBUG: 16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] apache_beam.runners.portability.fn_api_runner.translations: DEBUG: Stages: ['external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse\n SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/MapElements/Map/ParMultiDo(Anonymous)\n SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/MapElements/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)\n SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc)\n SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Impulse_5\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2826>)_6\n assert_that/Create/FlatMap(<lambda at core.py:2826>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Map(decode)_8\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_9\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/ToVoidKey_10\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_0_12\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_1_13\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Flatten_14\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/GroupByKey_15\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_16\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Unkey_17\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Match_18\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'flink_master' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'job_name' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'runner' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'temp_location' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'streaming' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'dataflow_kms_key' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'enable_streaming_engine' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'project' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'worker_region' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'worker_zone' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'zone' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'environment_cache_millis' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'files_to_stage' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'job_endpoint' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'output_executable_path' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'sdk_worker_parallelism' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'experiments' was already added apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'pubsub_root_url' was already added --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: nosetests-xlangSqlValidateRunner.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 9 tests in 107.370s FAILED (errors=9) > Task > :runners:flink:1.10:job-server:validatesCrossLanguageRunnerPythonUsingSql > FAILED > Task :runners:flink:1.10:job-server:flinkJobServerCleanup FAILURE: Build completed with 5 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:flink:1.10:job-server:validatesCrossLanguageRunnerJavaUsingJava'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/runners/flink/1.10/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:flink:1.10:job-server:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/runners/flink/1.10/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:flink:1.10:job-server:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 4: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:flink:1.10:job-server:validatesCrossLanguageRunnerPythonUsingPython'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 5: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:flink:1.10:job-server:validatesCrossLanguageRunnerPythonUsingSql'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 28m 12s 147 actionable tasks: 114 executed, 31 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/tqyxitfn3dwrw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
