See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/925/display/redirect?page=changes>
Changes: [Kenneth Knowles] Remove use of model SYNCHRONIZED_PROCESSING_TIME [Kenneth Knowles] Remove SYNCHRONIZED_PROCESSING_TIME from model proto [samuelw] [BEAM-11707] Change WindmillStateCache cache invalidation to be based [shehzaad] [BEAM-10961] enable strict dependency checking for [shehzaad] [BEAM-10961] undo line moves (originally intended for alphabeticization) [shehzaad] [BEAM-10961] enable strict dependency checking for [shehzaad] [BEAM-10961] enable strict dependency checking for [shehzaad] [BEAM-10961] enable strict dependency checking for [shehzaad] [BEAM-10961] enable strict dependency checking for [shehzaad] [BEAM-10961] enable strict dependency checking for [shehzaad] [BEAM-10961] enable strict dependency checking for [shehzaad] [BEAM-10961] enable strict dependency checking for [shehzaad] [BEAM-10961] fix stray reordering of lines [zyichi] Add validate runner test for testing custom merging windows fn without [zyichi] Fix up! formatting [Boyuan Zhang] Do not stage dataflow worker jar when use runner_v2. [Kenneth Knowles] Recognize JOB_STATE_PENDING from Dataflow and map to RUNNING [Pablo Estrada] Attempting improvements on DirectRunner Python dash [shehzaad] [BEAM-10961] add explicit compile for auto_value_annotations in [shehzaad] [BEAM-10961] add reference to BEAM-11761 [noreply] Merge pull request #13802: [BEAM-1474]. Adding MapState and SetState [noreply] [BEAM-10961] enable strict dependency checking for [Kenneth Knowles] Initial watermark latency benchmark [noreply] [BEAM-10961] Strict dependency checking for sdks/java/io/gcp (#13791) ------------------------------------------ [...truncated 661.57 KB...] root: INFO: ==================== <function expand_gbk at 0x7f285808ad08> ==================== root: INFO: ==================== <function sink_flattens at 0x7f285808ae18> ==================== root: INFO: ==================== <function greedily_fuse at 0x7f285808aea0> ==================== root: INFO: ==================== <function read_to_impulse at 0x7f285808af28> ==================== root: INFO: ==================== <function impulse_to_input at 0x7f285808b048> ==================== root: INFO: ==================== <function sort_stages at 0x7f285808b268> ==================== root: INFO: ==================== <function setup_timer_mapping at 0x7f285808b1e0> ==================== root: INFO: ==================== <function populate_data_channel_coders at 0x7f285808b2f0> ==================== root: INFO: starting control server on port 45851 root: INFO: starting data server on port 38937 root: INFO: starting state server on port 38099 root: INFO: starting logging server on port 37757 root: INFO: Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2857b45978> for environment ref_Environment_default_environment_1 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.29.0.dev') root: INFO: Attempting to pull image apache/beam_python3.6_sdk:2.29.0.dev root: INFO: Unable to pull image apache/beam_python3.6_sdk:2.29.0.dev, defaulting to local image if it exists root: INFO: Waiting for docker to start up. Current status is running root: INFO: Docker container is running. container_id = b'e190fc829d97dc8031ca34b22422540180dffc5daa3ea9bf3eae27c3fa78e5b1', worker_id = worker_109 root: INFO: Running ((((ref_AppliedPTransform_Create/Impulse_3)+(ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2957>)_4))+(ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/AddRandomKeys_7))+(ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write) root: INFO: Running (((((ref_AppliedPTransform_assert_that/Create/Impulse_17)+(ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2957>)_18))+(ref_AppliedPTransform_assert_that/Create/Map(decode)_20))+(ref_AppliedPTransform_assert_that/Group/pair_with_0_24))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0) root: INFO: Running ((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_11))+(ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys_12))+(ref_AppliedPTransform_Create/Map(decode)_13))+(ref_PCollection_PCollection_1/Write) root: INFO: Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2857a839b0> for environment external_4beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.29.0.dev') root: INFO: Attempting to pull image apache/beam_java8_sdk:2.29.0.dev root: INFO: Unable to pull image apache/beam_java8_sdk:2.29.0.dev, defaulting to local image if it exists root: INFO: Waiting for docker to start up. Current status is running root: INFO: Docker container is running. container_id = b'7c72ea6ef5cb3c33431deed89f3a018e34a44cf773e8ffa1d6f9e500f1ff9c57', worker_id = worker_110 root: INFO: Running ((ref_PCollection_PCollection_1/Read)+(external_4SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_30/ParDo(Calc)/ParMultiDo(Calc)))+(ref_PCollection_PCollection_9/Write) root: INFO: Running (((((ref_PCollection_PCollection_9/Read)+(ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_21))+(ref_AppliedPTransform_assert_that/ToVoidKey_22))+(ref_AppliedPTransform_assert_that/Group/pair_with_1_25))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1) root: INFO: Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write) root: INFO: Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_28))+(ref_AppliedPTransform_assert_that/Unkey_29))+(ref_AppliedPTransform_assert_that/Match_30) --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: test_row (apache_beam.transforms.sql_test.SqlTransformTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/transforms/sql_test.py";,> line 154, in test_row assert_that(out, equal_to([(1, 1), (4, 1), (100, 2)])) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/pipeline.py";,> line 580, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/testing/test_pipeline.py";,> line 114, in run state = result.wait_until_finish() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 604, in wait_until_finish raise self._runtime_exception File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 610, in _observe_state for state_response in self._state_stream: File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,> line 416, in __next__ return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,> line 803, in _next raise self grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.DEADLINE_EXCEEDED details = "Deadline Exceeded" debug_error_string = "{"created":"@1614386562.679796923","description":"Error received from peer ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Deadline Exceeded","grpc_status":4}" > -------------------- >> begin captured logging << -------------------- apache_beam.utils.subprocess_server: INFO: Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.29.0-SNAPSHOT.jar> apache_beam.utils.subprocess_server: INFO: Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.29.0-SNAPSHOT.jar'> '39769'] root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. apache_beam.utils.subprocess_server: INFO: b'Starting expansion service at localhost:39769' root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. apache_beam.utils.subprocess_server: INFO: b'Feb 27, 2021 12:41:29 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms' apache_beam.utils.subprocess_server: INFO: b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]' apache_beam.utils.subprocess_server: INFO: b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178' apache_beam.utils.subprocess_server: INFO: b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a' root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. root: DEBUG: Waiting for grpc channel to be ready at localhost:39769. apache_beam.utils.subprocess_server: INFO: b'Feb 27, 2021 12:41:32 AM org.apache.beam.sdk.expansion.service.ExpansionService expand' apache_beam.utils.subprocess_server: INFO: b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'" apache_beam.utils.subprocess_server: INFO: b'Feb 27, 2021 12:41:33 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig' apache_beam.utils.subprocess_server: INFO: b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach." apache_beam.utils.subprocess_server: INFO: b'Feb 27, 2021 12:41:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' apache_beam.utils.subprocess_server: INFO: b'INFO: SQL:' apache_beam.utils.subprocess_server: INFO: b'SELECT `PCOLLECTION`.`a` * `PCOLLECTION`.`a` AS `s`, `LENGTH`(`PCOLLECTION`.`b`) AS `c`' apache_beam.utils.subprocess_server: INFO: b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`' apache_beam.utils.subprocess_server: INFO: b'Feb 27, 2021 12:41:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' apache_beam.utils.subprocess_server: INFO: b'INFO: SQLPlan>' apache_beam.utils.subprocess_server: INFO: b'LogicalProject(s=[*($0, $0)], c=[LENGTH($1)])' apache_beam.utils.subprocess_server: INFO: b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])' apache_beam.utils.subprocess_server: INFO: b'' apache_beam.utils.subprocess_server: INFO: b'Feb 27, 2021 12:41:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' apache_beam.utils.subprocess_server: INFO: b'INFO: BEAMPlan>' apache_beam.utils.subprocess_server: INFO: b'BeamCalcRel(expr#0..1=[{inputs}], expr#2=[*($t0, $t0)], expr#3=[LENGTH($t1)], s=[$t2], c=[$t3])' apache_beam.utils.subprocess_server: INFO: b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])' apache_beam.utils.subprocess_server: INFO: b'' root: DEBUG: Sending SIGINT to job_server root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: WARNING: Make sure that locally built Python SDK docker image has Python 3.6 interpreter. root: INFO: Default Python SDK image for environment is apache/beam_python3.6_sdk:2.29.0.dev root: INFO: No image given, using default Python SDK image root: WARNING: Make sure that locally built Python SDK docker image has Python 3.6 interpreter. root: INFO: Default Python SDK image for environment is apache/beam_python3.6_sdk:2.29.0.dev root: INFO: Python SDK container image set to "apache/beam_python3.6_sdk:2.29.0.dev" for Docker environment apache_beam.runners.portability.fn_api_runner.translations: INFO: ==================== <function lift_combiners at 0x7fd348831378> ==================== apache_beam.runners.portability.fn_api_runner.translations: DEBUG: 22 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] apache_beam.runners.portability.fn_api_runner.translations: DEBUG: Stages: ['ref_AppliedPTransform_Create/Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2957>)_4\n Create/FlatMap(<lambda at core.py:2957>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/Map(decode)_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map(<lambda at sql_test.py:152>)_14\n Map(<lambda at sql_test.py:152>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_6SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParDo(Calc)/ParMultiDo(Calc)\n SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Impulse_18\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2957>)_19\n assert_that/Create/FlatMap(<lambda at core.py:2957>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Map(decode)_21\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_22\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/ToVoidKey_23\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_0_25\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_1_26\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Flatten_27\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/GroupByKey_28\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_29\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Unkey_30\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Match_31\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] apache_beam.runners.portability.fn_api_runner.translations: INFO: ==================== <function sort_stages at 0x7fd348831a60> ==================== apache_beam.runners.portability.fn_api_runner.translations: DEBUG: 22 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] apache_beam.runners.portability.fn_api_runner.translations: DEBUG: Stages: ['ref_AppliedPTransform_Create/Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2957>)_4\n Create/FlatMap(<lambda at core.py:2957>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/Map(decode)_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map(<lambda at sql_test.py:152>)_14\n Map(<lambda at sql_test.py:152>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_6SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParDo(Calc)/ParMultiDo(Calc)\n SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Impulse_18\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2957>)_19\n assert_that/Create/FlatMap(<lambda at core.py:2957>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Map(decode)_21\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_22\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/ToVoidKey_23\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_0_25\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_1_26\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Flatten_27\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/GroupByKey_28\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_29\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Unkey_30\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Match_31\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] apache_beam.runners.portability.portable_runner: INFO: Job state changed to STOPPED apache_beam.runners.portability.portable_runner: INFO: Job state changed to STARTING apache_beam.runners.portability.portable_runner: INFO: Job state changed to RUNNING root: INFO: ==================== <function annotate_downstream_side_inputs at 0x7f285808a620> ==================== root: INFO: ==================== <function fix_side_input_pcoll_coders at 0x7f285808a730> ==================== root: INFO: ==================== <function lift_combiners at 0x7f285808aae8> ==================== root: INFO: ==================== <function expand_sdf at 0x7f285808ac80> ==================== root: INFO: ==================== <function expand_gbk at 0x7f285808ad08> ==================== root: INFO: ==================== <function sink_flattens at 0x7f285808ae18> ==================== root: INFO: ==================== <function greedily_fuse at 0x7f285808aea0> ==================== root: INFO: ==================== <function read_to_impulse at 0x7f285808af28> ==================== root: INFO: ==================== <function impulse_to_input at 0x7f285808b048> ==================== root: INFO: ==================== <function sort_stages at 0x7f285808b268> ==================== root: INFO: ==================== <function setup_timer_mapping at 0x7f285808b1e0> ==================== root: INFO: ==================== <function populate_data_channel_coders at 0x7f285808b2f0> ==================== root: INFO: starting control server on port 43741 root: INFO: starting data server on port 35823 root: INFO: starting state server on port 43485 root: INFO: starting logging server on port 41809 root: INFO: Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f28578ffd68> for environment ref_Environment_default_environment_1 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.29.0.dev') root: INFO: Attempting to pull image apache/beam_python3.6_sdk:2.29.0.dev root: INFO: Unable to pull image apache/beam_python3.6_sdk:2.29.0.dev, defaulting to local image if it exists root: INFO: Waiting for docker to start up. Current status is running root: INFO: Docker container is running. container_id = b'67d1cb6fb58003238184dad5c48c374bdd9275fd7a6421d95090e5e5a76734b2', worker_id = worker_116 root: INFO: Running (((((ref_AppliedPTransform_assert_that/Create/Impulse_18)+(ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2957>)_19))+(ref_AppliedPTransform_assert_that/Create/Map(decode)_21))+(ref_AppliedPTransform_assert_that/Group/pair_with_0_25))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0) root: INFO: Running ((((ref_AppliedPTransform_Create/Impulse_3)+(ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2957>)_4))+(ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/AddRandomKeys_7))+(ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write) root: INFO: Running (((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_11))+(ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys_12))+(ref_AppliedPTransform_Create/Map(decode)_13))+(ref_AppliedPTransform_Map(<lambda at sql_test.py:152>)_14))+(ref_PCollection_PCollection_1/Write) root: INFO: Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f28579a24e0> for environment external_6beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.29.0.dev') root: INFO: Attempting to pull image apache/beam_java8_sdk:2.29.0.dev root: INFO: Unable to pull image apache/beam_java8_sdk:2.29.0.dev, defaulting to local image if it exists root: INFO: Waiting for docker to start up. Current status is running root: INFO: Docker container is running. container_id = b'3b36dbef4c136f072948ceca695f1c387e2c18e6ad0b87336b263257736c81cc', worker_id = worker_118 --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: nosetests-xlangSqlValidateRunner.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 9 tests in 550.917s FAILED (errors=2) > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql > FAILED > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava > FROM-CACHE > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > partitionTest FAILED org.apache.beam.vendor.grpc.v1p26p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:127 Caused by: org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at SocketChannelImpl.java:-2 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > coGroupByKeyTest FAILED org.apache.beam.vendor.grpc.v1p26p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:233 Caused by: org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at SocketChannelImpl.java:-2 java.lang.NullPointerException at ValidateRunnerXlangTest.java:126 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > groupByKeyTest FAILED org.apache.beam.vendor.grpc.v1p26p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:201 Caused by: org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at SocketChannelImpl.java:-2 java.lang.NullPointerException at ValidateRunnerXlangTest.java:126 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combinePerKeyTest FAILED org.apache.beam.vendor.grpc.v1p26p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:278 Caused by: org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at SocketChannelImpl.java:-2 java.lang.NullPointerException at ValidateRunnerXlangTest.java:126 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest FAILED org.apache.beam.vendor.grpc.v1p26p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:298 Caused by: org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at SocketChannelImpl.java:-2 java.lang.NullPointerException at ValidateRunnerXlangTest.java:126 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > singleInputOutputTest FAILED org.apache.beam.vendor.grpc.v1p26p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:159 Caused by: org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at SocketChannelImpl.java:-2 java.lang.NullPointerException at ValidateRunnerXlangTest.java:126 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > multiInputOutputWithSideInputTest FAILED org.apache.beam.vendor.grpc.v1p26p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:181 Caused by: org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at SocketChannelImpl.java:-2 java.lang.NullPointerException at ValidateRunnerXlangTest.java:126 8 tests completed, 7 failed > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup > Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup FAILURE: Build completed with 3 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 43m 43s 166 actionable tasks: 120 executed, 42 from cache, 4 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/4mvgulu5d2pt4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
