See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/588/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-10925] Refactor ZetaSqlJavaUdfTypeTest. [Boyuan Zhang] SDF bounded wrapper returns None when any exception happen in the [Steve Niemitz] [BEAM-12126] Fix DirectRunner not respecting use_deprecated_reads [randomstep] [BEAM-12092] Bump jedis to 3.5.2 [noreply] [BEAM-11227] Try reverting #14295: Moving from vendored gRPC 1.26 to [noreply] Merge pull request #14446 from [BEAM-10854] Fix PeriodicImpulse for ------------------------------------------ [...truncated 2.98 MB...] INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:09.154Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:09.220Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:08.391Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:08.473Z: JOB_MESSAGE_DEBUG: Executing success step success27 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:08.538Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:08.589Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:08.646Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:11.121Z: JOB_MESSAGE_BASIC: Finished operation Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create simple/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create simple/Map(decode)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/extractKeyrhs/ParMultiDo(Anonymous)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:11.192Z: JOB_MESSAGE_BASIC: Executing operation SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:11.281Z: JOB_MESSAGE_BASIC: Finished operation SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:11.372Z: JOB_MESSAGE_BASIC: Executing operation SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)/ParMultiDo(ConvertCoGbkResult)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Select.Fields/ParDo(Select)/ParMultiDo(Select)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_96/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:18.284Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:18.328Z: JOB_MESSAGE_DEBUG: Executing success step success27 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:18.397Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:18.447Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:18.479Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:22.316Z: JOB_MESSAGE_BASIC: Finished operation SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)/ParMultiDo(ConvertCoGbkResult)+SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Select.Fields/ParDo(Select)/ParMultiDo(Select)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_96/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:22.381Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:22.422Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:22.506Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:31.571Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:31.634Z: JOB_MESSAGE_DEBUG: Executing success step success55 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:31.703Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:31.751Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:31.769Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:39.081Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:39.125Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:39.150Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:39.073Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:39.115Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:39.139Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-04-08_12_16_43-11562422333264085257 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-04-08_12_16_46-2528339264445678569 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:50.495Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2955>)+assert_that/Create/Map(decode)+assert_that/Group/pair_with_0+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:53.449Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:53.492Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:53.532Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:55.458Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:55.498Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:55.526Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:57.282Z: JOB_MESSAGE_BASIC: Finished operation SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse+SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+external_2SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction+external_2SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitWithSizing INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:57.347Z: JOB_MESSAGE_DEBUG: Value "external_2SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)-split-with-sizing-out3" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:24:57.413Z: JOB_MESSAGE_BASIC: Executing operation external_2SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/ProcessElementAndRestrictionWithSizing+SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-04-08_12_16_48-10401123518936492476 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:03.115Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:03.169Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:03.210Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-04-08_12_16_50-6386128982430479440 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:02.429Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:02.459Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:02.490Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-04-08_12_16_46-12326117562343567533 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-04-08_12_16_45-3178001209427840398 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:14.124Z: JOB_MESSAGE_BASIC: Finished operation external_2SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/ProcessElementAndRestrictionWithSizing+SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:14.270Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:14.324Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:14.400Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:24.104Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:24.153Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:24.185Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:21.728Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:21.792Z: JOB_MESSAGE_DEBUG: Executing success step success24 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:21.855Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:21.899Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:25:21.933Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-04-08_12_16_49-16029673475193181788 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:26:06.124Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:26:06.151Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-04-08T19:26:06.184Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-04-08_12_16_55-8628949196369091179 is in state JOB_STATE_DONE test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ... ERROR test_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_project (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_row (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_agg (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_map (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_filter (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_tagged_join (apache_beam.transforms.sql_test.SqlTransformTest) ... ok test_zetasql_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ... ok ====================================================================== ERROR: test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/sql_test.py";,> line 178, in test_windowing_before_sql | SqlTransform("SELECT COUNT(*) as `count` FROM PCOLLECTION")) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,> line 142, in __or__ return self.pipeline.apply(ptransform, self) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,> line 685, in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,> line 146, in apply return super(DataflowRunner, self).apply(transform, input, options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 188, in apply return m(transform, input, options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,> line 218, in apply_PTransform return transform.expand(input) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 295, in expand with self._service() as service: File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 351, in _service with self._expansion_service as stub: File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,> line 497, in __enter__ self._service = self._service_provider.__enter__() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/utils/subprocess_server.py";,> line 71, in __enter__ return self.start() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/utils/subprocess_server.py";,> line 88, in start 'Service failed to start up with error %s' % self._process.poll()) RuntimeError: Service failed to start up with error 1 -------------------- >> begin captured logging << -------------------- apache_beam.utils.subprocess_server: INFO: Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.30.0-SNAPSHOT.jar> apache_beam.utils.subprocess_server: INFO: Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.30.0-SNAPSHOT.jar'> '38145'] root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. apache_beam.utils.subprocess_server: INFO: b'Starting expansion service at localhost:38145' root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. apache_beam.utils.subprocess_server: INFO: b'Apr 08, 2021 7:15:56 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms' apache_beam.utils.subprocess_server: INFO: b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]' apache_beam.utils.subprocess_server: INFO: b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178' apache_beam.utils.subprocess_server: INFO: b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a' root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: DEBUG: Waiting for grpc channel to be ready at localhost:38145. root: WARNING: Waiting for grpc channel to be ready at localhost:38145. apache_beam.utils.subprocess_server: INFO: b'Exception in thread "main" java.io.IOException: Failed to bind' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.grpc.netty.NettyServer.start(NettyServer.java:257)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl.start(ServerImpl.java:184)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl.start(ServerImpl.java:90)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.sdk.expansion.service.ExpansionService.main(ExpansionService.java:521)' apache_beam.utils.subprocess_server: INFO: b'Caused by: java.net.BindException: Address already in use' apache_beam.utils.subprocess_server: INFO: b'\tat sun.nio.ch.Net.bind0(Native Method)' apache_beam.utils.subprocess_server: INFO: b'\tat sun.nio.ch.Net.bind(Net.java:461)' apache_beam.utils.subprocess_server: INFO: b'\tat sun.nio.ch.Net.bind(Net.java:453)' apache_beam.utils.subprocess_server: INFO: b'\tat sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:132)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:551)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1346)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:503)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:488)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:985)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel.bind(AbstractChannel.java:247)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:344)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:510)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:518)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)' apache_beam.utils.subprocess_server: INFO: b'\tat org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)' apache_beam.utils.subprocess_server: INFO: b'\tat java.lang.Thread.run(Thread.java:748)' root: WARNING: Waiting for grpc channel to be ready at localhost:38145. apache_beam.utils.subprocess_server: ERROR: Starting job service with ['java', '-jar', '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.30.0-SNAPSHOT.jar',> '38145'] apache_beam.utils.subprocess_server: ERROR: Error bringing up service Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/utils/subprocess_server.py";,> line 88, in start 'Service failed to start up with error %s' % self._process.poll()) RuntimeError: Service failed to start up with error 1 --------------------- >> end captured logging << --------------------- Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-08_12_16_50-6386128982430479440?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-08_12_16_45-3178001209427840398?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-08_12_16_43-11562422333264085257?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-08_12_16_46-12326117562343567533?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-08_12_16_46-2528339264445678569?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-08_12_16_48-10401123518936492476?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-08_12_16_49-16029673475193181788?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-08_12_16_55-8628949196369091179?project=apache-beam-testing ---------------------------------------------------------------------- XML: nosetests-xlangSqlValidateRunner.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 9 tests in 667.908s FAILED (errors=1) > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 23262. Stopping expansion service pid: 23295. > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210408185958 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56dc530f6f3af8b328f4ad45f6bf00aa733c6d32cecfa67dbf5d1f30a61d769a Deleted: sha256:313bda91722b1301dedf4da18cae61bdba285a90aa75d4c064c7c8cbb3de0dda Deleted: sha256:d53e69db8cf905984c8971f670e495c328c273dbc4bc8614ade69e2c52bbddb8 Deleted: sha256:b32cb68a4267ae2a748a2560ab6e9be215e608b1e38fb82ac60f585e29930d43 Deleted: sha256:dc41c67783f8ad19f61bfb1729a8a3a5dd22ee402fdd97d99ea2ee2ae91c87c5 Deleted: sha256:3404c5f149b2d7cfac998ff511d4b864bbeb320d53bc51ffec99d3ea503ad7c0 Deleted: sha256:804da480cda568e00e068e95c0630540c082e6e8f1f012c64b8925ca172c41a8 Deleted: sha256:944aec1f9ebbb64384c192c2f7e4e359924fd6ce5ef15026f6d8e78e294656b9 Deleted: sha256:f7d1ee60f6e91458720e19d069488964178434d6db53be63e4ef51483ec61b41 Deleted: sha256:e9c77c6e5a8a0b0d93ce9f6dd006ac7ef8c833f88bdb95f88fa351e5f192ffe6 Deleted: sha256:b95ac6fa1013b9d79012e9cab37e981f924bad6834251db1d75c2e3af6f9abcd Deleted: sha256:6df3fb304df2217116de6dea0228452d7a8db40c05edfede5da278c9e9fbc792 Deleted: sha256:7183ccb86c464660bca7883e67525ddc550025bee06b0d4b3170a6ba4d28dd68 Deleted: sha256:74141281cbac2d35331e7e6447a21157caaab94ae16118349a05e3790b40b3ae Deleted: sha256:3369b666e9a31942a62afda472017018bccc7d7925f5f7c667409594a03e4c12 Deleted: sha256:f9a4905252d61ec5bc96aaa04511cd1611d1c0ea2f9b3f9ecab97f907a170c58 Deleted: sha256:79be8e17e952727c2100604b46e6d2c6a4a3b45dcefcf847bc803e82dfa4d911 Deleted: sha256:b6de2c086586f04337c93f0c5105f551019ebe6c842d77b26699c8ca685608a2 Deleted: sha256:563399209db05eb78792f84a742d487b3965c1bb1a2a0383d558b86c84b022fa Deleted: sha256:5a061fa83b89268423a9b9751e2f62a5b9365ed0c43187e71103c2b663e98e1b Deleted: sha256:8da6e45491c5452f727e0bd489c89091ef4f0b361e491550ca4a153ce5de7c1f Deleted: sha256:6c3d9e321a4fd419be4e47de746fb9aa8de4fed85eec5c32a70f8c0e00342d52 Deleted: sha256:e9bdcb1ab773658506d79687a1294951abeadba8e0c0cdd6d8cd4c0e837b0f1b Deleted: sha256:649c10334bb17deaf44b776a89919f4d45a33b1ed44449724b096abae2fa87d2 Deleted: sha256:2b778e03359f713c38df9c58f0b26e0730128213f66a7a970b1b38d81aa7f662 Deleted: sha256:00f4b1fb722ce82770d93018d0411d56cdf7770288cd31bc7ae9d396b0814bf8 Deleted: sha256:f3b361b6b2244d99e65510477f687516feb6cfcc5dcb2b74eb5256a7a97e6c55 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56dc530f6f3af8b328f4ad45f6bf00aa733c6d32cecfa67dbf5d1f30a61d769a Associated tags: - 20210408185958 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210408185958 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210408185958]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56dc530f6f3af8b328f4ad45f6bf00aa733c6d32cecfa67dbf5d1f30a61d769a]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 26m 57s 139 actionable tasks: 49 executed, 12 from cache, 78 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/lors3w5f3hqng Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
