See 
<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/3971/display/redirect?page=changes>

Changes:

[emilyye] sync nltk, orjson for Python image

[noreply] Allow `google-auth < 3`

[samuelw] [BEAM-12776] Change closing to happen in background in parallel for

[noreply] Fix typo in BigQuery documentation

[Steve Niemitz] [BEAM-12767] Improve PipelineOption parsing UX


------------------------------------------
[...truncated 93.01 KB...]
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:13 AM 
org.apache.beam.runners.jobsubmission.JobServerDriver run'
INFO:apache_beam.utils.subprocess_server:b'INFO: Job server now running, 
terminate with Ctrl+C'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:14 AM 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext'
INFO:apache_beam.utils.subprocess_server:b'INFO: Staging artifacts for 
job_b6f02b3c-1f6a-47a0-94eb-b8c9c1a0612a.'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:14 AM 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 
resolveNextEnvironment'
INFO:apache_beam.utils.subprocess_server:b'INFO: Resolving artifacts for 
job_b6f02b3c-1f6a-47a0-94eb-b8c9c1a0612a.ref_Environment_default_environment_1.'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:14 AM 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext'
INFO:apache_beam.utils.subprocess_server:b'INFO: Getting 1 artifacts for 
job_b6f02b3c-1f6a-47a0-94eb-b8c9c1a0612a.null.'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:14 AM 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 
finishStaging'
INFO:apache_beam.utils.subprocess_server:b'INFO: Artifacts fully staged for 
job_b6f02b3c-1f6a-47a0-94eb-b8c9c1a0612a.'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:15 AM 
org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor'
INFO:apache_beam.utils.subprocess_server:b'INFO: Invoking job 
BeamApp-jenkins-0901002714-1ae14122_2b794cd2-6710-4da1-9724-a52690293512 with 
pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@44b027b7'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:15 AM 
org.apache.beam.runners.jobsubmission.InMemoryJobService run'
INFO:apache_beam.utils.subprocess_server:b'SEVERE: Encountered Unexpected 
Exception for Preparation job_b6f02b3c-1f6a-47a0-94eb-b8c9c1a0612a'
INFO:apache_beam.utils.subprocess_server:b"java.lang.IllegalArgumentException: 
Error while populating display data for component 
'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData':
 null"
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.flink.FlinkJobInvoker.createJobInvocation(FlinkJobInvoker.java:108)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.flink.FlinkJobInvoker.invokeWithExecutor(FlinkJobInvoker.java:92)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.jobsubmission.JobInvoker.invoke(JobInvoker.java:48)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.jobsubmission.InMemoryJobService.run(InMemoryJobService.java:246)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:948)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:797)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
java.lang.Thread.run(Thread.java:748)'
INFO:apache_beam.utils.subprocess_server:b"Caused by: 
com.fasterxml.jackson.databind.JsonMappingException: Error while populating 
display data for component 
'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData':
 null"
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)'
INFO:apache_beam.utils.subprocess_server:b'\t... 18 more'
INFO:apache_beam.utils.subprocess_server:b"Caused by: 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException:
 Error while populating display data for component 
'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData':
 null"
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.sun.proxy.$Proxy15.populateDisplayData(Unknown Source)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)'
INFO:apache_beam.utils.subprocess_server:b'\t... 21 more'
INFO:apache_beam.utils.subprocess_server:b'Caused by: 
java.lang.NullPointerException'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)'
INFO:apache_beam.utils.subprocess_server:b'\t... 30 more'
INFO:apache_beam.utils.subprocess_server:b''
Traceback (most recent call last):
  File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/examples/wordcount.py";,>
 line 94, in <module>
    run()
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/examples/wordcount.py";,>
 line 89, in run
    output | 'Write' >> WriteToText(known_args.output)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/pipeline.py";,>
 line 586, in __exit__
    self.result = self.run()
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/pipeline.py";,>
 line 565, in run
    return self.runner.run_pipeline(self, self._options)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/portability/flink_runner.py";,>
 line 45, in run_pipeline
    return super(FlinkRunner, self).run_pipeline(pipeline, options)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/portability/portable_runner.py";,>
 line 440, in run_pipeline
    job_service_handle.submit(proto_pipeline)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/portability/portable_runner.py";,>
 line 115, in submit
    return self.run(prepare_response.preparation_id)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/portability/portable_runner.py";,>
 line 242, in run
    beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id))
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py";,>
 line 946, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py";,>
 line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
        status = StatusCode.INTERNAL
        details = ""
        debug_error_string = 
"{"created":"@1630456035.107938638","description":"Error received from peer 
ipv4:127.0.0.1:41495","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"","grpc_status":13}"
>

> Task :sdks:python:test-suites:portable:py36:portableWordCountFlinkRunnerBatch 
> FAILED

> Task 
> :sdks:python:test-suites:portable:py36:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:46701
WARNING:root:Make sure that locally built Python SDK docker image has Python 
3.6 interpreter.
INFO:root:Default Python SDK image for environment is 
apache/beam_python3.6_sdk:2.34.0.dev
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' 
'<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.34.0-SNAPSHOT.jar'>
 '--flink-master' '[auto]' '--artifacts-dir' 
'/tmp/beam-tempvyzf2vym/artifactsdkl78hln' '--job-port' '44001' 
'--artifact-port' '0' '--expansion-port' '0']
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:20 AM 
org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder'
INFO:apache_beam.utils.subprocess_server:b"INFO: The AWS S3 Beam extension was 
included in this build, but the awsRegion flag was not specified. If you don't 
plan to use S3, then ignore this message."
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:21 AM 
org.apache.beam.runners.jobsubmission.JobServerDriver 
createArtifactStagingService'
INFO:apache_beam.utils.subprocess_server:b'INFO: ArtifactStagingService started 
on localhost:37587'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:21 AM 
org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService'
INFO:apache_beam.utils.subprocess_server:b'INFO: Java ExpansionService started 
on localhost:34029'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:21 AM 
org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer'
INFO:apache_beam.utils.subprocess_server:b'INFO: JobService started on 
localhost:44001'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:21 AM 
org.apache.beam.runners.jobsubmission.JobServerDriver run'
INFO:apache_beam.utils.subprocess_server:b'INFO: Job server now running, 
terminate with Ctrl+C'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:22 AM 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext'
INFO:apache_beam.utils.subprocess_server:b'INFO: Staging artifacts for 
job_e513f2f3-2bb2-4f78-9e74-47085fddf38e.'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:22 AM 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 
resolveNextEnvironment'
INFO:apache_beam.utils.subprocess_server:b'INFO: Resolving artifacts for 
job_e513f2f3-2bb2-4f78-9e74-47085fddf38e.ref_Environment_default_environment_1.'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:22 AM 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext'
INFO:apache_beam.utils.subprocess_server:b'INFO: Getting 1 artifacts for 
job_e513f2f3-2bb2-4f78-9e74-47085fddf38e.null.'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:22 AM 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 
finishStaging'
INFO:apache_beam.utils.subprocess_server:b'INFO: Artifacts fully staged for 
job_e513f2f3-2bb2-4f78-9e74-47085fddf38e.'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:22 AM 
org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor'
INFO:apache_beam.utils.subprocess_server:b'INFO: Invoking job 
BeamApp-jenkins-0901002722-14e83581_57fe4dfd-75cd-44c0-828f-61e3e5bdc6f5 with 
pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@44b027b7'
INFO:apache_beam.utils.subprocess_server:b'Sep 01, 2021 12:27:22 AM 
org.apache.beam.runners.jobsubmission.InMemoryJobService run'
INFO:apache_beam.utils.subprocess_server:b'SEVERE: Encountered Unexpected 
Exception for Preparation job_e513f2f3-2bb2-4f78-9e74-47085fddf38e'
INFO:apache_beam.utils.subprocess_server:b"java.lang.IllegalArgumentException: 
Error while populating display data for component 
'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData':
 null"
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.flink.FlinkJobInvoker.createJobInvocation(FlinkJobInvoker.java:108)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.flink.FlinkJobInvoker.invokeWithExecutor(FlinkJobInvoker.java:92)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.jobsubmission.JobInvoker.invoke(JobInvoker.java:48)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.runners.jobsubmission.InMemoryJobService.run(InMemoryJobService.java:246)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:948)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:797)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
java.lang.Thread.run(Thread.java:748)'
INFO:apache_beam.utils.subprocess_server:b"Caused by: 
com.fasterxml.jackson.databind.JsonMappingException: Error while populating 
display data for component 
'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData':
 null"
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)'
INFO:apache_beam.utils.subprocess_server:b'\t... 18 more'
INFO:apache_beam.utils.subprocess_server:b"Caused by: 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException:
 Error while populating display data for component 
'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData':
 null"
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.sun.proxy.$Proxy15.populateDisplayData(Unknown Source)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)'
INFO:apache_beam.utils.subprocess_server:b'\t... 21 more'
INFO:apache_beam.utils.subprocess_server:b'Caused by: 
java.lang.NullPointerException'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)'
INFO:apache_beam.utils.subprocess_server:b'\tat 
org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)'
Traceback (most recent call last):
  File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
INFO:apache_beam.utils.subprocess_server:b'\t... 30 more'
INFO:apache_beam.utils.subprocess_server:b''
    exec(code, run_globals)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/examples/wordcount.py";,>
 line 94, in <module>
    run()
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/examples/wordcount.py";,>
 line 89, in run
    output | 'Write' >> WriteToText(known_args.output)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/pipeline.py";,>
 line 586, in __exit__
    self.result = self.run()
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/pipeline.py";,>
 line 565, in run
    return self.runner.run_pipeline(self, self._options)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/portability/flink_runner.py";,>
 line 45, in run_pipeline
    return super(FlinkRunner, self).run_pipeline(pipeline, options)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/portability/portable_runner.py";,>
 line 440, in run_pipeline
    job_service_handle.submit(proto_pipeline)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/portability/portable_runner.py";,>
 line 115, in submit
    return self.run(prepare_response.preparation_id)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/portability/portable_runner.py";,>
 line 242, in run
    beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id))
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py";,>
 line 946, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File 
"<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py";,>
 line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
        status = StatusCode.INTERNAL
        details = ""
        debug_error_string = 
"{"created":"@1630456042.866094570","description":"Error received from peer 
ipv4:127.0.0.1:44001","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"","grpc_status":13}"
>

> Task 
> :sdks:python:test-suites:portable:py36:portableWordCountFlinkRunnerStreaming 
> FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task 
':sdks:python:test-suites:portable:py36:portableWordCountFlinkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug 
option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task 
':sdks:python:test-suites:portable:py36:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug 
option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See 
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 8s
139 actionable tasks: 96 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jjry2v4oixyhw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to