[
https://issues.apache.org/jira/browse/BEAM-6488?focusedWorklogId=196526&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-196526
]
ASF GitHub Bot logged work on BEAM-6488:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Feb/19 04:43
Start Date: 09/Feb/19 04:43
Worklog Time Spent: 10m
Work Description: tweise commented on issue #7709: [BEAM-6488] Portable
Flink runner support for running cross-language …
URL: https://github.com/apache/beam/pull/7709#issuecomment-462013193
@ihji after repeating `Run Portable_Python PreCommit` I see that the
exception does not appear always and cannot say for sure if the changes in this
PR change the status quo or not. You can for reference also check the cron
executions of the job, where in the few cases I checked I did not see it:
https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/
It would be great if you could create a new ticket and take a look at
eliminating these exceptions (listed below). Thanks!
During job termination:
```
14:53:22 [grpc-default-executor-1] WARN
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
failed unexpectedly.
14:53:22 org.apache.beam.vendor.grpc.v1p13p1.io.grpc.StatusRuntimeException:
CANCELLED: cancelled before receiving half close
14:53:22 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Status.asRuntimeException(Status.java:517)
14:53:22 at
```
During job submission
```
14:52:56 [main] INFO org.apache.beam.runners.flink.FlinkJobServerDriver -
JobService started on localhost:58179
14:52:57 [grpc-default-executor-0] ERROR
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService -
Encountered Unexpected Exception for Invocation
job_bfb7df0e-408e-4bfd-bb3c-432e946ca819
14:52:57 org.apache.beam.vendor.grpc.v1p13p1.io.grpc.StatusException:
NOT_FOUND
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Status.asException(Status.java:534)
14:52:57 at
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.getInvocation(InMemoryJobService.java:341)
14:52:57 at
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.getStateStream(InMemoryJobService.java:262)
14:52:57 at
org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
14:52:57 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
14:52:57 at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
14:52:57 at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
```
The following seems to appear consistently in the PVR tests:
https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Commit/
```
14:54:50 Feb 07, 2019 10:54:50 PM
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference
cleanQueue
14:54:50 SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=628,
target=localhost:41409} was not shutdown properly!!! ~*~*~*
14:54:50 Make sure to call shutdown()/shutdownNow() and wait until
awaitTermination() returns true.
14:54:50 java.lang.RuntimeException: ManagedChannel allocation site
14:54:50 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
14:54:50 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
14:54:50 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
14:54:50 at
org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
14:54:50 at
org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
14:54:50 at
org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
14:54:50 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:154)
14:54:50 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:137)
14:54:50 at
org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
14:54:50 at
org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
14:54:50 at
org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
14:54:50 at
org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
14:54:50 at
org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
14:54:50 at
org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
14:54:50 at
org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
14:54:50 at
org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
14:54:50 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:162)
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 196526)
Time Spent: 3h 50m (was: 3h 40m)
> Portable Flink runner support for running cross-language transforms
> -------------------------------------------------------------------
>
> Key: BEAM-6488
> URL: https://issues.apache.org/jira/browse/BEAM-6488
> Project: Beam
> Issue Type: New Feature
> Components: beam-model, runner-core, runner-flink, sdk-java-core,
> sdk-py-core
> Reporter: Chamikara Jayalath
> Assignee: Heejong Lee
> Priority: Major
> Labels: triaged
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> To support running cross-language transforms, Portable Flink runner needs to
> support executing pipelines with steps defined to be executed for different
> environments.
> I believe this support is already there. If that is the case we should
> validate that and add any missing tests.
> If there are missing pieces, we should figure out details and create more
> JIRAs as needed.
> CC: [~angoenka]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
