[
https://issues.apache.org/jira/browse/FLINK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630840#comment-17630840
]
Matthias Pohl commented on FLINK-28394:
---------------------------------------
[~hxbks2ks] can you give some guidance here on what the actual issue is? I'm
not happy with what we extracted from the failed builds so far to give this
Jira issue a meaningful purpose. The only thing I found is the following
stacktrace (but that might be unrelated):
{code}
02:56:45,358 [Source: PythonInputFormatTableSource(a, b, c) ->
SourceConversion[610] -> PythonCorrelate[611] -> Calc[612] ->
SinkConversion[613] -> Map -> Sink: Unnamed (2/2)#0] WARN
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory [] - Error
cleaning up server>
payload:
"\0327/__w/1/s/flink-python/pyflink/bin/pyflink-udf-runner.sh\"\312\002\n\004PATH\022\301\002/__w/1/s/flink-python/.tox/py38-cython/bin:/__w/1/s/flink-python/dev/.conda/envs/3.8/bin:/__w/1/s/flink-python/dev/.conda/envs/3.7/bin:/__w/1/s/flink-python/dev/.conda/envs/3.6/bi>
java.lang.IllegalStateException: call already closed
at
org.apache.beam.vendor.grpc.v1p26p0.com.google.common.base.Preconditions.checkState(Preconditions.java:511)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:209)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:202)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:371)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:64)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.GrpcFnServer.close(GrpcFnServer.java:156)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:212)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:319)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.api.runners.python.beam.PythonSharedResources.close(PythonSharedResources.java:67)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.memory.SharedResources$LeasedResource.dispose(SharedResources.java:180)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.memory.SharedResources.release(SharedResources.java:108)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.memory.MemoryManager.lambda$getSharedMemoryResourceForManagedMemory$7(MemoryManager.java:565)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.memory.OpaqueMemoryResource.close(OpaqueMemoryResource.java:65)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.close(BeamPythonFunctionRunner.java:284)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.api.operators.python.AbstractExternalPythonFunctionOperator.close(AbstractExternalPythonFunctionOperator.java:64)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:163)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:125)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1000)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.afterInvoke(StreamTask.java:879)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:762)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_292]
{code}
> Python py36-cython: InvocationError for command install_command.sh fails with
> exit code 1
> -----------------------------------------------------------------------------------------
>
> Key: FLINK-28394
> URL: https://issues.apache.org/jira/browse/FLINK-28394
> Project: Flink
> Issue Type: Bug
> Components: API / Python
> Affects Versions: 1.16.0, 1.15.2
> Reporter: Martijn Visser
> Assignee: Huang Xingbo
> Priority: Major
> Labels: stale-assigned, test-stability
>
> {code:java}
> Jul 05 03:47:22 Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> Jul 05 03:47:32 Using Python version 3.8.13 (default, Mar 28 2022 11:38:47)
> Jul 05 03:47:32 pip_test_code.py success!
> Jul 05 03:47:32 py38-cython finish: run-test after 1658.14 seconds
> Jul 05 03:47:32 py38-cython start: run-test-post
> Jul 05 03:47:32 py38-cython finish: run-test-post after 0.00 seconds
> Jul 05 03:47:32 ___________________________________ summary
> ____________________________________
> Jul 05 03:47:32 ERROR: py36-cython: InvocationError for command
> /__w/3/s/flink-python/dev/install_command.sh --exists-action w
> .tox/.tmp/package/1/apache-flink-1.15.dev0.zip (exited with code 1)
> Jul 05 03:47:32 py37-cython: commands succeeded
> Jul 05 03:47:32 py38-cython: commands succeeded
> Jul 05 03:47:32 cleanup
> /__w/3/s/flink-python/.tox/.tmp/package/1/apache-flink-1.15.dev0.zip
> Jul 05 03:47:33 ============tox checks... [FAILED]============
> Jul 05 03:47:33 Process exited with EXIT CODE: 1.
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37604&view=logs&j=bf5e383b-9fd3-5f02-ca1c-8f788e2e76d3&t=85189c57-d8a0-5c9c-b61d-fc05cfac62cf&l=27789
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
