执行命令1的时候,localhost:8081看上去是正常的,有可用的TaskManager,JobSlot等。log下的StandaloneSession和TaskExecutor的log均无异常。
dispatcher也是正常起来的:

2019-11-03 21:07:58,438 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint    - Rest
endpoint listening at localhost:8081

2019-11-03 21:07:58,438 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint    -
http://localhost:8081 was granted leadership with
leaderSessionID=00000000-0000-0000-0000-000000000000

2019-11-03 21:07:58,439 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint    - Web
frontend listening at http://localhost:8081.

2019-11-03 21:07:58,507 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService              - Starting
RPC endpoint for
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at
akka://flink/user/resourcemanager .

2019-11-03 21:07:58,526 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService              - Starting
RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher
at akka://flink/user/dispatcher .

2019-11-03 21:07:58,549 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager  -
ResourceManager akka.tcp://flink@localhost:6123/user/resourcemanager was
granted leadership with fencing token 00000000000000000000000000000000

2019-11-03 21:07:58,550 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager  -
Starting the SlotManager.

2019-11-03 21:07:58,563 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Dispatcher
akka.tcp://flink@localhost:6123/user/dispatcher was granted leadership with
fencing token 00000000-0000-0000-0000-000000000000

2019-11-03 21:07:58,565 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Recovering
all persisted jobs.

2019-11-03 21:08:02,248 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager  -
Registering TaskManager with ResourceID ba0633856bb7670711e9e4e946168800
(akka.tcp://[email protected]:54796/user/taskmanager_0) at
ResourceManager

On Tue, Nov 5, 2019 at 8:21 PM zhisheng <[email protected]> wrote:

> 执行命令 1 的时候,建议打开 localhost:8081 看看是否 Flink UI 打开是否有问题,再或者看看 Flink log 目录下的
> jobmanager 和 taskmanager 的日志是否有异常?
>
> 我本地测试你同样的命令是 OK 的
>
> tison <[email protected]> 于2019年11月5日周二 下午3:01写道:
>
> > 这个问题其实还挺常见的,问题有很多种可能。比如你看一下 log 下面 cluster 的日志看看
> > Dispatcher 有没有正常的起起来,flink-conf 你有没有改过导致超时过短(比如 1 ms)或者
> > 资源不够。也有升级 jdk 小版本后就不复现的。
> >
> > Best,
> > tison.
> >
> >
> > jeff kit <[email protected]> 于2019年11月5日周二 下午2:43写道:
> >
> > > 你好。
> > > 我本地的Flink是官网提供的Binary包,非自己编译的。
> > > 我相信我的情况是少数,绝大多数人的Mac都是能跑的。
> > >
> > > On Tue, Nov 5, 2019 at 2:24 PM Biao Liu <[email protected]> wrote:
> > >
> > > > 你好,
> > > >
> > > > MacOS 可以跑 Flink,我自己刚试了下,复制你的命令就可以跑。
> > > > 建议再查一下你本地的环境,你本地的 Flink 是自己编译的吗?如果不行试一下 Flink 提供的 binary 包 [1]?
> > > >
> > > > [1] https://flink.apache.org/downloads.html
> > > >
> > > > Thanks,
> > > > Biao /'bɪ.aʊ/
> > > >
> > > >
> > > >
> > > > On Tue, 5 Nov 2019 at 12:30, jeff kit <[email protected]> wrote:
> > > >
> > > > > HI,大家好:
> > > > > 我在运行Flink官方的Quick
> > > > >
> Start就遇到了问題。为了避免自己问蠢问題,我先做了很多尝试,如换Flink的版本,从1.7到1.8及至1.9都试过,在我自己的Mac
> > OS
> > > > > X上这个问題是必然出现的,而换到其他操作系统例如Windows,则是正常的。
> > > > >
> > > > > 这也许不是一个常见的问題,更多是我本机的运行环境问題,但多天尝试下来仍然没有找到解决方法,才在这里求助一下。
> > > > >
> > > > > 操作步骤:
> > > > > 1. ./bin/start-cluster.sh  # 启动flink。
> > > > > 2. ./bin/flink run examples/batch/WordCount.jar   # 提交wordCount 包
> > > > >
> > > > > 随后就是抛了异常:
> > > > > Starting execution of program
> > > > > Executing WordCount example with default input data set.
> > > > > Use --input to specify file input.
> > > > > Printing result to stdout. Use --output to specify output path.
> > > > >
> > > > > ------------------------------------------------------------
> > > > >  The program finished with the following exception:
> > > > >
> > > > > org.apache.flink.client.program.ProgramInvocationException: Could
> not
> > > > > retrieve the execution result. (JobID:
> > > 81bc8720dee57710788cc8e41079ba4d)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:255)
> > > > > at
> > > > >
> > >
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338)
> > > > > at
> > > > >
> > >
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:820)
> > > > > at org.apache.flink.api.java.DataSet.collect(DataSet.java:413)
> > > > > at org.apache.flink.api.java.DataSet.print(DataSet.java:1652)
> > > > > at
> > > > >
> > > >
> > >
> >
> org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:88)
> > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > > at java.lang.reflect.Method.invoke(Method.java:483)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438)
> > > > > at
> > > > >
> > >
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:274)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:746)
> > > > > at
> > > >
> > org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:273)
> > > > > at
> org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083)
> > > > > at
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.cli.CliFrontend$$Lambda$31/1990451863.call(Unknown
> > > > > Source)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
> > > > > at
> > org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083)
> > > > > Caused by: org.apache.flink.runtime.client.JobSubmissionException:
> > > Failed
> > > > > to submit JobGraph.
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:382)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.client.program.rest.RestClusterClient$$Lambda$44/1067599825.apply(Unknown
> > > > > Source)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture$ExceptionCompletion.run(CompletableFuture.java:1246)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture$ThenCopy.run(CompletableFuture.java:1333)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2361)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:263)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.runtime.concurrent.FutureUtils$$Lambda$63/318445555.accept(Unknown
> > > > > Source)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1298)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:626)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > > > > at java.lang.Thread.run(Thread.java:745)
> > > > > Caused by: org.apache.flink.runtime.rest.util.RestClientException:
> > > > > [Internal server error., <Exception on server side:
> > > > > akka.pattern.AskTimeoutException: Ask timed out on
> > > > > [Actor[akka://flink/user/dispatcher#-80166821]] after [10000 ms].
> > > Message
> > > > > of type
> [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A
> > > > > typical reason for `AskTimeoutException` is that the recipient
> actor
> > > > didn't
> > > > > send a reply.
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> akka.pattern.PromiseActorRef$.$anonfun$defaultOnTimeout$1(AskSupport.scala:635)
> > > > > at
> akka.pattern.PromiseActorRef$$$Lambda$190/1064265473.apply(Unknown
> > > > > Source)
> > > > > at
> > akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:650)
> > > > > at
> > > >
> > akka.pattern.PromiseActorRef$$$Lambda$191/517355658.apply$mcV$sp(Unknown
> > > > > Source)
> > > > > at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:870)
> > > > > at
> > > scala.concurrent.BatchingExecutor.execute(BatchingExecutor.scala:109)
> > > > > at
> > > scala.concurrent.BatchingExecutor.execute$(BatchingExecutor.scala:103)
> > > > > at
> > > > >
> > > >
> > >
> >
> scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:868)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:279)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:283)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:235)
> > > > > at java.lang.Thread.run(Thread.java:745)
> > > > >
> > > > > End of exception on server side>]
> > > > > at
> > > > >
> > > >
> > >
> >
> org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.flink.runtime.rest.RestClient$$Lambda$62/2010911005.apply(Unknown
> > > > > Source)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:604)
> > > > > ... 4 more
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
> 对了,在我的Mac上,遇到的奇怪问題还不止这一个,在其他人的机器上正常运行的Flink程序,到我这里都是有这样那样的问題的。所以,Flink对系统环境有什么依赖吗?
> > > > > 我本地的环境是 jdk 1.8.0, maven 3.5.4
> > > > >
> > > > > 谢谢大家。
> > > > >
> > > >
> > >
> >
>

回复