Re: Could not forward element to next operator

2019-09-28 Thread 18612537914
我看过这个我不是这个问题,作业没有设置水印,作业可以正常运行,最近可能是运行一天多会报这个异常 发自我的 iPhone > 在 2019年9月29日,上午11:49,Wesley Peng 写道: > > Hello, > > May this article match your issue? > https://blog.csdn.net/qq_41910230/article/details/90411237 > > regards. > >> On Sun, Sep 29, 2019 at 10:33 AM allan <18612537...@163.com>

flink 命令行疑问

2019-09-28 Thread 戴嘉诚
大家好: 我的flink代码打包的jar包是放到了hdfs上面,但是当我在flink中用命令行执行的时候,flink本地是否只能解析本地jar包?不能解析到hdfs上面的jar包? 我把jar包下载到服务器本地后,就可以执行成功了 我的命令是: ./bin/flink run -yid application_1567652112073_0001 -p 6 -yj hdfs://ysec-storage/flink/runJar/business-security-1.0-SNAPSHOT.jar --appId act_test 返回的结果是:

Re: 使用flink-sql实现mysql维表的join的ddl和dml的示列

2019-09-28 Thread Jark Wu
Hi, mysql 维表的 DDL 和 源表/结果表 的 DDL 是一样的。 例如下面这个 DDL 的声明,rates 在 flink sql 中既可以作为 source 也可以是 sink,也可以是维表。 CREATE TABLE rates ( currency VARCHAR, rate BIGINT ) WITH ( 'connector.type' = 'jdbc', -- 使用 jdbc connector 'connector.url' = 'jdbc:mysql://localhost:3306/flink-test', -- jdbc

Re: Running flink on AWS ECS

2019-09-28 Thread sri hari kali charan Tummala
Aws already has auto scale flink cluster it’s called Kinesis Data Analytics just add your flink Jar to Kinesis Sql analytics that’s all , aws will auto provision a flink cluster and do the admin part for you. On Saturday, September 28, 2019, David Anderson wrote: > I believe there can be

Apache Flink write to multiple sinks one after the other in sequence

2019-09-28 Thread shrridevi sreedharan
Hello Team, Could you please help with the below query. I have a CsvTableSource to read CSV files and write the data to S3 and after that I want to load the file from S3 to JDBC sink. How can I make the JDBC sink execute only after the S3 sink is completed successfully. The reason is, S3 is going

Re: Running flink on AWS ECS

2019-09-28 Thread David Anderson
I believe there can be advantages and disadvantages in both directions. For example, fewer containers with multiple slots reduces the effort the Flink Master has to do whenever global coordination is required, i.e., during checkpointing. And the network stack in the task managers is optimized to