Hi Yufan,
Thanks for starting this discussion. My two coins:
1. It can help the upstream to fix the transaction issues by submitting the
instability and performance issues to the pulsar repo also.
2. Could you elaborate on whether and (if so) why we should drop the Shared and
Key_Share subscrip
FYI there is already a corresponding issue
https://issues.apache.org/jira/browse/FLINK-13660
Best,
tison.
Till Rohrmann 于2019年10月18日周五 下午9:42写道：
> Hi Martin,
>
> Flink's web UI based job submission is not well suited to be run behind a
> load balancer at the moment. The problem is that the web
Thanks a lot for being release manager Jark. Great work!
Best,
tison.
Till Rohrmann 于2019年10月19日周六 下午10:15写道：
> Thanks a lot for being our release manager Jark and thanks to everyone who
> has helped to make this release possible.
>
> Cheers,
> Till
>
> On Sat, Oct 19, 2019 at 3:26 PM Jark Wu
+1 to add Stateful Function to FLINK core repository.
Best,
tison.
Becket Qin 于2019年10月14日周一 下午4:16写道：
> +1 to adding Stateful Function to Flink. It is a very useful addition to
> the Flink ecosystem.
>
> Given this is essentially a new top-level / first-citizen API of Flink, it
> seems better
ow...
>>
>> I have 3 Zookeepers, 3 Job Nodes and 3 Tasks Nodes
>>
>> On Thu, 3 Oct 2019 at 11:15, Zili Chen wrote:
>>
>>> Hi John,
>>>
>>> could you provide some details such as which mode you runs
>>> on(standalone/YA
Hi John,
could you provide some details such as which mode you runs
on(standalone/YARN)
and related configuration(jobmanager.address jobmanager.port and so on)?
Best,
tison.
John Smith 于2019年10月3日周四 下午11:02写道：
> Hi running 1.8 the cluster seems to be OK but I see these warnings in the
> logs.
re public
> interfaces.
>
> Regards,
> Dian
>
> 在 2019年9月30日，下午4:49，Zili Chen 写道：
>
> Hi Dian,
>
> What about rename api.java to japi if there is no unexpected compatibility
> issue? I think we can always avoid use a `.java.` in package names.
>
> Best,
Hi Dian,
What about rename api.java to japi if there is no unexpected compatibility
issue? I think we can always avoid use a `.java.` in package names.
Best,
tison.
Dian Fu 于2019年9月26日周四 下午10:54写道：
> Hi Nick,
>
> There is a package named "org.apache.flink.table.api.java" in flink and
> so the
>> only Flink but other types of streaming engines as well like Spark and Akka
>>> Streams.
>>>
>>> regards.
>>>
>>>
>>> On Tue, Sep 24, 2019 at 10:17 AM Biao Liu wrote:
>>>
>>>> Hi Zili,
>>>>
>&g
t; asking this because I noticed that you used Future to execute the job
>>> unblocking. I guess ThreadLocal doesn't work well in this case.
>>>
>>> Regards,
>>> Dian
>>>
>>> 在 2019年9月23日，下午11:57，Debasish Ghosh 写道：
>>>
>>> Hi tison -
t; ./flink-tests/src/test/java/org/apache/flink/test/optimizer/jsonplan/DumpCompiledPlanTest.java:
>>>> } catch (OptimizerPlanEnvironment.ProgramAbortException pae) {
>>>> ./flink-tests/src/test/java/org/apache/flink/test/optimizer/jsonplan/DumpCompiledPlanTest.java:
>>>> } catch
The situation is as Dian said. Flink identifies jobs by job id instead of
job name.
However, I think it is still a valid question if it is an alternative Flink
identifies jobs by job name and
leaves the work to distinguish jobs by name to users. The advantages in
this way includes a readable
displ
Hi Debasish,
As mentioned by Dian, it is an internal exception that should be always
caught by
Flink internally. I would suggest you share the job(abstractly). Generally
it is because
you use StreamPlanEnvironment/OptimizerPlanEnvironment directly.
Best,
tison.
Austin Cawley-Edwards 于2019年9月23
Hi Deepak,
There is a similar thread[1] recently. Could you please checkout it first?
Briefly, Flink hasn't maintained a good first issue list so far. But the
community is open to answer questions from you and if you provide more
information about topics you might be interested in, members who ar
Hi Debasish,
>From the information in the corresponding JIRA[1] 1.9.1 is not a fixed
version
of the issue you referred to. Technically Flink back ports notable fixes to
brach release-1.9 and start the release of 1.9.1 from that branch.
Visually, it looks like
... - ... - PR#9565 - ... - master
Thanks a lot everyone for the warm welcome. Happy Mid-autumn Festival!
Best,
tison.
Leonard Xu 于2019年9月12日周四 上午11:05写道：
> Congratulations Zili Chen ! ！
>
> Best，
> Leonard Xu
> > On 2019年9月12日, at 上午11:02, Yun Tang wrote:
> >
> > Congratulations
Attach the missing link.
[1]
https://docs.google.com/document/d/1E-8UjOLz4QPUTxetGWbU23OlsIH9VIdodpTsxwoQTs0/edit#heading=h.s8r4pkyalskt
[2]
https://lists.apache.org/x/thread.html/ce99cba4a10b9dc40eb729d39910f315ae41d80ec74f09a356c73938@
Zili Chen 于2019年9月7日周六 上午12:52写道：
> Besides, if
Besides, if you submit the job by Jar Run REST API, it is also
OptimizerPlanEnvironment to be used. So again, _no_ post
processing support at the moment.
Zili Chen 于2019年9月7日周六 上午12:51写道：
> Hi spoganshev,
>
> If you deploy in per-job mode, OptimizerPlanEnvironment would be used, a
Hi spoganshev,
If you deploy in per-job mode, OptimizerPlanEnvironment would be used, and
thus
as you pointed out, there is _no_ way to post processing JobExecutionResult.
We the community regard this situation as a shortcoming and work on an
enhancement
progress to enable you get a JobClient as r
Congrats Klou!
Best,
tison.
Till Rohrmann 于2019年9月6日周五 下午9:23写道：
> Congrats Klou!
>
> Cheers,
> Till
>
> On Fri, Sep 6, 2019 at 3:00 PM Dian Fu wrote:
>
>> Congratulations Kostas!
>>
>> Regards,
>> Dian
>>
>> > 在 2019年9月6日，下午8:58，Wesley Peng 写道：
>> >
>> > On 2019/9/6 8:55 下午, Fabian Hueske w
icesFactory
> FileSystemSubmittedJobGraphStore implements SubmittedJobGraphStore
>
> Testing so far proved that bringing down a JobManager and bringing it back
> up does indeed restore all the running jobs. Job creation/destruction also
> works.
>
> Hope this helps!
>
> T
Hi Oytun,
I think it intents to publish flink-queryable-state-client-java
without scala suffix since it is scala-free. An artifact without
scala suffix has been published [2].
See also [1].
Best,
tison.
[1] https://issues.apache.org/jira/browse/FLINK-12602
[2]
https://mvnrepository.com/artifact
ss was removed in flink-dist_2.12-1.9
>> jar
>> file.
>> Seems broken here for scala 2.12, right?
>>
>> [1]
>>
>> http://mirror.bit.edu.cn/apache/flink/flink-1.9.0/flink-1.9.0-bin-scala_2.12.tgz
>>
>> On Fri, Aug 23, 2019 at 4:37 PM Zili Chen
ectory under root folder of flink distribution.
>
>
> On Fri, Aug 23, 2019 at 4:10 PM Zili Chen wrote:
>
>> Hi Gavin,
>>
>> I also find a problem in shell if the directory contain whitespace
>> then the final command to run is incorrect. Could you check the
>>
Hi Gavin,
I also find a problem in shell if the directory contain whitespace
then the final command to run is incorrect. Could you check the
final command to be executed?
FYI, here is the ticket[1].
Best,
tison.
[1] https://issues.apache.org/jira/browse/FLINK-13827
Gavin Lee 于2019年8月23日周五 下午
mble now starts fine, I’m working on ironing out the bugs
> now.
>
> I’ll participate in the survey too!
>
> On Aug 21, 2019, at 7:18 PM, Zili Chen wrote:
>
> Besides, would you like to participant our survey thread[1] on
> user list about "How do you use high-availa
Congratulations!
Thanks Gordon and Kurt for being the release manager.
Thanks all the contributors who have made this release possible.
Best,
tison.
Jark Wu 于2019年8月22日周四 下午8:11写道：
> Congratulations!
>
> Thanks Gordon and Kurt for being the release manager and thanks a lot to
> all the contr
hread.html/c0cc07197e6ba30b45d7709cc9e17d8497e5e3f33de504d58dfcafad@%3Cuser.flink.apache.org%3E
Zili Chen 于2019年8月22日周四 上午10:16写道：
> Hi Aleksandar,
>
> base on your log:
>
> taskmanager_1 | 2019-08-22 00:05:03,713 INFO
> org.apache.flink.runtime.taskexecutor.TaskExecutor- Connecting
> to ResourceManager
>
Hi Aleksandar,
base on your log:
taskmanager_1 | 2019-08-22 00:05:03,713 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor- Connecting
to ResourceManager
akka.tcp://flink@jobmanager:6123/user/jobmanager()
.
taskmanager_1 | 2019-08-22 00:05:04
tates with a save point directory? e.g.
>
> ./bin/flink run myJob.jar -s savepointDirectory
>
>
>
> Regards,
>
>
>
> Min
>
>
>
> *From:* Zili Chen [mailto:wander4...@gmail.com]
> *Sent:* Dienstag, 20. August 2019 04:16
> *To:* Biao Liu
> *Cc:* Ta
In addition, FLINK-13750[1] also likely introduce breaking change
on high-availability services. So it is highly encouraged you who
might be affected by the change share your cases :-)
Best,
tison.
[1] https://issues.apache.org/jira/browse/FLINK-13750
Zili Chen 于2019年8月21日周三 下午3:32写道：
>
Hi guys,
We want to have an accurate idea of how users actually use
high-availability services in Flink, especially how you customize
high-availability services by HighAvailabilityServicesFactory.
Basically there are standalone impl., zookeeper impl., embedded impl.
used in MiniCluster, YARN impl
at 13:27, Paul Lam wrote:
>
>> Hi Tison,
>>
>> Big +1 for the Chinese Weekly Community Update. The content is
>> well-organized, and I believe it would be very helpful for Chinese users to
>> get an overview of what’s going on in the community.
>
Hi Min,
I guess you use standalone high-availability and when TM fails,
JM can recovered the job from an in-memory checkpoint store.
However, when JM fails, since you don't persist state on ha backend
such as ZooKeeper, even JM relaunched by YARN RM superseded by a
stand by, the new one knows not
Hi community,
Inspired by weekly community updates thread, regards the growth
of Chinese community and kind of different concerns for community
members I'd like to start a personally maintained Chinese version of
Weekly Community Update.
Right now I posted these weeks' updates on this page[1] whe
Congratulations Andrey!
Best,
tison.
Till Rohrmann 于2019年8月14日周三 下午9:26写道：
> Hi everyone,
>
> I'm very happy to announce that Andrey Zagrebin accepted the offer of the
> Flink PMC to become a committer of the Flink project.
>
> Andrey has been an active community member for more than 15 months
Hi Eduardo,
JDBCSinkFunction is a package-private class which you can make use of
by JDBCAppendTableSink. A typical statement could be
new JDBCAppendTableSink.builder()
. ...
.build()
.consumeDataStream(upstream);
Also JDBCUpse
Hi Vishwas,
Replace ',' with ' '(space) should work.
Best,
tison.
Vishwas Siravara 于2019年8月13日周二 上午6:50写道：
> Hi guys,
> I have this entry in flink-conf.yaml file for jvm options.
> env.java.opts: "-Djava.security.auth.login.config={{ flink_installed_dir
> }}/kafka-jaas.conf,-Djava.security.kr
Hi Cam,
If you set parallelism to 60, then you would make use of all 60 slots you
have and
for you case, each slot executes a chained operator contains 13 tasks. It
is not
the case one slot executes at least 60 sub-tasks.
Best,
tison.
Cam Mach 于2019年8月12日周一 下午7:55写道：
> Hi Zhu and Abhishek,
>
Hi,
Could you attach the stack trace in exception or relevant logs?
Best,
tison.
pengcheng...@bonc.com.cn 于2019年8月9日周五 下午4:55写道：
> Hi,
>
> Why are some slots unavailable?
>
> My cluster model is standalone,and high-availability mode is zookeeper.
> task.cancellation.timeout: 0
> some slots ar
Congrats Hequn!
Best,
tison.
Jeff Zhang 于2019年8月7日周三 下午5:14写道：
> Congrats Hequn!
>
> Paul Lam 于2019年8月7日周三 下午5:08写道：
>
>> Congrats Hequn! Well deserved!
>>
>> Best,
>> Paul Lam
>>
>> 在 2019年8月7日，16:28，jincheng sun 写道：
>>
>> Hi everyone,
>>
>> I'm very happy to announce that Hequn accepted th
I can see that we relocate akka's netty, akka uncommon math but also
be curious why Flink doesn't shaded all of akka dependencies...
Best,
tison.
Debasish Ghosh 于2019年7月24日周三 下午3:15写道：
> Hello Haibo -
>
> Yes, my application depends on Akka 2.5.
> Just curious, why do you think it's recommende
Hi Xiangyu,
Could you share the corresponding JIRA that fixed this issue?
Best,
tison.
Xiangyu Su 于2019年7月19日周五 下午8:47写道：
> btw. it seems like this issue has been fixed in 1.8.1
>
> On Fri, 19 Jul 2019 at 12:21, Xiangyu Su wrote:
>
>> Ok, thanks.
>>
>> and this time-consuming until now alway
Hi guys,
We want to have an accurate idea of how many people are implementing
Flink job based on the interface Program, and how they actually
implement it.
The reason I ask for the survey is from this thread[1] where we notice
this codepath is stale and less useful than it should be. As it is an
te the pipeline
> through beam and flink instead of kafka and flink, as i see that python is
> a full class citizen in the beam framework!
>
> Regards,
> Dante
>
> Op 20 jul. 2019 om 01:59 heeft Zili Chen het
> volgende geschreven:
>
> Hi Dante,
>
> Both Jython
Hi Dante,
Both Jython and Jython support for Flink are out of development
and maintain. As pointed out by Jeff, Flink 1.9 supports Python
api via py4j[1] and the document page as posted.
I guess your algorithms are written in CPython instead of Jython
and want Jython only for interoperate, and th
Hi Konstantin and all,
Thank Konstantin very much for reviving this tradition! It reminds
me of the joyful time I can easily catch up interesting ongoing threads.
Thanks for Till's work, too.
Besides exciting updates and news above, I'd like to pick up
some other threads you guys may be intereste
Hi Dan,
Said "The files are removed after a restart of the process", it sounds Flink
cleaned up blobs properly. From your description I don't understand clearly
in which case/situation you expected Flink deleted blobs but it doesn't.
Could you describe the difference between 1.4.2 and 1.7.2/1.8.0
+1
Best,
tison.
zhijiang 于2019年6月11日周二 下午10:52写道：
> It is reasonable as stephan explained. +1 from my side!
>
> --
> From:Jeff Zhang
> Send Time:2019年6月11日(星期二) 22:11
> To:Stephan Ewen
> Cc:user ; dev
> Subject:Re: [DISCUSS] De
Cheers!
Glad to meet the release of 1.8.0. Thank Aljoscha for being
the release manager and all contributors who made this release
possible.
Best,
tison.
Aljoscha Krettek 于2019年4月10日周三 下午4:31写道：
> The Apache Flink community is very happy to announce the release of Apache
> Flink 1.8.0, which
e next operator like sink?
>
> Thanks,
>
> On Thu, Apr 4, 2019 at 9:46 AM Zili Chen wrote:
>
>> Hi Son,
>>
>> As from Collector's document, it collects a record and forwards it.
>> The collector is the "push" counterpart of the Iterator which &qu
Hi Son,
As from Collector's document, it collects a record and forwards it.
The collector is the "push" counterpart of the Iterator which "pulls" data
in.
Best,
tison.
Son Mai 于2019年4月4日周四 上午10:15写道：
> Hi all,
>
> when I create new classes extending ProcessFunction or implementing
> WindowFun
Option 1. Provide command-line parameter following
https://stackoverflow.com/questions/2066307/how-do-you-input-commandline-argument-in-intellij-idea
Option 2. Directly set `String inputPath =
"/home/alaa/Downloads/sorted_data.csv";`
Best,
tison.
alaa 于2019年4月1日周一 下午2:42写道：
> So what should i
Hi,
Isn't it because you do not provide command-line arguments?
Best,
tison.
alaa 于2019年4月1日周一 下午2:33写道：
> Hi,
>
> I am following the Taxi example provided on
> "http://training.data-artisans.com/exercises/taxiData.html";, however, I
> got
> the following error message when I run AreasTotalPe
Congrats Thomas!
Best,
tison.
Jeff Zhang 于2019年2月12日周二 下午6:01写道：
> Congrats Thomas !
>
> Fabian Hueske 于2019年2月12日周二 下午5:59写道：
>
>> Hi everyone,
>>
>> On behalf of the Flink PMC I am happy to announce Thomas Weise as a new
>> member of the Apache Flink PMC.
>>
>> Thomas is a long time contrib
The version is generated in EnvironmentInformation#getVersion. As the
comment stands,
the version can be null(and rendered as "") if the JobManager does
not run from a Maven build.
Specifically Flink getVersion by "version =
EnvironmentInformation.class.getPackage().getImplementationVersion();"
I
56 matches
Mail list logo
