Hi Dhurandar:
Currently StreamingFileSink should be able to change the prefix and suffix
of the filename[1], it could be changed to something like -0-0.
Could this solve your problem ?
Best,
Yun
[1]
Yun Gao created FLINK-17594:
---
Summary: Support path-based PartFileWriter
Key: FLINK-17594
URL: https://issues.apache.org/jira/browse/FLINK-17594
Project: Flink
Issue Type: Sub-task
Yun Gao created FLINK-17593:
---
Summary: Support arbitrary recovery mechanism for PartFileWriter
Key: FLINK-17593
URL: https://issues.apache.org/jira/browse/FLINK-17593
Project: Flink
Issue Type
Yun Gao created FLINK-17590:
---
Summary: Add Bucket lifecycle listener to support acquiring bucket
state
Key: FLINK-17590
URL: https://issues.apache.org/jira/browse/FLINK-17590
Project: Flink
Issue
Yun Gao created FLINK-17589:
---
Summary: Extend StreamingFileSink to Support Streaming Hive
Connector
Key: FLINK-17589
URL: https://issues.apache.org/jira/browse/FLINK-17589
Project: Flink
Issue
Congratulations Hequn!
Best,
Yun
--
From:Hequn Cheng
Send Time:2020 Apr. 18 (Sat.) 12:48
To:dev
Subject:Re: [ANNOUNCE] New Apache Flink PMC Member - Hequn Chen
Many thanks for your support. Thank you!
Hi,
Very thanks for Jinsong to bring up this discussion! It should largely
improve the usability after enhancing the FileSystem connector in Table.
I have the same question with Piotr. From my side, I think it should be
better to be able to reuse existing
Yun Gao created FLINK-16582:
---
Summary: NettyBufferPoolTest may have warns on NettyBuffer leak
Key: FLINK-16582
URL: https://issues.apache.org/jira/browse/FLINK-16582
Project: Flink
Issue Type
+1 (non-binding)
I think the PoC result has shown the effect on reducing checkpoint time
when back-pressure occurs, and I totally agree with that the feature could be
implemented in steps.
--
From:Roman Khachatryan
Send
+1 (non-binding)
This should make tuning back pressure easier, which is one of the most
common problems met for users.
Best,
Yun
--
From:Benchao Li
Send Time:2020 Feb. 24 (Mon.) 08:32
To:dev
Cc:Zhijiang
Congratulations Jingsong!
Best,
Yun
--
From:Jingsong Li
Send Time:2020 Feb. 21 (Fri.) 21:42
To:Hequn Cheng
Cc:Yang Wang ; Zhijiang ;
Zhenghua Gao ; godfrey he ; dev
; user
Subject:Re: [ANNOUNCE] Jingsong Lee becomes a
Yun Gao created FLINK-16154:
---
Summary: Translate "Operator/Join" into Chinese
Key: FLINK-16154
URL: https://issues.apache.org/jira/browse/FLINK-16154
Project: Flink
Issue Type
Yun Gao created FLINK-16155:
---
Summary: Translate "Operator/Process Function" into Chinese
Key: FLINK-16155
URL: https://issues.apache.org/jira/browse/FLINK-16155
Project: Flink
Issue
Yun Gao created FLINK-16153:
---
Summary: Translate "Operator/windows" into Chinese
Key: FLINK-16153
URL: https://issues.apache.org/jira/browse/FLINK-16153
Project: Flink
Issue Type
Yun Gao created FLINK-16152:
---
Summary: Translate "Operator/index" into Chinese
Key: FLINK-16152
URL: https://issues.apache.org/jira/browse/FLINK-16152
Project: Flink
Issue Type
Yun Gao created FLINK-16151:
---
Summary: Translate "Event-time/Pre-defined Timestamp Extractors /
Watermark Emitters" into Chinese
Key: FLINK-16151
URL: https://issues.apache.org/jira/browse/F
Yun Gao created FLINK-16138:
---
Summary: Translate "Overview" page of "DataStream API" into Chinese
Key: FLINK-16138
URL: https://issues.apache.org/jira/browse/FLINK-16138
Project: Flink
Yun Gao created FLINK-16137:
---
Summary: Translate all DataStream API related pages into Chinese
Key: FLINK-16137
URL: https://issues.apache.org/jira/browse/FLINK-16137
Project: Flink
Issue Type
Yun Gao created FLINK-16009:
---
Summary: Native support for the Variable-length and Zig-zag
Variable-length integers
Key: FLINK-16009
URL: https://issues.apache.org/jira/browse/FLINK-16009
Project: Flink
Congratulations Yu!
Best,
Yun
--
From:felixzheng zheng
Send Time:2020 Jan. 31 (Fri.) 10:19
To:dev
Subject:Re: [ANNOUNCE] Yu Li became a Flink committer
Congrats!
Benchao Li 于2020年1月31日周五 上午10:02写道：
>
Yun Gao created FLINK-15701:
---
Summary: Allows transfer.sh to retry when fails to uploads logs.
Key: FLINK-15701
URL: https://issues.apache.org/jira/browse/FLINK-15701
Project: Flink
Issue Type
Hi Dominik,
If I understand the scenario correctly, I think one possible solution
is to implement one specified TwoInputStreamOperator directly, and also
implements the InputSelectable interface. Then this operator could control the
priority its two inputs by return proper
Yun Gao created FLINK-15664:
---
Summary: Flink plan visualizer does not show operators information
completely when there are line wrap
Key: FLINK-15664
URL: https://issues.apache.org/jira/browse/FLINK-15664
+1 (non-binding).
Very thanks for introducing this topic back, and it should be able to bring
improvements in the discussed scenarios.
Best,
Yun
--
From:Arvid Heise
Send Time:2020 Jan. 10 (Fri.) 16:48
To:dev ; Zhijiang
Congratulations Zhuzhu!
Best,
Yun
--
From:Guowei Ma
Send Time:2019 Dec. 16 (Mon.) 11:16
To:dev
Subject:Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer
Congrats Zhuzhu!
Best,
Guowei
Zhenghua Gao 于2019年12月16日周一
Congratulations Jark！
Best,
Yun
--
From:wenlong.lwl
Send Time:2019 Nov. 8 (Fri.) 18:31
To:dev
Subject:Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC
Congratulations Jark, well deserved!
Best,
Wenlong Lyu
On Fri, 8 Nov
+1 (non-binding)
Very thanks for bringing this to the community!
--
From:jincheng sun
Send Time:2019 Oct. 31 (Thu.) 10:22
To:dev
Cc:Vasiliki Kalavri
Subject:Re: [VOTE] Accept Stateful Functions into Apache Flink
big +1
Congratulations Becket!
Best,
Yun
--
From:Jingsong Li
Send Time:2019 Oct. 29 (Tue.) 10:23
To:dev
Subject:Re: [ANNOUNCE] Becket Qin joins the Flink PMC
Congratulations Becket!
Best,
Jingsong Lee
On Tue, Oct 29, 2019 at 10:18 AM
Yun Gao created FLINK-14521:
---
Summary: CoLocationGroup is not set into JobVertex if the stream
node chained with others
Key: FLINK-14521
URL: https://issues.apache.org/jira/browse/FLINK-14521
Project
Hi Chesnay,
+1 (non-binding).
Very thanks for driving this.
Best,
Yun
--
From:Chesnay Schepler
Send Time:2019 Oct. 16 (Wed.) 21:01
To:dev@flink.apache.org
Subject:[VOTE] FLINK-67: Cluster
Hi Arvid,
Very thanks for bring up the discussion! From our side unable to
finish the checkpoint is commonly met for online jobs, therefore +1 from my
side to implement this.
A tiny issue of the FLIP is that the Discussion Thread URL attached
seems to be not right.
Congratulations Zili!
Best,
Yun
--
From:Yangze Guo
Send Time:2019 Sep. 12 (Thu.) 09:38
To:dev
Subject:Re: [ANNOUNCE] Zili Chen becomes a Flink committer
Congratulations!
Best,
Yangze Guo
On Thu, Sep 12, 2019 at
Congratulations, Kostas!
Best,
Yun
--
From:Becket Qin
Send Time:2019 Sep. 9 (Mon.) 10:47
To:dev
Subject:Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC
Congrats, Kostas!
On Sun, Sep 8, 2019 at 11:48 PM
d also prefer
to see a motivation design doc, how that feature would be used for example for
cross or theta joins in the Table API, since very similar questions would apply
to that as well.
Piotrek
> On 27 Aug 2019, at 08:10, SHI Xiaogang wrote:
>
> Hi Yun Gao,
>
>
to decouple the broadcasting
events requirements and more generalized multicasting mechanism. :)
Best,
Yun
--
From:SHI Xiaogang
Send Time:2019 Aug. 27 (Tue.) 09:16
To:dev ; Yun Gao
Cc:Piotr Nowojski
Subject:Re: [DISCUSS] Enhance
che.org/jira/browse/FLINK-6936
On Aug 24, 2019, at 5:54 AM, Zhu Zhu wrote:
Hi Piotr,
Thanks for the explanation.
Agreed that the broadcastEmit(record) is a better choice for
broadcasting
for the iterations.
As broadcasting for the iterations is the first motivation, let's
support
it first.
Thanks,
Z
--
From:Piotr Nowojski
Send Time:2019 Aug. 23 (Fri.) 22:29
To:Zhu Zhu
Cc:dev ; Yun Gao
Subject:Re: [DISCUSS] Enhance Support for Multicast Communication Pattern
Hi,
If the primary motivation is broadcasting (for the iterations) and we have no
immediate need for multicast (cross join
at 10:20, Yun Gao wrote:
>
>Hi Piotr,
>
> Thanks a lot for the suggestions!
>
> The core motivation of this discussion is to implement a new
> iteration library on the DataStream, and it requires to insert special
> records in the
is hard to maintain and extend.
Thanks,
Zhu Zhu
Yun Gao 于2019年8月22日周四 下午8:42写道：
Hi everyone,
In some scenarios we met a requirement that some operators want to
send records to theirs downstream operators with an multicast communication
pattern. In detail, for some records, the operators
Hi everyone,
In some scenarios we met a requirement that some operators want to send
records to theirs downstream operators with an multicast communication pattern.
In detail, for some records, the operators want to send them according to the
partitioner (for example, Rebalance), and for
Yun Gao created FLINK-13752:
---
Summary: TaskDeploymentDescriptor cannot be recycled by GC due to
referenced by an anonymous function
Key: FLINK-13752
URL: https://issues.apache.org/jira/browse/FLINK-13752
Hi,
Very thanks for the great points!
For the prioritizing inputs, from another point of view, I think it might
not cause other bad effects, since we do not need to totally block the channels
that have seen barriers after the operator has taking snapshot. After the
snapshotting, if the
Congratulations Andrey!
Best,
Yun
--
From:Congxian Qiu
Send Time:2019 Aug. 15 (Thu.) 10:28
To:dev@flink.apache.org
Subject:Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer
Congratulations Andery!
Best,
Congxian
Kurt
Hi,
Very thanks for sharing the thoughts on the unaligned checkpoint !
Another question regarding I 2.C (Performance) by Paris is that do we
always snapshot and broadcast the marks once the task receives the first mark
from JM o? If so, then we will always need to snapshot all the
Congratulations Hequn!
Best,
Yun
--
From:Congxian Qiu
Send Time:2019 Aug. 8 (Thu.) 21:34
To:Yu Li
Cc:Haibo Sun ; dev ; Rong Rong
; user
Subject:Re: Re: [ANNOUNCE] Hequn becomes a Flink committer
Congratulations Hequn!
Best,
Yun Gao created FLINK-13531:
---
Summary: Do not print log and call release if no requests should
be evicted in slot sharing
Key: FLINK-13531
URL: https://issues.apache.org/jira/browse/FLINK-13531
Project
Congratulations Kurt!
best,
Yun
--
From:Jeff Zhang
Send Time:2019 Jul. 23 (Tue.) 18:14
To:dev
Subject:Re: [ANNOUNCE] Kete Young is now part of the Flink PMC
Congratulations Kurt
Biao Liu 于2019年7月23日周二 下午6:07写道：
> Congrats
Congratulations Zhijiang!
Best,
Yun
--
From:Paul Lam
Send Time:2019 Jul. 23 (Tue.) 09:38
To:dev
Subject:Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink
project
Congrats Zhijiang!
Best,
Paul Lam
> 在
Congratulations!
Best,
Yun
--
From:Kostas Kloudas
Send Time:2019 Jul. 18 (Thu.) 17:30
To:dev
Subject:Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to
the Flink project
Congratulations Becket!
Kostas
On
Congratulations!
Best,
Yun
--
From:Robert Metzger
Send Time:2019 Jun. 24 (Mon.) 23:16
To:dev
Subject:[ANNOUNCE] Jincheng Sun is now part of the Flink PMC
Hi all,
On behalf of the Flink PMC, I'm happy to announce that Jincheng
Yun Gao created FLINK-12865:
---
Summary: State inconsistency between RM and TM on the slot status
Key: FLINK-12865
URL: https://issues.apache.org/jira/browse/FLINK-12865
Project: Flink
Issue Type
Yun Gao created FLINK-12852:
---
Summary: Deadlock occurs when requiring exclusive buffer for
RemoteInputChannel
Key: FLINK-12852
URL: https://issues.apache.org/jira/browse/FLINK-12852
Project: Flink
Yun Gao created FLINK-12171:
---
Summary: The network buffer memory size should not be checked
against the heap size on the TM side
Key: FLINK-12171
URL: https://issues.apache.org/jira/browse/FLINK-12171
icator.
Besides, another similar thought is that we may also add new
InputBufferUsage and OutputBufferUsage metrics to show (number of queued
buffers / number of all buffers) instead.
Best,
Yun Gao
[1] https://issues.apache.org/jira/browse/FLINK-10981
[2] https://issues.apac
obey
the blacklist, then we may need to deal with the inappropriate resource.
Looking forward to the future advance of this feature! Thanks again for
the exciting proposal.
Best,
Yun Gao
--
From:zhijiang
Send Time:2018 Nov
Yun Gao created FLINK-10981:
---
Summary: Add or modify metrics to show the maximum usage of
InputBufferPool/OutputBufferPool to help debugging back pressure
Key: FLINK-10981
URL: https://issues.apache.org/jira/browse
the
design doc!
Yours sincerely
Yun Gao
--
发件人：Weihua Jiang
发送时间：2018年11月20日(星期二) 20:53
收件人：dev
主 题：[DISCUSS] Embracing Table API in Flink ML
ML Pipeline is the idea brought by Scikit-learn
<https://arxiv.org/abs/1309.0238>
Thanks a lot ! @Chesnay Schepler@Tzu-Li Chen : )
Yours
Yun Gao
--
发件人：Chesnay Schepler
发送时间：2018年10月1日(星期一) 17:10
收件人：dev ; Tzu-Li Chen ; yungao.gy
; trohrmann ; Stephan Ewen
主 题：Re: Request for contributor permission
@Yun
Yun Gao created FLINK-10469:
---
Summary: FileChannel may not write the whole buffer in a single
call to FileChannel.write(Buffer buffer)
Key: FLINK-10469
URL: https://issues.apache.org/jira/browse/FLINK-10469
501 - 559 of 559 matches
Mail list logo
