Weihua Hu created FLINK-31808:
-
Summary: wrong examples of how to set operator name in documents
Key: FLINK-31808
URL: https://issues.apache.org/jira/browse/FLINK-31808
Project: Flink
Issue
Wenlong Lyu created FLINK-25070:
---
Summary: FLIP-195: Improve the name and structure of vertex and
operator name for job
Key: FLINK-25070
URL: https://issues.apache.org/jira/browse/FLINK-25070
Project
;
> Best,
> Yun--
> Sender:Xianxun Ye
> Date:2021/11/24 16:49:44
> Recipient:dev@flink.apache.org
> Theme:[VOTE][FLIP-195] Improve the name and structure of vertex and
> operator name for job
>
> +1 (non-bin
+1 (binding).
Very thanks Wenlong for the proposal!
Best,
Yun--
Sender:Xianxun Ye
Date:2021/11/24 16:49:44
Recipient:dev@flink.apache.org
Theme:[VOTE][FLIP-195] Improve the name and structure of vertex and operator
name for job
]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
Best,
Wenlong Lyu
--
Best regards,
Sergey
; > > > > > > > would
> > > > > like
> > > > > > to
> > > > > > > > start a vote on FLIP-195 [2].
> > > > > > > > Thanks for all of your feedback.
> > > > > > > >
> > > > > > > > The vote will last for at least 72 hours (Nov 26th 16:00 GMT)
> > > unless
> > > > > > > > there is an objection or insufficient votes.
> > > > > > > >
> > > > > > > > [1]
> > > https://lists.apache.org/thread/kvdxr8db0l5s6wk7hwlt0go5fms99b8t
> > > > > > > > [2]
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
> > > > > > > >
> > > > > > > > Best,
> > > > > > > > Wenlong Lyu
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > >
> >
> >
> > --
> > Best regards,
> > Sergey
> >
gt; > start a vote on FLIP-195 [2].
> > > > > > > Thanks for all of your feedback.
> > > > > > >
> > > > > > > The vote will last for at least 72 hours (Nov 26th 16:00 GMT)
> > unless
> > > > > > > there is an objection or insufficient votes.
> > > > > > >
> > > > > > > [1]
> > https://lists.apache.org/thread/kvdxr8db0l5s6wk7hwlt0go5fms99b8t
> > > > > > > [2]
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
> > > > > > >
> > > > > > > Best,
> > > > > > > Wenlong Lyu
> > > > > > >
> > > > > >
> > > > >
> > > >
> >
>
>
> --
> Best regards,
> Sergey
>
t; > > > to
> > > > > > start a vote on FLIP-195 [2].
> > > > > > Thanks for all of your feedback.
> > > > > >
> > > > > > The vote will last for at least 72 hours (Nov 26th 16:00 GMT)
> unless
> > > > > > there is an objection or insufficient votes.
> > > > > >
> > > > > > [1]
> https://lists.apache.org/thread/kvdxr8db0l5s6wk7hwlt0go5fms99b8t
> > > > > > [2]
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
> > > > > >
> > > > > > Best,
> > > > > > Wenlong Lyu
> > > > > >
> > > > >
> > > >
> > >
>
--
Best regards,
Sergey
gt; like
> > > to
> > > > > start a vote on FLIP-195 [2].
> > > > > Thanks for all of your feedback.
> > > > >
> > > > > The vote will last for at least 72 hours (Nov 26th 16:00 GMT) unless
> > > > > there is an
ike
> > > to
> > > > > start a vote on FLIP-195 [2].
> > > > > Thanks for all of your feedback.
> > > > >
> > > > > The vote will last for at least 72 hours (Nov 26th 16:00 GMT)
> unless
> > > > > there is an obje
16:00 GMT) unless
> > > > there is an objection or insufficient votes.
> > > >
> > > > [1] https://lists.apache.org/thread/kvdxr8db0l5s6wk7hwlt0go5fms99b8t
> > > > [2]
> > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
> > > >
> > > > Best,
> > > > Wenlong Lyu
> > > >
> > >
> >
>
(Nov 26th 16:00 GMT) unless
> > > there is an objection or insufficient votes.
> > >
> > > [1] https://lists.apache.org/thread/kvdxr8db0l5s6wk7hwlt0go5fms99b8t
> > > [2]
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
> > >
> > > Best,
> > > Wenlong Lyu
> > >
> >
>
t
> > [2]
> >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
> >
> > Best,
> > Wenlong Lyu
> >
>
s (Nov 26th 16:00 GMT) unless
> there is an objection or insufficient votes.
>
> [1] https://lists.apache.org/thread/kvdxr8db0l5s6wk7hwlt0go5fms99b8t
> [2]
>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
>
> Best,
> Wenlong Lyu
>
t;
> The vote will last for at least 72 hours (Nov 26th 16:00 GMT) unless
> there is an objection or insufficient votes.
>
> [1] https://lists.apache.org/thread/kvdxr8db0l5s6wk7hwlt0go5fms99b8t
> [2]
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+str
Hi,
Very thanks Wenlong for the update! Also +1 for the proposal~
Best,
Yun Gao
--
From:Yun Gao
Send Time:2021 Nov. 23 (Tue.) 16:09
To:dev
Subject:Re: [DISCUSS] Improve the name and structure of job vertex and operator
name
/thread/kvdxr8db0l5s6wk7hwlt0go5fms99b8t
[2]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
Best,
Wenlong Lyu
org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
> to
> add a prefix [vertex-idx] for vertex name. please checkout to see whether
> you have more comments, thanks.
>
> Add a prefix [vertex-idx] for vertex name, so that we
Hi, Yun Gao, Yun Tang, and Aitozi,
thanks for the suggestion again, I have added following section in proposed
changes at
https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+job
to
add a prefix [vertex-idx] for vertex name
Hi,
Very thanks Wenlong for bringing up this issue and very thanks for the warm
discussion! Big +1 to improve the name and structure of job vertex for it make
the life of the developers much easier and shorten the operator name would
saves a lot of money for reducing the amount of logs
> enough, we can get the vertex id easily.
> > Does anyone have some comments on this?
> >
> >
> > Best,
> > Wenlong Lyu
> >
> > On Thu, 18 Nov 2021 at 19:03, Yun Tang wrote:
> >
> > > Hi Wenlong,
> > >
> > >
believe many guys have ever
> > suffered from the long and unreadable operator name for long time.
> >
> > I have another suggestion which inspired by Aitozi, that we could add
> some
> > hint to tell the vertex index. Such as make the pipeline from "source -->
wrote:
> Hi Wenlong,
>
> Thanks for bringing up this discussion and I believe many guys have ever
> suffered from the long and unreadable operator name for long time.
>
> I have another suggestion which inspired by Aitozi, that we could add some
> hint to tell the verte
Hi Wenlong,
Thanks for bringing up this discussion and I believe many guys have ever
suffered from the long and unreadable operator name for long time.
I have another suggestion which inspired by Aitozi, that we could add some hint
to tell the vertex index. Such as make the pipeline from
Nov 2021 at 19:14, Chesnay Schepler
> > wrote:
> > >
> > > > Why should this be specific to the table API? The datastream API has
> > > > similar issues with long operator names (like windowing).
> > > >
> > > > On 16/11/2021 11:
epler
> wrote:
> >
> > > Why should this be specific to the table API? The datastream API has
> > > similar issues with long operator names (like windowing).
> > >
> > > On 16/11/2021 11:22, wenlong.lwl wrote:
> > > > Thanks Godfrey
t; > similar issues with long operator names (like windowing).
> >
> > On 16/11/2021 11:22, wenlong.lwl wrote:
> > > Thanks Godfrey for the suggestion.
> > > Regarding 1, how about table.optimizer.simplify-operator-name-enabled,
> > >
ng.lwl wrote:
> > Thanks Godfrey for the suggestion.
> > Regarding 1, how about table.optimizer.simplify-operator-name-enabled,
> > which means that we would simplify the name of operator and keep the
> > details in description only.
> > "table.optimizer.operator-
Why should this be specific to the table API? The datastream API has
similar issues with long operator names (like windowing).
On 16/11/2021 11:22, wenlong.lwl wrote:
Thanks Godfrey for the suggestion.
Regarding 1, how about table.optimizer.simplify-operator-name-enabled,
which means that we
Thanks Godfrey for the suggestion.
Regarding 1, how about table.optimizer.simplify-operator-name-enabled,
which means that we would simplify the name of operator and keep the
details in description only.
"table.optimizer.operator-name.description-enabled" can not describe what
it mea
Thanks for creating this FLIP Wenlong.
The FLIP already looks pretty solid, I think the config options can be
improved a little:
1) about table.optimizer.separate-name-and-description, I think
"operator-name" should be considered in the option,
how about table.optimizer.operator-name.d
Hi, all, FYI the FLIP doc has been created ：
https://cwiki.apache.org/confluence/display/FLINK/FLIP-195%3A+Improve+the+name+and+structure+of+vertex+and+operator+name+for+sql+job
Best,
Wenlong
On Mon, 15 Nov 2021 at 11:41, wenlong.lwl wrote:
> Hi all,
> Thanks for the feedback, It
Hi all,
Thanks for the feedback, It seems that the proposal is accepted by all of
you guys. I will prepare a formal FLIP document and then go ahead to the
vote stage.
If any one has any other comments or suggestions, please let me know,
thanks.
Best,
Wenlong
On Fri, 12 Nov 2021 at 05:54, Neng Lu
+1 (non-binding)
This change will really help to ease developer life.
On Thu, Nov 11, 2021 at 6:33 AM Guowei Ma wrote:
> +1
> This would be very helpful for our debugging online job.
>
> Best,
> Guowei
>
>
> On Thu, Nov 11, 2021 at 8:03 PM Yuepeng Pan wrote:
>
> > +1. It's useful to understand
+1
This would be very helpful for our debugging online job.
Best,
Guowei
On Thu, Nov 11, 2021 at 8:03 PM Yuepeng Pan wrote:
> +1. It's useful to understand the job topology.
> Looking forward to this feature.
> Best,
> Yuepeng Pan.
>
>
>
>
>
>
> At 2021-11-11 19:44:44, "Yangze Guo" wrote:
>
+1. It's useful to understand the job topology.
Looking forward to this feature.
Best,
Yuepeng Pan.
At 2021-11-11 19:44:44, "Yangze Guo" wrote:
>+1. That's gonna help a lot for debugging.
>
>Best,
>Yangze Guo
>
>On Thu, Nov 11, 2021 at 7:37 PM Till Rohrmann wrote:
>>
>> This improvement
+1. That's gonna help a lot for debugging.
Best,
Yangze Guo
On Thu, Nov 11, 2021 at 7:37 PM Till Rohrmann wrote:
>
> This improvement looks like it makes the life of our users a lot easier
> when it comes to understanding logs and reading the UI. Hence +1.
>
> Cheers,
> Till
>
> On Thu, Nov 11,
This improvement looks like it makes the life of our users a lot easier
when it comes to understanding logs and reading the UI. Hence +1.
Cheers,
Till
On Thu, Nov 11, 2021 at 11:59 AM JING ZHANG wrote:
> Big +1.
>
> This is a problem frequently encountered in our production platform, look
>
Big +1.
This is a problem frequently encountered in our production platform, look
forward to this improvement.
Best,
Jing Zhang
Martijn Visser 于2021年11月11日周四 下午6:26写道：
> +1. Looks much better now
>
> On Thu, 11 Nov 2021 at 11:07, godfrey he wrote:
>
> > Thanks for driving this, this
+1. Looks much better now
On Thu, 11 Nov 2021 at 11:07, godfrey he wrote:
> Thanks for driving this, this improvement solves a long-complained
> problem, +1
>
> Best,
> Godfrey
>
> Jark Wu 于2021年11月11日周四 下午5:40写道：
> >
> > +1 for this. It looks much more clear and structured.
> >
> > Best,
> >
Thanks for driving this, this improvement solves a long-complained problem, +1
Best,
Godfrey
Jark Wu 于2021年11月11日周四 下午5:40写道：
>
> +1 for this. It looks much more clear and structured.
>
> Best,
> Jark
>
> On Thu, 11 Nov 2021 at 17:23, Chesnay Schepler wrote:
>
> > I'm generally in favor of it,
+1 for this. It looks much more clear and structured.
Best,
Jark
On Thu, 11 Nov 2021 at 17:23, Chesnay Schepler wrote:
> I'm generally in favor of it, and there are already tickets that
> proposed a dedicated operator/vertex description:
>
> https://issues.apache.org/jira/browse/FLINK-20388
>
I'm generally in favor of it, and there are already tickets that
proposed a dedicated operator/vertex description:
https://issues.apache.org/jira/browse/FLINK-20388
https://issues.apache.org/jira/browse/FLINK-21858
On 11/11/2021 10:02, wenlong.lwl wrote:
Hi, all, I would like to start a
Hi, all, I would like to start a discussion about an improvement on name
and structure of job vertex name, mainly to improve experience of debugging
and analyzing sql job at runtime.
the main proposed changes including:
1. separate description and name for operator, so that we can have detailed
Qingsheng Ren created FLINK-24376:
-
Summary: Operator name in OperatorCoordinator should not use
chained name
Key: FLINK-24376
URL: https://issues.apache.org/jira/browse/FLINK-24376
Project: Flink
Lu Niu created FLINK-22162:
--
Summary: Make Max Operator name Length Configurable
Key: FLINK-22162
URL: https://issues.apache.org/jira/browse/FLINK-22162
Project: Flink
Issue Type: Improvement
Danny Chen created FLINK-20368:
--
Summary: Supports custom operator name for Flink SQL
Key: FLINK-20368
URL: https://issues.apache.org/jira/browse/FLINK-20368
Project: Flink
Issue Type
Boyang Jerry Peng created FLINK-19468:
-
Summary: Metrics not returned when data stream / operator name
contains "+"
Key: FLINK-19468
URL: https://issues.apache.org/jira/browse/FLINK-19468
Jark Wu created FLINK-18846:
---
Summary: Set a meaningful operator name for the filesystem sink
Key: FLINK-18846
URL: https://issues.apache.org/jira/browse/FLINK-18846
Project: Flink
Issue Type
mzz created FLINK-18443:
---
Summary: The operator name select: (ip, ts, count,
environment.access AS access, environment.brand AS brand, sid, params.adid AS
adid, eventid) exceeded the 80 characters length limit and was truncated
Key: FLINK
Zou created FLINK-16372:
---
Summary: Generate unique operator name
Key: FLINK-16372
URL: https://issues.apache.org/jira/browse/FLINK-16372
Project: Flink
Issue Type: Improvement
Reporter
lining created FLINK-11212:
--
Summary: operator metric key can repalce operator name by operator
id
Key: FLINK-11212
URL: https://issues.apache.org/jira/browse/FLINK-11212
Project: Flink
Issue Type
Chesnay Schepler created FLINK-10021:
Summary: All-round E2E tests query metric with wrong operator name
Key: FLINK-10021
URL: https://issues.apache.org/jira/browse/FLINK-10021
Project: Flink
Julian Stephen created FLINK-9653:
-
Summary: Add operator name to latency metrics
Key: FLINK-9653
URL: https://issues.apache.org/jira/browse/FLINK-9653
Project: Flink
Issue Type: New Feature
Hi to all,
in many of my Flink job it is helpful to give a name to operators in order
to make JobManager UI simpler to read.
Currently, to give a name to operators it is necessary to specify it of the
operator everytime it is used, for example:
- env.readAsCsv().map().name("My map function")
Chesnay Schepler created FLINK-4875:
---
Summary: operator name not correctly inferred
Key: FLINK-4875
URL: https://issues.apache.org/jira/browse/FLINK-4875
Project: Flink
Issue Type: Bug
56 matches
Mail list logo
