Thanks for the comments Zhu Zhu!
> 1. How do we measure the job throughput? By measuring the job execution
> time on a finite input data set, or measuring the QPS when the job has
> reached a stable state?
>I ask this because that, with LazyFromSource schedule mode, tasks are
> launched
Hi all,
According to our previous discussion in [1], I'd like to bring up a vote to set
up a secur...@flink.apache.org mailing list.
The vote will be open for at least 72 hours (excluding weekend). I'll try to
close it by 2019-11-26 18:00 UTC, unless there is an objection or not enough
votes.
+1 (non-binding)
- verified the signature and checksum
- checked the maven central artifices
- checked "release-9.0-rc1" source code
- verified website pull request listing the new release
Best,
Jingsong Lee
On Thu, Nov 21, 2019 at 5:28 PM Dian Fu wrote:
> +1 (non-binding)
>
> - verified the
Hi all,
After some offline discussion with Dawid, I changed my mind. We still agree
on that
we should only support reading from tables with primary key, forbid writing
to such table.
But the enforce flag should be introduced with primary key, and probably
should be
`NOR ENFORCE` be default. The
Zili Chen created FLINK-14885:
-
Summary: YarnClusterDescriptor should not know about detached
option
Key: FLINK-14885
URL: https://issues.apache.org/jira/browse/FLINK-14885
Project: Flink
Issue
Hi Yun and Congxian,
I would actually want checkpoint to avoid being triggered on a certain
time. It still remains as system mechanism just avoid being triggered at a
certain range of time.
Waiting for the checkpoint to timeout still waste CPU IO resources
since it was being triggered. I would
Hi,
I agree with Dawid that we should either fully accept FLIPs or don’t accept
them and split them off into smaller parts when necessary. This happened for
the configuration FLIP-54 [1], where we couldn’t find consensus on the bigger
issue and then created FLIP-77 [2]. This makes it clear
So this probably doesn't belong in this thread, but here goes:
When you think of the metric system as source and reporters and sinks,
one has to consider what he source emits:
Either:
a) events for added/removed metrics
b) periodically emit the values of all metrics, with the plethora of
Kurt Young created FLINK-14887:
--
Summary: Provide a dedicated test class for SqlDateTimeUtils
Key: FLINK-14887
URL: https://issues.apache.org/jira/browse/FLINK-14887
Project: Flink
Issue Type:
Leonard Xu created FLINK-14886:
--
Summary: Wrong result in scalar query using blink planner
Key: FLINK-14886
URL: https://issues.apache.org/jira/browse/FLINK-14886
Project: Flink
Issue Type: Bug
+1 (non-binding)
- verified the signature and checksum
- checked the maven central artifices
Regards,
Dian
On Wed, Nov 20, 2019 at 8:47 PM tison wrote:
> +1 (non-binding)
>
> Best,
> tison.
>
>
> Aljoscha Krettek 于2019年11月20日周三 下午6:58写道：
>
> > +1 (binding)
> >
> > Best,
> > Aljoscha
> >
>
Hi Shuwen
Conceptually, checkpoints in Flink behaves more like a system mechanism to
achieve fault tolerance and transparent for users. On the other hand, savepoint
in Flink behaves more like a user control behavior, can savepoint not satisfy
your demands for crontab?
Best
Yun Tang
From:
Dian Fu created FLINK-14888:
---
Summary: Move the Python SqlDialect to module table
Key: FLINK-14888
URL: https://issues.apache.org/jira/browse/FLINK-14888
Project: Flink
Issue Type: Task
Hello everyone,
Flink 1.9 shipped with a new UI, with the old one being kept around as a
backup in case something wasn't working as expected.
Currently there are no issues indicating any significant problems
(exclusive to the new UI), so I wanted to check what people think about
dropping
Jun Qin created FLINK-14890:
---
Summary: TestHarness for KeyedBroadcastProcessFunction
Key: FLINK-14890
URL: https://issues.apache.org/jira/browse/FLINK-14890
Project: Flink
Issue Type: Improvement
Hi
thanks for your explanation, what you want is to disable periodic
checkpoint in some time duration, and at other times the periodic
checkpoint is doing as normal. Currently, Flink does not support this, as
you've created an issue for this, we can track this in the issue side. for
now, if you
Dian Fu created FLINK-14891:
---
Summary: PythonScalarFunctionOperator should be chained with
upstream operators by default
Key: FLINK-14891
URL: https://issues.apache.org/jira/browse/FLINK-14891
Project:
Timo Walther created FLINK-14903:
Summary: Relax structured types constraints
Key: FLINK-14903
URL: https://issues.apache.org/jira/browse/FLINK-14903
Project: Flink
Issue Type: Sub-task
Michel Davit created FLINK-14896:
Summary: Kinesis connector doesn't shade jackson dependency
Key: FLINK-14896
URL: https://issues.apache.org/jira/browse/FLINK-14896
Project: Flink
Issue
Andrey Zagrebin created FLINK-14901:
---
Summary: Throw Error in MemoryUtils if there is problem with using
system classes over reflection
Key: FLINK-14901
URL: https://issues.apache.org/jira/browse/FLINK-14901
Zhenghua Gao created FLINK-14889:
Summary: TIMESTAMPADD/TIMESTAMPDIFF with microsecond/nanosecond
unit lost precision
Key: FLINK-14889
URL: https://issues.apache.org/jira/browse/FLINK-14889
Project:
Andrey Zagrebin created FLINK-14898:
---
Summary: Enable background cleanup of state with TTL by default
Key: FLINK-14898
URL: https://issues.apache.org/jira/browse/FLINK-14898
Project: Flink
Leonard Xu created FLINK-14900:
--
Summary: output contains null value when a is null where a <>
'String'
Key: FLINK-14900
URL: https://issues.apache.org/jira/browse/FLINK-14900
Project: Flink
Congxian Qiu(klion26) created FLINK-14892:
-
Summary: Add description for checkpoint directory layout
Key: FLINK-14892
URL: https://issues.apache.org/jira/browse/FLINK-14892
Project: Flink
Thank you very much. It works for me.
> 在 2019年11月14日，下午1:06，Biao Liu 写道：
>
> Hi,
>
> I have encountered the same issue when setting up a dev environment.
>
> It seems that the my Intellij (2019.2.1) unexpectedly activates java11
> profile of maven. It doesn't match the Java compiler (JDK8).
Gary Yao created FLINK-14894:
Summary: HybridOffHeapUnsafeMemorySegmentTest#testByteBufferWrap
failed on Travis
Key: FLINK-14894
URL: https://issues.apache.org/jira/browse/FLINK-14894
Project: Flink
Leonard Xu created FLINK-14895:
--
Summary: same rank in rollup row with group row that all group key
are null
Key: FLINK-14895
URL: https://issues.apache.org/jira/browse/FLINK-14895
Project: Flink
+1 (binding)
* built master against flink-shaded 9.0 and jackson 2.10.1 (via
https://repository.apache.org/content/repositories/orgapacheflink-1275)
- code: https://github.com/uce/flink/tree/flink-shaded-9.0
- travis: https://travis-ci.org/uce/flink/builds/615013399
* ran examples against web
Chesnay Schepler created FLINK-14905:
Summary: Unify packaging process
Key: FLINK-14905
URL: https://issues.apache.org/jira/browse/FLINK-14905
Project: Flink
Issue Type: Sub-task
hailong wang created FLINK-14893:
Summary: Using Child ClassLoader to load class when Parent
ClassLoader couldn't load in ParentFirstPatterns
Key: FLINK-14893
URL:
Rui Li created FLINK-14897:
--
Summary: HiveTableOutputFormat fails to finalize on master
Key: FLINK-14897
URL: https://issues.apache.org/jira/browse/FLINK-14897
Project: Flink
Issue Type: Bug
godfrey he created FLINK-14899:
--
Summary: can not be translated to StreamExecDeduplicate when
PROCTIME is defined in query
Key: FLINK-14899
URL: https://issues.apache.org/jira/browse/FLINK-14899
hailong wang created FLINK-14902:
Summary: JDBCTableSource support AsyncLookupFunction
Key: FLINK-14902
URL: https://issues.apache.org/jira/browse/FLINK-14902
Project: Flink
Issue Type:
Timo Walther created FLINK-14904:
Summary: Rename ANY type to RAW type
Key: FLINK-14904
URL: https://issues.apache.org/jira/browse/FLINK-14904
Project: Flink
Issue Type: Sub-task
+1 (binding)
Best,
Gary
On Thu, Nov 21, 2019 at 7:55 AM Zhu Zhu wrote:
> Thanks Yu for this proposal.
> +1(non-binding) for the overall design.
>
> I have 2 questions about the result check though. Posted in the discussion
> ML thread.
>
> Thanks,
> Zhu Zhu
>
> Becket Qin 于2019年11月21日周四
Zhenqiu Huang created FLINK-14906:
-
Summary: Add function related method in CatalogManager
Key: FLINK-14906
URL: https://issues.apache.org/jira/browse/FLINK-14906
Project: Flink
Issue Type:
Thanks Aihua for the explanation.
The proposal looks good to me then.
Thanks,
Zhu Zhu
aihua li 于2019年11月21日周四 下午3:59写道：
> Thanks for the comments Zhu Zhu!
>
> > 1. How do we measure the job throughput? By measuring the job execution
> > time on a finite input data set, or measuring the QPS
Zhu Zhu created FLINK-14909:
---
Summary: Let tasks in a batch get scheduled in topological order
and subtaskIndex ascending pattern
Key: FLINK-14909
URL: https://issues.apache.org/jira/browse/FLINK-14909
Dawid Wysakowicz created FLINK-14908:
Summary: Distributing CacheFiles through DFS does not work
Key: FLINK-14908
URL: https://issues.apache.org/jira/browse/FLINK-14908
Project: Flink
William Cheng created FLINK-14910:
-
Summary: disableAutoGeneratedUIDs fails on keyBy
Key: FLINK-14910
URL: https://issues.apache.org/jira/browse/FLINK-14910
Project: Flink
Issue Type: Bug
Konstantin Knauf created FLINK-14907:
Summary: Support to Configure Azure Storage Key via Environment
Variable
Key: FLINK-14907
URL: https://issues.apache.org/jira/browse/FLINK-14907
Project:
Bowen Li created FLINK-14912:
Summary: register,drop, and alter catalog functions from DDL to
FunctionCatalog
Key: FLINK-14912
URL: https://issues.apache.org/jira/browse/FLINK-14912
Project: Flink
Bowen Li created FLINK-14914:
Summary: refactor CatalogFunction interface and impls to add
language field
Key: FLINK-14914
URL: https://issues.apache.org/jira/browse/FLINK-14914
Project: Flink
Bowen Li created FLINK-14911:
Summary: register temp catalog functions created by DDL to
FunctionCatalog
Key: FLINK-14911
URL: https://issues.apache.org/jira/browse/FLINK-14911
Project: Flink
Bowen Li created FLINK-14913:
Summary: refactor CatalogFunction interface and impls by removing
properties map
Key: FLINK-14913
URL: https://issues.apache.org/jira/browse/FLINK-14913
Project: Flink
Hi Gyula,
I did not meant to say the MetricsReporter code should stay with the metric
storage, e.g. Kafka. I am trying to argue that metric reporter is a plugin
less related to Flink, but more related to a specific user environment. If
we include such plugins into Flink, as time goes, the user
Hi All,
Since the voting time has passed and we've reached a consensus on the
further discussions [1], I'm concluding the vote now.
Result:
- 6 x +1 (binding)
- 9 x +1 (non-binding)
- 0 x -1
- 0 x +/-0
Since there're enough binding votes and no disapproval, the vote has passed
and
Yu Li created FLINK-14919:
-
Summary: Add performance e2e test suite for basic operations
Key: FLINK-14919
URL: https://issues.apache.org/jira/browse/FLINK-14919
Project: Flink
Issue Type: Sub-task
Yu Li created FLINK-14920:
-
Summary: Set up environment to run performance e2e tests
Key: FLINK-14920
URL: https://issues.apache.org/jira/browse/FLINK-14920
Project: Flink
Issue Type: Sub-task
Zili Chen created FLINK-14916:
-
Summary: Asynchronously deploy cluster in
AbstractJobClusterExecutor#execute
Key: FLINK-14916
URL: https://issues.apache.org/jira/browse/FLINK-14916
Project: Flink
Yu Li created FLINK-14917:
-
Summary: Add end to end performance testing framework
Key: FLINK-14917
URL: https://issues.apache.org/jira/browse/FLINK-14917
Project: Flink
Issue Type: New Feature
Yu Li created FLINK-14918:
-
Summary: Add performance e2e test module and scripts
Key: FLINK-14918
URL: https://issues.apache.org/jira/browse/FLINK-14918
Project: Flink
Issue Type: Sub-task
Zili Chen created FLINK-14915:
-
Summary: SchedulingStrategyFactory#createInstance might not need
to know JobGraph
Key: FLINK-14915
URL: https://issues.apache.org/jira/browse/FLINK-14915
Project: Flink
Yu Li created FLINK-14922:
-
Summary: Add performance e2e test suite for state backend
Key: FLINK-14922
URL: https://issues.apache.org/jira/browse/FLINK-14922
Project: Flink
Issue Type: Sub-task
Yu Li created FLINK-14921:
-
Summary: Add more metrics for performance end to end benchmark
Key: FLINK-14921
URL: https://issues.apache.org/jira/browse/FLINK-14921
Project: Flink
Issue Type: Sub-task
Yu Li created FLINK-14923:
-
Summary: Add performance e2e test suite for shuffle service
Key: FLINK-14923
URL: https://issues.apache.org/jira/browse/FLINK-14923
Project: Flink
Issue Type: Bug
Hi Dawid,
I don't have other concerns now. Thanks for the explanation.
Best,
Jark
On Thu, 21 Nov 2019 at 18:13, Kurt Young wrote:
> Hi all,
>
> After some offline discussion with Dawid, I changed my mind. We still agree
> on that
> we should only support reading from tables with primary key,
Leonard Xu created FLINK-14924:
--
Summary: CsvTableSource can not config empty column as null
Key: FLINK-14924
URL: https://issues.apache.org/jira/browse/FLINK-14924
Project: Flink
Issue Type:
Zhenghua Gao created FLINK-14925:
Summary: the return type of TO_TIMESTAMP should be Timestamp(9)
instead of Timestamp(3)
Key: FLINK-14925
URL: https://issues.apache.org/jira/browse/FLINK-14925
Thanks a lot for putting this together, Dian! Definitely +1 for this!
It is great to make sure that the resources used by the Python process are
managed properly by Flink’s resource management framework.
Also, thanks to the guys that working on the unified memory management
framework.
Best,
61 matches
Mail list logo
