Re: [DISCUSS] FLIP-84: Improve & Refactor execute/sqlQuery/sqlUpdate APIS of TableEnvironment

2020-02-14 Thread Jark Wu
Thanks Kurt and Godfrey for the explanation, It makes sense to me that renaming `from(tableName)` to `fromCatalog(tableName)`. However, I still think `sqlQuery(query)` is clear and works well. Is it necessary to change it? We removed `sql(query)` and introduced `sqlQuery(query)`, we removed

Re: [ANNOUNCE] New Documentation Style Guide

2020-02-14 Thread Jark Wu
Great summary! Thanks for adding the translation specification in it. I learned a lot from the guide. Best, Jark On Fri, 14 Feb 2020 at 23:39, Aljoscha Krettek wrote: > Hi Everyone, > > we just merged a new style guide for documentation writing: >

Re: [DISCUSS] Improve history server with log support

2020-02-14 Thread Venkata Sanath Muppalla
@Xiaogang Could please share more details about the trace mechanism you mentioned. As Rong mentioned, we are also working on something similar. On Fri, Feb 14, 2020, 9:12 AM Rong Rong wrote: > Thank you for the prompt feedbacks > > @Aljoscha. Yes you are absolutely correct - adding Hadoop

[jira] [Created] (FLINK-16069) Create TaskDeploymentDescriptor in future.

2020-02-14 Thread huweihua (Jira)
huweihua created FLINK-16069: Summary: Create TaskDeploymentDescriptor in future. Key: FLINK-16069 URL: https://issues.apache.org/jira/browse/FLINK-16069 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16068) table with keyword-escaped columns and computed_column_expression columns

2020-02-14 Thread pangliang (Jira)
pangliang created FLINK-16068: - Summary: table with keyword-escaped columns and computed_column_expression columns Key: FLINK-16068 URL: https://issues.apache.org/jira/browse/FLINK-16068 Project: Flink

Re: [DISCUSS] Remove transfer.sh from CI setup

2020-02-14 Thread Chesnay Schepler
The S3 setup only works in the apache repo though; not on contributor branches or PR builds. We can tighten the timeouts (already talked to Robert about that), at which point it doesn't hurt. On 14/02/2020 18:28, Stephan Ewen wrote: Hi all! I propose to remove the log upload via

Re: Total recovery time estimation after checkpoint recovery

2020-02-14 Thread Till Rohrmann
Hi Jessica, multiple factors affect the total recovery time. First of all, Flink needs to detect that something went wrong. In the worst case this happens through the missing heartbeat of a died machine. The default heartbeat value is configured to 50s but one can tune it. Next, Flink needs to

[DISCUSS] Remove transfer.sh from CI setup

2020-02-14 Thread Stephan Ewen
Hi all! I propose to remove the log upload via transfer.sh and rely on the S3 upload instead. The reason is that transfer.sh seems to be very unreliable (times out in many profiles recently) and it seems that we also often don't get access to uploaded logs (errors out on the transfer.sh

Re: [DISCUSS] Improve history server with log support

2020-02-14 Thread Rong Rong
Thank you for the prompt feedbacks @Aljoscha. Yes you are absolutely correct - adding Hadoop dependency to cluster runtime component is definitely not what we are proposing. We were trying to see how the community thinks about the idea of adding log support into History server. - The reference

Re: [ANNOUNCE] Flink Forward San Francisco 2020 Program is Live

2020-02-14 Thread Fabian Hueske
Hi everyone, Sorry for writing another email but I forgot to mention the community discounts. When you register for the conference [1], you can use one of the following discount codes: * As a member of the Flink community we offer a 50% discount on your conference pass if you register with the

[ANNOUNCE] Flink Forward San Francisco 2020 Program is Live

2020-02-14 Thread Fabian Hueske
Hi everyone, We announced the program of Flink Forward San Francisco 2020. The conference takes place at the Hyatt Regency in San Francisco from March 23rd to 25th. On the first day we offer four training sessions [1]: * Apache Flink Developer Training * Apache Flink Runtime & Operations

Re: [VOTE] Support Python ML Pipeline API

2020-02-14 Thread Rong Rong
+1 (binding) On Fri, Feb 14, 2020 at 7:15 AM Zhijiang wrote: > +1 (binding), it is valuable to enhance the python API for supporting ML > well. > > Best, > Zhijiang > > > -- > From:Dian Fu > Send Time:2020 Feb. 14 (Fri.) 15:07 >

[jira] [Created] (FLINK-16067) Flink's CalciteParser swallows error position information

2020-02-14 Thread Fabian Hueske (Jira)
Fabian Hueske created FLINK-16067: - Summary: Flink's CalciteParser swallows error position information Key: FLINK-16067 URL: https://issues.apache.org/jira/browse/FLINK-16067 Project: Flink

[ANNOUNCE] New Documentation Style Guide

2020-02-14 Thread Aljoscha Krettek
Hi Everyone, we just merged a new style guide for documentation writing: https://flink.apache.org/contributing/docs-style.html. Anyone who is writing documentation or is planning to do so should check this out. Please open a Jira Issue or respond here if you have any comments or questions.

[jira] [Created] (FLINK-16066) StateBinder should pickup persisted values in inner class

2020-02-14 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16066: Summary: StateBinder should pickup persisted values in inner class Key: FLINK-16066 URL: https://issues.apache.org/jira/browse/FLINK-16066 Project: Flink

Re: [VOTE] Support Python ML Pipeline API

2020-02-14 Thread Zhijiang
+1 (binding), it is valuable to enhance the python API for supporting ML well. Best, Zhijiang -- From:Dian Fu Send Time:2020 Feb. 14 (Fri.) 15:07 To:dev Subject:Re: [VOTE] Support Python ML Pipeline API +1 (binding) Regards,

[jira] [Created] (FLINK-16065) Unignore FileUtilsTest.testDeleteDirectoryConcurrently()

2020-02-14 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-16065: Summary: Unignore FileUtilsTest.testDeleteDirectoryConcurrently() Key: FLINK-16065 URL: https://issues.apache.org/jira/browse/FLINK-16065 Project: Flink

[jira] [Created] (FLINK-16064) Introduce HELM charts for StatefulFunctions

2020-02-14 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16064: Summary: Introduce HELM charts for StatefulFunctions Key: FLINK-16064 URL: https://issues.apache.org/jira/browse/FLINK-16064 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-16063) Add back-pressure mechanism

2020-02-14 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16063: Summary: Add back-pressure mechanism Key: FLINK-16063 URL: https://issues.apache.org/jira/browse/FLINK-16063 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-16062) Remove the use of a checkpointLock

2020-02-14 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16062: Summary: Remove the use of a checkpointLock Key: FLINK-16062 URL: https://issues.apache.org/jira/browse/FLINK-16062 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-16061) Disable state multiplexing

2020-02-14 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16061: Summary: Disable state multiplexing Key: FLINK-16061 URL: https://issues.apache.org/jira/browse/FLINK-16061 Project: Flink Issue Type: Task

[DISCUSS] FLIP-105: Support to Interpret and Emit Changelog in Flink SQL

2020-02-14 Thread Jark Wu
Hi everyone, I would like to start discussion about how to support interpreting external changelog into Flink SQL, and how to emit changelog from Flink SQL. This topic has already been mentioned several times in the past. CDC (Change Data Capture) data has been a very important streaming data in

[jira] [Created] (FLINK-16060) Create MVP of multiple input processor

2020-02-14 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-16060: -- Summary: Create MVP of multiple input processor Key: FLINK-16060 URL: https://issues.apache.org/jira/browse/FLINK-16060 Project: Flink Issue Type:

[jira] [Created] (FLINK-16059) Order properties in REST API docs alphabetically

2020-02-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16059: Summary: Order properties in REST API docs alphabetically Key: FLINK-16059 URL: https://issues.apache.org/jira/browse/FLINK-16059 Project: Flink

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-14 Thread Robert Metzger
+1 (binding) - Checked some artifacts in the staging repo - checked license documentation - source release is binary free On Fri, Feb 14, 2020 at 8:01 AM Dian Fu wrote: > +1 (non-binding) > > - Verified the signature and checksum > - Checked the release note that all the tickets included in

[jira] [Created] (FLINK-16058) Could not start TaskManager in flink 1.10.0

2020-02-14 Thread BlaBlabla (Jira)
BlaBlabla created FLINK-16058: - Summary: Could not start TaskManager in flink 1.10.0 Key: FLINK-16058 URL: https://issues.apache.org/jira/browse/FLINK-16058 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16057) Performance regression in ContinuousFileReader

2020-02-14 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-16057: - Summary: Performance regression in ContinuousFileReader Key: FLINK-16057 URL: https://issues.apache.org/jira/browse/FLINK-16057 Project: Flink

[jira] [Created] (FLINK-16056) NullPointerException during ContinuousFileProcessingITCase

2020-02-14 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-16056: - Summary: NullPointerException during ContinuousFileProcessingITCase Key: FLINK-16056 URL: https://issues.apache.org/jira/browse/FLINK-16056 Project: Flink

[jira] [Created] (FLINK-16055) Avoid catalog functions when listing Hive built-in functions

2020-02-14 Thread Rui Li (Jira)
Rui Li created FLINK-16055: -- Summary: Avoid catalog functions when listing Hive built-in functions Key: FLINK-16055 URL: https://issues.apache.org/jira/browse/FLINK-16055 Project: Flink Issue

[jira] [Created] (FLINK-16054) Support Java 13

2020-02-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16054: Summary: Support Java 13 Key: FLINK-16054 URL: https://issues.apache.org/jira/browse/FLINK-16054 Project: Flink Issue Type: Sub-task