Re: [Discuss] Update the pull request description template.

In my experience, the template is helpful. Especially for the people just joined the community and give their first PR. I don't know how many people have read the contributor guide entirely before they commit their first PR, but I should admit that I did not read it word by word for the first

[jira] [Created] (FLINK-16197) Failed to query partitioned table when partition folder is removed

Rui Li created FLINK-16197: -- Summary: Failed to query partitioned table when partition folder is removed Key: FLINK-16197 URL: https://issues.apache.org/jira/browse/FLINK-16197 Project: Flink

Re: [DISCUSS] Improve TableFactory

Hi all, I would like to add an additional method `getClassloader()` into the context. Because a TableFactory may require this classloader to find another TableFactory, e.g. we will find format factory in KafkaTableSourceSinkFactory. See FLINK-15992. I don't think we need a new VOTE for this, I

[jira] [Created] (FLINK-16196) FlinkStandaloneHiveRunner leaks HMS process

Rui Li created FLINK-16196: -- Summary: FlinkStandaloneHiveRunner leaks HMS process Key: FLINK-16196 URL: https://issues.apache.org/jira/browse/FLINK-16196 Project: Flink Issue Type: Test

Flink CEP greedy match of single pattern

Hey, I have a question regarding CEP, assume I have a stream of readings from various sensors. The application is running in EventTime, so according to the CEP docs the events are buffered and sorted by timestamp ascending. So, I want to record the situations when reading from the sensor goes

Re: [VOTE] FLIP-104: Add More Metrics to Jobmanager

FYI, there's an effort planned for 1.11 to improve the memory configuration of the Flink master process, similar to FLIP-49 but definitely less complexity. I would not consider the memory configuration improvement as a blocker for this effort. As far as I can see, there's nothing in conflict.

Adding a new "Docker Images" component to Jira

Hi, Could someone with permissions add a new component to the FLINK project in Jira for the Docker images ? There is already a "Deployment / Docker" component, but that's not quite the same as maintenance/improvements on the flink-docker images. Either

Re: Adding a new "Docker Images" component to Jira

Thanks, Chesnay! On Fri, Feb 21, 2020 at 11:26 AM Chesnay Schepler wrote: > I've added a "Release System / Docker" component. > > On 21/02/2020 11:19, Patrick Lucas wrote: > > Hi, > > > > Could someone with permissions add a new component to the FLINK project > in > > Jira for the Docker images

[jira] [Created] (FLINK-16206) Support JSON_ARRAYAGG for blink planner

Zili Chen created FLINK-16206: - Summary: Support JSON_ARRAYAGG for blink planner Key: FLINK-16206 URL: https://issues.apache.org/jira/browse/FLINK-16206 Project: Flink Issue Type: Sub-task

Re: Adding a new "Docker Images" component to Jira

I've added a "Release System / Docker" component. On 21/02/2020 11:19, Patrick Lucas wrote: Hi, Could someone with permissions add a new component to the FLINK project in Jira for the Docker images ? There is already a "Deployment / Docker" component,

[jira] [Created] (FLINK-16199) Support IS JSON predicate for blink planner

Zili Chen created FLINK-16199: - Summary: Support IS JSON predicate for blink planner Key: FLINK-16199 URL: https://issues.apache.org/jira/browse/FLINK-16199 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16200) Support JSON_EXISTS for blink planner

Zili Chen created FLINK-16200: - Summary: Support JSON_EXISTS for blink planner Key: FLINK-16200 URL: https://issues.apache.org/jira/browse/FLINK-16200 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16201) Support JSON_VALUE for blink planner

Zili Chen created FLINK-16201: - Summary: Support JSON_VALUE for blink planner Key: FLINK-16201 URL: https://issues.apache.org/jira/browse/FLINK-16201 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16198) FileUtilsTest fails on Mac OS

Andrey Zagrebin created FLINK-16198: --- Summary: FileUtilsTest fails on Mac OS Key: FLINK-16198 URL: https://issues.apache.org/jira/browse/FLINK-16198 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16205) Support JSON_OBJECTAGG for blink planner

Zili Chen created FLINK-16205: - Summary: Support JSON_OBJECTAGG for blink planner Key: FLINK-16205 URL: https://issues.apache.org/jira/browse/FLINK-16205 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16203) Support JSON_OBJECT for blink planner

Zili Chen created FLINK-16203: - Summary: Support JSON_OBJECT for blink planner Key: FLINK-16203 URL: https://issues.apache.org/jira/browse/FLINK-16203 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16202) Support JSON_QUERY for blink planner

Zili Chen created FLINK-16202: - Summary: Support JSON_QUERY for blink planner Key: FLINK-16202 URL: https://issues.apache.org/jira/browse/FLINK-16202 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16204) Support JSON_ARRAY for blink planner

Zili Chen created FLINK-16204: - Summary: Support JSON_ARRAY for blink planner Key: FLINK-16204 URL: https://issues.apache.org/jira/browse/FLINK-16204 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16207) In stream processing concepts section, rework distribution patterns description

Aljoscha Krettek created FLINK-16207: Summary: In stream processing concepts section, rework distribution patterns description Key: FLINK-16207 URL: https://issues.apache.org/jira/browse/FLINK-16207

[jira] [Created] (FLINK-16209) Add Latency and Completeness section in timely stream processing concepts

Aljoscha Krettek created FLINK-16209: Summary: Add Latency and Completeness section in timely stream processing concepts Key: FLINK-16209 URL: https://issues.apache.org/jira/browse/FLINK-16209

[jira] [Created] (FLINK-16211) Add introduction to stream processing concepts documentation

Aljoscha Krettek created FLINK-16211: Summary: Add introduction to stream processing concepts documentation Key: FLINK-16211 URL: https://issues.apache.org/jira/browse/FLINK-16211 Project: Flink

[jira] [Created] (FLINK-16212) Describe how Flink is a unified batch/stream processing system in concepts documentation

Aljoscha Krettek created FLINK-16212: Summary: Describe how Flink is a unified batch/stream processing system in concepts documentation Key: FLINK-16212 URL: https://issues.apache.org/jira/browse/FLINK-16212

[jira] [Created] (FLINK-16214) Describe how state is different for stream/batch programs in concepts documentation

Aljoscha Krettek created FLINK-16214: Summary: Describe how state is different for stream/batch programs in concepts documentation Key: FLINK-16214 URL: https://issues.apache.org/jira/browse/FLINK-16214

Re: [DISCUSS] Improve TableFactory

Hi Jark, I think user ClassLoader is clear in SQL-CLI. I agree with you that we can add ClassLoader to Context. But how to implement user ClassLoader in TableEnvironment, there is no ClassLoader in TableEnvironment. (Maybe EnvironmentSettings could contains user ClassLoader in the future) So I

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Thanks everyone~ It's my pleasure to be part of the community. I hope I can make a better contribution in future. Best, Jingsong Lee On Fri, Feb 21, 2020 at 2:48 PM Hequn Cheng wrote: > Congratulations Jingsong! Well deserved. > > Best, > Hequn > > On Fri, Feb 21, 2020 at 2:42 PM Yang Wang

[jira] [Created] (FLINK-16217) SQL Client crashed when any uncatched exception is thrown

Jark Wu created FLINK-16217: --- Summary: SQL Client crashed when any uncatched exception is thrown Key: FLINK-16217 URL: https://issues.apache.org/jira/browse/FLINK-16217 Project: Flink Issue Type:

[jira] [Created] (FLINK-16208) Add introduction to timely stream processing concepts documentation

Aljoscha Krettek created FLINK-16208: Summary: Add introduction to timely stream processing concepts documentation Key: FLINK-16208 URL: https://issues.apache.org/jira/browse/FLINK-16208 Project:

[jira] [Created] (FLINK-16210) Add section about applications and clusters/session in concepts documentation

Aljoscha Krettek created FLINK-16210: Summary: Add section about applications and clusters/session in concepts documentation Key: FLINK-16210 URL: https://issues.apache.org/jira/browse/FLINK-16210

[jira] [Created] (FLINK-16213) Add "What Is State" section in concepts documentation

Aljoscha Krettek created FLINK-16213: Summary: Add "What Is State" section in concepts documentation Key: FLINK-16213 URL: https://issues.apache.org/jira/browse/FLINK-16213 Project: Flink

[jira] [Created] (FLINK-16215) Start redundant TaskExecutor when JM failed

YufeiLiu created FLINK-16215: Summary: Start redundant TaskExecutor when JM failed Key: FLINK-16215 URL: https://issues.apache.org/jira/browse/FLINK-16215 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16216) Describe end-to-end exactly once programs in stateful stream processing concepts documentation

Aljoscha Krettek created FLINK-16216: Summary: Describe end-to-end exactly once programs in stateful stream processing concepts documentation Key: FLINK-16216 URL:

[jira] [Created] (FLINK-16220) JsonRowSerializationSchema throws cast exception : NullNode cannot be cast to ArrayNode

Benchao Li created FLINK-16220: -- Summary: JsonRowSerializationSchema throws cast exception : NullNode cannot be cast to ArrayNode Key: FLINK-16220 URL: https://issues.apache.org/jira/browse/FLINK-16220

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congratulations Jingsong! Best, Yun -- From:Jingsong Li Send Time:2020 Feb. 21 (Fri.) 21:42 To:Hequn Cheng Cc:Yang Wang ; Zhijiang ; Zhenghua Gao ; godfrey he ; dev ; user Subject:Re: [ANNOUNCE] Jingsong Lee becomes a

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congrats, Jingsong! On Fri, Feb 21, 2020 at 7:28 AM Till Rohrmann wrote: > Congratulations Jingsong! > > Cheers, > Till > > On Fri, Feb 21, 2020 at 4:03 PM Yun Gao wrote: > >> Congratulations Jingsong! >> >>Best, >>Yun >> >>

Re: Flink CEP greedy match of single pattern

Hi Dominik, you can control FlinkCEP's consumption behaviour via the after match skip strategies [1]. They allow you to control how Flink treats events after a match has occurred. If you are interested in the longest possible window of events exceeding your threshold, then you could also add

Re: [DISCUSS] FLINK-16194: Refactor the Kubernetes architecture design

Thanks for starting this discussion Canbin. If I understand your proposal correctly, then you would like to evolve the existing decorator approach so that decorators are monadic and smaller in size and functionality. The latter aspect will allow to reuse them between the client and the cluster.

[jira] [Created] (FLINK-16223) Flat aggregate misuses key group ranges

Seth Wiesman created FLINK-16223: Summary: Flat aggregate misuses key group ranges Key: FLINK-16223 URL: https://issues.apache.org/jira/browse/FLINK-16223 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-101: Add Pending Slots Detail

Thanks Yadong for this FLIP! If I understood correctly, the motivation is based on the scenario of scheduled job state for long time in the well resourced cluster. It is meaningful for me if we can provide some useful infos to help users analyze the reason. I see from PoC that we can get the

Re: [Discuss] Update the pull request description template.

Thanks for launching this discussion and all the involved feedbacks! Since there are still many users relying on the template to raise attentions and guide review, it sounds reasonable to update the template based on demands. In my experience, I was always filling the template when submitting

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congratulations Jingsong!! Cheers, Rong On Fri, Feb 21, 2020 at 8:45 AM Bowen Li wrote: > Congrats, Jingsong! > > On Fri, Feb 21, 2020 at 7:28 AM Till Rohrmann > wrote: > >> Congratulations Jingsong! >> >> Cheers, >> Till >> >> On Fri, Feb 21, 2020 at 4:03 PM Yun Gao wrote: >> >>>

Re: [DISCUSS] FLINK-16194: Refactor the Kubernetes architecture design

Thanks for the feedback @Yang Wang. I would like to discuss some of the details in depth about why I am confused about the existing design. Question 1: How do we mount a configuration file? For the existing design, 1. We need several classes to finish it: 1.

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congrats Jingsong! Cheers, Fabian Am Fr., 21. Feb. 2020 um 17:49 Uhr schrieb Rong Rong : > Congratulations Jingsong!! > > Cheers, > Rong > > On Fri, Feb 21, 2020 at 8:45 AM Bowen Li wrote: > > > Congrats, Jingsong! > > > > On Fri, Feb 21, 2020 at 7:28 AM Till Rohrmann > > wrote: > > > >>

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congratulations Jingsong! Cheers, Till On Fri, Feb 21, 2020 at 4:03 PM Yun Gao wrote: > Congratulations Jingsong! > >Best, >Yun > > -- > From:Jingsong Li > Send Time:2020 Feb. 21 (Fri.) 21:42 > To:Hequn Cheng >

[jira] [Created] (FLINK-16222) Use plugins mechanism for initializing MetricReporters

Alexander Fedulov created FLINK-16222: - Summary: Use plugins mechanism for initializing MetricReporters Key: FLINK-16222 URL: https://issues.apache.org/jira/browse/FLINK-16222 Project: Flink

[jira] [Created] (FLINK-16226) Add back pressure to HttpFunction.

Igal Shilman created FLINK-16226: Summary: Add back pressure to HttpFunction. Key: FLINK-16226 URL: https://issues.apache.org/jira/browse/FLINK-16226 Project: Flink Issue Type: Task

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congrats Jingsong! On Fri, Feb 21, 2020 at 8:49 AM Rong Rong wrote: > Congratulations Jingsong!! > > Cheers, > Rong > > On Fri, Feb 21, 2020 at 8:45 AM Bowen Li wrote: > >> Congrats, Jingsong! >> >> On Fri, Feb 21, 2020 at 7:28 AM Till Rohrmann >> wrote: >> >>> Congratulations Jingsong! >>>

[jira] [Created] (FLINK-16221) Execution::transitionState() should log an error when error parameter is not null

yazgoo created FLINK-16221: -- Summary: Execution::transitionState() should log an error when error parameter is not null Key: FLINK-16221 URL: https://issues.apache.org/jira/browse/FLINK-16221 Project:

[jira] [Created] (FLINK-16225) Metaspace Out Of Memory should be handled as Fatal Error in TaskManager

Stephan Ewen created FLINK-16225: Summary: Metaspace Out Of Memory should be handled as Fatal Error in TaskManager Key: FLINK-16225 URL: https://issues.apache.org/jira/browse/FLINK-16225 Project:

[jira] [Created] (FLINK-16224) Refine Hadoop Delegation Token based testing framework

Rong Rong created FLINK-16224: - Summary: Refine Hadoop Delegation Token based testing framework Key: FLINK-16224 URL: https://issues.apache.org/jira/browse/FLINK-16224 Project: Flink Issue Type:

[jira] [Created] (FLINK-16230) Use LinkedHashMap instead of HashMap for a deterministic order when testing serialization

cpugputpu created FLINK-16230: - Summary: Use LinkedHashMap instead of HashMap for a deterministic order when testing serialization Key: FLINK-16230 URL: https://issues.apache.org/jira/browse/FLINK-16230

Re: [DISCUSS] FLINK-16194: Refactor the Kubernetes architecture design

Great thanks for the quick feedback Till. You are right; it is not a fundamentally different approach compared to what we have right now, all the Kubernetes resources created are the same, we aim to evolve the existing decorator approach so that, 1. the decorators are monadic and smaller in size

[jira] [Created] (FLINK-16227) Streaming bucketing end-to-end test / test_streaming_bucketing.sh unstable

Robert Metzger created FLINK-16227: -- Summary: Streaming bucketing end-to-end test / test_streaming_bucketing.sh unstable Key: FLINK-16227 URL: https://issues.apache.org/jira/browse/FLINK-16227

[jira] [Created] (FLINK-16229) testCompressionOnRelativePath() fails due to Files.createDirectory() in macOS

Liu created FLINK-16229: --- Summary: testCompressionOnRelativePath() fails due to Files.createDirectory() in macOS Key: FLINK-16229 URL: https://issues.apache.org/jira/browse/FLINK-16229 Project: Flink

[jira] [Created] (FLINK-16228) test_mesos_wordcount.sh fails

Robert Metzger created FLINK-16228: -- Summary: test_mesos_wordcount.sh fails Key: FLINK-16228 URL: https://issues.apache.org/jira/browse/FLINK-16228 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16218) Chinese character is garbled when reading from MySQL using JDBC source

Jark Wu created FLINK-16218: --- Summary: Chinese character is garbled when reading from MySQL using JDBC source Key: FLINK-16218 URL: https://issues.apache.org/jira/browse/FLINK-16218 Project: Flink

[jira] [Created] (FLINK-16219) Make AsyncWaitOperator chainable again

Arvid Heise created FLINK-16219: --- Summary: Make AsyncWaitOperator chainable again Key: FLINK-16219 URL: https://issues.apache.org/jira/browse/FLINK-16219 Project: Flink Issue Type: Improvement