Re: Consuming data from dynamoDB streams to flink

HI Gordon: We are starting to implement some of the primitives along this path. Please let us know if you have any suggestions. Thanks! On Fri, Jun 29, 2018 at 12:31 AM, Ying Xu wrote: > Hi Gordon: > > Really appreciate the reply. > > Yes our plan is to build the connector on top of the

Flink memory management in table api

Hello folks, I am using flink table api to join multiple tables and create a single table from them. I have some doubts in my mind. 1. How long the query will maintain partial results per key and how it maintains state of each key? 2. If it is maintains state in memory then the memory will

[jira] [Created] (FLINK-9734) Typo in ' field-deleimiter'

Sergey Nuyanzin created FLINK-9734: -- Summary: Typo in ' field-deleimiter' Key: FLINK-9734 URL: https://issues.apache.org/jira/browse/FLINK-9734 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9733) Make location for job graph files configurable

Chesnay Schepler created FLINK-9733: --- Summary: Make location for job graph files configurable Key: FLINK-9733 URL: https://issues.apache.org/jira/browse/FLINK-9733 Project: Flink Issue

[jira] [Created] (FLINK-9732) Report more detailed error message on SobSubmissionFailure

Chesnay Schepler created FLINK-9732: --- Summary: Report more detailed error message on SobSubmissionFailure Key: FLINK-9732 URL: https://issues.apache.org/jira/browse/FLINK-9732 Project: Flink

[jira] [Created] (FLINK-9731) Kafka source subtask begins to consume from earliest offset

Elias Levy created FLINK-9731: - Summary: Kafka source subtask begins to consume from earliest offset Key: FLINK-9731 URL: https://issues.apache.org/jira/browse/FLINK-9731 Project: Flink Issue

[jira] [Created] (FLINK-9730) avoid access static via class reference

lamber-ken created FLINK-9730: - Summary: avoid access static via class reference Key: FLINK-9730 URL: https://issues.apache.org/jira/browse/FLINK-9730 Project: Flink Issue Type: Improvement

Re: Job jumbo jar can't be extracted on Windows

Looking at javadoc of separatorChar : * The system-dependent default name-separator character. This field is * initialized to contain the first character of the value of the system * property file.separator. On UNIX systems the value of this * field is '/'; on Microsoft

Job jumbo jar can't be extracted on Windows

When I try to "flink run" a job jar that includes dependent jar's - it fails on Windows with the following Exception: org.apache.flink.client.program.ProgramInvocationException: Unknown I/O error while extracting contained jar files. at

[jira] [Created] (FLINK-9729) Dupplicate lines for "Weekday name (Sunday .. Saturday)"

Sergey Nuyanzin created FLINK-9729: -- Summary: Dupplicate lines for "Weekday name (Sunday .. Saturday)" Key: FLINK-9729 URL: https://issues.apache.org/jira/browse/FLINK-9729 Project: Flink

[jira] [Created] (FLINK-9728) Wrong ruby version for building flink docs in docker container

Florian Schmidt created FLINK-9728: -- Summary: Wrong ruby version for building flink docs in docker container Key: FLINK-9728 URL: https://issues.apache.org/jira/browse/FLINK-9728 Project: Flink

[jira] [Created] (FLINK-9727) Allow user to pass resource tag expression in command line

Renjie Liu created FLINK-9727: - Summary: Allow user to pass resource tag expression in command line Key: FLINK-9727 URL: https://issues.apache.org/jira/browse/FLINK-9727 Project: Flink Issue

[jira] [Created] (FLINK-9726) Enable job task manager isolation use tag support

Renjie Liu created FLINK-9726: - Summary: Enable job task manager isolation use tag support Key: FLINK-9726 URL: https://issues.apache.org/jira/browse/FLINK-9726 Project: Flink Issue Type: New

[jira] [Created] (FLINK-9725) Add tag support to standalone cluster manager.

Renjie Liu created FLINK-9725: - Summary: Add tag support to standalone cluster manager. Key: FLINK-9725 URL: https://issues.apache.org/jira/browse/FLINK-9725 Project: Flink Issue Type: New

[jira] [Created] (FLINK-9724) Add tag support to yarn resource manager

Renjie Liu created FLINK-9724: - Summary: Add tag support to yarn resource manager Key: FLINK-9724 URL: https://issues.apache.org/jira/browse/FLINK-9724 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9723) Add tags support to mesos resource manager

Renjie Liu created FLINK-9723: - Summary: Add tags support to mesos resource manager Key: FLINK-9723 URL: https://issues.apache.org/jira/browse/FLINK-9723 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9722) Add resource tag predicate into slot manager

Renjie Liu created FLINK-9722: - Summary: Add resource tag predicate into slot manager Key: FLINK-9722 URL: https://issues.apache.org/jira/browse/FLINK-9722 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9721) Introduce ResourceTagExpression class

Renjie Liu created FLINK-9721: - Summary: Introduce ResourceTagExpression class Key: FLINK-9721 URL: https://issues.apache.org/jira/browse/FLINK-9721 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9720) Introduce ResourceTag class for tag support in scheduling

Renjie Liu created FLINK-9720: - Summary: Introduce ResourceTag class for tag support in scheduling Key: FLINK-9720 URL: https://issues.apache.org/jira/browse/FLINK-9720 Project: Flink Issue

[jira] [Created] (FLINK-9719) Mesos should use hostname as default jobmanager.rpc.address

Renjie Liu created FLINK-9719: - Summary: Mesos should use hostname as default jobmanager.rpc.address Key: FLINK-9719 URL: https://issues.apache.org/jira/browse/FLINK-9719 Project: Flink Issue

Re: [TABLE][SQL] Enirchment/Time versioned joins support in Flink

+1 from my side as well. Very excited to have this on the roadmap... On Mon, Jul 2, 2018 at 5:41 PM, vino yang wrote: > +1, great work! > > 2018-07-02 22:57 GMT+08:00 Rong Rong : > > > Huge +1!!! > > > > On Mon, Jul 2, 2018 at 6:07 AM Piotr Nowojski > > wrote: > > > > > Hi, > > > > > >

[jira] [Created] (FLINK-9718) Add enviroment variable in start-scala-shell.sh to enable remote debug

Jeff Zhang created FLINK-9718: - Summary: Add enviroment variable in start-scala-shell.sh to enable remote debug Key: FLINK-9718 URL: https://issues.apache.org/jira/browse/FLINK-9718 Project: Flink

[jira] [Created] (FLINK-9717) Flush state of one side of the join if other side is bounded

Piotr Nowojski created FLINK-9717: - Summary: Flush state of one side of the join if other side is bounded Key: FLINK-9717 URL: https://issues.apache.org/jira/browse/FLINK-9717 Project: Flink

[jira] [Created] (FLINK-9716) Support scans from table version function

Piotr Nowojski created FLINK-9716: - Summary: Support scans from table version function Key: FLINK-9716 URL: https://issues.apache.org/jira/browse/FLINK-9716 Project: Flink Issue Type:

[jira] [Created] (FLINK-9715) Support versioned joins with event time

Piotr Nowojski created FLINK-9715: - Summary: Support versioned joins with event time Key: FLINK-9715 URL: https://issues.apache.org/jira/browse/FLINK-9715 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-9714) Support versioned joins with processing time

Piotr Nowojski created FLINK-9714: - Summary: Support versioned joins with processing time Key: FLINK-9714 URL: https://issues.apache.org/jira/browse/FLINK-9714 Project: Flink Issue Type:

[jira] [Created] (FLINK-9713) Support versioned joins in planning phase

Piotr Nowojski created FLINK-9713: - Summary: Support versioned joins in planning phase Key: FLINK-9713 URL: https://issues.apache.org/jira/browse/FLINK-9713 Project: Flink Issue Type:

[jira] [Created] (FLINK-9712) Support enrichment joins in Flink SQL/Table API

Piotr Nowojski created FLINK-9712: - Summary: Support enrichment joins in Flink SQL/Table API Key: FLINK-9712 URL: https://issues.apache.org/jira/browse/FLINK-9712 Project: Flink Issue Type:

[jira] [Created] (FLINK-9711) Flink CLI does not filter RUNNING only jobs

Sayat Satybaldiyev created FLINK-9711: - Summary: Flink CLI does not filter RUNNING only jobs Key: FLINK-9711 URL: https://issues.apache.org/jira/browse/FLINK-9711 Project: Flink Issue

[jira] [Created] (FLINK-9710) Make ClusterClient be used as multiple instances in a single jvm process

Chuanlei Ni created FLINK-9710: -- Summary: Make ClusterClient be used as multiple instances in a single jvm process Key: FLINK-9710 URL: https://issues.apache.org/jira/browse/FLINK-9710 Project: Flink

[jira] [Created] (FLINK-9709) Docs: Unnecessary transition in flink job lifecycle visualization

Florian Schmidt created FLINK-9709: -- Summary: Docs: Unnecessary transition in flink job lifecycle visualization Key: FLINK-9709 URL: https://issues.apache.org/jira/browse/FLINK-9709 Project: Flink

Re: Kafka Avro Table Source

Hi Will, The community is currently working on improving the Kafka Avro integration for Flink SQL. There's a PR [1]. If you like, you could try it out and give some feedback. Timo (in CC) has been working Kafka Avro and should be able to help with any specific questions. Best, Fabian [1]

Re: [DISCUSS] Release Flink 1.5.1

Hi Chesnay, I made FLINK-9554 as blocker of 1.5.1, as scala shell still doesn't work in yarn mode in the latest master branch. (I believe it is the same in branch-1.5) Zhijiang(wangzhijiang999) 于2018年7月3日周二 下午12:04写道： > Hi Chesnay, > > Agree

[jira] [Created] (FLINK-9708) Network buffer leaks when buffer request fails during buffer redistribution

Nico Kruber created FLINK-9708: -- Summary: Network buffer leaks when buffer request fails during buffer redistribution Key: FLINK-9708 URL: https://issues.apache.org/jira/browse/FLINK-9708 Project: Flink

[jira] [Created] (FLINK-9707) LocalFileSystem does not support concurrent directory creations

Till Rohrmann created FLINK-9707: Summary: LocalFileSystem does not support concurrent directory creations Key: FLINK-9707 URL: https://issues.apache.org/jira/browse/FLINK-9707 Project: Flink

[jira] [Created] (FLINK-9706) DispatcherTest#testSubmittedJobGraphListener fails on Travis

Chesnay Schepler created FLINK-9706: --- Summary: DispatcherTest#testSubmittedJobGraphListener fails on Travis Key: FLINK-9706 URL: https://issues.apache.org/jira/browse/FLINK-9706 Project: Flink