Re: Job recovery with task manager restart

Hi Till, Thanks for the background. It seems that we cannot always rely on the user code to not cause leaks and that can wreak havoc even when everything in Flink works as expected (user code managed threads may not terminate, class loader GC may not work due to references in the parent class

[jira] [Created] (FLINK-12564) Remove getBufferProvider method from ResultPartitionWriter interface

zhijiang created FLINK-12564: Summary: Remove getBufferProvider method from ResultPartitionWriter interface Key: FLINK-12564 URL: https://issues.apache.org/jira/browse/FLINK-12564 Project: Flink

[jira] [Created] (FLINK-12563) Introduce vector data format in blink

Jingsong Lee created FLINK-12563: Summary: Introduce vector data format in blink Key: FLINK-12563 URL: https://issues.apache.org/jira/browse/FLINK-12563 Project: Flink Issue Type:

Contributor

Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is zxhe. My JIRA Fullname is ZeXiong.

Re: Fwd: [DISCUSS] Flink SQL DDL Design

Thanks for all you discussions Timo, Jark Wu, Lin Li, Fabian I have fired a new design doc in [1] which reorganized from the MVP doc[2] and the initial doc[3] that both proposed by Shuyi Chen. The main diff is that i extend the create table DDL to support complex sql type (array, map and

[jira] [Created] (FLINK-12562) Improve code in ExpandColumnFunctionsRule

Hequn Cheng created FLINK-12562: --- Summary: Improve code in ExpandColumnFunctionsRule Key: FLINK-12562 URL: https://issues.apache.org/jira/browse/FLINK-12562 Project: Flink Issue Type:

[DISCUSS] FLIP to Restructure, Update & Rework Apache Flink's Documentation

Hi all, following our unsuccessful application to Season of Docs Fabian, Seth, Stephan and myself have drafted a FLIP for reworking our documentation and implementing some (or most) of the changes, we would have liked to tackle in SoD. The overarching goals of the FLIP are: * Top-level

[ANNOUNCE] Seattle Flink Meetup at AWS on May 30

Hi Greater Seattle folks! We are hosting our next meetup with AWS Kinesis Analytics team on May 30 next Thursday in downtown Seattle. We feature two talks this time: 1. *"AWS Kinesis Analytics: running Flink serverless in multi-tenant environment"* by Kinesis Analytics team on: -

[jira] [Created] (FLINK-12561) Unable to insert into cassandra table using FileWordCount example using Remote Cassandra Host with credentials

Ramesh Srinivasalu created FLINK-12561: -- Summary: Unable to insert into cassandra table using FileWordCount example using Remote Cassandra Host with credentials Key: FLINK-12561 URL:

[jira] [Created] (FLINK-12560) Documentation language build flags

Seth Wiesman created FLINK-12560: Summary: Documentation language build flags Key: FLINK-12560 URL: https://issues.apache.org/jira/browse/FLINK-12560 Project: Flink Issue Type: Sub-task

Re: Flink Forward Europe 2019 - Call for Presentations open until 17th May

Thanks for the update, Robert! I am planning to prepare a use case content with how we use Flink at MotaWord, focusing more on Flink as "application framework", rather than confining our mindset to Flink as "stream processor", on non-Uber, non-Alibaba scales. Hopefully over the weekend, I should

[jira] [Created] (FLINK-12559) Introduce metadata handlers on window aggregate

godfrey he created FLINK-12559: -- Summary: Introduce metadata handlers on window aggregate Key: FLINK-12559 URL: https://issues.apache.org/jira/browse/FLINK-12559 Project: Flink Issue Type: New

Re: questions about yarn container（taskmanager）memory allocation

Hi XiangWei, Thank you for the inputs. I agree with you that it is possible that containers may use extra memory in 1.8. As for native memory, it is memory used by JVM and other processes outside JVM. So it's not limited by MaxDirectMemorySize. The community is working on a refactoring plan

[jira] [Created] (FLINK-12558) Yarn application can't stop when flink job finished

lamber-ken created FLINK-12558: -- Summary: Yarn application can't stop when flink job finished Key: FLINK-12558 URL: https://issues.apache.org/jira/browse/FLINK-12558 Project: Flink Issue Type:

[jira] [Created] (FLINK-12557) Unify create table DDL with clause and connector descriptor keys

Danny Chan created FLINK-12557: -- Summary: Unify create table DDL with clause and connector descriptor keys Key: FLINK-12557 URL: https://issues.apache.org/jira/browse/FLINK-12557 Project: Flink

[jira] [Created] (FLINK-12556) Extend some end-to-end tests to run with custom (input) File System implementation

Alex created FLINK-12556: Summary: Extend some end-to-end tests to run with custom (input) File System implementation Key: FLINK-12556 URL: https://issues.apache.org/jira/browse/FLINK-12556 Project: Flink

[jira] [Created] (FLINK-12555) Introduce an incapsulated metric group layout for shuffle API and deprecate old one

Andrey Zagrebin created FLINK-12555: --- Summary: Introduce an incapsulated metric group layout for shuffle API and deprecate old one Key: FLINK-12555 URL: https://issues.apache.org/jira/browse/FLINK-12555

Re: [DISCUSS] Clean up and reorganize the JIRA components

Hi, > Concrete operator implementations will then go into the "API / DataStream"? > (or "API / DataSet" or Table) > Afaik, there were some ideas to share operator implementations between > DataStream and Table Yes & yes. I think for now we could keep the concrete operators implementations under

questions about yarn container（taskmanager）memory allocation

Hi all, Currently i am running my flink application in yarn session mode and using below commnad : *bin/yarn-session.sh -d -s 3 -jm 1024 -tm 4096* when taskmanager complete to started,i found the container launching command is : * bin/java -Xms2765m -Xmx2765m -XX:MaxDirectMemorySize=1331m

[jira] [Created] (FLINK-12554) Create TableFactory for Hive connector

Rui Li created FLINK-12554: -- Summary: Create TableFactory for Hive connector Key: FLINK-12554 URL: https://issues.apache.org/jira/browse/FLINK-12554 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12553) Fix a bug in SqlDateTimeUtils#parseToTimeMillis

Liya Fan created FLINK-12553: Summary: Fix a bug in SqlDateTimeUtils#parseToTimeMillis Key: FLINK-12553 URL: https://issues.apache.org/jira/browse/FLINK-12553 Project: Flink Issue Type: Bug