[FLINK-14076] non-deserializable root cause in DeclineCheckpoint

(possible dupe; I wasn't subscribed before and the previous message didn't seem to go through) I'm on Flink v1.9 with the Kafka connector and a standalone JM. If FlinkKafkaProducer fails while checkpointing, it throws a KafkaException which gets wrapped in a CheckpointException which is sent to

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

+1 for using the keyword "SYSTEM". Thanks to Timo for chiming in! --Xuefu On Fri, Sep 20, 2019 at 3:28 PM Timo Walther wrote: > Hi everyone, > > sorry, for the late replay. I give also +1 for option #2. Thus, I guess > we have a clear winner. > > I would also like to find a better

[jira] [Created] (FLINK-14158) Update Mesos configs to add leaseOfferExpiration and declinedOfferRefuse durations

Piyush Narang created FLINK-14158: - Summary: Update Mesos configs to add leaseOfferExpiration and declinedOfferRefuse durations Key: FLINK-14158 URL: https://issues.apache.org/jira/browse/FLINK-14158

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

Hi everyone, sorry, for the late replay. I give also +1 for option #2. Thus, I guess we have a clear winner. I would also like to find a better keyword/syntax for this statement. Esp. the BUILTIN keyword can confuse people, because it could be written as BUILTIN, BUILDIN, BUILT_IN, or

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

I also like the 'System' keyword. I think we can assume we reached consensus on this topic. On Sat, 21 Sep 2019, 06:37 Xuefu Z, wrote: > +1 for using the keyword "SYSTEM". Thanks to Timo for chiming in! > > --Xuefu > > On Fri, Sep 20, 2019 at 3:28 PM Timo Walther wrote: > > > Hi everyone, > >

[jira] [Created] (FLINK-14159) flink rocksdb StreamCompressionDecorator not right

jackylau created FLINK-14159: Summary: flink rocksdb StreamCompressionDecorator not right Key: FLINK-14159 URL: https://issues.apache.org/jira/browse/FLINK-14159 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

"SYSTEM" sounds good to me. FYI, this FLIP only impacts low level of the SQL function stack and won't actually involve any DDL, thus I will just document the decision and we should keep it in mind when it's time to implement the DDLs. I'm in the process of updating the FLIP to reflect changes

Re: Add Bucket File System Table Sink

Hi Jun, Thanks for your understanding. If we all agree adding this functionality into FLIP-63 is a good idea, I would suggest you also help reviewing the FLIP-63 design document to see if current design meet your requirements. You can also raise some comments to the design document if you have

Re: [FLINK-14076] non-deserializable root cause in DeclineCheckpoint

To be clear -- I'm happy to make a PR for either option below. (Either is <10 lines diff.) It's just the contributor guidelines said to get consensus first and then only make a PR if I'm assigned to do the work. On Fri, Sep 20, 2019 at 12:23 PM Jeffrey Martin wrote: > (possible dupe; I wasn't

[jira] [Created] (FLINK-14150) Unnecessary __pycache__ directories appears in pyflink.zip

Wei Zhong created FLINK-14150: - Summary: Unnecessary __pycache__ directories appears in pyflink.zip Key: FLINK-14150 URL: https://issues.apache.org/jira/browse/FLINK-14150 Project: Flink Issue

Re: [DISCUSS] Add ARM CI build to Flink (information-only)

Sure, we can run daily ARM job as Travis CI nightly jobs firstly. Once it's stable enough, we can consider adding it to peer PR. BTW, I tested flink-end-to-end-test on ARM in last few days. Keeping the same as Travis, all 7 scenarios were tested: 1. split_checkpoints.sh 2. split_sticky.sh 3.

[jira] [Created] (FLINK-14139) Fix potential memory leak of rest server when using session/standalone cluster

Yingjie Cao created FLINK-14139: --- Summary: Fix potential memory leak of rest server when using session/standalone cluster Key: FLINK-14139 URL: https://issues.apache.org/jira/browse/FLINK-14139

[jira] [Created] (FLINK-14140) The Flink Logo Displayed in Flink Python Shell is Broken

Wei Zhong created FLINK-14140: - Summary: The Flink Logo Displayed in Flink Python Shell is Broken Key: FLINK-14140 URL: https://issues.apache.org/jira/browse/FLINK-14140 Project: Flink Issue

[jira] [Created] (FLINK-14143) Failed Attempt does not display in the timeline

Yadong Xie created FLINK-14143: -- Summary: Failed Attempt does not display in the timeline Key: FLINK-14143 URL: https://issues.apache.org/jira/browse/FLINK-14143 Project: Flink Issue Type:

[jira] [Created] (FLINK-14145) getLatestCheckpoint returns wrong checkpoint

Ufuk Celebi created FLINK-14145: --- Summary: getLatestCheckpoint returns wrong checkpoint Key: FLINK-14145 URL: https://issues.apache.org/jira/browse/FLINK-14145 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-14146) Introduce Pulsar connector

Yijie Shen created FLINK-14146: -- Summary: Introduce Pulsar connector Key: FLINK-14146 URL: https://issues.apache.org/jira/browse/FLINK-14146 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-14141) Locate Jobs/SubTask/Vertex Running on TaskManager

Yadong Xie created FLINK-14141: -- Summary: Locate Jobs/SubTask/Vertex Running on TaskManager Key: FLINK-14141 URL: https://issues.apache.org/jira/browse/FLINK-14141 Project: Flink Issue Type:

[DISCUSS] FLIP-72: Introduce Pulsar Connector

Hi everyone, Per discussion in the previous thread , I have created FLIP-72 to kick off a more detailed discussion on the Flink Pulsar connector:

[jira] [Created] (FLINK-14142) Add more metrics to task manager list

Yadong Xie created FLINK-14142: -- Summary: Add more metrics to task manager list Key: FLINK-14142 URL: https://issues.apache.org/jira/browse/FLINK-14142 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-14144) Add Metric for job manager

Yadong Xie created FLINK-14144: -- Summary: Add Metric for job manager Key: FLINK-14144 URL: https://issues.apache.org/jira/browse/FLINK-14144 Project: Flink Issue Type: Improvement

Re: Confluence permission for FLIP creation

Thanks, Fabian Best, Terry Wang > 在 2019年9月19日，下午7:37，Fabian Hueske 写道： > > Hi Terry, > > I gave you permissions. > > Thanks, Fabian > > Am Do., 19. Sept. 2019 um 04:09 Uhr schrieb Terry Wang : > >> Hi all, >> >> As communicated in an email thread, I'm proposing Flink SQL ddl >>

[jira] [Created] (FLINK-14148) Investigate pushing predicate/projection to underlying Hive input format

Rui Li created FLINK-14148: -- Summary: Investigate pushing predicate/projection to underlying Hive input format Key: FLINK-14148 URL: https://issues.apache.org/jira/browse/FLINK-14148 Project: Flink

[jira] [Created] (FLINK-14149) Introduce ZooKeeperLeaderElectionServiceNG

tison created FLINK-14149: - Summary: Introduce ZooKeeperLeaderElectionServiceNG Key: FLINK-14149 URL: https://issues.apache.org/jira/browse/FLINK-14149 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14152) Add class for DocCountVectorizerMapper.

Xu Yang created FLINK-14152: --- Summary: Add class for DocCountVectorizerMapper. Key: FLINK-14152 URL: https://issues.apache.org/jira/browse/FLINK-14152 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14151) Add class for DocHashIDFVectorizerModelMapper.

Xu Yang created FLINK-14151: --- Summary: Add class for DocHashIDFVectorizerModelMapper. Key: FLINK-14151 URL: https://issues.apache.org/jira/browse/FLINK-14151 Project: Flink Issue Type: Sub-task

Re: java8 lambdas and exceptions lead to compile error

thanks for reply. "add some context/comment" is very necessary, but I am not sure where to add to remind others for avoiding similar mistakes, so Is that a better way to add corresponding grammar checkstyle in checkstyle.xml? we can remove corresponding grammar checkstyle when we upgrade new Java

[jira] [Created] (FLINK-14153) Add to BLAS a method that performs DenseMatrix and SparseVector multiplication.

Xu Yang created FLINK-14153: --- Summary: Add to BLAS a method that performs DenseMatrix and SparseVector multiplication. Key: FLINK-14153 URL: https://issues.apache.org/jira/browse/FLINK-14153 Project: Flink

[jira] [Created] (FLINK-14154) Add the class for multivariate Gaussian Distribution.

Xu Yang created FLINK-14154: --- Summary: Add the class for multivariate Gaussian Distribution. Key: FLINK-14154 URL: https://issues.apache.org/jira/browse/FLINK-14154 Project: Flink Issue Type:

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

Thanks Becket. I think it is better for the Flink community to judge the benefits of doing this. I was trying to provide some views from outsiders. Thanks, Sijie On Fri, Sep 20, 2019 at 10:25 AM Becket Qin wrote: > Hi Sijie, > > Yes, we will have to support existing old connectors and new

[jira] [Created] (FLINK-14155) Add a wrapper class of a JSON library to provide the unified json format.

Xu Yang created FLINK-14155: --- Summary: Add a wrapper class of a JSON library to provide the unified json format. Key: FLINK-14155 URL: https://issues.apache.org/jira/browse/FLINK-14155 Project: Flink

Re: [ANNOUNCEMENT] September 2019 Bay Area Apache Flink Meetup

Hi all, Happy Friday! As a kind reminder, the meetup is ON next Tuesday at Yelp HQ in San Francisco. See you all there at 6:30pm. Regards, Xuefu On Fri, Aug 30, 2019 at 11:44 AM Xuefu Zhang wrote: > Hi all, > > As promised, we planned to have quarterly Flink meetup and now it's about > the

Re: Add Bucket File System Table Sink

Hi??Fabian ?? Thank you very much for your suggestion. This is when I use flink sql to write data to hdfs at work. I feel that it is inconvenient. I wrote this function, and then I want to contribute it to the community. This is my first PR , some processes may not be clear, I am very sorry.

Re: [DISCUSS] FLIP-66: Support time attribute in SQL DDL

Hi Jark, Thanks for the summary! I like the proposal! It makes it very clear that an event time attribute is an existing column on which watermark metadata is defined whereas a processing time attribute is a computed field. I have one comment regarding the section on "Complex Watermark

[jira] [Created] (FLINK-14157) Temporarily remove S3 StreamingFileSink end-to-end test

Kostas Kloudas created FLINK-14157: -- Summary: Temporarily remove S3 StreamingFileSink end-to-end test Key: FLINK-14157 URL: https://issues.apache.org/jira/browse/FLINK-14157 Project: Flink