Re: Using FileSystem SQL Connector to Commit Hive Partition Exception

2021-04-14 Thread Rui Li
Hi Chenzuoli, The NoSuchMethodError seems to indicate there's a dependency conflict. What's the hadoop version you're using? And could you also check whether there are multiple hadoop jars (in different versions) in the classpath? On Wed, Apr 14, 2021 at 5:10 PM chenzuoli wrote: > Hi: > This

[jira] [Created] (FLINK-22284) Null address will be logged when channel is closed in NettyPartitionRequestClient

2021-04-14 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-22284: Summary: Null address will be logged when channel is closed in NettyPartitionRequestClient Key: FLINK-22284 URL: https://issues.apache.org/jira/browse/FLINK-22284

[jira] [Created] (FLINK-22283) GraphiteReporter Metrics named xxx alredy exists

2021-04-14 Thread HideOnBush (Jira)
HideOnBush created FLINK-22283: -- Summary: GraphiteReporter Metrics named xxx alredy exists Key: FLINK-22283 URL: https://issues.apache.org/jira/browse/FLINK-22283 Project: Flink Issue Type: Bug

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Yang Wang
+1 Best, Yang Robert Metzger 于2021年4月15日周四 上午2:49写道: > +1 > > On Wed, Apr 14, 2021 at 11:32 AM Arvid Heise wrote: > > > +1 > > > > On Wed, Apr 14, 2021 at 11:21 AM Xintong Song > > wrote: > > > > > +1 > > > > > > Thank you~ > > > > > > Xintong Song > > > > > > > > > > > > On Wed, Apr 14,

[jira] [Created] (FLINK-22282) Move creation of SplitEnumerator to the SourceCoordinator thread

2021-04-14 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-22282: Summary: Move creation of SplitEnumerator to the SourceCoordinator thread Key: FLINK-22282 URL: https://issues.apache.org/jira/browse/FLINK-22282 Project: Flink

[jira] [Created] (FLINK-22281) flink sql

2021-04-14 Thread xx chai (Jira)
xx chai created FLINK-22281: --- Summary: flink sql Key: FLINK-22281 URL: https://issues.apache.org/jira/browse/FLINK-22281 Project: Flink Issue Type: Improvement Reporter: xx chai

RE: [DISCUSS] Add checkpoint id in FLIP-27 source SplitEnumerator::snapshotState()

2021-04-14 Thread Zhou, Brian
Hi Becket, OK, Can you give me the write permission to the wiki? Then I can start to write a FLIP. Thanks, Brian From: Becket Qin Sent: Wednesday, April 14, 2021 5:46 PM To: Zhou, Brian Cc: dev@flink.apache.org Subject: Re: [DISCUSS] Add checkpoint id in FLIP-27 source

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Robert Metzger
+1 On Wed, Apr 14, 2021 at 11:32 AM Arvid Heise wrote: > +1 > > On Wed, Apr 14, 2021 at 11:21 AM Xintong Song > wrote: > > > +1 > > > > Thank you~ > > > > Xintong Song > > > > > > > > On Wed, Apr 14, 2021 at 4:58 PM Yangze Guo wrote: > > > > > +1 > > > > > > Best, > > > Yangze Guo > > > > > >

Re: [PSA] Documentation is currently not being updated

2021-04-14 Thread Tzu-Li (Gordon) Tai
The same thing happened to the StateFun builds as well. They also have not been running since April 7th. After asking infra to reset the builds, the issue persisted. I recently switched the node to asf945_ubuntu for the StateFun doc builds because of this. On Thu, Apr 15, 2021, 12:48 AM Chesnay

Re: [PSA] Documentation is currently not being updated

2021-04-14 Thread 戴資力
The same thing happened to the StateFun builds as well. They also have not been running since April 7th. After asking infra to reset the builds, the issue persisted. I recently switched the node to asf945_ubuntu for the StateFun doc builds because of this. On Thu, Apr 15, 2021, 12:48 AM Chesnay

[PSA] Documentation is currently not being updated

2021-04-14 Thread Chesnay Schepler
Just a quick PSA that our buildbot builds hasn't been running since April 7th, meaning that the documentation has not been updated since. This appears to be an issue on the INFRA side of things, for which I have opened a ticket . So don't be

[jira] [Created] (FLINK-22280) Add XML output format for Flink Table

2021-04-14 Thread Jira
François Lacombe created FLINK-22280: Summary: Add XML output format for Flink Table Key: FLINK-22280 URL: https://issues.apache.org/jira/browse/FLINK-22280 Project: Flink Issue Type:

[jira] [Created] (FLINK-22279) Upload the pipeline.classpaths file in yarn application mode

2021-04-14 Thread renjianxu (Jira)
renjianxu created FLINK-22279: - Summary: Upload the pipeline.classpaths file in yarn application mode Key: FLINK-22279 URL: https://issues.apache.org/jira/browse/FLINK-22279 Project: Flink

[jira] [Created] (FLINK-22278) Refactor sql client's DynamicResult

2021-04-14 Thread Kurt Young (Jira)
Kurt Young created FLINK-22278: -- Summary: Refactor sql client's DynamicResult Key: FLINK-22278 URL: https://issues.apache.org/jira/browse/FLINK-22278 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-22277) Refactor sql client's DynamicResult

2021-04-14 Thread Kurt Young (Jira)
Kurt Young created FLINK-22277: -- Summary: Refactor sql client's DynamicResult Key: FLINK-22277 URL: https://issues.apache.org/jira/browse/FLINK-22277 Project: Flink Issue Type: Improvement

Re: Update on Implementation of Flink Jira Process & Bot (go live today)

2021-04-14 Thread Konstantin Knauf
Yes, only Rule 3. > Why is the ticket for said rule still open? https://issues.apache.org/jira/browse/FLINK-22032 Because I forgot to close it yesterday. I am not so good with the Jira process myself apparently ;) On Wed, Apr 14, 2021 at 12:34 PM Chesnay Schepler wrote: > So which rule

Re: Update on Implementation of Flink Jira Process & Bot (go live today)

2021-04-14 Thread Chesnay Schepler
So which rule exactly is now enabled? Is it Rule 3 (because it is the only one listed as implemented under https://github.com/apache/flink-jira-bot#about-the-rules)? > An unresolved Minor ticket without an update for {stale.minor.stale_days} is closed after a warning period of

Re: Update on Implementation of Flink Jira Process & Bot (go live today)

2021-04-14 Thread Konstantin Knauf
Thank you, Chesnay. Here we go again: Hi everyone, I would like to give you an update on the recently discussed Jira Process and Bot. The implementation is tracked in Jira [1] and the new process has already been documented in Confluence [2]. The Flink Jira Bot is implemented in a separate

[jira] [Created] (FLINK-22276) ExceptionHistoryEntryExtractor throws fatal error when task failure

2021-04-14 Thread Jin Xing (Jira)
Jin Xing created FLINK-22276: Summary: ExceptionHistoryEntryExtractor throws fatal error when task failure Key: FLINK-22276 URL: https://issues.apache.org/jira/browse/FLINK-22276 Project: Flink

Re: [DISCUSS] Add checkpoint id in FLIP-27 source SplitEnumerator::snapshotState()

2021-04-14 Thread Becket Qin
Hi Brian, Passing the checkpoint ID to SplitEnumerator.snapshotState() seems reasonable to me. So +1 to the change. BTW, typically for such API changes, we expect a FLIP wiki [1] to be included in the discussion thread. Thanks, Jiangjie (Becket) Qin [1]

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Arvid Heise
+1 On Wed, Apr 14, 2021 at 11:21 AM Xintong Song wrote: > +1 > > Thank you~ > > Xintong Song > > > > On Wed, Apr 14, 2021 at 4:58 PM Yangze Guo wrote: > > > +1 > > > > Best, > > Yangze Guo > > > > On Wed, Apr 14, 2021 at 4:56 PM Chesnay Schepler > > wrote: > > > > > > +1 > > > > > > On

Re: Update on Implementation of Flink Jira Process & Bot (go live today)

2021-04-14 Thread Chesnay Schepler
I think you forgot to add the links. On 4/14/2021 11:25 AM, Konstantin Knauf wrote: Hi everyone, I would like to give you an update on the recently discussed Jira Process and Bot. The implementation is tracked in Jira [1] and the new process has already been documented in Confluence [2]. The

[jira] [Created] (FLINK-22275) Datagen add a max lag option for a series of timestamp-related types

2021-04-14 Thread Yi Tang (Jira)
Yi Tang created FLINK-22275: --- Summary: Datagen add a max lag option for a series of timestamp-related types Key: FLINK-22275 URL: https://issues.apache.org/jira/browse/FLINK-22275 Project: Flink

Update on Implementation of Flink Jira Process & Bot (go live today)

2021-04-14 Thread Konstantin Knauf
Hi everyone, I would like to give you an update on the recently discussed Jira Process and Bot. The implementation is tracked in Jira [1] and the new process has already been documented in Confluence [2]. The Flink Jira Bot is implemented in a separate repository [3], which contains the details

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Xintong Song
+1 Thank you~ Xintong Song On Wed, Apr 14, 2021 at 4:58 PM Yangze Guo wrote: > +1 > > Best, > Yangze Guo > > On Wed, Apr 14, 2021 at 4:56 PM Chesnay Schepler > wrote: > > > > +1 > > > > On 4/14/2021 10:11 AM, Till Rohrmann wrote: > > > +1 > > > > > > Cheers, > > > Till > > > > > > On Wed,

Re: Using FileSystem SQL Connector to Commit Hive Partition Exception

2021-04-14 Thread chenzuoli
Hi: This is the log attachment:

[jira] [Created] (FLINK-22274) SQL parser fails to parse group by statements with brackets in views

2021-04-14 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-22274: --- Summary: SQL parser fails to parse group by statements with brackets in views Key: FLINK-22274 URL: https://issues.apache.org/jira/browse/FLINK-22274 Project: Flink

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Yangze Guo
+1 Best, Yangze Guo On Wed, Apr 14, 2021 at 4:56 PM Chesnay Schepler wrote: > > +1 > > On 4/14/2021 10:11 AM, Till Rohrmann wrote: > > +1 > > > > Cheers, > > Till > > > > On Wed, Apr 14, 2021 at 10:10 AM Konstantin Knauf wrote: > > > >> +1 > >> > >> On Wed, Apr 14, 2021 at 9:46 AM Matthias

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Chesnay Schepler
+1 On 4/14/2021 10:11 AM, Till Rohrmann wrote: +1 Cheers, Till On Wed, Apr 14, 2021 at 10:10 AM Konstantin Knauf wrote: +1 On Wed, Apr 14, 2021 at 9:46 AM Matthias Pohl wrote: Hi everyone, After the discussion of deprecating the Mesos support went on for a while now in [1] and

[jira] [Created] (FLINK-22273) Add documentation for General Python Group Window Aggregation in Python Table API

2021-04-14 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-22273: Summary: Add documentation for General Python Group Window Aggregation in Python Table API Key: FLINK-22273 URL: https://issues.apache.org/jira/browse/FLINK-22273

Re: Using FileSystem SQL Connector to Commit Hive Partition Exception

2021-04-14 Thread Alessandro Solimando
Hi Chenzuoli, it seems that you are using Windows 10, you could follow this page to improve the screenshots quality:

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Till Rohrmann
+1 Cheers, Till On Wed, Apr 14, 2021 at 10:10 AM Konstantin Knauf wrote: > +1 > > On Wed, Apr 14, 2021 at 9:46 AM Matthias Pohl > wrote: > > > Hi everyone, > > After the discussion of deprecating the Mesos support went on for a while > > now in [1] and considering that we already plan to

Re: Using FileSystem SQL Connector to Commit Hive Partition Exception

2021-04-14 Thread Till Rohrmann
Hi Chenzuoli, The pictures are unfortunately not readable for me. Cheers, Till On Wed, Apr 14, 2021 at 3:31 AM chenzuoli wrote: > Download full resolution images > Available until May 14, 2021 > >

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Konstantin Knauf
+1 On Wed, Apr 14, 2021 at 9:46 AM Matthias Pohl wrote: > Hi everyone, > After the discussion of deprecating the Mesos support went on for a while > now in [1] and considering that we already plan to retire it mid-term [2], > I want to start a vote on deprecating the Mesos support in the Flink

Re: Add jobId and JobName variable to JobManager metrics in per-job deployment mode

2021-04-14 Thread Till Rohrmann
Hi Lu, thanks for reaching out to the dev community. I would suggest keeping the discussion on the JIRA ticket. Cheers, Till On Tue, Apr 13, 2021 at 11:59 PM Lu Niu wrote: > Hi, Flink dev > > Could you share your thoughts about > https://issues.apache.org/jira/browse/FLINK-22164 ? > >

[VOTE] Deprecating Mesos support

2021-04-14 Thread Matthias Pohl
Hi everyone, After the discussion of deprecating the Mesos support went on for a while now in [1] and considering that we already plan to retire it mid-term [2], I want to start a vote on deprecating the Mesos support in the Flink documentation as a next step. Ideally, we could even add this

[DISCUSS] Add checkpoint id in FLIP-27 source SplitEnumerator::snapshotState()

2021-04-14 Thread Zhou, Brian
Hi all, I'd like to start a discussion thread about adding a checkpointId parameter in the SplitEnumerator:: snapshotState() method [1] . This is required for Pravega Flink connector[2] FLIP-27 source implementation. We want to use the ExternallyInducedSourceReader, and it requires the split

Re: [BULK]Re: [SURVEY] Remove Mesos support

2021-04-14 Thread Matthias Pohl
Thanks for everyone's feedback. I'm gonna initiate a vote in a separate thread. On Mon, Mar 29, 2021 at 9:18 AM Robert Metzger wrote: > +1 > > > > On Mon, Mar 29, 2021 at 5:44 AM Yangze Guo wrote: > > > +1 > > > > Best, > > Yangze Guo > > > > On Mon, Mar 29, 2021 at 11:31 AM Xintong Song > >

[jira] [Created] (FLINK-22272) Some scenes can't drop table by hive catalog

2021-04-14 Thread wangzeyu (Jira)
wangzeyu created FLINK-22272: Summary: Some scenes can't drop table by hive catalog Key: FLINK-22272 URL: https://issues.apache.org/jira/browse/FLINK-22272 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22271) FlinkSQL Read Hive(parquet file) field does not exist

2021-04-14 Thread moran (Jira)
moran created FLINK-22271: - Summary: FlinkSQL Read Hive(parquet file) field does not exist Key: FLINK-22271 URL: https://issues.apache.org/jira/browse/FLINK-22271 Project: Flink Issue Type: Bug