Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Zhijiang
+1 for extending the feature freeze until May 15th. Best, Zhijiang -- From:Danny Chan Send Time:2020 Apr. 24 (Fri.) 10:51 To:dev Subject:Re: [DISCUSS] Exact feature freeze date +1 for extending the feature freeze until May 15th.

[jira] [Created] (FLINK-17364) Support StreamingFileSink in PrestoS3FileSystem

2020-04-23 Thread Lu Niu (Jira)
Lu Niu created FLINK-17364: -- Summary: Support StreamingFileSink in PrestoS3FileSystem Key: FLINK-17364 URL: https://issues.apache.org/jira/browse/FLINK-17364 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-17363) Asynchronous association dimension table timeout

2020-04-23 Thread robert (Jira)
robert created FLINK-17363: -- Summary: Asynchronous association dimension table timeout Key: FLINK-17363 URL: https://issues.apache.org/jira/browse/FLINK-17363 Project: Flink Issue Type: Bug

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Danny Chan
+1 for extending the feature freeze until May 15th. Best, Danny Chan 在 2020年4月24日 +0800 AM9:51,Yangze Guo ,写道: > +1 > > Best, > Yangze Guo > > On Fri, Apr 24, 2020 at 9:49 AM Dian Fu wrote: > > > > +1 > > > > Regards, > > Dian > > > > > 在 2020年4月24日,上午9:47,Leonard Xu 写道: > > > > > > + 1 for the

[RESULT][VOTE] Release 1.9.3, release candidate #1

2020-04-23 Thread Dian Fu
Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 9 approving votes, 4 of which are binding: * Robert (binding) * Ufuk (binding) * Dawid (binding) * Jincheng (binding) * Yu * ZhuZhu * Fabian * Leonard Xu * Dian There are no disapproving votes. Thanks

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-23 Thread Dian Fu
Thanks Jincheng for the help. :) Thanks, Dian > 在 2020年4月24日,上午9:49,jincheng sun 写道: > > +1(binding) > > with the check of built form the source and run some test case. > > BTW: I added you(dianfu) as a PyPI maintainer of Apache Flink. > > Best, > Jincheng > > > Dawid Wysakowicz

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Yangze Guo
+1 Best, Yangze Guo On Fri, Apr 24, 2020 at 9:49 AM Dian Fu wrote: > > +1 > > Regards, > Dian > > > 在 2020年4月24日,上午9:47,Leonard Xu 写道: > > > > + 1 for the feature freeze date > > > > Best, > > Leonard Xu > > > > > >> 在 2020年4月24日,09:32,Jingsong Li 写道: > >> > >> +1 > >> > >> Best, > >>

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-23 Thread Dian Fu
Hi all, Thanks a lot for checking and voting for this release! I’ll summarize the result in another email. Thanks, Dian > 在 2020年4月23日,下午7:43,Dawid Wysakowicz 写道: > > +1 (binding) > > - verified checksums and signatures > > - verified no binary artifacts in source release > > - reviewed

[jira] [Created] (FLINK-17362) Improve table examples to reflect latest status

2020-04-23 Thread Kurt Young (Jira)
Kurt Young created FLINK-17362: -- Summary: Improve table examples to reflect latest status Key: FLINK-17362 URL: https://issues.apache.org/jira/browse/FLINK-17362 Project: Flink Issue Type:

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-23 Thread jincheng sun
+1(binding) with the check of built form the source and run some test case. BTW: I added you(dianfu) as a PyPI maintainer of Apache Flink. Best, Jincheng Dawid Wysakowicz 于2020年4月23日周四 下午7:43写道: > +1 (binding) > > - verified checksums and signatures > > - verified no binary artifacts in

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Dian Fu
+1 Regards, Dian > 在 2020年4月24日,上午9:47,Leonard Xu 写道: > > + 1 for the feature freeze date > > Best, > Leonard Xu > > >> 在 2020年4月24日,09:32,Jingsong Li 写道: >> >> +1 >> >> Best, >> Jingsong Lee >> >> On Fri, Apr 24, 2020 at 2:27 AM Zhu Zhu wrote: >> >>> +1 for extending the code freeze

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Leonard Xu
+ 1 for the feature freeze date Best, Leonard Xu > 在 2020年4月24日,09:32,Jingsong Li 写道: > > +1 > > Best, > Jingsong Lee > > On Fri, Apr 24, 2020 at 2:27 AM Zhu Zhu wrote: > >> +1 for extending the code freeze date. >> FLIP-119 could benefit from it. >> May 15th sounds reasonable. >> >>

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Jingsong Li
+1 Best, Jingsong Lee On Fri, Apr 24, 2020 at 2:27 AM Zhu Zhu wrote: > +1 for extending the code freeze date. > FLIP-119 could benefit from it. > May 15th sounds reasonable. > > Thanks, > Zhu Zhu > > Jark Wu 于2020年4月24日周五 上午12:01写道: > > > +1 > > > > Thanks, > > Jark > > > > On Thu, 23 Apr

Re: [DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

2020-04-23 Thread Becket Qin
Hi Xuannan, Thanks for picking up the FLIP. It looks good to me overall. Some quick comments / questions below: 1. Do we also need changes in the Java API? 2. What are the cases that users may want to retry reading the intermediate result? It seems that once the intermediate result has gone, it

[jira] [Created] (FLINK-17361) Support creating of a JDBC table using a custom query

2020-04-23 Thread Flavio Pompermaier (Jira)
Flavio Pompermaier created FLINK-17361: -- Summary: Support creating of a JDBC table using a custom query Key: FLINK-17361 URL: https://issues.apache.org/jira/browse/FLINK-17361 Project: Flink

[jira] [Created] (FLINK-17360) Support custom partitioners in JDBCReadOptions

2020-04-23 Thread Flavio Pompermaier (Jira)
Flavio Pompermaier created FLINK-17360: -- Summary: Support custom partitioners in JDBCReadOptions Key: FLINK-17360 URL: https://issues.apache.org/jira/browse/FLINK-17360 Project: Flink

[jira] [Created] (FLINK-17359) Entropy key is not resolved if flink-s3-fs-hadoop is added as a plugin

2020-04-23 Thread Prem Santosh (Jira)
Prem Santosh created FLINK-17359: Summary: Entropy key is not resolved if flink-s3-fs-hadoop is added as a plugin Key: FLINK-17359 URL: https://issues.apache.org/jira/browse/FLINK-17359 Project:

[jira] [Created] (FLINK-17358) JDBCTableSource support FiltertableTableSource

2020-04-23 Thread Flavio Pompermaier (Jira)
Flavio Pompermaier created FLINK-17358: -- Summary: JDBCTableSource support FiltertableTableSource Key: FLINK-17358 URL: https://issues.apache.org/jira/browse/FLINK-17358 Project: Flink

[jira] [Created] (FLINK-17357) add "DROP catalog" DDL to blink planner

2020-04-23 Thread Flavio Pompermaier (Jira)
Flavio Pompermaier created FLINK-17357: -- Summary: add "DROP catalog" DDL to blink planner Key: FLINK-17357 URL: https://issues.apache.org/jira/browse/FLINK-17357 Project: Flink Issue

[jira] [Created] (FLINK-17356) Properly set constraints (PK and UNIQUE)

2020-04-23 Thread Flavio Pompermaier (Jira)
Flavio Pompermaier created FLINK-17356: -- Summary: Properly set constraints (PK and UNIQUE) Key: FLINK-17356 URL: https://issues.apache.org/jira/browse/FLINK-17356 Project: Flink Issue

[jira] [Created] (FLINK-17355) Exactly once kafka checkpointing sensitive to single node failures

2020-04-23 Thread Teng Fei Liao (Jira)
Teng Fei Liao created FLINK-17355: - Summary: Exactly once kafka checkpointing sensitive to single node failures Key: FLINK-17355 URL: https://issues.apache.org/jira/browse/FLINK-17355 Project: Flink

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Zhu Zhu
+1 for extending the code freeze date. FLIP-119 could benefit from it. May 15th sounds reasonable. Thanks, Zhu Zhu Jark Wu 于2020年4月24日周五 上午12:01写道: > +1 > > Thanks, > Jark > > On Thu, 23 Apr 2020 at 22:36, Xintong Song wrote: > > > +1 > > From our side we can also benefit from the extending

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Jark Wu
+1 Thanks, Jark On Thu, 23 Apr 2020 at 22:36, Xintong Song wrote: > +1 > From our side we can also benefit from the extending of feature freeze, for > pluggable slot allocation, GPU support and perjob mode on Kubernetes > deployment. > > Thank you~ > > Xintong Song > > > > On Thu, Apr 23, 2020

[jira] [Created] (FLINK-17354) Introduce range sort for batch sort operator in blink

2020-04-23 Thread Benchao Li (Jira)
Benchao Li created FLINK-17354: -- Summary: Introduce range sort for batch sort operator in blink Key: FLINK-17354 URL: https://issues.apache.org/jira/browse/FLINK-17354 Project: Flink Issue

[jira] [Created] (FLINK-17353) Broken links in Flink docs master

2020-04-23 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-17353: Summary: Broken links in Flink docs master Key: FLINK-17353 URL: https://issues.apache.org/jira/browse/FLINK-17353 Project: Flink Issue Type: Bug

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Xintong Song
+1 >From our side we can also benefit from the extending of feature freeze, for pluggable slot allocation, GPU support and perjob mode on Kubernetes deployment. Thank you~ Xintong Song On Thu, Apr 23, 2020 at 10:31 PM Timo Walther wrote: > From the SQL side, I'm sure that FLIP-95 and

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Timo Walther
From the SQL side, I'm sure that FLIP-95 and FLIP-105 could benefit from extending the feature freeze. Thanks, Timo On 23.04.20 16:11, Aljoscha Krettek wrote: +1 Aljoscha On 23.04.20 15:23, Till Rohrmann wrote: +1 for extending the feature freeze until May 15th. Cheers, Till On Thu, Apr

Re: [DISCUSS] Removing deprecated state methods in 1.11

2020-04-23 Thread Aljoscha Krettek
Definitely +1! I'm always game for decreasing the API surface if it doesn't decrease functionality. Aljoscha On 23.04.20 14:18, DONG, Weike wrote: Hi Stephan, +1 for the removal, as there are so many deprecated methods scattered around, making APIs a little bit messy and confusing. Best,

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Aljoscha Krettek
+1 Aljoscha On 23.04.20 15:23, Till Rohrmann wrote: +1 for extending the feature freeze until May 15th. Cheers, Till On Thu, Apr 23, 2020 at 1:00 PM Piotr Nowojski wrote: Hi Stephan, As release manager I’ve seen that quite a bit of features could use of the extra couple of weeks. This

Re: [PROPOSAL] Google Season of Docs 2020.

2020-04-23 Thread Marta Paes Moreira
Hi, Manish. If you would like to contribute to Flink, please read the "How to Contribute" section on the website [1]. This thread has a different scope. Feel free to reach out (in a separate thread) if you have any questions. Marta [1]

Re: [PROPOSAL] Google Season of Docs 2020.

2020-04-23 Thread Manish G
Hi, I would also like to contribute to documentation and unit testing. Please let me know. Manish On Thu, Apr 23, 2020 at 7:08 PM Marta Paes Moreira wrote: > > Thanks for the feedback! > > So far, the projects on the table are: > >1. Improving the Table API/SQL documentation. >2.

Re: [PROPOSAL] Google Season of Docs 2020.

2020-04-23 Thread Marta Paes Moreira
Thanks for the feedback! So far, the projects on the table are: 1. Improving the Table API/SQL documentation. 2. Improving the documentation about Deployments. 3. Restructuring and standardizing the documentation about Connectors. 4. Finishing the Chinese translation. I think 2.

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Till Rohrmann
+1 for extending the feature freeze until May 15th. Cheers, Till On Thu, Apr 23, 2020 at 1:00 PM Piotr Nowojski wrote: > Hi Stephan, > > As release manager I’ve seen that quite a bit of features could use of the > extra couple of weeks. This also includes some features that I’m involved >

[jira] [Created] (FLINK-17352) All doc links w/ site.baseurl & link tag are broken

2020-04-23 Thread David Anderson (Jira)
David Anderson created FLINK-17352: -- Summary: All doc links w/ site.baseurl & link tag are broken Key: FLINK-17352 URL: https://issues.apache.org/jira/browse/FLINK-17352 Project: Flink

Re: [DISCUSS] FLIP-124: Add open/close and Collector to (De)SerializationSchema

2020-04-23 Thread Stephan Ewen
Hi! Sorry for being a bit late to the party. One very important thing to consider for "serialization under checkpoint lock or not" is: - If you do it under checkpoint lock, things are automatically correct. Checkpoint barriers go between original records that correspond to offsets in the

[jira] [Created] (FLINK-17351) CheckpointCoordinator and CheckpointFailureManager ignores checkpoint timeouts

2020-04-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17351: -- Summary: CheckpointCoordinator and CheckpointFailureManager ignores checkpoint timeouts Key: FLINK-17351 URL: https://issues.apache.org/jira/browse/FLINK-17351

[jira] [Created] (FLINK-17350) StreamTask should always fail immediately on failures in synchronous part of a checkpoint

2020-04-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17350: -- Summary: StreamTask should always fail immediately on failures in synchronous part of a checkpoint Key: FLINK-17350 URL: https://issues.apache.org/jira/browse/FLINK-17350

[jira] [Created] (FLINK-17349) Reduce runtime of LocalExecutorITCase

2020-04-23 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-17349: Summary: Reduce runtime of LocalExecutorITCase Key: FLINK-17349 URL: https://issues.apache.org/jira/browse/FLINK-17349 Project: Flink Issue Type:

Re: [DISCUSS] Removing deprecated state methods in 1.11

2020-04-23 Thread DONG, Weike
Hi Stephan, +1 for the removal, as there are so many deprecated methods scattered around, making APIs a little bit messy and confusing. Best, Weike Stephan Ewen 于2020年4月23日 周四下午8:07写道: > Hi all! > > There are a bunch of deprecated methods for state access: > > -

[DISCUSS] Removing deprecated state methods in 1.11

2020-04-23 Thread Stephan Ewen
Hi all! There are a bunch of deprecated methods for state access: - RuntimeContext.getFoldingState(...) - OperatorStateStore.getSerializableListState(...) - OperatorStateStore.getOperatorState(...) All of them have been deprecated for around three years now. All have good alternatives.

[jira] [Created] (FLINK-17348) Expose metric group to ascendingTimestampExtractor

2020-04-23 Thread Theo Diefenthal (Jira)
Theo Diefenthal created FLINK-17348: --- Summary: Expose metric group to ascendingTimestampExtractor Key: FLINK-17348 URL: https://issues.apache.org/jira/browse/FLINK-17348 Project: Flink

Re: Contribution

2020-04-23 Thread Caizhi Weng
Hi Manish! Glad to hear that you're willing to contribute! All of our current tasks are on the JIRA issue list ( https://issues.apache.org/jira/projects/FLINK/issues). Feel free to pick what you like and start discussing and coding. Manish G 于2020年4月23日周四 下午7:35写道: > Hi All, > > I have just

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-23 Thread Dawid Wysakowicz
+1 (binding) - verified checksums and signatures - verified no binary artifacts in source release - reviewed the website PR - built from source - checked diff of source release between 1.9.2 for changes in licenses and dependencies - started standalone cluster and run StreamSQLExample Best,

Contribution

2020-04-23 Thread Manish G
Hi All, I have just joined the dev list. I would like to contribute in my capacity as a programmer. Please let me know if I can be helpful to any of the current task. Manish

[DISCUSS] Move docker development into versioned branches

2020-04-23 Thread Chesnay Schepler
Hello everyone, Currently, all development in docker-flink occurs on the master branch, for all releases at once. The master branch also serves as a publishing area for our docker files. This means that all versions share the same generators, templates (i.e., production code that we plugin

Re: Reading a single input file in parallel?

2020-04-23 Thread Niels Basjes
Hi, Yes, you are correct. Flink does use a minSplitSize to determine the splits. I missed that part. Also this is the part I do not intend to change. In this I would focus on essentially: - "is splittable" is decided per file --> Similar to Hadoop: Both a codec and fileformat get a

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Piotr Nowojski
Hi Stephan, As release manager I’ve seen that quite a bit of features could use of the extra couple of weeks. This also includes some features that I’m involved with, like FLIP-76, or limiting the in-flight buffers. +1 From my side for extending the feature freeze until May 15th. Piotrek >

[GitHub] [flink-web] dianfu commented on issue #329: Add Apache Flink release 1.9.3

2020-04-23 Thread GitBox
dianfu commented on issue #329: URL: https://github.com/apache/flink-web/pull/329#issuecomment-618330787 @carp84 @uce Thanks a lot for the review. I will update the post date and release date before merging this PR. This is

[jira] [Created] (FLINK-17347) upgrade to latest angular version

2020-04-23 Thread Yadong Xie (Jira)
Yadong Xie created FLINK-17347: -- Summary: upgrade to latest angular version Key: FLINK-17347 URL: https://issues.apache.org/jira/browse/FLINK-17347 Project: Flink Issue Type: Improvement

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-23 Thread Ufuk Celebi
+1 (binding) - checked release notes ✅ - verified sums and hashes ✅ - verified no binary artifacts in source release ✅ - reviewed website PR ✅ - built from source ✅ - built an internal Flink distribution based on the 1.9.3-rc1 commit ✅ - built internal jobs against the staging repo ✅ - deployed

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-23 Thread Chesnay Schepler
This would only work so long as all Hadoop APIs do not directly expose any transitive non-hadoop dependency. Otherwise the user code classloader might search for this transitive dependency in lib instead of the hadoop classpath (and possibly not find it). On 23/04/2020 11:34, Stephan Ewen

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-23 Thread Stephan Ewen
True, connectors built on Hadoop make this a bit more complex. That is also the reason why Hadoop is on the "parent first" patterns. Maybe this is a bit of a wild thought, but what would happen if we had a "first class" notion of a Hadoop Classloader in the system, and the user code classloader

Re: Reading a single input file in parallel?

2020-04-23 Thread Jingsong Li
Hi Niels, Thanks for start this discussion. Share some thought about your questions/proposals. > Judge whether splittable for each individual file Looks good to me. > BZIP2 support splittable Looks good to me. > the Flink implementation is controlled by the number of splits Can you check

[DISCUSS] Add a custom label on MetricReporter like PrometheusPushGatewayReporter's groupingKey

2020-04-23 Thread jinhai wang
Hi all We need add some custom labels on MetricReporter. We can add groupingKey to PrometheusPushGatewayReporter in version 1.10, but not in PrometheusReporter. Can we add several methods to the interface MetricReporter to support? Best Regards jinhai...@gmail.com

[jira] [Created] (FLINK-17346) Deduplicate process setup in docker tests

2020-04-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17346: Summary: Deduplicate process setup in docker tests Key: FLINK-17346 URL: https://issues.apache.org/jira/browse/FLINK-17346 Project: Flink Issue

[jira] [Created] (FLINK-17345) Support registering and getting Python UDF in HiveCatalog

2020-04-23 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-17345: - Summary: Support registering and getting Python UDF in HiveCatalog Key: FLINK-17345 URL: https://issues.apache.org/jira/browse/FLINK-17345 Project: Flink Issue

[jira] [Created] (FLINK-17344) RecordWriterTest.testIdleTime possibly deadlocks on Travis

2020-04-23 Thread Andrey Zagrebin (Jira)
Andrey Zagrebin created FLINK-17344: --- Summary: RecordWriterTest.testIdleTime possibly deadlocks on Travis Key: FLINK-17344 URL: https://issues.apache.org/jira/browse/FLINK-17344 Project: Flink

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-23 Thread Robert Metzger
+1 (binding) - for license documentation, I checked the diff between 1.9.2 and 1.9.3: https://github.com/apache/flink/compare/release-1.9.2...release-1.9.3-rc1 - Kafka dependency changed from 0.10.2.1 to 0.10.2.2 --> License doc was updated in PR https://github.com/apache/flink/pull/11617/files

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-23 Thread Chesnay Schepler
although, if you can load the HADOOP_CLASSPATH as a plugin, then you can also load it in the user-code classloader. On 23/04/2020 10:50, Chesnay Schepler wrote: @Stephan I'm not aware of anyone having tried that; possibly since we have various connectors that require hadoop (hadoop-compat,

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-23 Thread Chesnay Schepler
@Stephan I'm not aware of anyone having tried that; possibly since we have various connectors that require hadoop (hadoop-compat, hive, orc/parquet/hbase, hadoop inputformats). This would require connectors to be loaded as plugins (or having access to the plugin classloader) to be feasible.

[jira] [Created] (FLINK-17343) Add doc for retraction behavior for all operators

2020-04-23 Thread Benchao Li (Jira)
Benchao Li created FLINK-17343: -- Summary: Add doc for retraction behavior for all operators Key: FLINK-17343 URL: https://issues.apache.org/jira/browse/FLINK-17343 Project: Flink Issue Type:

[jira] [Created] (FLINK-17342) Schedule savepoint if max-inflight-checkpoints limit is reached isntead of forcing (in UC mode)

2020-04-23 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17342: - Summary: Schedule savepoint if max-inflight-checkpoints limit is reached isntead of forcing (in UC mode) Key: FLINK-17342 URL:

[jira] [Created] (FLINK-17341) freeSlot in TaskExecutor.closeJobManagerConnection cause ConcurrentModificationException

2020-04-23 Thread huweihua (Jira)
huweihua created FLINK-17341: Summary: freeSlot in TaskExecutor.closeJobManagerConnection cause ConcurrentModificationException Key: FLINK-17341 URL: https://issues.apache.org/jira/browse/FLINK-17341

[jira] [Created] (FLINK-17340) Update docs which related to default planner changes

2020-04-23 Thread Kurt Young (Jira)
Kurt Young created FLINK-17340: -- Summary: Update docs which related to default planner changes Key: FLINK-17340 URL: https://issues.apache.org/jira/browse/FLINK-17340 Project: Flink Issue Type:

[jira] [Created] (FLINK-17339) Change default planner to blink and update test cases in both planners

2020-04-23 Thread Kurt Young (Jira)
Kurt Young created FLINK-17339: -- Summary: Change default planner to blink and update test cases in both planners Key: FLINK-17339 URL: https://issues.apache.org/jira/browse/FLINK-17339 Project: Flink

Re: Reading a single input file in parallel?

2020-04-23 Thread Niels Basjes
Hi, I wanted to spend some time on this idea I asked about a year ago. So I had a look at the actual code and found this where the file splits are calculated https://github.com/apache/flink/blob/master/flink-core/src/main/java/org/apache/flink/api/common/io/FileInputFormat.java#L601 What I

[DISCUSS] Exact feature freeze date

2020-04-23 Thread Stephan Ewen
Hi all! I want to bring up a discussion about when we want to do the feature freeze for 1.11. When kicking off the release cycle, we tentatively set the date to end of April, which would be in one week. I can say from the features I am involved with (FLIP-27, FLIP-115, reviewing some state

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-23 Thread Stephan Ewen
Hi all! +1 for the simplification of dropping hadoop-shaded Have we ever investigated how much work it would be to load the HADOOP_CLASSPATH through the plugin loader? Then Hadoop's crazy dependency footprint would not spoil the main classpath. - HDFS might be very simple, because file

Re: Flink dev blog

2020-04-23 Thread Robert Metzger
Hey all, I wanted to remind everybody that we've started this nice initiative with the "Flink Engine Room" / dev blog. It would be great if we could start filling it with more content. In my opinion, the blog posts can be fairly unpolished, as it's more important to share the knowledge than to

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-04-23 Thread Robert Metzger
FYI: I have moved the Flink PR and master builds from my personal Azure account to a PMC controlled account: https://dev.azure.com/apache-flink/apache-flink/_build On Fri, Apr 17, 2020 at 8:28 PM Robert Metzger wrote: > Thanks a lot for bringing up this topic again. > The reason why I was

[jira] [Created] (FLINK-17338) LocalExecutorITCase.testBatchQueryCancel test timeout

2020-04-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17338: -- Summary: LocalExecutorITCase.testBatchQueryCancel test timeout Key: FLINK-17338 URL: https://issues.apache.org/jira/browse/FLINK-17338 Project: Flink

[jira] [Created] (FLINK-17337) Send UPDATE messages instead of INSERT and DELETE in streaming join operator

2020-04-23 Thread Jark Wu (Jira)
Jark Wu created FLINK-17337: --- Summary: Send UPDATE messages instead of INSERT and DELETE in streaming join operator Key: FLINK-17337 URL: https://issues.apache.org/jira/browse/FLINK-17337 Project: Flink

[jira] [Created] (FLINK-17336) MVN exited with EXIT CODE: 143. in "libraries" test job

2020-04-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17336: -- Summary: MVN exited with EXIT CODE: 143. in "libraries" test job Key: FLINK-17336 URL: https://issues.apache.org/jira/browse/FLINK-17336 Project: Flink