Re: [VOTE] Multi-topics consuming from KafkaTableSource

2019-12-06 Thread Rong Rong
Hi Leo, Thanks for sharing the JIRA ticket and the idea of supporting multiple Kafka topic in KafkaTableSource. I've also commented on the JIRA ticket so sorry for joining the discussion late. My question was similar to @Jingsong's: 1. can you share some concrete examples on how this could

[jira] [Created] (FLINK-15121) Add public constructor/getter for execution environments that takes Configuration

2019-12-06 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-15121: Summary: Add public constructor/getter for execution environments that takes Configuration Key: FLINK-15121 URL: https://issues.apache.org/jira/browse/FLINK-15121

Re: [DISCUSS] Adding e2e tests for Flink's Mesos integration

2019-12-06 Thread Piyush Narang
+1 from our end as well. At Criteo, we are running some Flink jobs on Mesos in production to compute short term features for machine learning. We’d love to help out and contribute on this initiative. Thanks, -- Piyush From: Till Rohrmann Date: Friday, December 6, 2019 at 8:10 AM To: dev Cc:

[jira] [Created] (FLINK-15120) Make FlinkYarnCli#isActive() & #getApplicationId() respect config APPLICATION_ID

2019-12-06 Thread Kostas Kloudas (Jira)
Kostas Kloudas created FLINK-15120: -- Summary: Make FlinkYarnCli#isActive() & #getApplicationId() respect config APPLICATION_ID Key: FLINK-15120 URL: https://issues.apache.org/jira/browse/FLINK-15120

[jira] [Created] (FLINK-15119) Remove PlanExecutor and its subclasses

2019-12-06 Thread Kostas Kloudas (Jira)
Kostas Kloudas created FLINK-15119: -- Summary: Remove PlanExecutor and its subclasses Key: FLINK-15119 URL: https://issues.apache.org/jira/browse/FLINK-15119 Project: Flink Issue Type:

[jira] [Created] (FLINK-15118) Make flink-scala-shell use Executors

2019-12-06 Thread Kostas Kloudas (Jira)
Kostas Kloudas created FLINK-15118: -- Summary: Make flink-scala-shell use Executors Key: FLINK-15118 URL: https://issues.apache.org/jira/browse/FLINK-15118 Project: Flink Issue Type:

[jira] [Created] (FLINK-15117) JoinITCase.testFullJoinWithLeftLocalPred fails

2019-12-06 Thread Bowen Li (Jira)
Bowen Li created FLINK-15117: Summary: JoinITCase.testFullJoinWithLeftLocalPred fails Key: FLINK-15117 URL: https://issues.apache.org/jira/browse/FLINK-15117 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-15116) Make JobClient stateless, remove AutoCloseable

2019-12-06 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-15116: Summary: Make JobClient stateless, remove AutoCloseable Key: FLINK-15116 URL: https://issues.apache.org/jira/browse/FLINK-15116 Project: Flink Issue

[jira] [Created] (FLINK-15115) Drop Kafka 0.8/0.9

2019-12-06 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15115: Summary: Drop Kafka 0.8/0.9 Key: FLINK-15115 URL: https://issues.apache.org/jira/browse/FLINK-15115 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Drop Kafka 0.8/0.9

2019-12-06 Thread Thomas Weise
+1 On Fri, Dec 6, 2019 at 3:46 AM Benchao Li wrote: > +1 for dropping. > > Zhenghua Gao 于2019年12月5日周四 下午4:05写道: > > > +1 for dropping. > > > > *Best Regards,* > > *Zhenghua Gao* > > > > > > On Thu, Dec 5, 2019 at 11:08 AM Dian Fu wrote: > > > > > +1 for dropping them. > > > > > > Just FYI:

[jira] [Created] (FLINK-15114) Add execute result info for alter/create/drop database in sql client.

2019-12-06 Thread Terry Wang (Jira)
Terry Wang created FLINK-15114: -- Summary: Add execute result info for alter/create/drop database in sql client. Key: FLINK-15114 URL: https://issues.apache.org/jira/browse/FLINK-15114 Project: Flink

[jira] [Created] (FLINK-15113) fs.azure.account.key not hidden from global configuration

2019-12-06 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-15113: --- Summary: fs.azure.account.key not hidden from global configuration Key: FLINK-15113 URL: https://issues.apache.org/jira/browse/FLINK-15113 Project: Flink

[jira] [Created] (FLINK-15112) NPE when trying to join on two temporal tables in a single query

2019-12-06 Thread Chris Miller (Jira)
Chris Miller created FLINK-15112: Summary: NPE when trying to join on two temporal tables in a single query Key: FLINK-15112 URL: https://issues.apache.org/jira/browse/FLINK-15112 Project: Flink

[jira] [Created] (FLINK-15111) java.lang.RuntimeException for KafkaPartitionDiscoverer.getAllPartitionsForTopics(KafkaPartitionDiscoverer.java:80) when using SASL_SSL

2019-12-06 Thread Hunter Kempf (Jira)
Hunter Kempf created FLINK-15111: Summary: java.lang.RuntimeException for KafkaPartitionDiscoverer.getAllPartitionsForTopics(KafkaPartitionDiscoverer.java:80) when using SASL_SSL Key: FLINK-15111 URL:

[jira] [Created] (FLINK-15110) Support exclusions for variables

2019-12-06 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15110: Summary: Support exclusions for variables Key: FLINK-15110 URL: https://issues.apache.org/jira/browse/FLINK-15110 Project: Flink Issue Type: New

[jira] [Created] (FLINK-15109) InternalTimerServiceImpl references restored state after use, taking up resources unnecessarily

2019-12-06 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-15109: - Summary: InternalTimerServiceImpl references restored state after use, taking up resources unnecessarily Key: FLINK-15109 URL:

[jira] [Created] (FLINK-15108) SQL-CLI can not execute same query multiple times

2019-12-06 Thread Danny Chen (Jira)
Danny Chen created FLINK-15108: -- Summary: SQL-CLI can not execute same query multiple times Key: FLINK-15108 URL: https://issues.apache.org/jira/browse/FLINK-15108 Project: Flink Issue Type:

[jira] [Created] (FLINK-15107) SQL-CLI can not execute insert into statement with lowercase "INSERT INTO" keyword

2019-12-06 Thread Danny Chen (Jira)
Danny Chen created FLINK-15107: -- Summary: SQL-CLI can not execute insert into statement with lowercase "INSERT INTO" keyword Key: FLINK-15107 URL: https://issues.apache.org/jira/browse/FLINK-15107

[jira] [Created] (FLINK-15106) Hive 3.x tests leave metastore_db folder under build directory

2019-12-06 Thread Rui Li (Jira)
Rui Li created FLINK-15106: -- Summary: Hive 3.x tests leave metastore_db folder under build directory Key: FLINK-15106 URL: https://issues.apache.org/jira/browse/FLINK-15106 Project: Flink Issue

Re: [DISCUSS] Adding e2e tests for Flink's Mesos integration

2019-12-06 Thread Till Rohrmann
Big +1 for adding a fully working e2e test for Flink's Mesos integration. Ideally we would have it ready for the 1.10 release. The lack of such a test has bitten us already multiple times. In general I would prefer to use the official image if possible since it frees us from maintaining our own

[jira] [Created] (FLINK-15105) Resuming Externalized Checkpoint after terminal failure (rocks, incremental) end-to-end test stalls on travis

2019-12-06 Thread Yu Li (Jira)
Yu Li created FLINK-15105: - Summary: Resuming Externalized Checkpoint after terminal failure (rocks, incremental) end-to-end test stalls on travis Key: FLINK-15105 URL: https://issues.apache.org/jira/browse/FLINK-15105

[jira] [Created] (FLINK-15104) Performance regression on 4.12.2019 in RocksDB benchmarks

2019-12-06 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-15104: -- Summary: Performance regression on 4.12.2019 in RocksDB benchmarks Key: FLINK-15104 URL: https://issues.apache.org/jira/browse/FLINK-15104 Project: Flink

[jira] [Created] (FLINK-15103) Performance regression on 3.12.2019 in various benchmarks

2019-12-06 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-15103: -- Summary: Performance regression on 3.12.2019 in various benchmarks Key: FLINK-15103 URL: https://issues.apache.org/jira/browse/FLINK-15103 Project: Flink

[jira] [Created] (FLINK-15102) Allow users to construct a DataStream from a new Source API

2019-12-06 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-15102: Summary: Allow users to construct a DataStream from a new Source API Key: FLINK-15102 URL: https://issues.apache.org/jira/browse/FLINK-15102 Project: Flink

[jira] [Created] (FLINK-15101) Add the interface for SpiltEnumerator and implementation for SourceCoordinator

2019-12-06 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-15101: Summary: Add the interface for SpiltEnumerator and implementation for SourceCoordinator Key: FLINK-15101 URL: https://issues.apache.org/jira/browse/FLINK-15101

[jira] [Created] (FLINK-15100) Add the interface and base implementation for SourceReader.

2019-12-06 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-15100: Summary: Add the interface and base implementation for SourceReader. Key: FLINK-15100 URL: https://issues.apache.org/jira/browse/FLINK-15100 Project: Flink

[jira] [Created] (FLINK-15099) Implement OperatorEvent passing RPC.

2019-12-06 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-15099: Summary: Implement OperatorEvent passing RPC. Key: FLINK-15099 URL: https://issues.apache.org/jira/browse/FLINK-15099 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-15098) CsvTableSink has no properties of a OVERWRITE mode to write, but the exception hint the user use it when a file or directory already exists

2019-12-06 Thread xiaojin.wy (Jira)
xiaojin.wy created FLINK-15098: -- Summary: CsvTableSink has no properties of a OVERWRITE mode to write, but the exception hint the user use it when a file or directory already exists Key: FLINK-15098 URL:

Re: [DISCUSS] Drop Kafka 0.8/0.9

2019-12-06 Thread Benchao Li
+1 for dropping. Zhenghua Gao 于2019年12月5日周四 下午4:05写道: > +1 for dropping. > > *Best Regards,* > *Zhenghua Gao* > > > On Thu, Dec 5, 2019 at 11:08 AM Dian Fu wrote: > > > +1 for dropping them. > > > > Just FYI: there was a similar discussion few months ago [1]. > > > > [1] > > >

[DISCUSS] Adding e2e tests for Flink's Mesos integration

2019-12-06 Thread Yangze Guo
Hi, all, Currently, there is no end to end test or IT case for Mesos deployment while the common deployment related developing would inevitably touch the logic of this component. Thus, some work needs to be done to guarantee experience for both Meos users and contributors. After offline

[jira] [Created] (FLINK-15097) flink can not use user specified hdfs conf

2019-12-06 Thread qian wang (Jira)
qian wang created FLINK-15097: - Summary: flink can not use user specified hdfs conf Key: FLINK-15097 URL: https://issues.apache.org/jira/browse/FLINK-15097 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-15096) Do not use GlobalJobParameters to pass system configuration

2019-12-06 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-15096: Summary: Do not use GlobalJobParameters to pass system configuration Key: FLINK-15096 URL: https://issues.apache.org/jira/browse/FLINK-15096 Project: Flink

[jira] [Created] (FLINK-15095) bridge table schema's primary key to metadata handler in blink planner

2019-12-06 Thread godfrey he (Jira)
godfrey he created FLINK-15095: -- Summary: bridge table schema's primary key to metadata handler in blink planner Key: FLINK-15095 URL: https://issues.apache.org/jira/browse/FLINK-15095 Project: Flink

[jira] [Created] (FLINK-15094) Warning about using private constructor of java.nio.DirectByteBuffer in Java 11

2019-12-06 Thread Andrey Zagrebin (Jira)
Andrey Zagrebin created FLINK-15094: --- Summary: Warning about using private constructor of java.nio.DirectByteBuffer in Java 11 Key: FLINK-15094 URL: https://issues.apache.org/jira/browse/FLINK-15094

[jira] [Created] (FLINK-15093) FLINK-13708 still exist in StreamExecutionEnvironment

2019-12-06 Thread Jeff Zhang (Jira)
Jeff Zhang created FLINK-15093: -- Summary: FLINK-13708 still exist in StreamExecutionEnvironment Key: FLINK-15093 URL: https://issues.apache.org/jira/browse/FLINK-15093 Project: Flink Issue

[jira] [Created] (FLINK-15092) Using sql-client excute sql(select sum(cast(null as int)) from t123;) has a TableException

2019-12-06 Thread xiaojin.wy (Jira)
xiaojin.wy created FLINK-15092: -- Summary: Using sql-client excute sql(select sum(cast(null as int)) from t123;) has a TableException Key: FLINK-15092 URL: https://issues.apache.org/jira/browse/FLINK-15092