Re: No SchemaValidator When switch to blink table planner.

2019-07-16 Thread kaka chen
Hi Danny, Thanks for quick reply. I replace the flink planner to blink planner deps in the kafka-connector pom file, and run the unit test. It throws errors which I found in class KafkaTableSourceSinkFactoryBase, it use SchemaValidator class which only exists flink-planner, not blink-planner.

[jira] [Created] (FLINK-13286) Port SchemaValidator and others validators to table-common

2019-07-16 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-13286: Summary: Port SchemaValidator and others validators to table-common Key: FLINK-13286 URL: https://issues.apache.org/jira/browse/FLINK-13286 Project: Flink

[jira] [Created] (FLINK-13287) Port ExistingField to api-java and use new Expression in FieldComputer

2019-07-16 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-13287: Summary: Port ExistingField to api-java and use new Expression in FieldComputer Key: FLINK-13287 URL: https://issues.apache.org/jira/browse/FLINK-13287 Project:

blink planner issue

2019-07-16 Thread kaka chen
Hi All, We are trying to switch to blink table planner in HBase connector, which found the following error: Running org.apache.flink.addons.hbase.HBaseSinkITCase Formatting using clusterid: testClusterID Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 28.042 sec <<< FAILURE!

Re: No SchemaValidator When switch to blink table planner.

2019-07-16 Thread kaka chen
Hi Jingsong: Thanks very much. Thanks, Kaka Chen JingsongLee 于2019年7月16日周二 下午5:03写道: > Hi kaka: > Yeah, there are still some problems, I create a JIRA[1] to trace it, I > think we should solve it before 1.9 release. > > [1] https://issues.apache.org/jira/browse/FLINK-13285 > > Best,

No SchemaValidator When switch to blink table planner.

2019-07-16 Thread kaka chen
Hi All, We are trying to switch to blink table planner in Kafka's connector, but found there is no SchemaValidator and related classes, how to resolve it? Thanks. Thanks, Kaka Chen

[jira] [Created] (FLINK-13285) Connectors need to get rid of flink-table-planner dependence

2019-07-16 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-13285: Summary: Connectors need to get rid of flink-table-planner dependence Key: FLINK-13285 URL: https://issues.apache.org/jira/browse/FLINK-13285 Project: Flink

Re: No SchemaValidator When switch to blink table planner.

2019-07-16 Thread Danny Chan
How do you use the Kafka connector, through the TableEnvironment#sqlUpdate (the DDL), or through the TableEnvironment#connect() (the table api) ? Best, Danny Chan 在 2019年7月16日 +0800 PM4:41,kaka chen ,写道: > Hi All, > > We are trying to switch to blink table planner in Kafka's connector, but >

Re: No SchemaValidator When switch to blink table planner.

2019-07-16 Thread JingsongLee
Hi kaka: Yeah, there are still some problems, I create a JIRA[1] to trace it, I think we should solve it before 1.9 release. [1] https://issues.apache.org/jira/browse/FLINK-13285 Best, JingsongLee -- From:kaka chen Send

Re: Flink benchmark Jenkins is broken due to missing 1.10 snapshots

2019-07-16 Thread Chesnay Schepler
Done. On 16/07/2019 12:47, Haibo Sun wrote:  `flink-tests_2.11:jar:tests:1.10-SNAPSHOT` was not deployed because the JIRA (https://issues.apache.org/jira/browse/FLINK-12602) changed the `artifactId` of `flink-tests` from `flink-tests_${scala.binary.version}` to `flink-tests`. I have

[jira] [Created] (FLINK-13288) Blink planner doesn't compile with Scala 2.12

2019-07-16 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-13288: Summary: Blink planner doesn't compile with Scala 2.12 Key: FLINK-13288 URL: https://issues.apache.org/jira/browse/FLINK-13288 Project: Flink Issue

Re: blink planner issue

2019-07-16 Thread kaka chen
I am looking this issue, the related codes which throw errors are: SinkCodeGenerator:: validateFieldType() ... // Tuple/Case class/Row type requested case tt: TupleTypeInfoBase[_] => fieldTypes.zipWithIndex foreach { case (fieldTypeInfo:

Re: blink planner issue

2019-07-16 Thread Jark Wu
Hi Kaka, Thanks for reporting this. We didn't cover integrate tests for connectors yet because of FLINK-13276. We will cover that after FLINK-13276 is fixed. The problem you raised might because we misused `LogicalType.equals` which will checks field names as well. I have created an issue

Re: blink planner issue

2019-07-16 Thread kaka chen
Hi Caizhi and Jark, I think you are correct, from the quick view for source code, it should only compares field types in the equals method. Currently some composite logical row type has compared name and description, such as RowType and StructuredType. Thanks, Kaka Chen Caizhi Weng

[jira] [Created] (FLINK-13290) Add IT cases for HBase connnector using blink planner

2019-07-16 Thread Jark Wu (JIRA)
Jark Wu created FLINK-13290: --- Summary: Add IT cases for HBase connnector using blink planner Key: FLINK-13290 URL: https://issues.apache.org/jira/browse/FLINK-13290 Project: Flink Issue Type:

Re: blink planner issue

2019-07-16 Thread Caizhi Weng
Hi Kaka and Jark, On a side note, `RowTypeInfo` only compares field types in its `equals` method. I think our new logical row type shouldn't break this behavior. kaka chen 于2019年7月16日周二 下午10:53写道: > Hi Jark, > > Thanks! > > Thanks, > Kaka Chen > > Jark Wu 于2019年7月16日周二 下午10:30写道: > > > Hi

Re: blink planner issue

2019-07-16 Thread kaka chen
Hi Jark, Thanks! Thanks, Kaka Chen Jark Wu 于2019年7月16日周二 下午10:30写道: > Hi Kaka, > > Thanks for reporting this. We didn't cover integrate tests for connectors > yet because of FLINK-13276. We will cover that after FLINK-13276 is fixed. > > The problem you raised might because we misused

[jira] [Created] (FLINK-13292) NullPointerException when reading a string field in a nested struct from an Orc file.

2019-07-16 Thread Alejandro Sellero (JIRA)
Alejandro Sellero created FLINK-13292: - Summary: NullPointerException when reading a string field in a nested struct from an Orc file. Key: FLINK-13292 URL: https://issues.apache.org/jira/browse/FLINK-13292

[jira] [Created] (FLINK-13294) disable LocalExecutorITCase.testUseCatalogAndUseDatabase

2019-07-16 Thread Bowen Li (JIRA)
Bowen Li created FLINK-13294: Summary: disable LocalExecutorITCase.testUseCatalogAndUseDatabase Key: FLINK-13294 URL: https://issues.apache.org/jira/browse/FLINK-13294 Project: Flink Issue Type:

[jira] [Created] (FLINK-13291) Cannot Privide AWS Direct Connect ENDPOINT

2019-07-16 Thread Shakir Poolakkal Mukkath (JIRA)
Shakir Poolakkal Mukkath created FLINK-13291: Summary: Cannot Privide AWS Direct Connect ENDPOINT Key: FLINK-13291 URL: https://issues.apache.org/jira/browse/FLINK-13291 Project: Flink

Re: blink planner issue

2019-07-16 Thread kaka chen
Hi Caizhi and Mark, I think you are correct, from the quick view for source code, it should only compares field types in the equals method. Currently some composite logical row type has compared name and description, such as RowType and StructuredType. Thanks, Kaka Chen Caizhi Weng

[jira] [Created] (FLINK-13298) write Chinese documentation and quickstart for Flink-Hive compatibility

2019-07-16 Thread Bowen Li (JIRA)
Bowen Li created FLINK-13298: Summary: write Chinese documentation and quickstart for Flink-Hive compatibility Key: FLINK-13298 URL: https://issues.apache.org/jira/browse/FLINK-13298 Project: Flink

Re: blink planner issue

2019-07-16 Thread Jark Wu
Hi Caizhi and Kaka, Actually, equals-with-field-names and equals-without-field-names are both needed in Flink SQL. It's not correct to ignore field names comparison simply in RowType#equals. We have encountered this problems before because RowTypeInfo doesn't compare field names (see

[jira] [Created] (FLINK-13296) FunctionCatalog.lookupFunction() should check in memory functions if the target function doesn't exist in catalog

2019-07-16 Thread Bowen Li (JIRA)
Bowen Li created FLINK-13296: Summary: FunctionCatalog.lookupFunction() should check in memory functions if the target function doesn't exist in catalog Key: FLINK-13296 URL:

[jira] [Created] (FLINK-13295) set current catalog and database after registering tables and views in SQL CLI

2019-07-16 Thread Bowen Li (JIRA)
Bowen Li created FLINK-13295: Summary: set current catalog and database after registering tables and views in SQL CLI Key: FLINK-13295 URL: https://issues.apache.org/jira/browse/FLINK-13295 Project:

[jira] [Created] (FLINK-13297) Flink SQL should be able to reference functions across catalogs with full path

2019-07-16 Thread Bowen Li (JIRA)
Bowen Li created FLINK-13297: Summary: Flink SQL should be able to reference functions across catalogs with full path Key: FLINK-13297 URL: https://issues.apache.org/jira/browse/FLINK-13297 Project:

[jira] [Created] (FLINK-13289) Blink Planner JDBCUpsertTableSink : UnsupportedOperationException "JDBCUpsertTableSink can not support "

2019-07-16 Thread LakeShen (JIRA)
LakeShen created FLINK-13289: Summary: Blink Planner JDBCUpsertTableSink : UnsupportedOperationException "JDBCUpsertTableSink can not support " Key: FLINK-13289 URL: https://issues.apache.org/jira/browse/FLINK-13289

Re: Flink benchmark Jenkins is broken due to missing 1.10 snapshots

2019-07-16 Thread Yu Li
Thanks Haibo for the nice catch and Chesnay for the quick fix! I just confirmed that flink-benchmark Jenkins is recovered and benchmark result updated in codespeed center. Best Regards, Yu On Tue, 16 Jul 2019 at 18:53, Chesnay Schepler wrote: > Done. > > On 16/07/2019 12:47, Haibo Sun wrote:

[jira] [Created] (FLINK-13293) Add state processor api to opt/ directory in flink-dist

2019-07-16 Thread Seth Wiesman (JIRA)
Seth Wiesman created FLINK-13293: Summary: Add state processor api to opt/ directory in flink-dist Key: FLINK-13293 URL: https://issues.apache.org/jira/browse/FLINK-13293 Project: Flink

Re: blink planner issue

2019-07-16 Thread JingsongLee
Hi caizhi and kaka and jark: I think we should keep current equals in RowType and StructuredType. @Timo WaltherWhat do you think? Do you think we can use asSerializableString? Best, JingsongLee -- From:kaka chen Send

flink-python failed on Travis

2019-07-16 Thread Haibo Sun
Hi, folks I noticed that all of the Travis tests reported the following failure. Is anyone working on this issue? ___ summary ERROR: py27: InvocationError for command

contributor permission application

2019-07-16 Thread zhang yue
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is mooonzhang.

Re: flink-python failed on Travis

2019-07-16 Thread Dian Fu
Thanks for reporting this issue. I will take a look at it. > 在 2019年7月17日,上午11:50,Danny Chan 写道: > > I have the same issue ~~ > > Best, > Danny Chan > 在 2019年7月17日 +0800 AM11:21,Haibo Sun ,写道: >> Hi, folks >> >> >> I noticed that all of the Travis tests reported the following failure. Is >>

[jira] [Created] (FLINK-13299) flink-python failed on Travis

2019-07-16 Thread Haibo Sun (JIRA)
Haibo Sun created FLINK-13299: - Summary: flink-python failed on Travis Key: FLINK-13299 URL: https://issues.apache.org/jira/browse/FLINK-13299 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-13300) Add OverwritableTableSink bridge logic to flink planner

2019-07-16 Thread Danny Chan (JIRA)
Danny Chan created FLINK-13300: -- Summary: Add OverwritableTableSink bridge logic to flink planner Key: FLINK-13300 URL: https://issues.apache.org/jira/browse/FLINK-13300 Project: Flink Issue

Re: flink-python failed on Travis

2019-07-16 Thread Danny Chan
I have the same issue ~~ Best, Danny Chan 在 2019年7月17日 +0800 AM11:21,Haibo Sun ,写道: > Hi, folks > > > I noticed that all of the Travis tests reported the following failure. Is > anyone working on this issue? > > > ___ summary >

[jira] [Created] (FLINK-13281) Fix the verify logic of AdaptedRestartPipelinedRegionStrategyNGAbortPendingCheckpointsTest

2019-07-16 Thread Yun Tang (JIRA)
Yun Tang created FLINK-13281: Summary: Fix the verify logic of AdaptedRestartPipelinedRegionStrategyNGAbortPendingCheckpointsTest Key: FLINK-13281 URL: https://issues.apache.org/jira/browse/FLINK-13281

[jira] [Created] (FLINK-13282) LocalExecutorITCase#testUseCatalogAndUseDatabase failed on Travis

2019-07-16 Thread Jark Wu (JIRA)
Jark Wu created FLINK-13282: --- Summary: LocalExecutorITCase#testUseCatalogAndUseDatabase failed on Travis Key: FLINK-13282 URL: https://issues.apache.org/jira/browse/FLINK-13282 Project: Flink

Re: Support InMemoryTableSink or support retraction in CsvTableSink

2019-07-16 Thread Xingcan Cui
Hi Fan, It’s not hard to implement an “InMemoryTableSink” for debugging use by yourself. The main part should be a SinkFunction that deals with Tuple records. You can either show the changelog (the record itself) or print the materialized result (e.g., a result list) for each received item.

[jira] [Created] (FLINK-13283) JDBCLookup Exception: Unsupported type: LocalDate

2019-07-16 Thread LakeShen (JIRA)
LakeShen created FLINK-13283: Summary: JDBCLookup Exception: Unsupported type: LocalDate Key: FLINK-13283 URL: https://issues.apache.org/jira/browse/FLINK-13283 Project: Flink Issue Type: Bug

Add relative path support in Savepoint Connector

2019-07-16 Thread bupt_ljy
Hi all, Firstly I appreciate Gordon and Seth’s effort on this feature, which is really helpful to our production use. Like you mentioned in the FLINK-12047, one of the production uses is that we use the existing state to derive new state. However, since the state handle is using the

[jira] [Created] (FLINK-13284) Correct some builtin functions' return type inference

2019-07-16 Thread lincoln lee (JIRA)
lincoln lee created FLINK-13284: --- Summary: Correct some builtin functions' return type inference Key: FLINK-13284 URL: https://issues.apache.org/jira/browse/FLINK-13284 Project: Flink Issue