[jira] [Created] (FLINK-17392) enable configuring minicluster in Flink SQL in IDE

2020-04-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-17392: Summary: enable configuring minicluster in Flink SQL in IDE Key: FLINK-17392 URL: https://issues.apache.org/jira/browse/FLINK-17392 Project: Flink Issue Type

[jira] [Created] (FLINK-17333) add doc for "create ddl"

2020-04-22 Thread Bowen Li (Jira)
Bowen Li created FLINK-17333: Summary: add doc for "create ddl" Key: FLINK-17333 URL: https://issues.apache.org/jira/browse/FLINK-17333 Project: Flink Issue Type: I

[jira] [Created] (FLINK-17175) StringUtils.arrayToString() should consider Object[] lastly

2020-04-15 Thread Bowen Li (Jira)
Bowen Li created FLINK-17175: Summary: StringUtils.arrayToString() should consider Object[] lastly Key: FLINK-17175 URL: https://issues.apache.org/jira/browse/FLINK-17175 Project: Flink Issue

[jira] [Created] (FLINK-17037) add e2e tests for reading array data types from postgres with JDBCTableSource and PostgresCatalog

2020-04-07 Thread Bowen Li (Jira)
Bowen Li created FLINK-17037: Summary: add e2e tests for reading array data types from postgres with JDBCTableSource and PostgresCatalog Key: FLINK-17037 URL: https://issues.apache.org/jira/browse/FLINK-17037

[jira] [Created] (FLINK-16820) support reading array of timestamp, data, and time in JDBCTableSource

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16820: Summary: support reading array of timestamp, data, and time in JDBCTableSource Key: FLINK-16820 URL: https://issues.apache.org/jira/browse/FLINK-16820 Project: Flink

[jira] [Created] (FLINK-16817) StringUtils.arrayToString() doesn't convert byte[][] correctly

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16817: Summary: StringUtils.arrayToString() doesn't convert byte[][] correctly Key: FLINK-16817 URL: https://issues.apache.org/jira/browse/FLINK-16817 Project:

[jira] [Created] (FLINK-16816) planner doesn't parse timestamp array correctly

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16816: Summary: planner doesn't parse timestamp array correctly Key: FLINK-16816 URL: https://issues.apache.org/jira/browse/FLINK-16816 Project: Flink Issue Type

[jira] [Created] (FLINK-16815) add e2e tests for reading from postgres with JDBCTableSource and PostgresCatalog

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16815: Summary: add e2e tests for reading from postgres with JDBCTableSource and PostgresCatalog Key: FLINK-16815 URL: https://issues.apache.org/jira/browse/FLINK-16815 Project

[jira] [Created] (FLINK-16814) StringUtils.arrayToString() doesn't convert byte[] correctly

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16814: Summary: StringUtils.arrayToString() doesn't convert byte[] correctly Key: FLINK-16814 URL: https://issues.apache.org/jira/browse/FLINK-16814 Project: Flink

[jira] [Created] (FLINK-16813) JDBCInputFormat doesn't correctly map Short

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16813: Summary: JDBCInputFormat doesn't correctly map Short Key: FLINK-16813 URL: https://issues.apache.org/jira/browse/FLINK-16813 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-16812) introduce PostgresRowConverter

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16812: Summary: introduce PostgresRowConverter Key: FLINK-16812 URL: https://issues.apache.org/jira/browse/FLINK-16812 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16811) introduce JDBCRowConverter

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16811: Summary: introduce JDBCRowConverter Key: FLINK-16811 URL: https://issues.apache.org/jira/browse/FLINK-16811 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16810) add back PostgresCatalogITCase

2020-03-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-16810: Summary: add back PostgresCatalogITCase Key: FLINK-16810 URL: https://issues.apache.org/jira/browse/FLINK-16810 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16781) add built-in cache mechanism for LookupableTableSource in lookup join

2020-03-25 Thread Bowen Li (Jira)
Bowen Li created FLINK-16781: Summary: add built-in cache mechanism for LookupableTableSource in lookup join Key: FLINK-16781 URL: https://issues.apache.org/jira/browse/FLINK-16781 Project: Flink

[jira] [Created] (FLINK-16780) improve Flink lookup join

2020-03-25 Thread Bowen Li (Jira)
Bowen Li created FLINK-16780: Summary: improve Flink lookup join Key: FLINK-16780 URL: https://issues.apache.org/jira/browse/FLINK-16780 Project: Flink Issue Type: New Feature

Re: [DISCUSS] Introduce TableFactory for StatefulSequenceSource

2020-03-23 Thread Bowen Li
nd also blackhole print sink as there are no built-in ones to use. > > > > > > > > > > Regards, > > > > > Dian > > > > > > > > > > > 在 2020年3月22日,上午11:24,Jark Wu 写道: > > > > > > > > > > >

Re: [DISCUSS] Introduce TableFactory for StatefulSequenceSource

2020-03-20 Thread Bowen Li
+1. I would suggest to take a step even further and see what users really need to test/try/play with table API and Flink SQL. Besides this one, here're some more sources and sinks that I have developed or used previously to facilitate building Flink table/SQL pipelines. 1. random input data s

[jira] [Created] (FLINK-16702) develop JDBCCatalogFactory for service discovery

2020-03-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-16702: Summary: develop JDBCCatalogFactory for service discovery Key: FLINK-16702 URL: https://issues.apache.org/jira/browse/FLINK-16702 Project: Flink Issue Type: Sub

Re: FLIP-117: HBase catalog

2020-03-16 Thread Bowen Li
come again. > Lots of UnsupportedOperationExceptions looks unhappy to this catalog api... > So can we do some refactor to catalog api? I can see a lot of catalogs > just need provide table information without partitions, functions, > statistics, views... > > CC: @Dawid Wysakowi

[jira] [Created] (FLINK-16575) develop HBaseCatalog to integrate HBase metadata into Flink

2020-03-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16575: Summary: develop HBaseCatalog to integrate HBase metadata into Flink Key: FLINK-16575 URL: https://issues.apache.org/jira/browse/FLINK-16575 Project: Flink Issue

Re: [DISCUSS]FLIP-113: Support SQL and planner hints

2020-03-11 Thread Bowen Li
rwritten by the hints: > >> TableSourceFactory.Context.getQueryHints(): ReadableConfig > >> > >> Regards, > >> Timo > >> > >> [1] https://en.wikipedia.org/wiki/SQL/MED > >> > >> Currently I see 3 options as a > >> > >

Re: [DISCUSS]FLIP-113: Support SQL and planner hints

2020-03-10 Thread Bowen Li
Thanks Danny for kicking off the effort The root cause of too much manual work is Flink DDL has mixed 3 types of params together and doesn't handle each of them very well. Below are how I categorize them and corresponding solutions in my mind: - type 1: Metadata of external data, like external en

[jira] [Created] (FLINK-16498) make Postgres table work end-2-end in Flink SQL with PostgresJDBCCatalog

2020-03-08 Thread Bowen Li (Jira)
Bowen Li created FLINK-16498: Summary: make Postgres table work end-2-end in Flink SQL with PostgresJDBCCatalog Key: FLINK-16498 URL: https://issues.apache.org/jira/browse/FLINK-16498 Project: Flink

[jira] [Created] (FLINK-16474) develop OracleJDBCCatalog to connect Flink with Oracle databases and ecosystem

2020-03-06 Thread Bowen Li (Jira)
Bowen Li created FLINK-16474: Summary: develop OracleJDBCCatalog to connect Flink with Oracle databases and ecosystem Key: FLINK-16474 URL: https://issues.apache.org/jira/browse/FLINK-16474 Project

[jira] [Created] (FLINK-16473) add documentation for PostgresJDBCCatalog

2020-03-06 Thread Bowen Li (Jira)
Bowen Li created FLINK-16473: Summary: add documentation for PostgresJDBCCatalog Key: FLINK-16473 URL: https://issues.apache.org/jira/browse/FLINK-16473 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16472) support precision of timestamp and time data types

2020-03-06 Thread Bowen Li (Jira)
Bowen Li created FLINK-16472: Summary: support precision of timestamp and time data types Key: FLINK-16472 URL: https://issues.apache.org/jira/browse/FLINK-16472 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-16471) develop PostgresJDBCCatalog

2020-03-06 Thread Bowen Li (Jira)
Bowen Li created FLINK-16471: Summary: develop PostgresJDBCCatalog Key: FLINK-16471 URL: https://issues.apache.org/jira/browse/FLINK-16471 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Introduce flink-connector-hive-xx modules

2020-03-05 Thread Bowen Li
cument, otherwise, write 1.0, and the result version is indeed 1.2.2, > which will make users have wrong expectations. > > Another, maybe 2.3.6 can support 2.0-2.2 after some efforts. > > Best, > Jingsong Lee > > On Fri, Mar 6, 2020 at 1:00 AM Bowen Li wrote: > > >

[jira] [Created] (FLINK-16448) add documentation for Hive table sink parallelism setting strategy

2020-03-05 Thread Bowen Li (Jira)
Bowen Li created FLINK-16448: Summary: add documentation for Hive table sink parallelism setting strategy Key: FLINK-16448 URL: https://issues.apache.org/jira/browse/FLINK-16448 Project: Flink

Re: [DISCUSS] Introduce flink-connector-hive-xx modules

2020-03-05 Thread Bowen Li
have the wrong expectation for the hive built-in functions. > > [1] https://github.com/apache/flink/pull/11304 > > Best, > Jingsong Lee > > On Thu, Mar 5, 2020 at 2:34 PM Bowen Li wrote: > > > Thanks Jingsong for your explanation! I'm +1 for this initiative. > >

Re: [DISCUSS] Introduce flink-connector-hive-xx modules

2020-03-04 Thread Bowen Li
ge? > > Yes, I have done some tests, not really for "fully", but it is a technical > judgment. > > Best, > Jingsong Lee > > On Thu, Mar 5, 2020 at 1:17 PM Bowen Li wrote: > > > Thanks, Jingsong, for bringing this up. We've received lots of feedbacks &g

Re: [VOTE] FLIP-93: JDBC catalog and Postgres catalog

2020-03-04 Thread Bowen Li
gt; Best, > >>> Jingsong Lee > >>> > >>> On Mon, Mar 2, 2020 at 11:06 AM Terry Wang wrote: > >>> > >>>> +1 (non-binding). > >>>> With this feature, we can more easily interact traditional database in > >>>>

Re: [DISCUSS] Introduce flink-connector-hive-xx modules

2020-03-04 Thread Bowen Li
Thanks, Jingsong, for bringing this up. We've received lots of feedbacks in the past few months that the complexity involved in different Hive versions has been quite painful for users to start with. So it's great to step forward and deal with such issue. Before getting on a decision, can you plea

Re: Creating TemporalTable based on Catalog table in SQL Client

2020-03-04 Thread Bowen Li
ula Fóra wrote: > > > You are right but still if the default catalog is something else and > > that's the one containing the table then it still wont work currently. > > > > Gyula > > > > On Wed, Mar 4, 2020 at 5:08 AM Bowen Li wrote: > > > &g

Re: Creating TemporalTable based on Catalog table in SQL Client

2020-03-03 Thread Bowen Li
Hi Gyula, What line 622 (the link you shared) does is not registering catalogs, but setting an already registered catalog as the current one. As you can see from the method and its comment, catalogs are loaded first before any tables in yaml are registered, so you should be able to achieve what yo

[VOTE] FLIP-93: JDBC catalog and Postgres catalog

2020-02-27 Thread Bowen Li
Hi all, I'd like to kick off the vote for FLIP-93 [1] to add JDBC catalog and Postgres catalog. The vote will last for at least 72 hours, following the consensus voting protocol. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-93%3A+JDBC+catalog+and+Postgres+catalog Discussion thread

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-21 Thread Bowen Li
Congrats, Jingsong! On Fri, Feb 21, 2020 at 7:28 AM Till Rohrmann wrote: > Congratulations Jingsong! > > Cheers, > Till > > On Fri, Feb 21, 2020 at 4:03 PM Yun Gao wrote: > >> Congratulations Jingsong! >> >>Best, >>Yun >> >>

Re: [DISCUSS] FLIP-92: JDBC catalog and Postgres catalog

2020-02-17 Thread Bowen Li
2020 at 11:05 AM Bowen Li wrote: > Hi Flavio, > > First, this is a generic question on how flink-jdbc is set up, not > specific to jdbc catalog, thus is better to be on its own thread. > > But to just quickly answer your question, you need to see where the > incomp

[jira] [Created] (FLINK-16107) github link on statefun.io should point to https://github.com/apache/flink-statefun

2020-02-16 Thread Bowen Li (Jira)
Bowen Li created FLINK-16107: Summary: github link on statefun.io should point to https://github.com/apache/flink-statefun Key: FLINK-16107 URL: https://issues.apache.org/jira/browse/FLINK-16107 Project

[jira] [Created] (FLINK-16028) hbase connector's 'connector.table-name' property should be optional rather than required

2020-02-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16028: Summary: hbase connector's 'connector.table-name' property should be optional rather than required Key: FLINK-16028 URL: https://issues.apache.org/jira/bro

[jira] [Created] (FLINK-16027) kafka connector's 'connector.topic' property should be optional rather than required

2020-02-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16027: Summary: kafka connector's 'connector.topic' property should be optional rather than required Key: FLINK-16027 URL: https://issues.apache.org/jira/browse/FLINK-16027

[jira] [Created] (FLINK-16024) support filter pushdown in jdbc connector

2020-02-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16024: Summary: support filter pushdown in jdbc connector Key: FLINK-16024 URL: https://issues.apache.org/jira/browse/FLINK-16024 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16023) jdbc connector's 'connector.table' property should be optional rather than required

2020-02-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16023: Summary: jdbc connector's 'connector.table' property should be optional rather than required Key: FLINK-16023 URL: https://issues.apache.org/jira/browse/FLINK-16023

[jira] [Created] (FLINK-15986) support setting or changing session properties in Flink SQL

2020-02-10 Thread Bowen Li (Jira)
Bowen Li created FLINK-15986: Summary: support setting or changing session properties in Flink SQL Key: FLINK-15986 URL: https://issues.apache.org/jira/browse/FLINK-15986 Project: Flink Issue

[jira] [Created] (FLINK-15985) offload runtime params from DDL to table hints in DML/queries

2020-02-10 Thread Bowen Li (Jira)
Bowen Li created FLINK-15985: Summary: offload runtime params from DDL to table hints in DML/queries Key: FLINK-15985 URL: https://issues.apache.org/jira/browse/FLINK-15985 Project: Flink Issue

[jira] [Created] (FLINK-15984) support hive stream table sink

2020-02-10 Thread Bowen Li (Jira)
Bowen Li created FLINK-15984: Summary: support hive stream table sink Key: FLINK-15984 URL: https://issues.apache.org/jira/browse/FLINK-15984 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-15983) add native reader for Hive parquet files

2020-02-10 Thread Bowen Li (Jira)
Bowen Li created FLINK-15983: Summary: add native reader for Hive parquet files Key: FLINK-15983 URL: https://issues.apache.org/jira/browse/FLINK-15983 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-15960) support creating Hive tables, views, functions within Flink

2020-02-09 Thread Bowen Li (Jira)
Bowen Li created FLINK-15960: Summary: support creating Hive tables, views, functions within Flink Key: FLINK-15960 URL: https://issues.apache.org/jira/browse/FLINK-15960 Project: Flink Issue

[jira] [Created] (FLINK-15933) update content of how generic table schema is stored in hive via HiveCatalog

2020-02-05 Thread Bowen Li (Jira)
Bowen Li created FLINK-15933: Summary: update content of how generic table schema is stored in hive via HiveCatalog Key: FLINK-15933 URL: https://issues.apache.org/jira/browse/FLINK-15933 Project: Flink

Re: [VOTE] Improve TableFactory to add Context

2020-02-05 Thread Bowen Li
+1, LGTM On Tue, Feb 4, 2020 at 11:28 PM Jark Wu wrote: > +1 form my side. > Thanks for driving this. > > Btw, could you also attach a JIRA issue with the changes described in it, > so that users can find the issue through the mailing list in the future. > > Best, > Jark > > On Wed, 5 Feb 2020 a

[jira] [Created] (FLINK-15809) component stack page needs to be updated for blink planner

2020-01-29 Thread Bowen Li (Jira)
Bowen Li created FLINK-15809: Summary: component stack page needs to be updated for blink planner Key: FLINK-15809 URL: https://issues.apache.org/jira/browse/FLINK-15809 Project: Flink Issue

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-01-23 Thread Bowen Li
congrats! On Thu, Jan 23, 2020 at 07:49 Kostas Kloudas wrote: > Congratulations Yu and welcome! > > On Thu, Jan 23, 2020 at 2:28 PM Till Rohrmann > wrote: > > > > Congrats Yu :-) > > > > On Thu, Jan 23, 2020 at 2:02 PM Yang Wang wrote: > > > > > Congratulations, Yu. > > > > > > > > > Best, > >

Re: [DISCUSS] Releasing Flink 1.9.2

2020-01-22 Thread Bowen Li
+1. Thanks Hequn On Wed, Jan 22, 2020 at 8:39 AM Till Rohrmann wrote: > Thanks for resuming the discussion Hequn. +1 for starting with the RC > creation. Thanks for driving the release process! > > Cheers, > Till > > On Tue, Jan 21, 2020 at 11:02 PM jincheng sun > wrote: > > > Cool, looking for

Re: [DISCUSS] FLIP-92: JDBC catalog and Postgres catalog

2020-01-22 Thread Bowen Li
ould be a rare situation (not in my experience > however..) but what if I have to connect to the same type of source (e.g. > Mysql) with 2 incompatible version...? How can I load the 2 (or more) > connectors jars without causing conflicts? > > Il Mar 14 Gen 2020, 23:32 Bowen

[jira] [Created] (FLINK-15645) enable COPY TO/FROM in Postgres JDBC source/sink for faster batch processing

2020-01-18 Thread Bowen Li (Jira)
Bowen Li created FLINK-15645: Summary: enable COPY TO/FROM in Postgres JDBC source/sink for faster batch processing Key: FLINK-15645 URL: https://issues.apache.org/jira/browse/FLINK-15645 Project: Flink

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

2020-01-16 Thread Bowen Li
Congrats! On Thu, Jan 16, 2020 at 13:45 Peter Huang wrote: > Congratulations, Dian! > > > Best Regards > Peter Huang > > On Thu, Jan 16, 2020 at 11:04 AM Yun Tang wrote: > >> Congratulations, Dian! >> >> Best >> Yun Tang >> -- >> *From:* Benchao Li >> *Sent:* Thursd

Re: [DISCUSS] Improve TableFactory

2020-01-15 Thread Bowen Li
Hi Jingsong, The 1st and 2nd pain points you described are very valid, as I'm more familiar with them. I agree these are shortcomings of the current Flink SQL design. A couple comments on your 1st proposal: 1. is it better to have explicit APIs like "createBatchTableSource(...)" and "createStrea

[jira] [Created] (FLINK-15607) throw exception when users trying to use Hive aggregate functions in streaming mode

2020-01-15 Thread Bowen Li (Jira)
Bowen Li created FLINK-15607: Summary: throw exception when users trying to use Hive aggregate functions in streaming mode Key: FLINK-15607 URL: https://issues.apache.org/jira/browse/FLINK-15607 Project

[jira] [Created] (FLINK-15593) add doc to remind users not using Hive aggregate functions in streaming mode

2020-01-14 Thread Bowen Li (Jira)
Bowen Li created FLINK-15593: Summary: add doc to remind users not using Hive aggregate functions in streaming mode Key: FLINK-15593 URL: https://issues.apache.org/jira/browse/FLINK-15593 Project: Flink

[jira] [Created] (FLINK-15591) support CREATE TEMPORARY TABLE/VIEW in DDL

2020-01-14 Thread Bowen Li (Jira)
Bowen Li created FLINK-15591: Summary: support CREATE TEMPORARY TABLE/VIEW in DDL Key: FLINK-15591 URL: https://issues.apache.org/jira/browse/FLINK-15591 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-15590) add section for current catalog and current database

2020-01-14 Thread Bowen Li (Jira)
Bowen Li created FLINK-15590: Summary: add section for current catalog and current database Key: FLINK-15590 URL: https://issues.apache.org/jira/browse/FLINK-15590 Project: Flink Issue Type

[jira] [Created] (FLINK-15589) remove beta tag from catalog and hive doc

2020-01-14 Thread Bowen Li (Jira)
Bowen Li created FLINK-15589: Summary: remove beta tag from catalog and hive doc Key: FLINK-15589 URL: https://issues.apache.org/jira/browse/FLINK-15589 Project: Flink Issue Type: Task

Re: [DISCUSS] FLIP-92: JDBC catalog and Postgres catalog

2020-01-14 Thread Bowen Li
Hi devs, I've updated the wiki according to feedbacks. Please take another look. Thanks! On Fri, Jan 10, 2020 at 2:24 PM Bowen Li wrote: > Thanks everyone for the prompt feedback. Please see my response below. > > > In Postgress, the TIME/TIMESTAMP WITH TIME ZONE has the &g

[jira] [Created] (FLINK-15588) check registered udf via catalog API cannot be a scala inner class

2020-01-14 Thread Bowen Li (Jira)
Bowen Li created FLINK-15588: Summary: check registered udf via catalog API cannot be a scala inner class Key: FLINK-15588 URL: https://issues.apache.org/jira/browse/FLINK-15588 Project: Flink

[jira] [Created] (FLINK-15576) remove isTemporary property from CatalogFunction API

2020-01-13 Thread Bowen Li (Jira)
Bowen Li created FLINK-15576: Summary: remove isTemporary property from CatalogFunction API Key: FLINK-15576 URL: https://issues.apache.org/jira/browse/FLINK-15576 Project: Flink Issue Type: Bug

Re: [DISCUSS] A mechanism to validate the precision of columns for connectors

2020-01-10 Thread Bowen Li
Hi Zhenghua, For external systems with schema, I think the schema information is available most of the time and should be the single source of truth to programmatically mapping column precision via Flink catalogs, to minimize users efforts creating schema redundantly again and avoid any human erro

Re: [DISCUSS] FLIP-92: JDBC catalog and Postgres catalog

2020-01-10 Thread Bowen Li
I'm a little confused the meaning of "base_url" at the first > > > glance, another idea is split it into several configurations: 'driver', > > > 'hostname', 'port'. > > > > > > 2) 'default-databa

[jira] [Created] (FLINK-15545) Separate runtime params and semantics params from Flink DDL for easier integration with catalogs and better user experience

2020-01-09 Thread Bowen Li (Jira)
Bowen Li created FLINK-15545: Summary: Separate runtime params and semantics params from Flink DDL for easier integration with catalogs and better user experience Key: FLINK-15545 URL: https://issues.apache.org/jira

Re: [DISCUSS] FLIP-92: JDBC catalog and Postgres catalog

2020-01-09 Thread Bowen Li
`JDBCDialect`, I guess JDBCCatalog also need to > quote > > identifiers. > > 1) we can easily to support a new database catalog (e.g. mysql) by > > implementing new dialects (e.g. MySQLDialect). > > 2) this can keep the same behavior as JDBC source/sink, i.e. > > conne

Re: [DISCUSS] FLIP-72: Introduce Pulsar Connector

2020-01-08 Thread Bowen Li
Hi Bowen, > > I've done updated the design doc, PTAL. > Btw the PR for catalog is https://github.com/apache/flink/pull/10455, > could > you please take a look? > > Best, > Yijie > > On Mon, Dec 9, 2019 at 8:44 AM Bowen Li wrote: > > > Hi Yijie, > > >

[DISCUSS] FLIP-92: JDBC catalog and Postgres catalog

2020-01-08 Thread Bowen Li
Hi dev, I'd like to kick off a discussion on adding JDBC catalogs, specifically Postgres catalog in Flink [1]. Currently users have to manually create schemas in Flink source/sink mirroring tables in their relational databases in use cases like JDBC read/write and consuming CDC. Many users have c

Re: [DISCUSS] FLIP-91 - Support SQL Client Gateway

2020-01-04 Thread Bowen Li
+1. It will improve user experience quite a bit. On Thu, Jan 2, 2020 at 22:07 Yangze Guo wrote: > Thanks for driving this, Xiaoling! > > +1 for supporting SQL client gateway. > > Best, > Yangze Guo > > > On Thu, Jan 2, 2020 at 9:58 AM 贺小令 wrote: > > > > Hey everyone, > > FLIP-24 > >

[jira] [Created] (FLINK-15411) HiveCatalog can't prune partition on DATE/TIMESTAMP columns

2019-12-26 Thread Bowen Li (Jira)
Bowen Li created FLINK-15411: Summary: HiveCatalog can't prune partition on DATE/TIMESTAMP columns Key: FLINK-15411 URL: https://issues.apache.org/jira/browse/FLINK-15411 Project: Flink

[jira] [Created] (FLINK-15376) support "CREATE TABLE AS" in Flink SQL

2019-12-23 Thread Bowen Li (Jira)
Bowen Li created FLINK-15376: Summary: support "CREATE TABLE AS" in Flink SQL Key: FLINK-15376 URL: https://issues.apache.org/jira/browse/FLINK-15376 Project: Flink Issue Type: N

[jira] [Created] (FLINK-15351) develop PostgresJDBCCatalog

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15351: Summary: develop PostgresJDBCCatalog Key: FLINK-15351 URL: https://issues.apache.org/jira/browse/FLINK-15351 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-15353) develop AbstractJDBCCatalog

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15353: Summary: develop AbstractJDBCCatalog Key: FLINK-15353 URL: https://issues.apache.org/jira/browse/FLINK-15353 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-15352) develop MySQLJDBCCatalog

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15352: Summary: develop MySQLJDBCCatalog Key: FLINK-15352 URL: https://issues.apache.org/jira/browse/FLINK-15352 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-15350) develop JDBCCatalog to connect to relational databases

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15350: Summary: develop JDBCCatalog to connect to relational databases Key: FLINK-15350 URL: https://issues.apache.org/jira/browse/FLINK-15350 Project: Flink Issue Type

[jira] [Created] (FLINK-15349) add Catalog DDL support in FLIP-69

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15349: Summary: add Catalog DDL support in FLIP-69 Key: FLINK-15349 URL: https://issues.apache.org/jira/browse/FLINK-15349 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-15348) Fix orc optimization for version less than 2.3 by introducing orc shim

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15348: Summary: Fix orc optimization for version less than 2.3 by introducing orc shim Key: FLINK-15348 URL: https://issues.apache.org/jira/browse/FLINK-15348 Project: Flink

Re: [DISCUSS] Flink docs vendor table

2019-12-19 Thread Bowen Li
Really cool. I especially like the list of tags on "Ververica Platform"! BTW, why is "Ververica Platform" placed at the last? I won't feel bothered if we move it to the top. On Thu, Dec 19, 2019 at 5:56 PM Seth Wiesman wrote: > I'm not sure, I think most all the options other than EMR abstract

Re: [DISCUSS] What parts of the Python API should we focus on next ?

2019-12-19 Thread Bowen Li
- integrate PyFlink with Jupyter notebook - Description: users should be able to run PyFlink seamlessly in Jupyter - Benefits: Jupyter is the industrial standard notebook for data scientists. I’ve talked to a few companies in North America, they think Jupyter is the #1 way to empower internal

[jira] [Created] (FLINK-15303) support predicate pushdown for sources in hive connector

2019-12-17 Thread Bowen Li (Jira)
Bowen Li created FLINK-15303: Summary: support predicate pushdown for sources in hive connector Key: FLINK-15303 URL: https://issues.apache.org/jira/browse/FLINK-15303 Project: Flink Issue Type

[jira] [Created] (FLINK-15302) properties in create table DDL need to be backward compatible

2019-12-17 Thread Bowen Li (Jira)
Bowen Li created FLINK-15302: Summary: properties in create table DDL need to be backward compatible Key: FLINK-15302 URL: https://issues.apache.org/jira/browse/FLINK-15302 Project: Flink

Re: [DISCUSS] have separate Flink distributions with built-in Hive dependencies

2019-12-17 Thread Bowen Li
I'm not sure providing an uber jar would be possible. Different from kafka and elasticsearch connector who have dependencies for a specific kafka/elastic version, or the kafka universal connector that provides good compatibilities, hive connector needs to deal with hive jars in all 1.x, 2.x, 3.x v

[jira] [Created] (FLINK-15263) add dedicated page for HiveCatalog

2019-12-15 Thread Bowen Li (Jira)
Bowen Li created FLINK-15263: Summary: add dedicated page for HiveCatalog Key: FLINK-15263 URL: https://issues.apache.org/jira/browse/FLINK-15263 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-15262) kafka connector doesn't read from beginning immediately when 'connector.startup-mode' = 'earliest-offset'

2019-12-15 Thread Bowen Li (Jira)
Bowen Li created FLINK-15262: Summary: kafka connector doesn't read from beginning immediately when 'connector.startup-mode' = 'earliest-offset' Key: FLINK-15262 URL: https://issues.apa

[jira] [Created] (FLINK-15261) add dedicated documentation for blink planner

2019-12-14 Thread Bowen Li (Jira)
Bowen Li created FLINK-15261: Summary: add dedicated documentation for blink planner Key: FLINK-15261 URL: https://issues.apache.org/jira/browse/FLINK-15261 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-15259) HiveInspector.toInspectors() should convert Flink constant to Hive constant

2019-12-13 Thread Bowen Li (Jira)
Bowen Li created FLINK-15259: Summary: HiveInspector.toInspectors() should convert Flink constant to Hive constant Key: FLINK-15259 URL: https://issues.apache.org/jira/browse/FLINK-15259 Project: Flink

[jira] [Created] (FLINK-15258) HiveModuleFactory doesn't take hive-version

2019-12-13 Thread Bowen Li (Jira)
Bowen Li created FLINK-15258: Summary: HiveModuleFactory doesn't take hive-version Key: FLINK-15258 URL: https://issues.apache.org/jira/browse/FLINK-15258 Project: Flink Issue Type

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-13 Thread Bowen Li
Congrats! On Fri, Dec 13, 2019 at 10:42 AM Xuefu Z wrote: > Congratulations, Zhu Zhu! > > On Fri, Dec 13, 2019 at 10:37 AM Peter Huang > wrote: > > > Congratulations!:) > > > > On Fri, Dec 13, 2019 at 9:45 AM Piotr Nowojski > > wrote: > > > > > Congratulations! :) > > > > > > > On 13 Dec 2019,

[jira] [Created] (FLINK-15257) convert HiveCatalogITCase.testCsvTableViaAPI() to use blink planner

2019-12-13 Thread Bowen Li (Jira)
Bowen Li created FLINK-15257: Summary: convert HiveCatalogITCase.testCsvTableViaAPI() to use blink planner Key: FLINK-15257 URL: https://issues.apache.org/jira/browse/FLINK-15257 Project: Flink

[jira] [Created] (FLINK-15256) unable to drop table in HiveCatalogITCase

2019-12-13 Thread Bowen Li (Jira)
Bowen Li created FLINK-15256: Summary: unable to drop table in HiveCatalogITCase Key: FLINK-15256 URL: https://issues.apache.org/jira/browse/FLINK-15256 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-15255) document how to create Hive table from java API and DDL

2019-12-13 Thread Bowen Li (Jira)
Bowen Li created FLINK-15255: Summary: document how to create Hive table from java API and DDL Key: FLINK-15255 URL: https://issues.apache.org/jira/browse/FLINK-15255 Project: Flink Issue Type

[jira] [Created] (FLINK-15254) hive module cannot be named "hive"

2019-12-13 Thread Bowen Li (Jira)
Bowen Li created FLINK-15254: Summary: hive module cannot be named "hive" Key: FLINK-15254 URL: https://issues.apache.org/jira/browse/FLINK-15254 Project: Flink Issue

Re: [DISCUSS] have separate Flink distributions with built-in Hive dependencies

2019-12-13 Thread Bowen Li
cc user ML in case anyone want to chime in On Fri, Dec 13, 2019 at 00:44 Bowen Li wrote: > Hi all, > > I want to propose to have a couple separate Flink distributions with Hive > dependencies on specific Hive versions (2.3.4 and 1.2.1). The distributions > will be provided to

[DISCUSS] have separate Flink distributions with built-in Hive dependencies

2019-12-13 Thread Bowen Li
Hi all, I want to propose to have a couple separate Flink distributions with Hive dependencies on specific Hive versions (2.3.4 and 1.2.1). The distributions will be provided to users on Flink download page [1]. A few reasons to do this: 1) Flink-Hive integration is important to many many Flink

[jira] [Created] (FLINK-15240) is_generic key is missing for Flink table stored in HiveCatalog

2019-12-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-15240: Summary: is_generic key is missing for Flink table stored in HiveCatalog Key: FLINK-15240 URL: https://issues.apache.org/jira/browse/FLINK-15240 Project: Flink

[jira] [Created] (FLINK-15235) create a Flink distribution for hive that includes all Hive dependencies

2019-12-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-15235: Summary: create a Flink distribution for hive that includes all Hive dependencies Key: FLINK-15235 URL: https://issues.apache.org/jira/browse/FLINK-15235 Project: Flink

[jira] [Created] (FLINK-15234) hive table created from flink catalog table cannot have null properties in parameters

2019-12-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-15234: Summary: hive table created from flink catalog table cannot have null properties in parameters Key: FLINK-15234 URL: https://issues.apache.org/jira/browse/FLINK-15234

  1   2   3   4   5   6   >