Regarding external metastore like HIVE

Hi, I have read Flink documentation that Flink supports Metastore which is currently InMemory. Is Flink community thinking to implement external Metastore like Hive? Thanks -- Shivam Sharma Data Engineer @ Goibibo Indian Institute Of Information Technology, Design and Manufacturing Jabalpur

Re: Regarding external metastore like HIVE

flink/flink-docs-master/ops/state/state_backends.html> >>> ? >>> >>> On 02.07.2018 18:41, Shivam Sharma wrote: >>> >>> Hi, >>> >>> I have read Flink documentation that Flink supports Metastore which is >>> currently InMemor

Re: Regarding external metastore like HIVE

ould be quite a few people interested in such a connector. > > Best, Fabian > > 2018-07-03 10:24 GMT+02:00 Shivam Sharma <28shivamsha...@gmail.com>: > >> Hi, >> >> Please find the documentation link here: >> https://ci.apache.org/projects/flink/flink-docs-

Want to write Kafka Sink to SQL Client by Flink-1.5

Hi All, We want to write Kafka Sink functionality for Flink(1.5) SQL Client. We have read the code and chalk out a rough plan for implementation. Any guidance for this implementation will be very helpful. Thanks -- Shivam Sharma Data Engineer @ Goibibo Indian Institute Of Information

Support for detached mode for Flink1.5 SQL Client

Hi All, Is there any way to run Flink1.5 sql-client queries in detached mode? Actually, we need to run multiple queries for different use cases and sql-client shell will open by the user on-demand. -- Shivam Sharma Data Engineer @ Goibibo Indian Institute Of Information Technology, Design and

Need to better way to create JSON If we have TableSchema and Row

Schema- - columnNames: [name, count] - columnTypes: [String, Integer] Row - ("shivam", 2) JSON - {"name": "shivam", count: 2} Thanks -- Shivam Sharma Data Engineer @ Goibibo Indian Institute Of Information Technology, Design and Manufacturing Jabalpur Mobile No-

Re: Want to write Kafka Sink to SQL Client by Flink-1.5

Awesome!!! It will be helpful if you share that PR. Thanks

Persisting Table in Flink API

Hi, We have one use case in which we need to persist Table in Flink which can be later used to join with other tables. This table can be huge so we need to store it in off-heap but faster access. Any suggestions regarding this? -- Shivam Sharma Data Engineer @ Goibibo Indian Institute Of

Re: Persisting Table in Flink API

ache/flink/blob/master/flink-libraries/flink-table/src/main/scala/org/apache/flink/table/plan/nodes/datastream/DataStreamJoin.scala >> [3] >> https://github.com/apache/flink/blob/master/flink-libraries/flink-table/src/main/scala/org/apache/flink/table/runtime/join/NonWindowInnerJoin.scal

Re: Persisting Table in Flink API

; > Let me know If you have any other confusions. > > Best, Hequn > > [1] > https://ci.apache.org/projects/flink/flink-docs-master/dev/table/streaming.html#idle-state-retention-time > > On Mon, Jul 16, 2018 at 5:18 PM, Shivam Sharma <28shivamsha...@gmail.com> > wrot

How & Where does flink stores data for aggregations.

ically how do we solve such kind of use-cases using FLINK where aggregation interval are quite high. Thanks in advance -- Shivam Sharma