--
Sender:Shuyi Chen
Sent at:2018 Nov 1 (Thu) 02:47
Recipient:Xuefu
Cc:vino yang ; Fabian Hueske ; dev
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Hi Xuefu,
Thanks a lot for driving this big effort. I would suggest convert your
01:08
> Recipient:Xuefu ; Shuyi Chen
> Cc:yanghua1127 ; Fabian Hueske ;
> dev ; user
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
> Hi all,
>
> To wrap up the discussion, I have attached a PDF describing the proposal,
> which is also attach
://issues.apache.org/jira/browse/FLINK-10556
--
Sender:Xuefu
Sent at:2018 Oct 16 (Tue) 03:40
Recipient:Shuyi Chen
Cc:yanghua1127 ; Fabian Hueske ; dev
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Hi Shuyi,
Thank
at:2018 Oct 14 (Sun) 08:30
Recipient:Xuefu
Cc:yanghua1127 ; Fabian Hueske ; dev
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Welcome to the community and thanks for the great proposal, Xuefu! I think the
proposal can be divided into 2 stages: making Flink
at:2018 Oct 13 (Sat) 21:55
Recipient:Xuefu ; Fabian Hueske
Cc:dev ; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Thank you Xuefu, for bringing up this awesome, detailed proposal! It will
resolve lots of existing pain for users like me.
In general, I totally agree
----------
> Sender:vino yang
> Sent at:2018 Oct 11 (Thu) 09:45
> Recipient:Fabian Hueske
> Cc:dev ; Xuefu ; user <
> user@flink.apache.org>
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
> Hi Xu
ndlers, etc.
>> 11. Better task failure tolerance and task scheduling at Flink runtime.
>>
>> As you can see, achieving all those requires significant effort and across
>> all layers in Flink. However, a short-term goal could include only core
>> areas (such as 1, 2,
> Sender:Jörn Franke
> Sent at:2018 Oct 11 (Thu) 13:54
> Recipient:Xuefu
> Cc:vino yang ; Fabian Hueske ; dev
> ; user
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
> Would it maybe make sense to provide Flink as an engine on Hive
> („flink-on-H
nt:Xuefu
> Cc:Rong Rong ; Timo Walther ;
> dev ; jornfranke ; vino yang <
> yanghua1...@gmail.com>; Fabian Hueske ; user <
> user@flink.apache.org>
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
> One other thought on the same lines was to u
; jornfranke ; vino yang
; Fabian Hueske ; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
One other thought on the same lines was to use hive tables to store kafka
information to process streaming tables. Something like
"create table streaming_table (
bootstrapSe
ovides. It's usually the servicer owner who provides drivers to their
>> services. We weren't talking about JDBC/ODBC driver to external DB systems.
>>
>> Let me know if you have further questions.
>>
>> Thanks,
>> Xuefu
>>
>> --------------
>> Sen
Sender:Rong Rong
> Sent at:2018 Oct 12 (Fri) 01:52
> Recipient:Timo Walther
> Cc:dev ; jornfranke ; Xuefu <
> xuef...@alibaba-inc.com>; vino yang ; Fabian
> Hueske ; user
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
> Hi Xuefu,
>
> Tha
Rong
Sent at:2018 Oct 12 (Fri) 01:52
Recipient:Timo Walther
Cc:dev ; jornfranke ; Xuefu
; vino yang ; Fabian Hueske
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Hi Xuefu,
Thanks for putting together the overview. I would like to add some more on top
of Timo's
(such as 1, 2, 4, 5, 6, 7) or start at a smaller scope (such as #3,
>> #6).
>>
>> Please share your further thoughts. If we generally agree that this is the
>> right direction, I could come up with a formal proposal quickly and then we
>> can follow up with broader discussions.
>>
>> Thanks,
>> Xuefu
>>
>>
>>
&
include only
> core areas (such as 1, 2, 4, 5, 6, 7) or start at a smaller scope (such as
> #3, #6).
> >>
> >> Please share your further thoughts. If we generally agree that this is
> the right direction, I could come up with a formal proposal quickly and
> then we can fol
--
Sender:Jörn Franke
Sent at:2018 Oct 11 (Thu) 13:54
Recipient:Xuefu
Cc:vino yang ; Fabian Hueske ; dev
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Would it maybe make sense to provide Flink as an engine on Hive
(„flink-on-Hive“)? Eg to address
an
follow up with broader discussions.
Thanks,
Xuefu
--
Sender:vino yang
Sent at:2018 Oct 11 (Thu) 09:45
Recipient:Fabian Hueske
Cc:dev ; Xuefu ; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
nks,
> Xuefu
>
>
>
> --------------
> Sender:vino yang
> Sent at:2018 Oct 11 (Thu) 09:45
> Recipient:Fabian Hueske
> Cc:dev ; Xuefu ; user
>
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
&
--
Sender:vino yang
Sent at:2018 Oct 11 (Thu) 09:45
Recipient:Fabian Hueske
Cc:dev ; Xuefu ; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Hi Xuefu,
Appreciate this proposal, and like Fabian, it would look better
Hi Xuefu,
Appreciate this proposal, and like Fabian, it would look better if you can
give more details of the plan.
Thanks, vino.
Fabian Hueske 于2018年10月10日周三 下午5:27写道：
> Hi Xuefu,
>
> Welcome to the Flink community and thanks for starting this discussion!
> Better Hive integration would be
Hi Xuefu,
Welcome to the Flink community and thanks for starting this discussion!
Better Hive integration would be really great!
Can you go into details of what you are proposing? I can think of a couple
ways to improve Flink in that regard:
* Support for Hive UDFs
* Support for Hive metadata
Hi all,
Along with the community's effort, inside Alibaba we have explored Flink's
potential as an execution engine not just for stream processing but also for
batch processing. We are encouraged by our findings and have initiated our
effort to make Flink's SQL capabilities full-fledged. When
22 matches
Mail list logo
