Yes, that’s what I meant. Ok I will go through it.



On 7/26/16, 6:17 AM, "Lukasz Cwik" <[email protected]> wrote:

>I think your interested in https://issues.apache.org/jira/browse/BEAM-25
>which is about exposing access to state in a runner independent way in the
>Beam model. You can watch that issue and comment on design / development as
>it is currently being worked on.
>
>On Tue, Jul 26, 2016 at 8:53 AM, Aparup Banerjee (apbanerj) <
>[email protected]> wrote:
>
>> Yes and no, I think state access is a valid use cases , and should surface
>> in beam layer , through the sdk abstraction, or through a separate function
>> like RichMapFunction of Flink. Hence the question.
>>
>> Aparup
>>
>>
>>
>>
>> On 7/26/16, 4:29 AM, "Aljoscha Krettek" <[email protected]> wrote:
>>
>> >Hi,
>> >the purpose of Beam is to abstract the user from the underlying execution
>> >engine. IMHO, allowing access to state of the underlying execution engine
>> >will never be a goal for the Beam project.
>> >
>> >If you want/need to access Flink state, I think this is a good indicator
>> >that you should use Flink directly because your programs would never run
>> on
>> >another runner anyways.
>> >
>> >Cheers,
>> >Aljoscha
>> >
>> >On Mon, 25 Jul 2016 at 17:04 Aparup Banerjee (apbanerj) <
>> [email protected]>
>> >wrote:
>> >
>> >> I am looking for a way to access streaming engine state (Flink) in my
>> beam
>> >> transformations. I understand this can be accessed only though the
>> runtime
>> >> context. Has any one tried accessing flink runtime context in beam? May
>> be
>> >> roll it up as a custom API of some sort. Might need some changes in
>> >> FlinkRunner is my hunch.
>> >>
>> >> Thanks,
>> >> Aparup
>> >>
>>

Reply via email to