[jira] [Created] (FLINK-9317) Async I/O API Example For Scala has Variable Name error

2018-05-08 Thread Yazdan Shirvany (JIRA) 
Yazdan Shirvany created FLINK-9317:
--

 Summary: Async I/O API Example For Scala has Variable Name error
 Key: FLINK-9317
 URL: https://issues.apache.org/jira/browse/FLINK-9317
 Project: Flink
  Issue Type: Bug
  Components: Documentation
Affects Versions: 1.4.2, 1.4.1
Reporter: Yazdan Shirvany


h2. Async I/O API Scala Example has duplicated {{resultFuture variable with 
different data type.}}

 

{{resultFuture: ResultFuture[(String, String)]}}

{{ val resultFuture: Future[String]}}

 

{{this cause error on compile as variables have same naming.}}

 

{{In order to example works properly we need to update variable names to be 
distinct,}}

 

{{```}}

override def asyncInvoke(input: (String,String, String), resultFuture: 
ResultFuture[(String,String, String, String)]): Unit = {


 // issue the asynchronous request, receive a future for the result
 val *resultFutureRequested*: Future[String] = Future {
 // client2.query(str)
 client.getAccountReferenceId(token, input._1)
 }

 // set the callback to be executed once the request by the client is complete
 // the callback simply forwards the result to the result future
 *resultFutureRequested*.onSuccess {
 case result: String => {
 resultFuture.complete(Iterable((input._1, input._2, input._3, result)))
 }
 }
}

{{```}}

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Xin Wang 
Congrats!

- Xin

2018-05-09 9:45 GMT+08:00 Hequn Cheng :

> Congratulations!
>
> On Wed, May 9, 2018 at 4:40 AM, Rong Rong  wrote:
>
> > Congratulations :-)
> >
> > On Tue, May 8, 2018 at 1:24 PM, Matthias J. Sax 
> wrote:
> >
> > > -BEGIN PGP SIGNED MESSAGE-
> > > Hash: SHA512
> > >
> > > Congrats!
> > >
> > > On 5/8/18 12:28 PM, Shuyi Chen wrote:
> > > > Congratulations!
> > > >
> > > > On Tue, May 8, 2018 at 12:18 PM, Dawid Wysakowicz <
> > > > wysakowicz.da...@gmail.com> wrote:
> > > >
> > > >> Congratulations Nico and Xingcan! Well deserved!
> > > >>
> > > >>
> > > >> On 08.05.2018 20:52, Fabian Hueske wrote:
> > > >>> Hi everyone,
> > > >>>
> > > >>> I'm happy to announce that two members of the Flink community
> > > >>> accepted
> > > >> the
> > > >>> offer of the PMC to become committers.
> > > >>>
> > > >>> * Xingcan Cui has been contributing to Flink for about a year,
> > > >>> focusing
> > > >> on
> > > >>> Flink's relational APIs (SQL & Table API). In the past year,
> > > >>> Xingcan has started design discussions, helped reviewing
> > > >>> several pull requests, and replied to questions on the user
> > > >>> mailing list.
> > > >>>
> > > >>> * Nico Kruber is an active contributor since 1.5 years and
> > > >>> worked mostly
> > > >> on
> > > >>> internal features, such as the blob manager and a new network
> > > >>> stack. Nico answers many questions on the user mailing list,
> > > >>> reports lots of bugs and is a very active PR reviewer.
> > > >>>
> > > >>> Please join me in congratulating Xingcan and Nico.
> > > >>>
> > > >>> Cheers, Fabian
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >
> > > >
> > > -BEGIN PGP SIGNATURE-
> > > Comment: GPGTools - https://gpgtools.org
> > >
> > > iQIzBAEBCgAdFiEEeiQdEa0SVXokodP3DccxaWtLg18FAlryB2MACgkQDccxaWtL
> > > g1/VYRAAnC9AH3GCd4BWKUaEg0bWBLBtqQHYxYlkcHA0y/tQ70tJENNmf0yufPn4
> > > FsT/1/PJlLQNBZfvoXnfAiMbveKph+9S4ieInN2ApURM+tTNKz0oLK3UW7YliHsR
> > > 8qgpanfzB8wTN2LDi8sxwWMZBeWZq4hKI0hIxOWtMrPkztFAWehZnoBCYUy36x0p
> > > QE57u89+x+HJDHWLLN0TWzyHwkvjhZlaqxbeWOlvG4wdEl4QV1Lr3wfx7uX9tbh3
> > > 0LsWCqe7FqGoRQQ2q5xOCob0sQeOp3iYMRFZKva471DeANwAUdu1Jg/ImFNBbMbY
> > > 8jLOw/dd+j49ULEC/+DYX4iKMDvLLNaDl8Slj7y3D2uJPBdjy4mfYpcpsKehr7vd
> > > uIa2r7jkou08bQXc2W+BqCqQk8F7qNV8WRD8Ps8ekDgknIVLQiGXcjRBQkve1hoz
> > > DaobnvsnDzusuYeOkap21bRq1iZoPzx8ZbVvLLwywxSarMb5UQQjBkx04FZjEBUB
> > > WGvFZZ3rhDOx5vwYliu3C3/BVPAE/Z+e4XisTPz2EMZJLsE22PaJqefyTvYwsiKA
> > > zAoQ6JaCbUjjPW8/6DeHCJkQSzprtlKr8x6Dt28Q3QYRYkv0MrtTWs1D9fTVit9K
> > > OUmEmTusp6n2+aGRl8szzWf0+IOG8e40TgO+Pnhbis4+N7s0mRM=
> > > =HLXS
> > > -END PGP SIGNATURE-
> > >
> >
>



-- 
Thanks,
Xin

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Hequn Cheng 
Congratulations!

On Wed, May 9, 2018 at 4:40 AM, Rong Rong  wrote:

> Congratulations :-)
>
> On Tue, May 8, 2018 at 1:24 PM, Matthias J. Sax  wrote:
>
> > -BEGIN PGP SIGNED MESSAGE-
> > Hash: SHA512
> >
> > Congrats!
> >
> > On 5/8/18 12:28 PM, Shuyi Chen wrote:
> > > Congratulations!
> > >
> > > On Tue, May 8, 2018 at 12:18 PM, Dawid Wysakowicz <
> > > wysakowicz.da...@gmail.com> wrote:
> > >
> > >> Congratulations Nico and Xingcan! Well deserved!
> > >>
> > >>
> > >> On 08.05.2018 20:52, Fabian Hueske wrote:
> > >>> Hi everyone,
> > >>>
> > >>> I'm happy to announce that two members of the Flink community
> > >>> accepted
> > >> the
> > >>> offer of the PMC to become committers.
> > >>>
> > >>> * Xingcan Cui has been contributing to Flink for about a year,
> > >>> focusing
> > >> on
> > >>> Flink's relational APIs (SQL & Table API). In the past year,
> > >>> Xingcan has started design discussions, helped reviewing
> > >>> several pull requests, and replied to questions on the user
> > >>> mailing list.
> > >>>
> > >>> * Nico Kruber is an active contributor since 1.5 years and
> > >>> worked mostly
> > >> on
> > >>> internal features, such as the blob manager and a new network
> > >>> stack. Nico answers many questions on the user mailing list,
> > >>> reports lots of bugs and is a very active PR reviewer.
> > >>>
> > >>> Please join me in congratulating Xingcan and Nico.
> > >>>
> > >>> Cheers, Fabian
> > >>>
> > >>
> > >>
> > >>
> > >
> > >
> > -BEGIN PGP SIGNATURE-
> > Comment: GPGTools - https://gpgtools.org
> >
> > iQIzBAEBCgAdFiEEeiQdEa0SVXokodP3DccxaWtLg18FAlryB2MACgkQDccxaWtL
> > g1/VYRAAnC9AH3GCd4BWKUaEg0bWBLBtqQHYxYlkcHA0y/tQ70tJENNmf0yufPn4
> > FsT/1/PJlLQNBZfvoXnfAiMbveKph+9S4ieInN2ApURM+tTNKz0oLK3UW7YliHsR
> > 8qgpanfzB8wTN2LDi8sxwWMZBeWZq4hKI0hIxOWtMrPkztFAWehZnoBCYUy36x0p
> > QE57u89+x+HJDHWLLN0TWzyHwkvjhZlaqxbeWOlvG4wdEl4QV1Lr3wfx7uX9tbh3
> > 0LsWCqe7FqGoRQQ2q5xOCob0sQeOp3iYMRFZKva471DeANwAUdu1Jg/ImFNBbMbY
> > 8jLOw/dd+j49ULEC/+DYX4iKMDvLLNaDl8Slj7y3D2uJPBdjy4mfYpcpsKehr7vd
> > uIa2r7jkou08bQXc2W+BqCqQk8F7qNV8WRD8Ps8ekDgknIVLQiGXcjRBQkve1hoz
> > DaobnvsnDzusuYeOkap21bRq1iZoPzx8ZbVvLLwywxSarMb5UQQjBkx04FZjEBUB
> > WGvFZZ3rhDOx5vwYliu3C3/BVPAE/Z+e4XisTPz2EMZJLsE22PaJqefyTvYwsiKA
> > zAoQ6JaCbUjjPW8/6DeHCJkQSzprtlKr8x6Dt28Q3QYRYkv0MrtTWs1D9fTVit9K
> > OUmEmTusp6n2+aGRl8szzWf0+IOG8e40TgO+Pnhbis4+N7s0mRM=
> > =HLXS
> > -END PGP SIGNATURE-
> >
>

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Rong Rong 
Congratulations :-)

On Tue, May 8, 2018 at 1:24 PM, Matthias J. Sax  wrote:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
>
> Congrats!
>
> On 5/8/18 12:28 PM, Shuyi Chen wrote:
> > Congratulations!
> >
> > On Tue, May 8, 2018 at 12:18 PM, Dawid Wysakowicz <
> > wysakowicz.da...@gmail.com> wrote:
> >
> >> Congratulations Nico and Xingcan! Well deserved!
> >>
> >>
> >> On 08.05.2018 20:52, Fabian Hueske wrote:
> >>> Hi everyone,
> >>>
> >>> I'm happy to announce that two members of the Flink community
> >>> accepted
> >> the
> >>> offer of the PMC to become committers.
> >>>
> >>> * Xingcan Cui has been contributing to Flink for about a year,
> >>> focusing
> >> on
> >>> Flink's relational APIs (SQL & Table API). In the past year,
> >>> Xingcan has started design discussions, helped reviewing
> >>> several pull requests, and replied to questions on the user
> >>> mailing list.
> >>>
> >>> * Nico Kruber is an active contributor since 1.5 years and
> >>> worked mostly
> >> on
> >>> internal features, such as the blob manager and a new network
> >>> stack. Nico answers many questions on the user mailing list,
> >>> reports lots of bugs and is a very active PR reviewer.
> >>>
> >>> Please join me in congratulating Xingcan and Nico.
> >>>
> >>> Cheers, Fabian
> >>>
> >>
> >>
> >>
> >
> >
> -BEGIN PGP SIGNATURE-
> Comment: GPGTools - https://gpgtools.org
>
> iQIzBAEBCgAdFiEEeiQdEa0SVXokodP3DccxaWtLg18FAlryB2MACgkQDccxaWtL
> g1/VYRAAnC9AH3GCd4BWKUaEg0bWBLBtqQHYxYlkcHA0y/tQ70tJENNmf0yufPn4
> FsT/1/PJlLQNBZfvoXnfAiMbveKph+9S4ieInN2ApURM+tTNKz0oLK3UW7YliHsR
> 8qgpanfzB8wTN2LDi8sxwWMZBeWZq4hKI0hIxOWtMrPkztFAWehZnoBCYUy36x0p
> QE57u89+x+HJDHWLLN0TWzyHwkvjhZlaqxbeWOlvG4wdEl4QV1Lr3wfx7uX9tbh3
> 0LsWCqe7FqGoRQQ2q5xOCob0sQeOp3iYMRFZKva471DeANwAUdu1Jg/ImFNBbMbY
> 8jLOw/dd+j49ULEC/+DYX4iKMDvLLNaDl8Slj7y3D2uJPBdjy4mfYpcpsKehr7vd
> uIa2r7jkou08bQXc2W+BqCqQk8F7qNV8WRD8Ps8ekDgknIVLQiGXcjRBQkve1hoz
> DaobnvsnDzusuYeOkap21bRq1iZoPzx8ZbVvLLwywxSarMb5UQQjBkx04FZjEBUB
> WGvFZZ3rhDOx5vwYliu3C3/BVPAE/Z+e4XisTPz2EMZJLsE22PaJqefyTvYwsiKA
> zAoQ6JaCbUjjPW8/6DeHCJkQSzprtlKr8x6Dt28Q3QYRYkv0MrtTWs1D9fTVit9K
> OUmEmTusp6n2+aGRl8szzWf0+IOG8e40TgO+Pnhbis4+N7s0mRM=
> =HLXS
> -END PGP SIGNATURE-
>

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Matthias J. Sax 
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Congrats!

On 5/8/18 12:28 PM, Shuyi Chen wrote:
> Congratulations!
> 
> On Tue, May 8, 2018 at 12:18 PM, Dawid Wysakowicz < 
> wysakowicz.da...@gmail.com> wrote:
> 
>> Congratulations Nico and Xingcan! Well deserved!
>> 
>> 
>> On 08.05.2018 20:52, Fabian Hueske wrote:
>>> Hi everyone,
>>> 
>>> I'm happy to announce that two members of the Flink community
>>> accepted
>> the
>>> offer of the PMC to become committers.
>>> 
>>> * Xingcan Cui has been contributing to Flink for about a year,
>>> focusing
>> on
>>> Flink's relational APIs (SQL & Table API). In the past year,
>>> Xingcan has started design discussions, helped reviewing
>>> several pull requests, and replied to questions on the user
>>> mailing list.
>>> 
>>> * Nico Kruber is an active contributor since 1.5 years and
>>> worked mostly
>> on
>>> internal features, such as the blob manager and a new network
>>> stack. Nico answers many questions on the user mailing list,
>>> reports lots of bugs and is a very active PR reviewer.
>>> 
>>> Please join me in congratulating Xingcan and Nico.
>>> 
>>> Cheers, Fabian
>>> 
>> 
>> 
>> 
> 
> 
-BEGIN PGP SIGNATURE-
Comment: GPGTools - https://gpgtools.org

iQIzBAEBCgAdFiEEeiQdEa0SVXokodP3DccxaWtLg18FAlryB2MACgkQDccxaWtL
g1/VYRAAnC9AH3GCd4BWKUaEg0bWBLBtqQHYxYlkcHA0y/tQ70tJENNmf0yufPn4
FsT/1/PJlLQNBZfvoXnfAiMbveKph+9S4ieInN2ApURM+tTNKz0oLK3UW7YliHsR
8qgpanfzB8wTN2LDi8sxwWMZBeWZq4hKI0hIxOWtMrPkztFAWehZnoBCYUy36x0p
QE57u89+x+HJDHWLLN0TWzyHwkvjhZlaqxbeWOlvG4wdEl4QV1Lr3wfx7uX9tbh3
0LsWCqe7FqGoRQQ2q5xOCob0sQeOp3iYMRFZKva471DeANwAUdu1Jg/ImFNBbMbY
8jLOw/dd+j49ULEC/+DYX4iKMDvLLNaDl8Slj7y3D2uJPBdjy4mfYpcpsKehr7vd
uIa2r7jkou08bQXc2W+BqCqQk8F7qNV8WRD8Ps8ekDgknIVLQiGXcjRBQkve1hoz
DaobnvsnDzusuYeOkap21bRq1iZoPzx8ZbVvLLwywxSarMb5UQQjBkx04FZjEBUB
WGvFZZ3rhDOx5vwYliu3C3/BVPAE/Z+e4XisTPz2EMZJLsE22PaJqefyTvYwsiKA
zAoQ6JaCbUjjPW8/6DeHCJkQSzprtlKr8x6Dt28Q3QYRYkv0MrtTWs1D9fTVit9K
OUmEmTusp6n2+aGRl8szzWf0+IOG8e40TgO+Pnhbis4+N7s0mRM=
=HLXS
-END PGP SIGNATURE-

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Shuyi Chen 
Congratulations!

On Tue, May 8, 2018 at 12:18 PM, Dawid Wysakowicz <
wysakowicz.da...@gmail.com> wrote:

> Congratulations Nico and Xingcan! Well deserved!
>
>
> On 08.05.2018 20:52, Fabian Hueske wrote:
> > Hi everyone,
> >
> > I'm happy to announce that two members of the Flink community accepted
> the
> > offer of the PMC to become committers.
> >
> > * Xingcan Cui has been contributing to Flink for about a year, focusing
> on
> > Flink's relational APIs (SQL & Table API). In the past year, Xingcan has
> > started design discussions, helped reviewing several pull requests, and
> > replied to questions on the user mailing list.
> >
> > * Nico Kruber is an active contributor since 1.5 years and worked mostly
> on
> > internal features, such as the blob manager and a new network stack. Nico
> > answers many questions on the user mailing list, reports lots of bugs and
> > is a very active PR reviewer.
> >
> > Please join me in congratulating Xingcan and Nico.
> >
> > Cheers,
> > Fabian
> >
>
>
>


-- 
"So you have to trust that the dots will somehow connect in your future."

Re: [HA] Is it possible to remove external dependency caused by high-availability.zookeeper.storageDir

2018-05-08 Thread Fabian Hueske 
Hi Hao,

You do not necessarily need HDFS but some kind of distribute filesystem
that can be accessed from all nodes is required.
Flink doesn't need the FS just for job meta data, but also to store
checkpoints of the application state for fault tolerance.

Best, Fabian

2018-05-08 4:31 GMT+02:00 Hao Chen :

> Hi,
>
> As for lots of companies, we have different architectures for
> near-time/off-line analytics platform (fink vs hadoop), so we may not
> want flink cluster to depend on a shared HDFS as an additional dependency
> to operate especially we may deploy the streaming stack all on k8s
> including kafka/flink without hdfs.
>
> Is it possible to implement a way to sync metadata across different HA job
> managers instead of depending on a shared file system
> for high-availability.zookeeper.storageDir.
>
>
> --
>
> Hao
>

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Dawid Wysakowicz 
Congratulations Nico and Xingcan! Well deserved!


On 08.05.2018 20:52, Fabian Hueske wrote:
> Hi everyone,
>
> I'm happy to announce that two members of the Flink community accepted the
> offer of the PMC to become committers.
>
> * Xingcan Cui has been contributing to Flink for about a year, focusing on
> Flink's relational APIs (SQL & Table API). In the past year, Xingcan has
> started design discussions, helped reviewing several pull requests, and
> replied to questions on the user mailing list.
>
> * Nico Kruber is an active contributor since 1.5 years and worked mostly on
> internal features, such as the blob manager and a new network stack. Nico
> answers many questions on the user mailing list, reports lots of bugs and
> is a very active PR reviewer.
>
> Please join me in congratulating Xingcan and Nico.
>
> Cheers,
> Fabian
>




signature.asc
Description: OpenPGP digital signature

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Ted Yu 
Congratulations, Xingcan and Nico !

On Tue, May 8, 2018 at 11:52 AM, Fabian Hueske  wrote:

> Hi everyone,
>
> I'm happy to announce that two members of the Flink community accepted the
> offer of the PMC to become committers.
>
> * Xingcan Cui has been contributing to Flink for about a year, focusing on
> Flink's relational APIs (SQL & Table API). In the past year, Xingcan has
> started design discussions, helped reviewing several pull requests, and
> replied to questions on the user mailing list.
>
> * Nico Kruber is an active contributor since 1.5 years and worked mostly on
> internal features, such as the blob manager and a new network stack. Nico
> answers many questions on the user mailing list, reports lots of bugs and
> is a very active PR reviewer.
>
> Please join me in congratulating Xingcan and Nico.
>
> Cheers,
> Fabian
>

[ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Fabian Hueske 
Hi everyone,

I'm happy to announce that two members of the Flink community accepted the
offer of the PMC to become committers.

* Xingcan Cui has been contributing to Flink for about a year, focusing on
Flink's relational APIs (SQL & Table API). In the past year, Xingcan has
started design discussions, helped reviewing several pull requests, and
replied to questions on the user mailing list.

* Nico Kruber is an active contributor since 1.5 years and worked mostly on
internal features, such as the blob manager and a new network stack. Nico
answers many questions on the user mailing list, reports lots of bugs and
is a very active PR reviewer.

Please join me in congratulating Xingcan and Nico.

Cheers,
Fabian

[jira] [Created] (FLINK-9316) Expose operator unique ID to the DataStream operators.

2018-05-08 Thread Piotr Nowojski (JIRA) 
Piotr Nowojski created FLINK-9316:
-

 Summary: Expose operator unique ID to the DataStream operators.
 Key: FLINK-9316
 URL: https://issues.apache.org/jira/browse/FLINK-9316
 Project: Flink
  Issue Type: New Feature
  Components: Streaming
Reporter: Piotr Nowojski
Assignee: Piotr Nowojski
 Fix For: 1.5.0


This is a prerequisite to fix https://issues.apache.org/jira/browse/FLINK-9295



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)