Re: There is no Open and Close method in Async I/O API of Scala

2017-02-12 Thread Tzu-Li (Gordon) Tai
Hi Howard, I don’t think there is a rich variant for Async IO in Scala yet. We should perhaps add support for it. Looped in Till who worked on the Async IO and its Scala support to clarify whether there were any concerns in not supporting it initially. Cheers, Gordon On February 13, 2017 at

Re: Specifying Schema dynamically

2017-02-12 Thread Tzu-Li (Gordon) Tai
Hi Luqman, From your description, it seems like that you want to infer the type (case class, tuple, etc.) of a stream dynamically at runtime. AFAIK, I don’t think this is supported in Flink. You’re required to have defined types for your DataStreams. Could you also provide an example code of

There is no Open and Close method in Async I/O API of Scala

2017-02-12 Thread Howard,Li(vip.com)
Hi, I’m going to test async IO of scala version. As we can see in https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/stream/asyncio.html. The java version of async IO API has method of open and close, in which I can do some init and clean work. The scala api, however, has

Re: Start streaming tuples depending on another streams rate

2017-02-12 Thread Jonas
For 2: You can also NOT read the Source (i.e. Kafka) while doing that. This way you don't have to buffer. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Start-streaming-tuples-depending-on-another-streams-rate-tp11542p11590.html Sent from

Re: Flink 1.2 Maven dependency

2017-02-12 Thread Robert Metzger
Hi Dominik, I hope the artifacts were distributed properly. did you get download errors for the 1.2.0 version from any official maven servers? Maybe mvnrepository.com is slow indexing new artifacts? Best, Robert On Fri, Feb 10, 2017 at 12:02 AM, Yassine MARZOUGUI < y.marzou...@mindlytix.com>

Re: Flink 1.2 and Cassandra Connector

2017-02-12 Thread Robert Metzger
Hi Nico, The cassandra connector should be available on Maven central: http://search.maven.org/#artifactdetails%7Corg.apache.flink%7Cflink-connector-cassandra_2.10%7C1.2.0%7Cjar Potentially, the issue you've mentioned is due to some shading issue. Is the "com/codahale/metrics/Metric" class in

Specifying Schema dynamically

2017-02-12 Thread Luqman Ghani
Hi, I hope everyone is doing well. I have a use case where we infer schema according to file headers and other information. Now, in Flink, we can specify schema of a stream with case classes and tuples. With tuples, we cannot give names to fields, but we will have to generate case classes on the