Hi, cool! Can you generalize the input format to read JSON into an arbitrary POJO?
It would be great if you could contribute the InputFormat into the "flink-contrib" module. I've seen many users reading JSON data with Flink, so its good to have a standard solution for that. If you want you can add the "Tweet into POJO" as an example into flink-contrib. On Fri, Feb 27, 2015 at 10:37 AM, Mustafa Elbehery < elbeherymust...@gmail.com> wrote: > Hi, > > I am really sorry for being so late, it was a whole month of projects and > examination, I was really busy. > > @Robert, it is IF for reading tweet into Pojo. I use an event-driven > parser, I retrieve most of the tweet into Java Pojos, it was tested on 1TB > dataset, for a Flink ETL job, and the performance was pretty good. > > > > On Sun, Jan 25, 2015 at 7:38 PM, Robert Metzger <rmetz...@apache.org> > wrote: > > > Hey, > > > > is it a input format for reading JSON data or an IF for reading tweets in > > some format into a pojo? > > > > I think a JSON Input Format would be something very useful for our users. > > Maybe you can add that and use the Tweet IF as a concrete example for > that? > > Do you have a preview of the code somewhere? > > > > Best, > > Robert > > > > On Sat, Jan 24, 2015 at 11:06 AM, Fabian Hueske <fhue...@gmail.com> > wrote: > > > > > Hi Mustafa, > > > > > > that would be a nice contribution! > > > > > > We are currently discussing how to add "non-core" API features into > Flink > > > [1]. > > > I will move this discussion onto the mailing list to decide where to > add > > > cool add-ons like yours. > > > > > > Cheers, Fabian > > > > > > [1] https://issues.apache.org/jira/browse/FLINK-1398 > > > > > > 2015-01-23 20:42 GMT+01:00 Henry Saputra <henry.sapu...@gmail.com>: > > > > > > > Contributions are welcomed! > > > > > > > > Here is the link on how to contribute to Apache Flink: > > > > http://flink.apache.org/how-to-contribute.html > > > > > > > > You can start by creating JIRA ticket [1] to help describe what you > > > > wanted to do and to get feedback from community. > > > > > > > > > > > > - Henry > > > > > > > > [1] https://issues.apache.org/jira/secure/Dashboard.jspa > > > > > > > > On Fri, Jan 23, 2015 at 10:54 AM, Mustafa Elbehery > > > > <elbeherymust...@gmail.com> wrote: > > > > > Hi, > > > > > > > > > > I have created a custom InputFormat for tweets on Flink, based on > > > > > JSON-Simple event driven parser. I would like to contribute my work > > > into > > > > > Flink, > > > > > > > > > > Regards. > > > > > > > > > > -- > > > > > Mustafa Elbehery > > > > > EIT ICT Labs Master School < > > > http://www.masterschool.eitictlabs.eu/home/> > > > > > +49(0)15218676094 > > > > > skype: mustafaelbehery87 > > > > > > > > > > > > > -- > Mustafa Elbehery > EIT ICT Labs Master School <http://www.masterschool.eitictlabs.eu/home/> > +49(0)15218676094 > skype: mustafaelbehery87 >
