+1 The current tutorial just tells the Scala Apex developer to walk. Scala tuned API can make them run.
Siyuan, why don't you open a JIRA issue to track it so someone interested can take it? -- Chetan On Tue, Sep 29, 2015 at 1:27 PM, Siyuan Hua <[email protected]> wrote: > This is a good example. But the code here is still in Java style. > I wish we could have another abstraction of scala api in the roadmap that > could leverage the functional paradigm to write code in a concise way: > for example: > A simple statement like this > stream.map(filter(tuple) -> {}, 5).reduce(aggregate(tuple, tuple)->{}, 1) > could spin up 5 filter operators and 1 aggregation operator > > Siyuan > > > On Tue, Sep 29, 2015 at 7:40 AM, Munagala Ramanath <[email protected]> > wrote: > > > Languages like Scala, Clojure and dialects like Jython and JRuby are > easier > > to > > support since they are JVM based and can interoperate with Java. > > > > Non JVM lanugages are a lot more work to support and also present > > significant > > performance issues because converting objects across the JVM boundary is > > often a heavy duty process. > > > > Ram > > > > On Mon, Sep 28, 2015 at 11:36 PM, Chinmay Kolhatkar < > > [email protected] > > > wrote: > > > > > This is great. Would it also make sense to have similar using native > > > language like C++ using JNI bindings. > > > > > > To my knowledge, complex enterprise based applications prefer language > > > closer to native for high performance and better memory utilization. > > > If we could get writing a streaming application in C++ along with power > > of > > > Apex, that would add a lot of value in my opinion. > > > > > > Any thoughts? > > > > > > > > > ~ Chinmay. > > > > > > On Mon, Sep 28, 2015 at 9:06 PM, Munagala Ramanath < > [email protected]> > > > wrote: > > > > > > > Hi Tushar, > > > > > > > > This is a great project to add to dtBackyard at: > > > > > > https://sites.google.com/a/datatorrent.com/dtbackyard/project-ownership > > > > > > > > Ram > > > > > > > > On Mon, Sep 28, 2015 at 7:29 AM, Tushar Gosavi < > [email protected] > > > > > > > wrote: > > > > > > > > > Hi All, > > > > > > > > > > I am trying to see how we can write a Streaming Application using > > Scala > > > > > language, > > > > > as Scala targets JVM and has good interoperability with Java. > > > > > > > > > > I am able to port simple pi demo in Scala along with the operators. > > > > Please > > > > > take > > > > > a look at PR#40 ( > > > https://github.com/apache/incubator-apex-malhar/pull/40 > > > > ) > > > > > for this work, and provide feedback. > > > > > > > > > > Created following operators in Scala > > > > > - RandomItemGenerator : Generate random points in 2d space. > > > > > - PiCalculator : Calculates value of pi > > > > > - ConsoleOutOperator : Write value of tuple on stdout, I could > not > > > use > > > > > the Java operator available in Malhar, because scala does more > strong > > > > type > > > > > checking. (I need to look into this more) > > > > > > > > > > And use these operators to write a simple streaming application. > > > > > > > > > > The following functionality is working > > > > > - Scala Operators recovers correctly from the crash. > > > > > - Scala supports generating setters/getters using @BeanProperty > > > > annotation, > > > > > and these > > > > > properties become accessible through config file and we can set > > them > > > > > dynamically through dtcli. > > > > > - get-operator-properties is working. > > > > > > > > > > > > > > > Thanks, > > > > > -Tushar. > > > > > > > > > > > > > > >
