What is your exact set of requirements for algo trading? Is it react in real-time or analysis over longer time? In the first case, I do not think a framework such as Spark or Flink makes sense. They are generic, but in order to compete with other usually custom developed highly - specialized engines in a low level language you need something else.
> On 18 Apr 2016, at 09:19, Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > > Please forgive me for going in tangent > > Well there may be many SQL engines but only 5-6 are in the league. Oracle has > Oracle and MySQL plus TimesTen from various acquisitions. SAP has Hana, SAP > ASE, SAP IQ and few others again from acquiring Sybase . So very few big > players. > > Cars, Fiat owns many groups including Ferrari and Maserati. The beloved > Jaguar belongs to Tata Motors and Rolls Royce belongs to BMW and actually > uses BMW engines. VW has many companies from Seat to Skoda etc. > > However, that is the results of Markets getting too fragmented when > consolidation happens. Big data world is quite young but I gather it will go > the same way as most go, consolidation. > > Anyway my original point was finding a tool that allows me to do CEP on Algo > trading using Kafka + another. As of now there is really none. I am still > exploring if Flink can do the job. > > HTH > > Dr Mich Talebzadeh > > LinkedIn > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > http://talebzadehmich.wordpress.com > > >> On 18 April 2016 at 07:46, Sean Owen <so...@cloudera.com> wrote: >> Interesting tangent. I think there will never be a time when an >> interesting area is covered only by one project, or product. Why are >> there 30 SQL engines? or 50 car companies? it's a feature not a bug. >> To the extent they provide different tradeoffs or functionality, >> they're not entirely duplicative; to the extent they compete directly, >> it's a win for the user. >> >> As others have said, Flink (née Stratosphere) started quite a while >> ago. But you can draw lines of influence back earlier than Spark. I >> presume MS Dryad is the forerunner of all these. >> >> And in case you wanted a third option, Google's DataFlow (now Apache >> Beam) is really a reinvention of FlumeJava (nothing to do with Apache >> Flume) from Google, in a way that Crunch was a port and minor update >> of FlumeJava earlier. And it claims to run on Flink/Spark if you want. >> >> https://cloud.google.com/dataflow/blog/dataflow-beam-and-spark-comparison >> >> >> On Sun, Apr 17, 2016 at 10:25 PM, Mich Talebzadeh >> <mich.talebza...@gmail.com> wrote: >> > Also it always amazes me why they are so many tangential projects in Big >> > Data space? Would not it be easier if efforts were spent on adding to Spark >> > functionality rather than creating a new product like Flink? >
