Thanks for the info @Wiliam. We are probably seeking for a streaming framework which is Engineering-oriented. The documentation you provided are mostly Algorithm-oriented. For instance, as an algorithm engineer, I can implement the algorithm Logistic regression by hand. But I won't do this, instead I will use a framework such as Tensorflow, which is much easier and more standard. For an engineering-oriented platform and technology details, please refer to this small book: https://mapr.com/introduction-to-apache-flink/assets/introduction-to-apache-flink.pdf
And, we team know streaming well, if the community has the interest to develop that a framework, we will try our best to support it. Thank you. On Wed, Jul 15, 2020 at 11:13 AM William Michels <w...@caa.columbia.edu> wrote: > Hi Warren, > > The topic you raise is an interesting one. When I've previously > searched for 'streaming' and 'Python' I often see articles on > Iterables such as the following: > > [1] "Data streaming in Python: generators, iterators, iterables" > > https://rare-technologies.com/data-streaming-in-python-generators-iterators-iterables/ > > [2] "Python Basics: Iteration, Iterables, Iterators, and Looping" > > https://towardsdatascience.com/python-basics-iteration-and-looping-6ca63b30835c > > From the first URL, there is an introductory quote regarding Lazy > Evaluation. Well, Raku does Lazy Evaluation, so no problem there: > > "There are tools and concepts in computing that are very powerful but > potentially confusing even to advanced users. One such concept is data > streaming (aka lazy evaluation), which can be realized neatly and > natively in Python." > > From the second URL, you will find a discussion on Iterators: > "An iterator is an object representing a stream of data. You can > create an iterator object by applying the iter() built-in function to > an iterable." > > So maybe we should be looking for articles on Iterators in Raku? Well > as luck would have it, there are two recent blog posts on the subject: > > https://datakinds.github.io/2020/06/24/python-s-itertools-in-pure-raku > https://datakinds.github.io/2020/06/25/explaining-raku-using-itertools > > And if you want to search further, you can also take a look at this > series of four Raku (Perl6) blog posts--which has been recently > updated--but stretches all the way back to 2018: > > https://0racle.info/articles/pick_and_choose_part_n > > HTH, Bill. > > W. Michels, Ph.D. > > > > > > > On Tue, Jul 14, 2020 at 5:43 PM Warren Pang <war...@gmail.com> wrote: > > > > Thank you all very much. > > > > I have tried to search "perl discussion" and it brings me to perl6's > list page. > > Yes for data analysis we primarily use classic perl5, which is smart > enough especially the regex matching. > > There are "spark streaming", "flink streaming", "storm streaming", and a > lot of others, but they don't support perl language well. > > So I expect the community, either perl6 or perl5, can make that a > framework. > > We can't lose the capability in big data, cloud computing, AI, ML, > streaming, these are the main features of current internet. > > Everyone today writes CGI with perl? NO. > > > > Thanks. > > >
