The Apache Wayang team is pleased to announce the release of Apache Wayang 1.1.1 Wayang is a cross-engine data processing system which (i) decouples applications from underlying data processing engines, such as Apache Flink, Apache Spark, databases, or ML systems, and (ii) automatically determines the optimal combination of engines to execute a given data pipeline using an optimizer.
The current release contains: * Support for bounded streaming textfile source, DataStream- map-, join- and collection sink operators in Flink platform * Spark executor can submit dataframe queries to Spark and not only RDD jobs * Security fixes on the object file sources for Java platform and Spark Visit the Apache Wayang website [1] for general information or the downloads page [2] for release notes and download information. Regards, The Apache Wayang team [1] http://wayang.apache.org [2] https://wayang.apache.org/docs/start/download
