This is an automated email from the ASF dual-hosted git repository. bertty pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git
commit 18a01c4e052e65d970dd920fb97154d6c5b2e02c Author: Zoi Kaoudi <[email protected]> AuthorDate: Wed Oct 20 00:06:00 2021 +0200 Update README.md minor fix Fixed some typos --- README.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index ff9c25b..fab9218 100644 --- a/README.md +++ b/README.md @@ -7,14 +7,14 @@   -#### Turning a shadows into a show +#### The first cross-platform data processing system +In contrast to traditional data processing systems that provide one dedicated execution engine, Apache Wayang is a *cross-platform data processing system*: Users can specify any data processing application using one of Wayang's API and then Wayang will choose the data processing platform(s), e.g., Postgres or Apache Spark, that best fits the application. Finally, Wayang will perform the execution, thereby hiding the different platform-specific APIs and coordinating inter-platform communication. -Apache Wayang in contrast to classical data processing systems that provide one dedicated execution engine, Apache Wayang rather is a *meta processing framework*: You can specify your data processing app via one of Wayang's API and then Wayang will pick an optimal configuration of classical processing frameworks, such as Java Streams or Apache Spark, to run your app on. Finally, Wayang will also perform the execution, thereby hiding the different specific platform APIs and coordinate int [...] - -This approach aims at freeing data engineers and software developers from the burden of knowing the zoo of different data processing systems, their APIs, strengths and weakness; the intricacies of coordinating and integrating different processing platforms; and the inflexibility when tying to a fix set of processing platforms. As of now, Wayang has built in support for the following processing platforms: +Apache Wayang aims at freeing data engineers and software developers from the burden of learning all different data processing systems, their APIs, strengths and weaknesses; the intricacies of coordinating and integrating different processing platforms; and the inflexibility when trying a fixed set of processing platforms. As of now, Wayang has built-in support for the following processing platforms: - [Java Streams](https://docs.oracle.com/javase/8/docs/api/java/util/stream/Stream.html) - [Apache Spark](https://spark.apache.org/) +- [Apache Flink](https://flink.apache.org/) - [GraphChi](https://github.com/GraphChi/graphchi-java) - [Postgres](http://www.postgresql.org) - [SQLite](https://www.sqlite.org/) @@ -22,11 +22,11 @@ This approach aims at freeing data engineers and software developers from the bu ## How to use Wayang **Requirements.** -Apache Wayang is built with Java 8 and Scala 2.11. However, to execute Wayang it is sufficient to have Java 8 installed. If you want to build Wayang yourself, you will also need to have [Apache Maven](http://maven.apache.org) installed and Apache Hadoop (The version that you want). Please also consider that processing platforms employed by Wayang might have further requirements. +Apache Wayang is built with Java 8 and Scala 2.11. However, to execute Wayang it is sufficient to have Java 8 installed. If you want to build Wayang yourself, you will also need to have [Apache Maven](http://maven.apache.org) installed and Apache Hadoop (the version that you want). Please also consider that processing platforms employed by Wayang might have further requirements. -> **NOTE:** In windows, you need to define the variable `HADOOP_HOME` with the winutils.exe, an not official option to obtain [this repository](https://github.com/steveloughran/winutils), or you can generate your winutils.exe following the instruction in the repository. Also, you may need to install [msvcr100.dll](https://www.microsoft.com/en-us/download/details.aspx?id=26999) +> **NOTE:** In windows, you need to define the variable `HADOOP_HOME` with the winutils.exe, an not official option to obtain [this repository](https://github.com/steveloughran/winutils), or you can generate your winutils.exe following the instructions in the repository. Also, you may need to install [msvcr100.dll](https://www.microsoft.com/en-us/download/details.aspx?id=26999) -> **NOTE:** Currently Apache Wayang is updating Java and Scala, consider that for you be enable to utilize Scala 2.12 you will need to install Java 11 in your enviroment +> **NOTE:** Currently Apache Wayang is updating Java and Scala, consider that to be able to utilize Scala 2.12 you will need to install Java 11 in your enviroment **Get Wayang.** Wayang is available via Maven Central. To use it with Maven, for instance, include the following into you POM file:
