The meeting notes and results of discussion are next: 1. We are going to release Apache Ignite 2.8 with limited support of Spark 2.4.4 (known issues are listed here https://issues.apache.org/jira/browse/IGNITE-12054) 2. The AI 2.8 will support both, Spark 2.3 and Spark 2.4.4 with known fixed bugs 3. We will create the developer-profiles spark_2_3 and spark_2_4 separately from current scala profile 4. We are ready to move the Ignite-Spark integration to the separate module after release 2.8 with support of most actual Spark versions and with independent release cycle 5. We will work together on the next release roadmap with Nikolay and all interested igniters to improve the current solution (add new features as thin client support, working with caches via binary object and so on) 6. Nikolay is ready to help with the review of tickets as an author of this component
Thanks пн, 14 окт. 2019 г. в 14:36, Alexey Zinoviev <[email protected]>: > Yes, let's use the Russian for short discussion, the meeting notes will be > presented in English > > пн, 14 окт. 2019 г. в 14:08, Nikolay Izhikov <[email protected]>: > >> Hello, Alexey. >> >> I'm ready to take part in the meeting. >> It will be in Russian, isn't it? >> >> В Пн, 14/10/2019 в 14:00 +0300, Alexey Zinoviev пишет: >> > Hi, Igniters, and especially Nikolay Izhikov >> > >> > I suggest to arrange the meeting via ASF-slack in >> #ignite-spark-integration >> > channel at 17 October, in 16 MSK Time. >> > The language of the meeting: Russian >> > >> > *The topics to discuss:* >> > >> > - Review of next tickets >> > >> > >> > 1. [Spark][Bug] IgniteSpark integration forget to close the >> > IgniteContext and stops the client node in case if error during >> > PairFunction logic >> > <https://issues.apache.org/jira/browse/IGNITE-11724> >> > 2. [Spark] Add initial support of Spark 2.4 >> > <https://issues.apache.org/jira/browse/IGNITE-12247> >> > 3. [Spark] Add joins to Spark Dataframe examples >> > <https://issues.apache.org/jira/browse/IGNITE-9732> >> > >> > >> > - Known issues of migration to 2.4 version >> > - Organization of multiple version support for Apache Spark >> > >> > P.S. meeting notes will be shared with the community >> > P.P.S Nikolay, if you have any objections about the time or topics, >> please >> > let me know >> >
