Hey, I think the best way would be to implement a plan-API which exposes the plan so you can serialize it? We discussed this a while ago, but we didn’t saw the necessity. Now it’s clear.
What do you think, Vedanta? Or do you have any ideas? Best, —Alex > On Oct 22, 2024, at 12:30 PM, vedanta neogi <vedantane...@gmail.com> wrote: > > Hi Zoi, > Thanks for your reply > > Allow me to explain what I'm trying to do at the moment: > > Below is a screenshot of the planBuilder that implements the WordCount > example from the Wayang repository > > > > So in order to incorporate wayang in our FL framework, we essentially need to > serialise this WayangPlan (or alternatively the planBuilder) > > The approach we were taking involved extracting the operators from the > planBuilder, serializing them, sending these serialized operators as pekko > messages to clients, deserializing them locally, and recreating the plan > using those operators and executing the plan > > However the issue we are facing at the moment is that we are unable to > uncover the WayangPlan object using the planBuilder object. The reason is > that most of the methods that we require to do this are private, and hence > can't be accessed outside the class. > > Could you please suggest a remedy to this, or an alternate approach perhaps? > > Kaustubh said you would connect us with Juri, and he would be able to help out > > Appreciate your inputs, and grateful for the same > > Thanks, > Vedanta > > On Tue, Oct 15, 2024 at 5:08 PM Zoi Kaoudi <zkao...@yahoo.gr.invalid> wrote: >> Hi Vedana, >> here is a json serializer: >> https://github.com/apache/incubator-wayang/blob/31b5a295186f3d6d9ac3e0a18b2adf15b2304cc4/wayang-commons/wayang-core/src/main/java/org/apache/wayang/core/util/JsonSerializer.java >> >> <https://www.google.com/url?q=https://github.com/apache/incubator-wayang/blob/31b5a295186f3d6d9ac3e0a18b2adf15b2304cc4/wayang-commons/wayang-core/src/main/java/org/apache/wayang/core/util/JsonSerializer.java&source=gmail-imap&ust=1730197880000000&usg=AOvVaw2Vfi-zrWiONrmiLqZE4MPU> >> Hope this works for you. >> Let us know if you need anything else. >> Best >> -- >> Zoi >> >> >> Στις Δευτέρα 14 Οκτωβρίου 2024 στις 12:25:07 μ.μ. CEST, ο χρήστης >> vedanta neogi <vedantane...@gmail.com <mailto:vedantane...@gmail.com>> >> έγραψε: >> >> Just to give some context: >> I am trying to implement a FL framework where the computation at the >> client’s end is abstracted out as a wayang job. >> >> On Mon, 14 Oct 2024 at 1:43 PM vedanta neogi <vedantane...@gmail.com >> <mailto:vedantane...@gmail.com>> wrote: >> >> > Is there some pre-existing code that serialises a wayang job in Java? >> > Could you share it? Thanks >> -- *Why Scalytics:* Break data silos. Put your data to work. All without ever sharing your data. That's the Scalytics difference. -- 3401 N. MIAMI AVE. STE 230 33127 Miami, Florida United States www.scalytics.io <http://www.scalytics.io> -- Please consider the environment before printing this email -- Disclaimer: The content of this message is confidential. If you have received it by mistake, please inform us by an email reply and then delete the message. It is forbidden to copy, forward, or in any way reveal the contents of this message to anyone. The integrity and security of this email cannot be guaranteed over the Internet. Therefore, the sender will not be held liable for any damage caused by the message.
