That sounds good Alex :) On Tue, 22 Oct 2024 at 4:31 PM Alexander Alten <a...@scalytics.io> wrote:
> Hey, > > I think the best way would be to implement a plan-API which exposes the > plan so you can serialize it? We discussed this a while ago, but we didn’t > saw the necessity. Now it’s clear. > > What do you think, Vedanta? Or do you have any ideas? > > Best, > —Alex > > > On Oct 22, 2024, at 12:30 PM, vedanta neogi <vedantane...@gmail.com> > wrote: > > > > Hi Zoi, > > Thanks for your reply > > > > Allow me to explain what I'm trying to do at the moment: > > > > Below is a screenshot of the planBuilder that implements the WordCount > example from the Wayang repository > > > > > > > > So in order to incorporate wayang in our FL framework, we essentially > need to serialise this WayangPlan (or alternatively the planBuilder) > > > > The approach we were taking involved extracting the operators from the > planBuilder, serializing them, sending these serialized operators as pekko > messages to clients, deserializing them locally, and recreating the plan > using those operators and executing the plan > > > > However the issue we are facing at the moment is that we are unable to > uncover the WayangPlan object using the planBuilder object. The reason is > that most of the methods that we require to do this are private, and hence > can't be accessed outside the class. > > > > Could you please suggest a remedy to this, or an alternate approach > perhaps? > > > > Kaustubh said you would connect us with Juri, and he would be able to > help out > > > > Appreciate your inputs, and grateful for the same > > > > Thanks, > > Vedanta > > > > On Tue, Oct 15, 2024 at 5:08 PM Zoi Kaoudi <zkao...@yahoo.gr.invalid> > wrote: > >> Hi Vedana, > >> here is a json serializer: > https://github.com/apache/incubator-wayang/blob/31b5a295186f3d6d9ac3e0a18b2adf15b2304cc4/wayang-commons/wayang-core/src/main/java/org/apache/wayang/core/util/JsonSerializer.java > < > https://www.google.com/url?q=https://github.com/apache/incubator-wayang/blob/31b5a295186f3d6d9ac3e0a18b2adf15b2304cc4/wayang-commons/wayang-core/src/main/java/org/apache/wayang/core/util/JsonSerializer.java&source=gmail-imap&ust=1730197880000000&usg=AOvVaw2Vfi-zrWiONrmiLqZE4MPU > > > >> Hope this works for you. > >> Let us know if you need anything else. > >> Best > >> -- > >> Zoi > >> > >> > >> Στις Δευτέρα 14 Οκτωβρίου 2024 στις 12:25:07 μ.μ. CEST, ο χρήστης > vedanta neogi <vedantane...@gmail.com <mailto:vedantane...@gmail.com>> > έγραψε: > >> > >> Just to give some context: > >> I am trying to implement a FL framework where the computation at the > >> client’s end is abstracted out as a wayang job. > >> > >> On Mon, 14 Oct 2024 at 1:43 PM vedanta neogi <vedantane...@gmail.com > <mailto:vedantane...@gmail.com>> wrote: > >> > >> > Is there some pre-existing code that serialises a wayang job in Java? > >> > Could you share it? Thanks > >> > > > -- > *Why Scalytics:* > Break data silos. Put your data to work. All without ever > sharing your data. That's the Scalytics difference. > > > -- > 3401 N. MIAMI AVE. > STE 230 > 33127 Miami, Florida > United States > www.scalytics.io > <http://www.scalytics.io> > > -- Please consider the environment before > printing this email -- > > Disclaimer: > The content of this message is > confidential. If you have received it by mistake, please inform us by an > email reply and then delete the message. It is forbidden to copy, forward, > or in any way reveal the contents of this message to anyone. The integrity > and security of this email cannot be guaranteed over the Internet. > Therefore, the sender will not be held liable for any damage caused by the > message. >
