Angel, okay, I see the announcement. Thanks for bringing that to my attention. So, I started out getting up to speed on GraphFrames and doing a little maintenance. Next I'm going to go in and fix some bugs in GraphX. On the GraphFrames side, there is actually a bug converting GraphFrames to GraphX and vice versa, which is a good place to learn. If you have any bug suggestions, please let me know.
Russ On Tue, Nov 12, 2024 at 12:58 PM Russell Jurney <russell.jur...@gmail.com> wrote: > That is unfortunate. I saw someone volunteer to review my PRs. I thought > there was a holdout? > > On Tue, Nov 12, 2024 at 12:56 PM Ángel <angel.alvarez.pas...@gmail.com> > wrote: > >> Nope. didn't miss that, in fact, I mentioned that graphframes used GraphX >> under the hood. >> >> The thing is ... even though we were trying to get maintainers the >> deprecation of GraphX passed suddenly in the middle of that discussion. >> >> El mar, 12 nov 2024, 21:47, Russell Jurney <russell.jur...@gmail.com> >> escribió: >> >>> I guess you missed where Reynold Xin suggested we instead bring >>> GraphFrames into Spark and others agreed? >>> >>> On Tue, Nov 12, 2024 at 12:08 PM Ángel <angel.alvarez.pas...@gmail.com> >>> wrote: >>> >>>> You only have to look at the subject of this thread of mails. It says >>>> nothing about graphframes. I thought we were "fighting" against deprecating >>>> GraphX because it seemed not have any maintainers in quite a few time. >>>> Maybe I got it wrong. >>>> >>>> El mar, 12 nov 2024, 19:12, Russell Jurney <russell.jur...@gmail.com> >>>> escribió: >>>> >>>>> Not sure what you mean? GraphX is the core Apache Spark technology >>>>> underneath GraphFrames - parts of GraphFrames use it. `git grep -i graphx >>>>> | >>>>> wc -l` shows 147 hits for `graphx` in GraphFrames master branch as of now. >>>>> >>>>> I started out getting familiar with the GraphFrames codebase with some >>>>> low hanging fixes for housekeeping - GraphFrames hasn't been maintained, >>>>> the docs are outdated and most examples didn't work. The friends graph >>>>> didn't even load in all of the examples, as the Python >>>>> graphframes.examples.Graphs interface changed to be object oriented. I am >>>>> now a maintainer of the Github repo thanks to Weichen Xu, who is reviewing >>>>> my PRs along with Reynold Xin (very nice, thanks!). I am getting familiar >>>>> with GraphFrames internals before looking at what it takes to get it into >>>>> Apache Spark proper. I was just letting people know that I am actively >>>>> taking on the work that we are discussing. >>>>> >>>>> Next, I am also going to get to know GraphX in the next couple of >>>>> weeks to better understand what moving GraphFrames into Spark would look >>>>> like. >>>>> >>>>> In a week or so, I will announce the hackathon. Need to figure out a >>>>> time that works for the people who've already expressed interest. >>>>> >>>>> Thanks, >>>>> Russell Jurney >>>>> >>>>> >>>>> >>>>> >>>>> On Tue, Nov 12, 2024 at 6:48 AM Ángel <angel.alvarez.pas...@gmail.com> >>>>> wrote: >>>>> >>>>>> But the goal wasn't to fix bugs in GraphX? What has that to do with >>>>>> graphframes? >>>>>> >>>>>> El mar, 12 nov 2024, 12:58, Russell Jurney <russell.jur...@gmail.com> >>>>>> escribió: >>>>>> >>>>>>> I started working on GraphFrames this weekend, got it building and >>>>>>> started with some docs PRs. A lot of the example code no longer worked, >>>>>>> so >>>>>>> I fixed it. I'm updating the docs to indicate our plan to integrate it >>>>>>> with >>>>>>> Apache Spark. >>>>>>> >>>>>>> I'll announce a hackathon in the next week or so :) >>>>>>> >>>>>>> Russell >>>>>>> >>>>>>> On Wed, Oct 16, 2024 at 6:53 PM Russell Jurney < >>>>>>> russell.jur...@gmail.com> wrote: >>>>>>> >>>>>>>> For starters I created a ticket. I'm going to work on the project a >>>>>>>> bit and then name a date and time. >>>>>>>> >>>>>>>> https://github.com/graphframes/graphframes/issues/460 >>>>>>>> >>>>>>>> On Tue, Oct 15, 2024 at 7:48 PM Ángel < >>>>>>>> angel.alvarez.pas...@gmail.com> wrote: >>>>>>>> >>>>>>>>> We could create a prioritized list of the most important bugs to >>>>>>>>> fix first and distribute the tasks among us. We can also share the >>>>>>>>> knowledge we gain from resolving them. >>>>>>>>> btw, what happened to the (great) hackathon idea? any date/s in >>>>>>>>> mind? >>>>>>>>> >>>>>>>>> El mié, 16 oct 2024 a las 3:53, Russell Jurney (< >>>>>>>>> russell.jur...@gmail.com>) escribió: >>>>>>>>> >>>>>>>>>> I've never used Visual Studio Code for Java / Scala, but I find >>>>>>>>>> IntelliJ works really well. >>>>>>>>>> >>>>>>>>>> On Tue, Oct 15, 2024 at 4:58 PM Mich Talebzadeh < >>>>>>>>>> mich.talebza...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> VSC is also another good candidate heavily used in the banks. >>>>>>>>>>> Anyway you parted with money so all the best. >>>>>>>>>>> >>>>>>>>>>> cheers >>>>>>>>>>> >>>>>>>>>>> Mich Talebzadeh, >>>>>>>>>>> >>>>>>>>>>> Architect | Data Engineer | Data Science | Financial Crime >>>>>>>>>>> PhD <https://en.wikipedia.org/wiki/Doctor_of_Philosophy> Imperial >>>>>>>>>>> College London >>>>>>>>>>> <https://en.wikipedia.org/wiki/Imperial_College_London> >>>>>>>>>>> London, United Kingdom >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> view my Linkedin profile >>>>>>>>>>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> https://en.everybodywiki.com/Mich_Talebzadeh >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> *Disclaimer:* The information provided is correct to the best >>>>>>>>>>> of my knowledge but of course cannot be guaranteed . It is >>>>>>>>>>> essential to >>>>>>>>>>> note that, as with any advice, quote "one test result is worth >>>>>>>>>>> one-thousand expert opinions (Werner >>>>>>>>>>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun >>>>>>>>>>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>
