I guess you missed where Reynold Xin suggested we instead bring GraphFrames into Spark and others agreed?
On Tue, Nov 12, 2024 at 12:08 PM Ángel <angel.alvarez.pas...@gmail.com> wrote: > You only have to look at the subject of this thread of mails. It says > nothing about graphframes. I thought we were "fighting" against deprecating > GraphX because it seemed not have any maintainers in quite a few time. > Maybe I got it wrong. > > El mar, 12 nov 2024, 19:12, Russell Jurney <russell.jur...@gmail.com> > escribió: > >> Not sure what you mean? GraphX is the core Apache Spark technology >> underneath GraphFrames - parts of GraphFrames use it. `git grep -i graphx | >> wc -l` shows 147 hits for `graphx` in GraphFrames master branch as of now. >> >> I started out getting familiar with the GraphFrames codebase with some >> low hanging fixes for housekeeping - GraphFrames hasn't been maintained, >> the docs are outdated and most examples didn't work. The friends graph >> didn't even load in all of the examples, as the Python >> graphframes.examples.Graphs interface changed to be object oriented. I am >> now a maintainer of the Github repo thanks to Weichen Xu, who is reviewing >> my PRs along with Reynold Xin (very nice, thanks!). I am getting familiar >> with GraphFrames internals before looking at what it takes to get it into >> Apache Spark proper. I was just letting people know that I am actively >> taking on the work that we are discussing. >> >> Next, I am also going to get to know GraphX in the next couple of weeks >> to better understand what moving GraphFrames into Spark would look like. >> >> In a week or so, I will announce the hackathon. Need to figure out a time >> that works for the people who've already expressed interest. >> >> Thanks, >> Russell Jurney >> >> >> >> >> On Tue, Nov 12, 2024 at 6:48 AM Ángel <angel.alvarez.pas...@gmail.com> >> wrote: >> >>> But the goal wasn't to fix bugs in GraphX? What has that to do with >>> graphframes? >>> >>> El mar, 12 nov 2024, 12:58, Russell Jurney <russell.jur...@gmail.com> >>> escribió: >>> >>>> I started working on GraphFrames this weekend, got it building and >>>> started with some docs PRs. A lot of the example code no longer worked, so >>>> I fixed it. I'm updating the docs to indicate our plan to integrate it with >>>> Apache Spark. >>>> >>>> I'll announce a hackathon in the next week or so :) >>>> >>>> Russell >>>> >>>> On Wed, Oct 16, 2024 at 6:53 PM Russell Jurney < >>>> russell.jur...@gmail.com> wrote: >>>> >>>>> For starters I created a ticket. I'm going to work on the project a >>>>> bit and then name a date and time. >>>>> >>>>> https://github.com/graphframes/graphframes/issues/460 >>>>> >>>>> On Tue, Oct 15, 2024 at 7:48 PM Ángel <angel.alvarez.pas...@gmail.com> >>>>> wrote: >>>>> >>>>>> We could create a prioritized list of the most important bugs to fix >>>>>> first and distribute the tasks among us. We can also share the knowledge >>>>>> we >>>>>> gain from resolving them. >>>>>> btw, what happened to the (great) hackathon idea? any date/s in mind? >>>>>> >>>>>> El mié, 16 oct 2024 a las 3:53, Russell Jurney (< >>>>>> russell.jur...@gmail.com>) escribió: >>>>>> >>>>>>> I've never used Visual Studio Code for Java / Scala, but I find >>>>>>> IntelliJ works really well. >>>>>>> >>>>>>> On Tue, Oct 15, 2024 at 4:58 PM Mich Talebzadeh < >>>>>>> mich.talebza...@gmail.com> wrote: >>>>>>> >>>>>>>> VSC is also another good candidate heavily used in the banks. >>>>>>>> Anyway you parted with money so all the best. >>>>>>>> >>>>>>>> cheers >>>>>>>> >>>>>>>> Mich Talebzadeh, >>>>>>>> >>>>>>>> Architect | Data Engineer | Data Science | Financial Crime >>>>>>>> PhD <https://en.wikipedia.org/wiki/Doctor_of_Philosophy> Imperial >>>>>>>> College London >>>>>>>> <https://en.wikipedia.org/wiki/Imperial_College_London> >>>>>>>> London, United Kingdom >>>>>>>> >>>>>>>> >>>>>>>> view my Linkedin profile >>>>>>>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >>>>>>>> >>>>>>>> >>>>>>>> https://en.everybodywiki.com/Mich_Talebzadeh >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> *Disclaimer:* The information provided is correct to the best of >>>>>>>> my knowledge but of course cannot be guaranteed . It is essential to >>>>>>>> note >>>>>>>> that, as with any advice, quote "one test result is worth one-thousand >>>>>>>> expert opinions (Werner >>>>>>>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun >>>>>>>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>>
