I suppose suggesting a YarcData system is out of the question too -- http://www.yarcdata.com .
-- Actually though - I think what you need to do is aggregate some of your nodes and edges, or you need to figure out (much) subgraphs and only look at them at one time. It is hard for the brain to take in a huge amount of data - even visually - without some sort of aggregation. If you can't figure out a subgraph or way to do aggregation, they you probably want to take a sample of the data. Select nodes at random. My 24" screen is configured with a resolution of 1920 x 1080. That gives me about 2M pixels. If I wanted to display 2.3M Nodes, with colors and information about those nodes, and edges between them, I'd need a much, much larger screen. ... Even if I had the memory and processing power. With Gephi, a 4G JVM, and my 24" screen, I find even 20,000 nodes a bit much to process and visualize at once. If you want to take an approach using a browser (such as D3), you should load only portions of the data at once. Anything more than a few (single digit) thousand data points at one time in a browser will drag it down pretty quickly. There are some examples out there of some techniques people have used. This one uses Neo4j as a back end -- http://getvouched.com/visualizations . For advanced D3 examples, check out Mike Bostock's D3 wiki rather than just on the main page or in the zip file -- https://github.com/mbostock/d3/wiki . Here are a couple of links with other ideas for visualizing large graph data sets: http://www.visualcomplexity.com/vc/ http://www.mkbergman.com/414/large-scale-rdf-graph-visualization-tools/ -----Original Message----- From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On Behalf Of Peter Neubauer Sent: Wednesday, April 11, 2012 5:25 AM To: Neo4j user discussions Subject: Re: [Neo4j] large graph visualizations/analytics Ajinkya, just talked to one of the Gephi guys, "2.3M nodes and 60M edges...you should buy another computer with at least 60GB of RAM for Gephi." Cheers, /peter neubauer G: neubauer.peter S: peter.neubauer P: +46 704 106975 L: http://www.linkedin.com/in/neubauer T: @peterneubauer Neo4j - Graphs rule. Program or be programmed - Computer Literacy for kids. http://foocafe.org/#CoderDojo On Wed, Apr 11, 2012 at 10:17 AM, Ajinkya Kale <kaleajin...@gmail.com> wrote: > Hi, I am trying to load neo4j db in Gephi on a 64-bit windows system > with 6GB RAM running a 64-bit jvm but it runs out of memory .. i tried > to allocate more memory through the jvm parameters and ended up > allocating the maximum possible without any luck. > My graphdb is of the following dimensions : > > nodes 2320895 > type1 relationship edge 50655143 > type2 relationship edge 10632833 > > Any suggestions on tools/techniques to visualize and run analytics on > graphdbs of this scale ? > > -- > > Regards, > Ajinkya > http://ajinkya.info > > .O. > ..O > OOO > _______________________________________________ > NOTICE: THIS MAILING LIST IS BEING SWITCHED TO GOOGLE GROUPS, please > register and consider posting at > https://groups.google.com/forum/#!forum/neo4j > > Neo4j mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user _______________________________________________ NOTICE: THIS MAILING LIST IS BEING SWITCHED TO GOOGLE GROUPS, please register and consider posting at https://groups.google.com/forum/#!forum/neo4j Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user _______________________________________________ NOTICE: THIS MAILING LIST IS BEING SWITCHED TO GOOGLE GROUPS, please register and consider posting at https://groups.google.com/forum/#!forum/neo4j Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
