> On Aug. 6, 2012, 6:15 p.m., Eugene Koontz wrote: > > The channel-pool seems like a good idea and so does the bandwidth metrics, > > but how about a JIRA for each one?
While I understand why you are saying this, I felt these changes were pretty close in nature as a set of optimizations. They also somewhat depend on each other, so I could split up into patches, but would have to rebase after each commit I think. > On Aug. 6, 2012, 6:15 p.m., Eugene Koontz wrote: > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/NettyClient.java, > > line 112 > > <https://reviews.apache.org/r/6008/diff/1/?file=123493#file123493line112> > > > > For consistency with other pipeline components, use new ByteCounter() > > here. I need the reference here so that I can print the metrics periodically in the client. See NettyClient.java:237. > On Aug. 6, 2012, 6:15 p.m., Eugene Koontz wrote: > > http://svn.apache.org/repos/asf/giraph/trunk/pom.xml, line 409 > > <https://reviews.apache.org/r/6008/diff/1/?file=123489#file123489line409> > > > > added this as a separate JIRA: > > https://issues.apache.org/jira/browse/GIRAPH-280 Committed. > On Aug. 6, 2012, 6:15 p.m., Eugene Koontz wrote: > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/NettyClient.java, > > line 79 > > <https://reviews.apache.org/r/6008/diff/1/?file=123493#file123493line79> > > > > The sendBufferSize and receiveBufferSize parameterizations should go in > > a new JIRA : added GIRAPH-281. I'll put this in GIRAPH-281. - Avery ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/6008/#review9890 ----------------------------------------------------------- On July 17, 2012, 7:33 a.m., Avery Ching wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/6008/ > ----------------------------------------------------------- > > (Updated July 17, 2012, 7:33 a.m.) > > > Review request for giraph. > > > Description > ------- > > * Makes netty the default instead of HadoopRPC > * Added optimization to handle requests locally when possible rather than go > over the network > * Added TimedLogger to print only within a given time period > * Added optimization for using multiple channels between clients/servers when > bandwidth is limited per connection > * Added ByteCounter to track bandwidth across Netty (can be later integrated > with GIRAPH-232). > * Upgraded rat to 0.8 and excluded iml files (Intellij Idea) > * Set 32 instead of 64 as the default maximum netty threads > > > This addresses bug GIRAPH-262. > https://issues.apache.org/jira/browse/GIRAPH-262 > > > Diffs > ----- > > http://svn.apache.org/repos/asf/giraph/trunk/pom.xml 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/benchmark/PseudoRandomVertexInputFormat.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/ByteCounter.java > PRE-CREATION > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/ChannelRotater.java > PRE-CREATION > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/NettyClient.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/NettyServer.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/NettyWorkerClient.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/NettyWorkerClientServer.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/NettyWorkerServer.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/RequestDecoder.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/ResponseClientHandler.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/comm/SendVertexRequest.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/graph/BspServiceWorker.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/graph/BspUtils.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/graph/GiraphJob.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/graph/GraphMapper.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/main/java/org/apache/giraph/utils/TimedLogger.java > PRE-CREATION > > http://svn.apache.org/repos/asf/giraph/trunk/src/test/java/org/apache/giraph/comm/ConnectionTest.java > 1362298 > > http://svn.apache.org/repos/asf/giraph/trunk/src/test/java/org/apache/giraph/comm/RequestTest.java > 1362298 > > Diff: https://reviews.apache.org/r/6008/diff/ > > > Testing > ------- > > Passed mvn verify. Used for the Hadoop Summit presentation results. > > > Thanks, > > Avery Ching > >
