[jira] [Created] (GIRAPH-1151) Avoid message value factory initialization in Apache Giraph
Yuksel Akinci created GIRAPH-1151: - Summary: Avoid message value factory initialization in Apache Giraph Key: GIRAPH-1151 URL: https://issues.apache.org/jira/browse/GIRAPH-1151 Project: Giraph Issue Type: Improvement Reporter: Yuksel Akinci Messages in Giraph are instantiated using a "message value factory" class. Currently the message value factory gets instantiated every time a message is sent, which is unnecessary and can cause high overhead if the message value factory constructor contains expensive operation. Factory objects are be saved to avoid repeated expensive object creations. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GIRAPH-1158) Allow JobProgressTrackers to provide job completion estimations to fail early.
Yuksel Akinci created GIRAPH-1158: - Summary: Allow JobProgressTrackers to provide job completion estimations to fail early. Key: GIRAPH-1158 URL: https://issues.apache.org/jira/browse/GIRAPH-1158 Project: Giraph Issue Type: Task Reporter: Yuksel Akinci Changes in DefaultJobProgressTrackerService to enable derived classes to provide job completion estimations and fail the job earlier if the job can't be completed in allotted time. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GIRAPH-1162) Make the VERTICES_TO_UPDATE_PROGRESS configurable.
Yuksel Akinci created GIRAPH-1162: - Summary: Make the VERTICES_TO_UPDATE_PROGRESS configurable. Key: GIRAPH-1162 URL: https://issues.apache.org/jira/browse/GIRAPH-1162 Project: Giraph Issue Type: Bug Reporter: Yuksel Akinci -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GIRAPH-1163) Changes to support sending exceptions over thrift calls.
Yuksel Akinci created GIRAPH-1163: - Summary: Changes to support sending exceptions over thrift calls. Key: GIRAPH-1163 URL: https://issues.apache.org/jira/browse/GIRAPH-1163 Project: Giraph Issue Type: Bug Reporter: Yuksel Akinci -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GIRAPH-1185) Adding faster serialization classes.
Yuksel Akinci created GIRAPH-1185: - Summary: Adding faster serialization classes. Key: GIRAPH-1185 URL: https://issues.apache.org/jira/browse/GIRAPH-1185 Project: Giraph Issue Type: Improvement Reporter: Yuksel Akinci These changes add two new kryo serialization classes (KryoSimpleWritable and KryoSimpleWrapper) which disable reference tracking at the expense of not supporting recursive and nested structures. Disabling reference tracking significantly improves the serialization performance. One a sample pipeline, the running time reduced from 75 minutes to 5 minutes. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GIRAPH-1188) Add kryo custom class resolver for faster serialization.
Yuksel Akinci created GIRAPH-1188: - Summary: Add kryo custom class resolver for faster serialization. Key: GIRAPH-1188 URL: https://issues.apache.org/jira/browse/GIRAPH-1188 Project: Giraph Issue Type: Improvement Reporter: Yuksel Akinci The custom class resolver allows kryo to always use the integer IDs for classes that are agreed by all nodes running the job. Default class resolver always writes the full class name of the first encountered class type to the stream, and then it assigns an integer for subsequent instances. These changes make the serialization faster by eliminating the need to write the full name for the first encountered class instance. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GIRAPH-1181) Changes to ExtendedByteArrayDataOutput
Yuksel Akinci created GIRAPH-1181: - Summary: Changes to ExtendedByteArrayDataOutput Key: GIRAPH-1181 URL: https://issues.apache.org/jira/browse/GIRAPH-1181 Project: Giraph Issue Type: Improvement Reporter: Yuksel Akinci Adding a new stream type which extends from com.esotericsoftware.kryo.io.Input/Output, so that it can be used with kryo serializer. It improves the performance of kryo by faster read/writes (unsafe IO), and also eliminates the need for interim buffers to convert from DataInput and DataOutput. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
