Apache Wiki
Tue, 26 Feb 2008 18:41:15 -0800
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification. The following page has been changed by OlgaN: http://wiki.apache.org/pig/PigStreamingFunctionalSpec ------------------------------------------------------------------------------ The following serializers/deserializer will be part of pig distribution: - 1. !DefaultSerializer, !DefaultDeserializer as described above + 1. !DefaultSerializer, !DefaultDeserializer as described above (This is going to be PigStorage) 2. !PythonSerializer, !PythonDeserializer + 3. !BinarSerailzie, !BinaryDeserializer - treats the entire file as byte stream - no formating or interpretation. Each deserializer will be implementing `LoadFunc` interface. Each serializer will be implementing `StoreFunc` interface. `StoreFunc` interface will be extended with `void flatten() throws OperationNotSupportedException;` method that would indicate that the data needs to be flattened before it is serialized. The class can choose not to support this functionality and through an exception.