Dear Wiki user, You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.
The "Pig070IncompatibleChanges" page has been changed by OlgaN. http://wiki.apache.org/pig/Pig070IncompatibleChanges?action=diff&rev1=28&rev2=29 -------------------------------------------------- || Change || Section || Impact || Steps to address || Comments || || Load/Store interface changes || Changes to the Load and Store Functions || High || [[LoadStoreMigrationGuide || Load Store Migration Guide]] || || - || Data compression becomes load/store function specific || Handling Compressed Data || Unknow but hopefully low || If compression is needed the underlying Input/Output format would need to support it || || + || Data compression becomes load/store function specific || Handling Compressed Data || Unknown but hopefully low || If compression is needed the underlying Input/Output format would need to support it || || - || Bzip compressed files can no longer have .bz extension || Handling Compressed Data || Low || 1. Rename existing .bz files to .bz2 files. 2. Update scripts to read/write files with bz2 extension || This change is due to the fact that Text{Input/Output}Format only supports bz2 extension || + || Bzip compressed files in PigStorage format can no longer have .bz extension || Handling Compressed Data || Low || 1. Rename existing .bz files to .bz2 files. 2. Update scripts to read/write files with bz2 extension || This change is due to the fact that Text{Input/Output}Format only supports bz2 extension || - || Switch to Hadoop's local mode || Local Mode || Low || None || Main change is 10-20x performance slowdown. Also, local mode now uses the same UDF interfaces to execute UDFs as the MR mode. || + || Switching to Hadoop's local mode || Local Mode || Low || None || Main change is 10-20x performance slowdown. Also, local mode now uses the same UDF interfaces to execute UDFs as the MR mode. || - || Load-Stream or Stream-Store optimizations no longer supported || Streaming || Low to None || None || This feature was never documented so it is unlikely it was ever used || + || Removing support for Load-Stream or Stream-Store optimization || Streaming || Low to None || None || This feature was never documented so it is unlikely it was ever used || - || No longer support serialization and decerialization via load/store functions || Streaming || Unknown but hopefully low to medium || Implement new Serializer/Deserializer interfaces for non-standard serialization || || + || We no longer support serialization and decerialization via load/store functions || Streaming || Unknown but hopefully low to medium || Implement new PigToStream and StreamToPig interfaces for non-standard serialization || LoadStoreRedesignProposal || - || Removed BinaryStorage builtin || Streaming || Low to None || None || As far as we know, this class was only used internally by streaming || + || Removing BinaryStorage builtin || Streaming || Low to None || None || As far as we know, this class was only used internally by streaming || - || Split by file feature is removed || Split by File || Low to None || Input format of the loader would need to be used || We don't know that this feature was widely/ever used || + || Removing Split by file feature || Split by File || Low to None || Input format of the loader would need to support this || We don't know that this feature was widely/ever used || - || Local files no longer accessible from hadoop || Access to Local Files from Map-Reduce Mode || low to none || copy the file to the cluster using copyToLocal command || This feature was not documented || + || Local files no longer accessible from cluster || Access to Local Files from Map-Reduce Mode || low to none || copy the file to the cluster using copyToLocal command prior to the load || This feature was not documented || - || Removing Custom Comparators || Removing Custom Comparators || Low to None || None || This feature has been depricated since Pig 0.5.0 release. We don't have a single known use case || + || Removing Custom Comparators || Removing Custom Comparators || Low to None || None || This feature has been deprecated since Pig 0.5.0 release. We don't have a single known use case || == Changes to the Load and Store Functions ==
