Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The following page has been changed by JeffHammerbacher: http://wiki.apache.org/hadoop/Hive/Roadmap ------------------------------------------------------------------------------ = 10/27/08 Roadmap Update = - # Integrating Dynamic SerDe with the DDL. (Zheng/Pete) - This allows the users to create typed tables along with list and map types from the DDL + 1. Integrating Dynamic SerDe with the DDL. (Zheng/Pete) - This allows the users to create typed tables along with list and map types from the DDL - # Support for Statistics. (Ashish) - These stats are needed to make optimization decisions + 2. Support for Statistics. (Ashish) - These stats are needed to make optimization decisions - # Join Optimizations. (Prasad) - Mapside joins, semi join techniques etc to do the join faster + 3. Join Optimizations. (Prasad) - Mapside joins, semi join techniques etc to do the join faster - # Predicate Pushdown Optimizations. (Namit) - pushing predicates just above the table scan for certain situations in joins as well as ensuring that only required columns are sent across map/reduce boundaries + 4. Predicate Pushdown Optimizations. (Namit) - pushing predicates just above the table scan for certain situations in joins as well as ensuring that only required columns are sent across map/reduce boundaries - # Group By Optimizations. (Joydeep) - various optimizations to make group by faster + 5. Group By Optimizations. (Joydeep) - various optimizations to make group by faster - # Optimizations to reduce the number of map files created by filter operations. (Dhrubha) - Filters with a large number of mappers produces a lot of files which slows down the following operations. This tries to address problems with that. + 6. Optimizations to reduce the number of map files created by filter operations. (Dhrubha) - Filters with a large number of mappers produces a lot of files which slows down the following operations. This tries to address problems with that. - # Transformations in LOAD. (Joydeep) - LOAD currently does not transform the input data if it is not in the format expected by the destination table. + 7. Transformations in LOAD. (Joydeep) - LOAD currently does not transform the input data if it is not in the format expected by the destination table. - # Schemaless map/reduce. (Zheng) - TRANSFORM needs schema while map/reduce is schema less. + 8. Schemaless map/reduce. (Zheng) - TRANSFORM needs schema while map/reduce is schema less. - # Improvements to TRANSFORM. (Zheng) - Make this more intuitive to map/reduce developers - evaluate some other keywords etc.. + 9. Improvements to TRANSFORM. (Zheng) - Make this more intuitive to map/reduce developers - evaluate some other keywords etc.. - # Error Reporting Improvements. (Pete) - Make error reporting for parse errors better + 10. Error Reporting Improvements. (Pete) - Make error reporting for parse errors better - # Help on CLI. (Joydeep) - add help to the CLI + 11. Help on CLI. (Joydeep) - add help to the CLI - # Explode and Collect Operators. (Zheng) - Explode and collect operators to convert collections to individual items and vice versa. + 12. Explode and Collect Operators. (Zheng) - Explode and collect operators to convert collections to individual items and vice versa. - # Propagating sort properties to destination tables. (Prasad) - If the query produces sorted we want to capture that in the destination table's metadata so that downstream optimizations can be enabled. + 13. Propagating sort properties to destination tables. (Prasad) - If the query produces sorted we want to capture that in the destination table's metadata so that downstream optimizations can be enabled. Other contributions from outside FB ... - # JDBC driver (Michi Mutsuzaki @ stanford.edu, Raghu @ stanford.edu) + 14. JDBC driver (Michi Mutsuzaki @ stanford.edu, Raghu @ stanford.edu) - # Fixes to CLI driver (Jeremy Huylebroeck) + 15. Fixes to CLI driver (Jeremy Huylebroeck) - # Web interface... + 16. Web interface... = Roadmap/call to add more features = The following is the list of useful features that are on the Hive Roadmap:
