> On 2011-12-06 21:12:02, Ahmed Radwan wrote: > > Thanks! Built a release tar ball with the new patch and did basic testing > > against a real 4-node hadoop 0.23 cluster. One issue I saw is the record > > count in the import use-case is showing 0, but the records are physically > > imported, and the job is successfull. Seems to be a Sqoop problem with > > mapreduce counters in 0.23. I think this can be addressed in a separate > > jira. > > Tom White wrote: > I wonder if the counter issue is > https://issues.apache.org/jira/browse/MAPREDUCE-3433 (fixed in 0.23.1). > > Ahmed Radwan wrote: > Good point, I'll retry using the MAPREDUCE-3433 patch to confirm. Thanks!
Using a hadoop build having the MAPREDUCE-3433 patch resolves the counters problem described above. Thanks Tom for pointing that out. This patch is checked to trunk and 0.23.1 so this counters problem should only exist in 0.23.0, and not any of the following releases. - Ahmed ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2983/#review3673 ----------------------------------------------------------- On 2011-12-06 19:14:02, Bilung Lee wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/2983/ > ----------------------------------------------------------- > > (Updated 2011-12-06 19:14:02) > > > Review request for Sqoop, Ahmed Radwan, Arvind Prabhakar, and Tom White. > > > Summary > ------- > > Make Sqoop work with Hadoop 0.23 > > > This addresses bug SQOOP-397. > https://issues.apache.org/jira/browse/SQOOP-397 > > > Diffs > ----- > > ./COMPILING.txt 1197706 > ./build.xml 1210580 > ./ivy.xml 1210686 > ./ivy/libraries.properties 1210579 > ./src/test/com/cloudera/sqoop/TestCompression.java 1208716 > ./src/test/com/cloudera/sqoop/hbase/HBaseTestCase.java 1209661 > ./src/test/com/cloudera/sqoop/hbase/TestHBaseImport.java 1209661 > ./src/test/com/cloudera/sqoop/hbase/TestHBaseQueryImport.java 1209661 > ./src/test/com/cloudera/sqoop/mapreduce/db/TestDataDrivenDBInputFormat.java > 1209644 > > Diff: https://reviews.apache.org/r/2983/diff > > > Testing > ------- > > > Thanks, > > Bilung > >
