See <https://builds.apache.org/job/Crunch-master-integration/38/changes>
Changes: [jwills] Remove leftover Cloudera/CDH references from some comments/fileheaders and the build.sbt file [jwills] CRUNCH-52: Let avro types be written to text files transparently. Contributed by Rahul Sharma. ------------------------------------------ [...truncated 1192 lines...] 865263 [Thread-2518] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 865304 [Thread-2518] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 865324 [Thread-2518] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.join.MultiAvroSchemaJoinIT: [[Avro(/tmp/employee3504417329920248333.avro)+S1+joinTagRight]/[Avro(/tmp/person7254918678481111923.avro)+S0+joinTagLeft]]+GBK+innerJoinGBK+PTables.values+Avro(/tmp/junit3142924952739237357/tmp-crunch.tmp.dir/crunch-1479354726/p1)" 865325 [Thread-2518] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.025 sec Running org.apache.crunch.lib.join.RightOuterJoinIT 875287 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 875290 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 875293 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 875296 [Thread-2537] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 875407 [Thread-2537] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 875429 [Thread-2537] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.join.InnerJoinIT: Text(/tmp/junit2080277519157380704/maugham.txt)+ws2+Aggregate.count+GBK+combine+joinTagRight+SeqFile(/tmp/junit2080277519157380704/tmp-crunch.tmp.dir/crunch-1790091148/p4)" 875429 [Thread-2537] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 875430 [Thread-2537] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 875570 [Thread-2537] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 875591 [Thread-2537] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.join.InnerJoinIT: Text(/tmp/junit2080277519157380704/shakes.txt)+ws1+Aggregate.count+GBK+combine+joinTagLeft+SeqFile(/tmp/junit2080277519157380704/tmp-crunch.tmp.dir/crunch-1790091148/p5)" 875591 [Thread-2537] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 882097 [Thread-2537] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 882128 [Thread-2537] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 882148 [Thread-2537] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.join.InnerJoinIT: [[SeqFile(/tmp/junit2080277519157380704/tmp-crunch.tmp.dir/crunch-1790091148/p5)]/[SeqFile(/tmp/junit2080277519157380704/tmp-crunch.tmp.dir/crunch-1790091148/p4)]]+GBK+rightOuterJoinGBK+cnt+SeqFile(/tmp/junit2080277519157380704/tmp-crunch.tmp.dir/crunch-1790091148/p1)" 882148 [Thread-2537] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 892438 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 892441 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 892444 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 892457 [Thread-2604] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 892509 [Thread-2604] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 892531 [Thread-2604] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.join.InnerJoinIT: Text(/tmp/junit3068883613163663518/maugham.txt)+ws2+Aggregate.count+GBK+combine+joinTagRight+Avro(/tmp/junit3068883613163663518/tmp-crunch.tmp.dir/crunch-290325880/p5)" 892531 [Thread-2604] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 892532 [Thread-2604] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 892669 [Thread-2604] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 892691 [Thread-2604] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.join.InnerJoinIT: Text(/tmp/junit3068883613163663518/shakes.txt)+ws1+Aggregate.count+GBK+combine+joinTagLeft+Avro(/tmp/junit3068883613163663518/tmp-crunch.tmp.dir/crunch-290325880/p4)" 892691 [Thread-2604] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 899196 [Thread-2604] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 899228 [Thread-2604] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 899249 [Thread-2604] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.join.InnerJoinIT: [[Avro(/tmp/junit3068883613163663518/tmp-crunch.tmp.dir/crunch-290325880/p4)]/[Avro(/tmp/junit3068883613163663518/tmp-crunch.tmp.dir/crunch-290325880/p5)]]+GBK+rightOuterJoinGBK+cnt+Avro(/tmp/junit3068883613163663518/tmp-crunch.tmp.dir/crunch-290325880/p1)" 899255 [Thread-2604] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.364 sec Running org.apache.crunch.lib.SortIT 909656 [Thread-2671] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 909690 [Thread-2671] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 909709 [Thread-2671] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit8532367781142701573/docs.txt)+S0+sort-pre+GBK+ungroup+sort-post+SeqFile(/tmp/junit8532367781142701573/tmp-crunch.tmp.dir/crunch-796878598/p1)" 909709 [Thread-2671] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 916672 [Thread-2689] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 916798 [Thread-2689] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 916816 [Thread-2689] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit7487434050615273735/docs.txt)+S0+sort-pre+GBK+ungroup+sort-post+SeqFile(/tmp/junit7487434050615273735/tmp-crunch.tmp.dir/crunch-447222904/p1)" 916816 [Thread-2689] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 923693 [Thread-2707] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 923725 [Thread-2707] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 923745 [Thread-2707] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit8448897193650675304/docs.txt)+S0+S1+GBK+ungroup+S2+SeqFile(/tmp/junit8448897193650675304/tmp-crunch.tmp.dir/crunch-1286614146/p1)" 923745 [Thread-2707] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 930716 [Thread-2725] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 930746 [Thread-2725] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 930767 [Thread-2725] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit2025050796220428960/docs.txt)+S0+S1+GBK+ungroup+S2+SeqFile(/tmp/junit2025050796220428960/tmp-crunch.tmp.dir/crunch-1659972533/p1)" 930767 [Thread-2725] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 937736 [Thread-2743] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 937767 [Thread-2743] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 937787 [Thread-2743] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit4306364162692987201/docs.txt)+S0+S1+GBK+ungroup+S2+SeqFile(/tmp/junit4306364162692987201/tmp-crunch.tmp.dir/crunch-523576868/p1)" 937787 [Thread-2743] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 944763 [Thread-2761] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 944795 [Thread-2761] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 944815 [Thread-2761] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit1522051608450508600/docs.txt)+S0+S1+GBK+ungroup+S2+SeqFile(/tmp/junit1522051608450508600/tmp-crunch.tmp.dir/crunch-778330969/p1)" 944816 [Thread-2761] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 951783 [Thread-2779] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 951818 [Thread-2779] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 951838 [Thread-2779] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit5165054243048915203/docs.txt)+S0+S1+GBK+ungroup+S2+SeqFile(/tmp/junit5165054243048915203/tmp-crunch.tmp.dir/crunch-1644075529/p1)" 951838 [Thread-2779] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 958801 [Thread-2797] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 958837 [Thread-2797] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 958856 [Thread-2797] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit6304446470110713960/docs.txt)+S0+GBK+ungroup+SeqFile(/tmp/junit6304446470110713960/tmp-crunch.tmp.dir/crunch-1089942071/p1)" 958857 [Thread-2797] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 965819 [Thread-2815] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 965850 [Thread-2815] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 965869 [Thread-2815] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit129044463875886982/docs.txt)+S0+sort-pre+GBK+ungroup+sort-post+Avro(/tmp/junit129044463875886982/tmp-crunch.tmp.dir/crunch-212510174/p1)" 965869 [Thread-2815] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 972837 [Thread-2833] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 972869 [Thread-2833] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 972888 [Thread-2833] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit454560503561765245/docs.txt)+S0+sort-pre+GBK+ungroup+sort-post+Avro(/tmp/junit454560503561765245/tmp-crunch.tmp.dir/crunch-1609825435/p1)" 972888 [Thread-2833] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 979871 [Thread-2851] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 979903 [Thread-2851] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 979922 [Thread-2851] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit8601784030204493468/docs.txt)+S0+S1+GBK+ungroup+S2+Avro(/tmp/junit8601784030204493468/tmp-crunch.tmp.dir/crunch-1889788896/p1)" 979922 [Thread-2851] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 986889 [Thread-2869] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 986999 [Thread-2869] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 987018 [Thread-2869] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit8525881129929670341/docs.txt)+S0+S1+GBK+ungroup+S2+Avro(/tmp/junit8525881129929670341/tmp-crunch.tmp.dir/crunch-1997461641/p1)" 987018 [Thread-2869] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 993908 [Thread-2887] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 993939 [Thread-2887] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 993958 [Thread-2887] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit1335785765893843604/docs.txt)+S0+S1+GBK+ungroup+S2+Avro(/tmp/junit1335785765893843604/tmp-crunch.tmp.dir/crunch-135340946/p1)" 993958 [Thread-2887] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1000927 [Thread-2905] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1000964 [Thread-2905] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1000983 [Thread-2905] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit8100688455998141563/docs.txt)+S0+S1+GBK+ungroup+S2+Avro(/tmp/junit8100688455998141563/tmp-crunch.tmp.dir/crunch-1813009410/p1)" 1000983 [Thread-2905] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1007947 [Thread-2923] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1007980 [Thread-2923] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1007998 [Thread-2923] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit1401903768694694927/set2.txt)+S0+sort-pre+GBK+ungroup+sort-post+Avro(/tmp/junit1401903768694694927/tmp-crunch.tmp.dir/crunch-103500206/p1)" 1007998 [Thread-2923] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1014966 [Thread-2941] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1014999 [Thread-2941] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1015018 [Thread-2941] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit3280540422970761727/set2.txt)+S0+GBK+ungroup+Avro(/tmp/junit3280540422970761727/tmp-crunch.tmp.dir/crunch-612089424/p1)" 1015019 [Thread-2941] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1021983 [Thread-2959] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1022016 [Thread-2959] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1022036 [Thread-2959] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit5122675575104795750/docs.txt)+S0+GBK+ungroup+Avro(/tmp/junit5122675575104795750/tmp-crunch.tmp.dir/crunch-1390520865/p1)" 1022036 [Thread-2959] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 18, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 119.353 sec Running org.apache.crunch.lib.SpecificAvroGroupByIT 1029000 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1029004 [Thread-2977] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1029038 [Thread-2977] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1029056 [Thread-2977] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SpecificAvroGroupByIT: Avro(/tmp/avrotest2356017225766989698.avro)+S0+GBK+ungroup+Avro(/tmp/junit9067066484181321472/tmp-crunch.tmp.dir/crunch-266068838/p1)" 1029057 [Thread-2977] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.021 sec Running org.apache.crunch.TextPairIT 1036023 [Thread-2995] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1036040 [Thread-2995] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1036055 [Thread-2995] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TextPairIT: Text(/tmp/junit2236738085021624517/shakes.txt)+my word duplicator+SeqFile(/tmp/junit2236738085021624517/tmp-crunch.tmp.dir/crunch-1616027663/p1)" 1036055 [Thread-2995] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.017 sec Running org.apache.crunch.MaterializeIT 1040039 [Thread-3005] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1040056 [Thread-3005] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1040071 [Thread-3005] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MaterializeIT: Text(/tmp/junit2448865512951867781/set1.txt)+SeqFile(/tmp/junit2448865512951867781/tmp-crunch.tmp.dir/crunch-455729363/p1)" 1040071 [Thread-3005] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1044053 [Thread-3015] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1044069 [Thread-3015] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1044085 [Thread-3015] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MaterializeIT: Text(/tmp/junit6056024724461179949/set1.txt)+SeqFile(/tmp/junit6056024724461179949/tmp-crunch.tmp.dir/crunch-194911019/p1)" 1044085 [Thread-3015] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1048072 [Thread-3025] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1048090 [Thread-3025] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1048106 [Thread-3025] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MaterializeIT: Text(/tmp/junit9083240288676272298/set1.txt)+S0+SeqFile(/tmp/junit9083240288676272298/tmp-crunch.tmp.dir/crunch-742903261/p1)" 1048106 [Thread-3025] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1052086 [Thread-3035] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1052103 [Thread-3035] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1052120 [Thread-3035] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MaterializeIT: Text(/tmp/junit4369973091774984010/set1.txt)+S0+SeqFile(/tmp/junit4369973091774984010/tmp-crunch.tmp.dir/crunch-1829969647/p1)" 1052120 [Thread-3035] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1056104 [Thread-3045] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1056117 [Thread-3045] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1056132 [Thread-3045] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MaterializeIT: Text(/tmp/junit3879195563985932710/set1.txt)+S0+Avro(/tmp/crunch-1513942205/p1)" 1056132 [Thread-3045] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.081 sec Running org.apache.crunch.MapsIT 1060123 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1060126 [Thread-3053] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1060179 [Thread-3053] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1060200 [Thread-3053] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MapsIT: Text(/tmp/junit3543010769442075599/shakes.txt)+S0+GBK+combine+SeqFile(/tmp/junit3543010769442075599/tmp-crunch.tmp.dir/crunch-2029852540/p1)" 1060200 [Thread-3053] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1067146 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1067148 [Thread-3078] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1067202 [Thread-3078] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1067224 [Thread-3078] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MapsIT: Text(/tmp/junit6356174493895135251/shakes.txt)+S0+GBK+combine+Avro(/tmp/junit6356174493895135251/tmp-crunch.tmp.dir/crunch-495849752/p1)" 1067224 [Thread-3078] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.044 sec Results : Failed tests: toTextShouldWriteAvroDataAsDatumText(org.apache.crunch.io.avro.AvroPipelineIT) Tests run: 117, Failures: 1, Errors: 0, Skipped: 2 mojoSucceeded org.apache.maven.plugins:maven-failsafe-plugin:2.12(default) [JENKINS] Recording test results [INFO] Failsafe report directory: <https://builds.apache.org/job/Crunch-master-integration/ws/crunch/target/failsafe-reports> mojoStarted org.apache.maven.plugins:maven-failsafe-plugin:2.12(default) [INFO] [INFO] --- maven-failsafe-plugin:2.12:verify (default) @ crunch --- mojoFailed org.apache.maven.plugins:maven-failsafe-plugin:2.12(default) projectFailed org.apache.crunch:crunch:0.4.0-incubating-SNAPSHOT sessionEnded [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Crunch ..................................... SUCCESS [18.455s] [INFO] Apache Crunch Test ................................ SUCCESS [17.353s] [INFO] Apache Crunch Core ................................ FAILURE [18:10.858s] [INFO] Apache Crunch HBase Support ....................... SKIPPED [INFO] Apache Crunch Examples ............................ SKIPPED [INFO] Apache Crunch for Scala ........................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 18:48.572s [INFO] Finished at: Sat Sep 08 00:27:23 UTC 2012 [INFO] Final Memory: 20M/93M [INFO] ------------------------------------------------------------------------ Projects to build: [MavenProject: org.apache.crunch:crunch-parent:0.4.0-incubating-SNAPSHOT @ <https://builds.apache.org/job/Crunch-master-integration/ws/pom.xml,> MavenProject: org.apache.crunch:crunch-test:0.4.0-incubating-SNAPSHOT @ <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-test/pom.xml,> MavenProject: org.apache.crunch:crunch:0.4.0-incubating-SNAPSHOT @ <https://builds.apache.org/job/Crunch-master-integration/ws/crunch/pom.xml,> MavenProject: org.apache.crunch:crunch-hbase:0.4.0-incubating-SNAPSHOT @ <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-hbase/pom.xml,> MavenProject: org.apache.crunch:crunch-examples:0.4.0-incubating-SNAPSHOT @ <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-examples/pom.xml,> MavenProject: org.apache.crunch:crunch-scrunch:0.4.0-incubating-SNAPSHOT @ <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-scrunch/pom.xml]> [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-hbase/pom.xml> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-hbase/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch-hbase/0.4.0-incubating-SNAPSHOT/crunch-hbase-0.4.0-incubating-SNAPSHOT.pom [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-scrunch/pom.xml> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-scrunch/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch-scrunch/0.4.0-incubating-SNAPSHOT/crunch-scrunch-0.4.0-incubating-SNAPSHOT.pom [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/crunch/pom.xml> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch/0.4.0-incubating-SNAPSHOT/crunch-0.4.0-incubating-SNAPSHOT.pom [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/crunch/target/apache-crunch-0.4.0-incubating-SNAPSHOT.jar> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch/0.4.0-incubating-SNAPSHOT/crunch-0.4.0-incubating-SNAPSHOT.jar [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/pom.xml> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-parent/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch-parent/0.4.0-incubating-SNAPSHOT/crunch-parent-0.4.0-incubating-SNAPSHOT.pom [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/target/crunch-parent-0.4.0-incubating-SNAPSHOT-site.xml> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-parent/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch-parent/0.4.0-incubating-SNAPSHOT/crunch-parent-0.4.0-incubating-SNAPSHOT-site.xml [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-examples/pom.xml> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-examples/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch-examples/0.4.0-incubating-SNAPSHOT/crunch-examples-0.4.0-incubating-SNAPSHOT.pom [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-test/pom.xml> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-test/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch-test/0.4.0-incubating-SNAPSHOT/crunch-test-0.4.0-incubating-SNAPSHOT.pom [JENKINS] Archiving <https://builds.apache.org/job/Crunch-master-integration/ws/crunch-test/target/apache-crunch-0.4.0-incubating-SNAPSHOT.jar> to /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-test/builds/2012-09-08_00-08-22/archive/org.apache.crunch/crunch-test/0.4.0-incubating-SNAPSHOT/crunch-test-0.4.0-incubating-SNAPSHOT.jar Waiting for Jenkins to finish collecting data mavenExecutionResult exceptions not empty message : Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.12:verify (default) on project crunch: There are test failures. Please refer to <https://builds.apache.org/job/Crunch-master-integration/ws/crunch/target/failsafe-reports> for the individual test results. cause : There are test failures. Please refer to <https://builds.apache.org/job/Crunch-master-integration/ws/crunch/target/failsafe-reports> for the individual test results. Stack trace : org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.12:verify (default) on project crunch: There are test failures. Please refer to <https://builds.apache.org/job/Crunch-master-integration/ws/crunch/target/failsafe-reports> for the individual test results. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239) at org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158) at hudson.maven.Maven3Builder.call(Maven3Builder.java:98) at hudson.maven.Maven3Builder.call(Maven3Builder.java:64) at hudson.remoting.UserRequest.perform(UserRequest.java:118) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:326) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures. Please refer to <https://builds.apache.org/job/Crunch-master-integration/ws/crunch/target/failsafe-reports> for the individual test results. at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:121) at org.apache.maven.plugin.failsafe.VerifyMojo.execute(VerifyMojo.java:208) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) ... 27 more Maven failed with error. Sending e-mails to: [email protected] channel stopped [locks-and-latches] Releasing all the locks [locks-and-latches] All the locks released
