https://bugzilla.wikimedia.org/show_bug.cgi?id=63371
Bug ID: 63371
Summary: Wikipedia Zero job for 2014-03-01 failed on Hadoop
with "java.io.IOException: stored gzip size doesn't
match decompressed size"
Product: Analytics
Version: unspecified
Hardware: All
OS: All
Status: NEW
Severity: normal
Priority: Unprioritized
Component: General/Unknown
Assignee: wikibugs-l@lists.wikimedia.org
Reporter: christ...@quelltextlich.at
CC: christ...@quelltextlich.at, oke...@wikimedia.org,
tneg...@wikimedia.org
Web browser: ---
Mobile Platform: ---
The tail of the relevant log is
-----8<-----Begin: log tail-----8<-----
2014-04-01 11:24:09,655 [communication thread] INFO
org.apache.hadoop.mapred.LocalJobRunner -
2014-04-01 11:24:12,656 [communication thread] INFO
org.apache.hadoop.mapred.LocalJobRunner -
2014-04-01 11:24:15,657 [communication thread] INFO
org.apache.hadoop.mapred.LocalJobRunner -
2014-04-01 11:24:18,658 [communication thread] INFO
org.apache.hadoop.mapred.LocalJobRunner -
2014-04-01 11:24:21,659 [communication thread] INFO
org.apache.hadoop.mapred.LocalJobRunner -
2014-04-01 11:24:24,660 [communication thread] INFO
org.apache.hadoop.mapred.LocalJobRunner -
2014-04-01 11:24:27,673 [communication thread] INFO
org.apache.hadoop.mapred.LocalJobRunner -
2014-04-01 11:24:27,730 [Thread-2] WARN
org.apache.hadoop.mapred.LocalJobRunner - job_local_0001
java.io.IOException: stored gzip size doesn't match decompressed size
at
org.apache.hadoop.io.compress.zlib.BuiltInGzipDecompressor.executeTrailerState(BuiltInGzipDecompressor.java:389)
at
org.apache.hadoop.io.compress.zlib.BuiltInGzipDecompressor.decompress(BuiltInGzipDecompressor.java:224)
at
org.apache.hadoop.io.compress.DecompressorStream.decompress(DecompressorStream.java:82)
at
org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:76)
at java.io.InputStream.read(InputStream.java:101)
at org.apache.hadoop.util.LineReader.readLine(LineReader.java:134)
at
org.apache.hadoop.mapreduce.lib.input.LineRecordReader.nextKeyValue(LineRecordReader.java:97)
at org.apache.pig.builtin.PigStorage.getNext(PigStorage.java:239)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:211)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:532)
at
org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
2014-04-01 11:24:27,924 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
6017: Job failed! Error - NA
-----8<-----End: log tail-----8<-----
I'll investigate whether it's a random failure, or something broke.
--
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
