[
https://issues.apache.org/jira/browse/MAPREDUCE-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ranjit Mathew updated MAPREDUCE-2095:
-------------------------------------
Status: Patch Available (was: Open)
The updated patch includes a unit-test that produces the following (snipped)
results with "ant test":
{quote}
test:
[echo] contrib: gridmix
[delete] Deleting directory
/home/ranjit/src/Hadoop/Apache/mapred_trunk/build/contrib/gridmix/test/logs
[mkdir] Created dir:
/home/ranjit/src/Hadoop/Apache/mapred_trunk/build/contrib/gridmix/test/logs
[junit] WARNING: multiple versions of ant detected in path for junit
[junit]
jar:file:/home/ranjit/apps/ant/lib/ant.jar!/org/apache/tools/ant/Project.class
[junit] and
jar:file:/home/ranjit/.ivy2/cache/ant/ant/jars/ant-1.6.5.jar!/org/apache/tools/ant/Project.class
[junit] Running org.apache.hadoop.mapred.gridmix.TestFilePool
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.294 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestFileQueue
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.449 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestGridmixRecord
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.262 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestGridmixSubmission
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 414.348 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestRandomAlgorithm
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.243 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestRecordFactory
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.242 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestSleepJob
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 570.155 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestUserResolve
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.457 sec
{quote}
The relevant extract from
{{TEST-org.apache.hadoop.mapred.gridmix.TestGridmixSubmission.txt}}:
{quote}
Verifying JobStory from compressed trace...
Verifying JobStory from uncompressed trace...
Verifying JobStory from trace in standard input...
{quote}
> Gridmix unable to run for compressed traces(.gz format).
> --------------------------------------------------------
>
> Key: MAPREDUCE-2095
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2095
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/gridmix
> Affects Versions: 0.20.1
> Reporter: Vinay Kumar Thota
> Assignee: Ranjit Mathew
> Attachments: MAPREDUCE-2095.patch, MAPREDUCE-2095_v2.patch,
> wordcount.json.gz
>
>
> I was trying to run gridmix with compressed trace file.However, it throws a
> JsonParseException and exit.
> exception details:
> ==================
> org.codehaus.jackson.JsonParseException: Illegal character ((CTRL-CHAR, code
> 31)): only regular white space (\r, \n,
> \t) is allowed between tokens
> at [Source: org.apache.hadoop.fs.fsdatainputstr...@17ba38f; line: 1, column:
> 2]
> at
> org.codehaus.jackson.impl.JsonParserBase._constructError(JsonParserBase.java:651)
> at
> org.codehaus.jackson.impl.JsonParserBase._reportError(JsonParserBase.java:635)
> at
> org.codehaus.jackson.impl.JsonParserBase._throwInvalidSpace(JsonParserBase.java:596)
> at
> org.codehaus.jackson.impl.Utf8StreamParser._skipWSOrEnd(Utf8StreamParser.java:981)
> at
> org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.java:77)
> at
> org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:688)
> at
> org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:624)
> at
> org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:275)
> at
> org.apache.hadoop.tools.rumen.JsonObjectMapperParser.getNext(JsonObjectMapperParser.java:84)
> at
> org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:117)
> at
> org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:29)
> at
> org.apache.hadoop.mapred.gridmix.JobFactory.getNextJobFiltered(JobFactory.java:174)
> at
> org.apache.hadoop.mapred.gridmix.StressJobFactory$StressReaderThread.run(StressJobFactory.java:166)
> 10/09/23 09:43:17 ERROR gridmix.Gridmix: Error in trace
> org.codehaus.jackson.JsonParseException: Illegal character ((CTRL-CHAR, code
> 31)): only regular white space (\r, \n,
> \t) is allowed between tokens
> at [Source: org.apache.hadoop.fs.fsdatainputstr...@17ba38f; line: 1, column:
> 2]
> at
> org.codehaus.jackson.impl.JsonParserBase._constructError(JsonParserBase.java:651)
> at
> org.codehaus.jackson.impl.JsonParserBase._reportError(JsonParserBase.java:635)
> at
> org.codehaus.jackson.impl.JsonParserBase._throwInvalidSpace(JsonParserBase.java:596)
> at
> org.codehaus.jackson.impl.Utf8StreamParser._skipWSOrEnd(Utf8StreamParser.java:981)
> at
> org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.java:77)
> at
> org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:688)
> at
> org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:624)
> at
> org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:275)
> at
> org.apache.hadoop.tools.rumen.JsonObjectMapperParser.getNext(JsonObjectMapperParser.java:84)
> at
> org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:117)
> at
> org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:29)
> at
> org.apache.hadoop.mapred.gridmix.JobFactory.getNextJobFiltered(JobFactory.java:174)
> at
> org.apache.hadoop.mapred.gridmix.StressJobFactory$StressReaderThread.run(StressJobFactory.java:166)
> 10/09/23 09:43:17 INFO gridmix.Gridmix: Exiting...
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
