ChukwaArchive byte[] needs to be wrapped in DataByteArray
---------------------------------------------------------
Key: CHUKWA-452
URL: https://issues.apache.org/jira/browse/CHUKWA-452
Project: Hadoop Chukwa
Issue Type: Bug
Affects Versions: 0.4.0
Reporter: Gerrit Jansen van Vuuren
Fix For: 0.4.0
I've been trying to read the data inserted into /chukwa/finalArchives using the
ChukwaArchive Loader in pig.
On trying to STORE only the data field using BinaryStore I get:
FAILED
java.lang.ClassCastException: [B cannot be cast to
org.apache.pig.data.DataByteArray
at org.apache.pig.builtin.BinaryStorage.putNext(BinaryStorage.java:128)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:200)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:174)
at
org.apache.hadoop.mapred.MapTask$DirectMapOutputCollector.collect(MapTask.java:642)
at
org.apache.hadoop.mapred.MapTask$OldOutputCollector.collect(MapTask.java:466)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.collect(PigMapOnly.java:70)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:255)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:244)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:65)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Looking at the ChukwaArchive class I saw that the data:byte[] is set to the
Tuple without wrapping to DataByteArray.
The patch I'm submitting applies this change by wrapping the data:byte[] with
the DataByteArray class.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
