[
https://issues.apache.org/jira/browse/TEZ-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205820#comment-15205820
]
Bikas Saha commented on TEZ-3181:
---------------------------------
I understand. But after that when this incomplete data is passed to 0.8
analyzers then how can we expect them to work correctly? My concern is that
consumers of this data may not handle such dropped data and instead depend on
the parser to ensure that the data is valid. Dropping this event would make the
data invalid. Perhaps instead of dropping it, we could translate it into
something that makes sense on the 0.8 side but that would need versioning via
TEZ-3179. Does this make sense or am I missing something? :) I am not sure how
making the parser succeed would be an end goal by itself since the parsed data
is going to be consumer by analyzers.
> History parser : Handle invalid/unsupported history event types gracefully
> --------------------------------------------------------------------------
>
> Key: TEZ-3181
> URL: https://issues.apache.org/jira/browse/TEZ-3181
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-3181.1.patch
>
>
> TEZ-2581 changed/renamed some of HistoryEventType. This causes parser to
> throw exception when trying to parse 0.7.x ATS data with 0.8.x parser.
> {noformat}
> Exception in thread "main" java.lang.IllegalArgumentException: No enum
> constant
> org.apache.tez.dag.history.HistoryEventType.VERTEX_PARALLELISM_UPDATED
> at java.lang.Enum.valueOf(Enum.java:238)
> at
> org.apache.tez.dag.history.HistoryEventType.valueOf(HistoryEventType.java:21)
> at
> org.apache.tez.history.parser.datamodel.VertexInfo.<init>(VertexInfo.java:117)
> at
> org.apache.tez.history.parser.datamodel.VertexInfo.create(VertexInfo.java:159)
> at
> org.apache.tez.history.parser.ATSFileParser.processVertices(ATSFileParser.java:98)
> at
> org.apache.tez.history.parser.ATSFileParser.parseATSZipFile(ATSFileParser.java:202)
> at
> org.apache.tez.history.parser.ATSFileParser.getDAGData(ATSFileParser.java:70)
> {noformat}
> Long term fix is to have versioning support (TEZ-3179) in ATS data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
