Ngone51 commented on a change in pull request #35185:
URL: https://github.com/apache/spark/pull/35185#discussion_r830827582
##########
File path: core/src/main/scala/org/apache/spark/status/storeTypes.scala
##########
@@ -286,6 +289,7 @@ private[spark] class TaskDataWrapper(
taskId,
index,
attempt,
+ partitionId,
new Date(launchTime),
Review comment:
Thanks, I have reproduced the issue with the above steps. And now I see
where the problem is. Basically, the fix in `JsonProtocol` only solves the
compatible issue when reading event files. But, when reading from LeveDB,
there's no compatible conversion for it. I tried to set the `partitionId` of
`TaskDataWrapper` with the default value -1 and seems to work. Could you
double-check? @jackylee-ch
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
