deepakpanda93 commented on issue #16985: URL: https://github.com/apache/hudi/issues/16985#issuecomment-4901126482
This issue was reviewed as part of the JIRA-migrated backlog triage. `java.io.InvalidClassException ... local class incompatible: stream classdesc serialVersionUID = 2474481021876753867, local class serialVersionUID = 4655759304258465903` is a Java-serialization class-mismatch symptom, not a table/data-format problem. `HoodieFileGroupReaderBasedParquetFileFormat` does not declare a fixed `serialVersionUID`, and its constructor signature changed between 1.0.0 and 1.0.2 (`tableState` -> `tablePath`), so its auto-generated UID differs across versions. This error occurs when the driver serializes the file-format object and ships it to executors that are running a *different* Hudi bundle version (driver/executor jar skew, or a stale Hudi jar on the executor/cluster classpath). To proceed, please share: (1) the exact Hudi bundle jar(s) on the driver AND on every executor/cluster node (2) how the job is submitted (spark-submit `--jars` vs cluster-installed jars) (3) confirmation that a single, identical Hudi version is present on all classpaths. In almost all cases, aligning the driver and executor Hudi versions resolves this. If we don't hear back in 30 days, we'll close as stale. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
