bvaradar commented on issue #764: Hoodie 0.4.7: Error upserting bucketType UPDATE for partition #, No value present URL: https://github.com/apache/incubator-hudi/issues/764#issuecomment-512960024 > @jackwang2 @amaranathv there are 3 issues here with different stack traces. > > @jackwang2 first issue you reported . is that gone? or you waiting for 0.4.7 to be fixed with issue below to try that? > > ``` > Caused by: java.util.NoSuchElementException: No value present > at com.uber.hoodie.common.util.Option.get(Option.java:112) > at com.uber.hoodie.io.HoodieMergeHandle.(HoodieMergeHandle.java:71) > at com.uber.hoodie.table.HoodieCopyOnWriteTable.getUpdateHandle(HoodieCopyOnWriteTable.java:226) > at com.uber.hoodie.table.HoodieCopyOnWriteTable.handleUpdate(HoodieCopyOnWriteTable.java:180) > at com.uber.hoodie.table.HoodieCopyOnWriteTable.handleUpsertPartition(HoodieCopyOnWriteTable.java:263) > ... 28 more > ``` > > @jackwang2 second issue (probably same as what you mentioned on slack?) . are you able to reproduce it? https://github.com/apache/incubator-hudi/blob/hoodie-0.4.7/hoodie-client/src/main/java/com/uber/hoodie/io/HoodieCommitArchiveLog.java#L279 seems its related to archiving CLEAN action. The schema for this has not changed in years. it looks like some corruption. are you able to print out `new String(commitTimeline.getInstantDetails(hoodieInstant).get())`, so we can see the bytes.. > > ``` > Caused by: java.io.IOException: Not an Avro data fileat org.apache.avro.file.DataFileReader.openReader(DataFileReader.java:50) > at com.uber.hoodie.common.util.AvroUtils.deserializeAvroMetadata(AvroUtils.java:215) > at com.uber.hoodie.io.HoodieCommitArchiveLog.convertToAvroRecord(HoodieCommitArchiveLog.java:279) > at com.uber.hoodie.io.HoodieCommitArchiveLog.archive(HoodieCommitArchiveLog.java:247)... 41 more > 19/06/25 12:37:52 INFO SparkContext: Invoking stop() from shutdown hook > ``` > > @amaranathv your stack trace is different.. > > ``` > Caused by: java.lang.IllegalArgumentException: Can not create a Path from an empty string > at org.apache.hadoop.fs.Path.checkPathArg(Path.java:130) > at org.apache.hadoop.fs.Path.<init>(Path.java:138) > at org.apache.hadoop.fs.Path.<init>(Path.java:92) > at com.uber.hoodie.table.HoodieMergeOnReadTable.lambda$rollback$5(HoodieMergeOnReadTable.java:510) > ``` > > can you print out partitionPath below? It seems like its null .. Please check if your input has valid non-null partition paths. > > ``` > writer = HoodieLogFormat.newWriterBuilder().onParentPath( > new Path(this.getMetaClient().getBasePath(), partitionPath)) > .withFileId(wStat.getFileId()).overBaseCommit(baseCommitTime) > .withFs(this.metaClient.getFs()) > .withFileExtension(HoodieLogFile.DELTA_EXTENSION).build(); > ``` @jackwang2 : Are you still seeing this issue ?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
