t0il3ts0ap commented on issue #2515:
URL: https://github.com/apache/hudi/issues/2515#issuecomment-779655692
@vinothchandar
Ya my bad, archival starts from older commit. Found the file with null
content. Relevant logs:
```
21/02/16 07:45:29 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073304.deltacommit.requested'
for reading
21/02/16 07:45:29 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073304.deltacommit.inflight'
for reading
21/02/16 07:45:29 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073304.deltacommit'
for reading
21/02/16 07:45:29 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073413.deltacommit.requested'
for reading
21/02/16 07:45:30 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073413.deltacommit.inflight'
for reading
21/02/16 07:45:30 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073413.deltacommit'
for reading
21/02/16 07:45:30 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073441.deltacommit.requested'
for reading
21/02/16 07:45:30 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073441.deltacommit.inflight'
for reading
21/02/16 07:45:30 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073441.deltacommit'
for reading
21/02/16 07:45:30 INFO S3NativeFileSystem: Opening
's3://navi-emr-poc/delta-streamer-test/tables/accountsv2/.hoodie/20210216073500.deltacommit.requested'
for reading
21/02/16 07:45:30 ERROR HoodieTimelineArchiveLog: Failed to archive commits,
.commit file: 20210216073500.deltacommit.requested
java.lang.NullPointerException: null of string of map of union in field
extraMetadata of org.apache.hudi.avro.model.HoodieCommitMetadata of union in
field hoodieCommitMetadata of org.apache.hudi.avro.model.HoodieArchivedMetaEntry
```
Content of 20210216073304.deltacommit
```
{
"partitionToWriteStats" : { },
"compacted" : false,
"extraMetadata" : {
"schema" : null,
"deltastreamer.checkpoint.key" :
"to_be_deleted.public.accounts,0:59615,1:2,2:0"
},
"operationType" : "UPSERT",
"fileIdAndRelativePaths" : { },
"totalRecordsDeleted" : 0,
"totalLogRecordsCompacted" : 0,
"totalLogFilesCompacted" : 0,
"totalCompactedRecordsUpdated" : 0,
"totalLogFilesSize" : 0,
"totalScanTime" : 0,
"totalCreateTime" : 0,
"totalUpsertTime" : 0
}
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
