andykrk commented on issue #4604:
URL: https://github.com/apache/hudi/issues/4604#issuecomment-1020263489


   @nsivabalan I just rerun my load with the same data last time (we made it 
static) and the only commit that was added in a directory today is:
   
![image](https://user-images.githubusercontent.com/24304947/150819406-7ff6b9af-e144-442d-8312-c31b88f86113.png)
   
   The content of 20220124144848903.commit is:
   
   ```
   {
     "partitionToWriteStats" : { },
     "compacted" : false,
     "extraMetadata" : {
       "schema" : 
"{\"type\":\"record\",\"name\":\"targetschema__target_table_record\",\"namespace\":\"hoodie.targetschema__target_table\",\"fields\":[{\"name\":\"col56\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col57\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col58\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col59\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col60\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col61\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col62\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col63\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col64\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col65\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col66\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col67\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col68\"
 
,\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col69\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col70\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col71\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col72\",\"type\":[\"null\",{\"type\":\"fixed\",\"name\":\"fixed\",\"namespace\":\"hoodie.targetschema__target_table.targetschema__target_table_record.col72\",\"size\":16,\"logicalType\":\"decimal\",\"precision\":38,\"scale\":18}],\"default\":null},{\"name\":\"col73\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col74\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col75\",\"type\":[\"null\",{\"type\":\"fixed\",\"name\":\"fixed\",\"namespace\":\"hoodie.targetschema__target_table.targetschema__target_table_record.col75\",\"size\":16,\"logicalType\":\"decimal\",\"precision\":38,\"scale\":18}],\"default\":null},{\"name\":\"col76\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"c
 
ol77\",\"type\":[\"null\",{\"type\":\"fixed\",\"name\":\"fixed\",\"namespace\":\"hoodie.targetschema__target_table.targetschema__target_table_record.col77\",\"size\":16,\"logicalType\":\"decimal\",\"precision\":38,\"scale\":18}],\"default\":null},{\"name\":\"col78\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col79\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col80\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col81\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col82\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col83\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col84\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col85\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col86\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col87\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col88\",\"type\":[\"null\",\"string\"],\"default
 
\":null},{\"name\":\"col89\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col90\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col91\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col92\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col93\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col94\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col95\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col96\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col97\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col98\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col1\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"col99\",\"type\":{\"type\":\"long\",\"logicalType\":\"timestamp-micros\"}}]}"
     },
     "operationType" : "UPSERT",
     "writePartitionPaths" : [ ],
     "totalRecordsDeleted" : 0,
     "totalLogRecordsCompacted" : 0,
     "totalLogFilesCompacted" : 0,
     "totalCompactedRecordsUpdated" : 0,
     "totalLogFilesSize" : 0,
     "totalScanTime" : 0,
     "totalCreateTime" : 0,
     "totalUpsertTime" : 0,
     "minAndMaxEventTime" : {
       "Optional.empty" : {
         "val" : null,
         "present" : false
       }
     },
     "fileIdAndRelativePaths" : { }
   }
   ```
   
   Please let me know if there is anything else we need.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to