khandelwal-prateek commented on code in PR #4146:
URL: https://github.com/apache/gobblin/pull/4146#discussion_r2508897452
##########
gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergTable.java:
##########
@@ -344,4 +351,119 @@ protected void updateSchema(Schema updatedSchema, boolean
onlyValidate) throws T
}
}
+ /**
+ * Container for file path, partition information, and file size.
+ */
+ public static class FilePathWithPartition {
+ private final String filePath;
+ private final Map<String, String> partitionData;
+ private final long fileSize;
+
+ public FilePathWithPartition(String filePath, Map<String, String>
partitionData) {
+ this(filePath, partitionData, 0L);
+ }
+
+ public FilePathWithPartition(String filePath, Map<String, String>
partitionData, long fileSize) {
+ this.filePath = filePath;
+ this.partitionData = partitionData;
+ this.fileSize = fileSize;
+ }
+
+ public String getFilePath() {
+ return filePath;
+ }
+
+ public Map<String, String> getPartitionData() {
Review Comment:
`getPartitionData()` is part of the `FilePathWithPartition` class's public
interface to access partition metadata. `getPartitionData()` is used in
IcebergSourceTest.java for testing assertions to validate partition metadata
and to extract partition values for uniqueness checks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
