aokolnychyi commented on a change in pull request #2362:
URL: https://github.com/apache/iceberg/pull/2362#discussion_r600049781
##########
File path: spark/src/main/java/org/apache/iceberg/spark/SparkUtil.java
##########
@@ -38,6 +39,13 @@
private SparkUtil() {
}
+ public static Table toStaticTable(Table table) {
+ // TODO: consider setting some fields as null to reduce the size
Review comment:
It may not make any difference. According to my preliminary tests, the
size of a serialized static table is around 75226 bytes where almost 72000
bytes are taken by FileIO. I need to test it with tables that have a lot of
columns and a number of specs and sort orders but it may not be worth it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
