RussellSpitzer commented on issue #7981: URL: https://github.com/apache/iceberg/issues/7981#issuecomment-1736513804
So I checked and this is user error. Although the title of this issue uses the correct name of the parameter, the actual command in the example uses underscores instead of dashes. `max_concurrent_file_group_rewrites` should be `max-concurrent-file-group-rewrites` https://github.com/apache/iceberg/blob/42cf1579ab97ff0080630c752e877593882a4fac/api/src/main/java/org/apache/iceberg/actions/RewriteDataFiles.java#L75-L80 ```scala scala> spark.sql("CALL local.system.rewrite_data_files(table => 'db.table', strategy => 'sort', sort_order=>'data asc', options => map( 'max_concurrent_file_group_rewrites', '10'))") java.lang.IllegalArgumentException: Cannot use options [max_concurrent_file_group_rewrites], they are not supported by the action or the rewriter SORT ... scala> spark.sql("CALL local.system.rewrite_data_files(table => 'db.table', strategy => 'sort', sort_order=>'data asc', options => map('max-concurrent-file-group-rewrites', '10'))") val res10: org.apache.spark.sql.DataFrame = [rewritten_data_files_count: int, added_data_files_count: int ... 2 more fields] ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
