Re: [PR] [GLUTEN-6590][CH] Support compact mergetree file on s3 [incubator-gluten]

Mon, 29 Jul 2024 01:27:55 -0700 


lwz9103 commented on code in PR #6591:
URL: https://github.com/apache/incubator-gluten/pull/6591#discussion_r1694811996


##########
backends-clickhouse/src/test/scala/org/apache/gluten/execution/GlutenClickHouseMergeTreeWriteOnS3Suite.scala:
##########
@@ -635,6 +671,7 @@ class GlutenClickHouseMergeTreeWriteOnS3Suite
 
     withSQLConf(
       "spark.databricks.delta.optimize.minFileSize" -> "200000000",
+      
"spark.gluten.sql.columnar.backend.ch.runtime_settings.mergetree.insert_without_local_storage"
 -> "true",

Review Comment:
   Test directly merge parts on s3. See this code branch
   
![image](https://github.com/user-attachments/assets/26c868db-1880-457e-9100-ac6cd987ea76)
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to