andygrove commented on code in PR #4986:
URL: https://github.com/apache/datafusion-comet/pull/4986#discussion_r3667214045
##########
docs/source/contributor-guide/native_shuffle.md:
##########
@@ -244,14 +250,14 @@ independently compressed, allowing parallel decompression
during reads.
## Configuration
-| Config | Default | Description
|
-| ------------------------------------------------- | ------- |
---------------------------------------- |
-| `spark.comet.exec.shuffle.enabled` | `true` | Enable Comet
shuffle |
-| `spark.comet.exec.shuffle.mode` | `auto` | Shuffle mode:
`native`, `jvm`, or `auto` |
-| `spark.comet.exec.shuffle.compression.codec` | `zstd` | Compression
codec |
-| `spark.comet.exec.shuffle.compression.zstd.level` | `1` | Zstd
compression level |
-| `spark.comet.shuffle.write.buffer.size` | `1MB` | Write buffer
size |
-| `spark.comet.columnar.shuffle.batch.size` | `8192` | Target rows
per batch |
+| Config | Default | Description
|
+| -------------------------------------------- | ------- |
---------------------------------------- |
+| `spark.comet.shuffle.enabled` | `true` | Enable Comet
shuffle |
+| `spark.comet.shuffle.mode` | `auto` | Shuffle mode:
`native`, `jvm`, or `auto` |
+| `spark.comet.shuffle.compression.codec` | `zstd` | Compression codec
|
+| `spark.comet.shuffle.compression.zstd.level` | `1` | Zstd compression
level |
+| `spark.comet.shuffle.write.buffer.size` | `1MB` | Write buffer size
|
Review Comment:
@mbutrovich could we merge this one and then do a separate docs-only follow
up? Save some CI time...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
