This is an automated email from the ASF dual-hosted git repository.
kfaraz pushed a commit to branch 25.0.0
in repository https://gitbox.apache.org/repos/asf/druid.git
The following commit(s) were added to refs/heads/25.0.0 by this push:
new 789922ac1b Update to native ingestion doc - backport (#13483)
789922ac1b is described below
commit 789922ac1b6ea7c46297fcd65d5214a724385862
Author: Jill Osborne <[email protected]>
AuthorDate: Wed Dec 7 09:38:05 2022 +0000
Update to native ingestion doc - backport (#13483)
* Update to native ingestion doc
(cherry picked from commit aba83f289dd4dfbf5414ef808c8e35440835b957)
* Update native-batch.md
* Update native-batch.md
---
docs/ingestion/native-batch.md | 3 +--
1 file changed, 1 insertion(+), 2 deletions(-)
diff --git a/docs/ingestion/native-batch.md b/docs/ingestion/native-batch.md
index 7106a9a000..e8d83f3404 100644
--- a/docs/ingestion/native-batch.md
+++ b/docs/ingestion/native-batch.md
@@ -679,8 +679,7 @@ Returns the task attempt history of the worker task spec of
the given id, or HTT
While ingesting data using the parallel task indexing, Druid creates segments
from the input data and pushes them. For segment pushing,
the parallel task index supports the following segment pushing modes based
upon your type of [rollup](./rollup.md):
-- Bulk pushing mode: Used for perfect rollup. Druid pushes every segment at
the very end of the index task. Until then, Druid stores created segments in
memory and local storage of the service running the index task. This mode can
cause problems if you have limited storage capacity, and is not recommended to
use in production.
-To enable bulk pushing mode, set `forceGuaranteedRollup` in your TuningConfig.
You cannot use bulk pushing with `appendToExisting` in your IOConfig.
+- Bulk pushing mode: Used for perfect rollup. Druid pushes every segment at
the very end of the index task. Until then, Druid stores created segments in
memory and local storage of the service running the index task. To enable bulk
pushing mode, set `forceGuaranteedRollup` to `true` in your tuning config. You
cannot use bulk pushing with `appendToExisting` in your IOConfig.
- Incremental pushing mode: Used for best-effort rollup. Druid pushes segments
are incrementally during the course of the indexing task. The index task
collects data and stores created segments in the memory and disks of the
services running the task until the total number of collected rows exceeds
`maxTotalRows`. At that point the index task immediately pushes all segments
created up until that moment, cleans up pushed segments, and continues to
ingest the remaining data.
## Capacity planning
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
