This is an automated email from the ASF dual-hosted git repository.
suneet pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/druid.git
The following commit(s) were added to refs/heads/master by this push:
new 8aaefb9 Docs - MiddleManager Affinity "strong" definition (#11480)
8aaefb9 is described below
commit 8aaefb91e3fa7721e28f3c9d24358ea419b9039b
Author: Peter Marshall <[email protected]>
AuthorDate: Sat Aug 14 03:17:16 2021 +0100
Docs - MiddleManager Affinity "strong" definition (#11480)
* Affinity "strong" definition
Reworded "strong" to emphasise meaning and consequences - OTBO
https://the-asf.slack.com/archives/CJ8D1JTB8/p1609558156092800
* Spelling corrections
* Update docs/configuration/index.md
Co-authored-by: Charles Smith <[email protected]>
* Update docs/configuration/index.md
Co-authored-by: Charles Smith <[email protected]>
Co-authored-by: Charles Smith <[email protected]>
---
docs/configuration/index.md | 7 +++----
1 file changed, 3 insertions(+), 4 deletions(-)
diff --git a/docs/configuration/index.md b/docs/configuration/index.md
index b365759..156a261 100644
--- a/docs/configuration/index.md
+++ b/docs/configuration/index.md
@@ -1210,13 +1210,12 @@ Example: a function that sends batch_index_task to
workers 10.0.0.1 and 10.0.0.2
###### Affinity
-Affinity configs can be provided to the _equalDistribution_ and _fillCapacity_
strategies using the "affinityConfig"
-field. If not provided, the default is to not use affinity at all.
+Use the `affinityConfig` field to pass affinity configuration to the
_equalDistribution_ and _fillCapacity_ strategies. If not provided, the default
is to not use affinity at all.
|Property|Description|Default|
|--------|-----------|-------|
|`affinity`|JSON object mapping a datasource String name to a list of indexing
service MiddleManager host:port String values. Druid doesn't perform DNS
resolution, so the 'host' value must match what is configured on the
MiddleManager and what the MiddleManager announces itself as (examine the
Overlord logs to see what your MiddleManager announces itself as).|{}|
-|`strong`|With weak affinity (the default), tasks for a dataSource may be
assigned to other MiddleManagers if their affinity-mapped MiddleManagers are
not able to run all pending tasks in the queue for that dataSource. With strong
affinity, tasks for a dataSource will only ever be assigned to their
affinity-mapped MiddleManagers, and will wait in the pending queue if
necessary.|false|
+|`strong`|When `true` tasks for a datasource must be assigned to
affinity-mapped MiddleManagers. Tasks remain queued until a slot becomes
available. When `false`, Druid may assign tasks for a datasource to other
MiddleManagers when affinity-mapped MiddleManagers are unavailable to run
queued tasks.|false|
###### WorkerCategorySpec
@@ -1408,7 +1407,7 @@ then the value from the configuration below is used:
|--------|-----------|-------|
|`druid.worker.version`|Version identifier for the Indexer.|0|
|`druid.worker.capacity`|Maximum number of tasks the Indexer can
accept.|Number of available processors - 1|
-|`druid.worker.globalIngestionHeapLimitBytes`|Total amount of heap available
for ingestion processing. This is applied by automatically setting the
`maxBytesInMemory` property on tasks.|60% of configured JVM heap|
+|`druid.worker.globalIngestionHeapLimitBytes`|Total amount of heap available
for ingestion processing. This is applied by automatically setting the
`maxBytesInMemory` property on tasks.|60% of configured JVM heap|
|`druid.worker.numConcurrentMerges`|Maximum number of segment persist or merge
operations that can run concurrently across all tasks.|`druid.worker.capacity`
/ 2, rounded down|
|`druid.indexer.task.baseDir`|Base temporary working
directory.|`System.getProperty("java.io.tmpdir")`|
|`druid.indexer.task.baseTaskDir`|Base temporary working directory for
tasks.|`${druid.indexer.task.baseDir}/persistent/tasks`|
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
