max.width.per.endpoint - how many minor fragments you can have per major fragment on a single node
global.max.width - max number of minor fragments per major fragment you can have across all nodes affinity.factor - When deciding how many minor fragments to schedule on each node, this is the factor by which you favor nodes which have data locality vs. nodes which do not. executor.threads - Seems like maximum number of threads we can have ? I am not very sure about this one. These messages are debug messages, not errors. So, what is the problem you have ? Thanks Padma On Tue, Jul 3, 2018 at 9:00 PM, Divya Gehlot <[email protected]> wrote: > Hi, > I would like to understand below configurations : > work: { > max.width.per.endpoint: 5, > global.max.width: 100, > affinity.factor: 1.2, > executor.threads: 4 > }, > > As I am getting below error at time in some of the Drill bits : > 2018-07-03 04:08:45,725 [pool-245-thread-13] INFO > o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on > host <DNSAddress> Skipping affinity to that host. > 2018-07-03 04:08:45,731 [pool-245-thread-11] INFO > o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on > host <DNSAddress> Skipping affinity to that host. > 2018-07-03 04:08:45,732 [pool-245-thread-12] INFO > o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on > host <DNSAddress> Skipping affinity to that host. > 2018-07-03 04:08:45,732 [pool-245-thread-14] INFO > o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on > host <DNSAddress> Skipping affinity to that host. > 2018-07-03 04:08:45,733 [pool-245-thread-3] INFO > o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on > host <DNSAddress> Skipping affinity to that host. > 2018-07-03 04:08:45,733 [pool-245-thread-16] INFO > o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on > host <DNSAddress> Skipping affinity to that host. > 2018-07-03 04:08:45,735 [pool-245-thread-15] INFO > o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on > host <DNSAddress> Skipping affinity to that host. > > Is there any relationship between affinity configurations and Drill logs ? > Appreciate if anybody can help me understand ! > > Thanks, > Divya >
