Michael Smith created IMPALA-11457:
--------------------------------------

             Summary: Ozone parallelism reduced when backends are co-located
                 Key: IMPALA-11457
                 URL: https://issues.apache.org/jira/browse/IMPALA-11457
             Project: IMPALA
          Issue Type: Bug
          Components: Backend
    Affects Versions: Impala 4.1.0
            Reporter: Michael Smith


When Impala and Ozone backends are co-located (at the same IP address), access 
to Ozone will use a local filesystem access path. It's supposed to assign each 
backend a separate disk ID so access happens in parallel, but a bug in 
assigning queues when storage ID is unknown results in all Ozone backends 
sharing the same queue. This results in reduced parallelism as the queue uses a 
single I/O thread.

To make Impala see Ozone as co-located in a dev environment, start Impala with 
{{--hostname=localhost}} (which is already the default for Ozone).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to