Philip Zeyliger has uploaded a new change for review.

  http://gerrit.cloudera.org:8080/7816

Change subject: IMPALA-3642: Adding backend addresses to error statuses for 
scratch failures.
......................................................................

IMPALA-3642: Adding backend addresses to error statuses for scratch failures.

Adds GetBackendAddress() (which is host:port) to status messages stemming
from IO failures writing to local scratch disks.

I tested this manually by running a query which spills after
"chmod 000 /tmp/impala-scratch" for one type of error. To wit:

    [hostname:21000] > select count(*) from tpch_parquet.lineitem join 
tpch_parquet.orders on l_orderkey = o_orderkey;
    Query: select count(*) from tpch_parquet.lineitem join tpch_parquet.orders 
on l_orderkey = o_orderkey
    Query submitted at: 2017-08-24 08:48:23 (Coordinator: http://hostname:25000)
    Query progress can be monitored at: 
http://hostname:25000/query_plan?query_id=5243a68eb540c075:85fd2ccc00000000
    WARNINGS: Could not create files in any configured scratch directories 
(--scratch_dirs). See logs for previous errors that may have prevented creating 
or writing scratch files.
    Opening 
'/tmp/impala-scratch/5243a68eb540c075:85fd2ccc00000000_bbee0878-805f-4881-bf0d-f18c7d18ee83'
 for write failed with errno=13 description=Error(13): Permission denied 
backend=hostname:22002
    Opening 
'/tmp/impala-scratch/5243a68eb540c075:85fd2ccc00000000_bbee0878-805f-4881-bf0d-f18c7d18ee83'
 for write failed with errno=13 description=Error(13): Permission denied 
backend=hostname:22002

Change-Id: If31a50fdf6031312d0348d48aeb8f9688274cac2
---
M be/src/runtime/disk-io-mgr.cc
1 file changed, 9 insertions(+), 9 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/16/7816/1
-- 
To view, visit http://gerrit.cloudera.org:8080/7816
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: If31a50fdf6031312d0348d48aeb8f9688274cac2
Gerrit-PatchSet: 1
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Philip Zeyliger <[email protected]>

Reply via email to