Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/12088 )
Change subject: Improve SCRATCH_ALLOCATION_FAILED error ...................................................................... Improve SCRATCH_ALLOCATION_FAILED error Adds additional context about how much scratch was allocated by the query and the impalad in total. We sometimes see scratch allocation failures because a query was spilling heavily and ate up all the disk. In this case, the high values in the error should provide an additional clue that the volume of spilling is the problem (rather than disks being full for other reasons). Example error after deleting /tmp/impala-scratch: [localhost:21000] default> set mem_limit=150m; select distinct * from tpch_parquet.lineitem limit 5; WARNINGS: Could not create files in any configured scratch directories (--scratch_dirs=/tmp/impala-scratch) on backend 'tarmstrong-box:22000'. 2.00 MB of scratch is currently in use by this Impala Daemon (2.00 MB by this query). See logs for previous errors that may have prevented creating or writing scratch files. Disk I/O error: open() failed for /tmp/impala-scratch/7d473ea7aef26431:c9105f7900000000_3120108e-475b-4616-9825-8bbdb1dc9cc2. The given path doesn't exist. errno=2 Change-Id: Icbedd586c57ec02e784143927e82b74455f98dc8 Reviewed-on: http://gerrit.cloudera.org:8080/12088 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M be/src/runtime/tmp-file-mgr.cc M be/src/runtime/tmp-file-mgr.h M common/thrift/generate_error_codes.py 3 files changed, 21 insertions(+), 13 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/12088 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Icbedd586c57ec02e784143927e82b74455f98dc8 Gerrit-Change-Number: 12088 Gerrit-PatchSet: 4 Gerrit-Owner: Tim Armstrong <[email protected]> Gerrit-Reviewer: Bikramjeet Vig <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
