Csaba Ringhofer created IMPALA-14673:
----------------------------------------

             Summary: Allow downloading Thrift profiles in impala-shell
                 Key: IMPALA-14673
                 URL: https://issues.apache.org/jira/browse/IMPALA-14673
             Project: IMPALA
          Issue Type: New Feature
          Components: Clients
            Reporter: Csaba Ringhofer


Setting the format is already supported Impala's HS2 interface:
https://github.com/apache/impala/blob/45051a27672c3a8a5be304ab2c71fc5c02946788/common/thrift/ImpalaService.thrift#L1216

This would be mainly useful together with IMPALA-572 that would allow writing 
profiles to  files as printing the binary format to stdout is not too helpful. 
E.g.
impala-shell --profile_format=thrift --profile_output=/tmp/impala_profile_log

A reason to do this is to get all counters if aggregated profiles are used, as 
the default text format is "lossy" in this case.

Using the same format as Impala's profile log would allow processing these 
files with impala-profile-tool.

A few more ideas that could improve this:
- supporting json format
- allowing to set this option runtime (set 
profile_output=/tmp/impala_profile_log)
- allow place holders in the file name to create a new file for each query 
(e.g. {date} or {queryid})



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to