[
https://issues.apache.org/jira/browse/IMPALA-14673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18056240#comment-18056240
]
ASF subversion and git services commented on IMPALA-14673:
----------------------------------------------------------
Commit 4e3c9d09d8a466d45be6bea02b8fea997f826ceb in impala's branch
refs/heads/master from Balazs Hevele
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=4e3c9d09d ]
IMPALA-14673 impala-shell: profile format argument
Selecting format was already supported by Impala's HS2 Interface,
but so far we only used the default STRING format in impala shell.
Added a command line argument to set which format to use:
impala-shell.sh --profile_format=Format
Can also be changed runtime as a shell option, in the shell:
set profile_format=Format;
Format can be string/base64/json.
If not set, the default string format will be used.
With base64 format, the output can be parsed with impala-profile-tool.
Change-Id: I032a5d0436f123d737d46d0b8cecbae09888a789
Reviewed-on: http://gerrit.cloudera.org:8080/23884
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Allow downloading Thrift profiles in impala-shell
> -------------------------------------------------
>
> Key: IMPALA-14673
> URL: https://issues.apache.org/jira/browse/IMPALA-14673
> Project: IMPALA
> Issue Type: New Feature
> Components: Clients
> Reporter: Csaba Ringhofer
> Assignee: Balazs Hevele
> Priority: Major
> Labels: ramp-up
>
> Setting the format is already supported Impala's HS2 interface:
> https://github.com/apache/impala/blob/45051a27672c3a8a5be304ab2c71fc5c02946788/common/thrift/ImpalaService.thrift#L1216
> This would be mainly useful together with IMPALA-572 that would allow writing
> profiles to files as printing the binary format to stdout is not too
> helpful. E.g.
> impala-shell --profile_format=thrift --profile_output=/tmp/impala_profile_log
> A reason to do this is to get all counters if aggregated profiles are used,
> as the default text format is "lossy" in this case.
> Using the same format as Impala's profile log would allow processing these
> files with impala-profile-tool.
> A few more ideas that could improve this:
> - supporting json format
> - allowing to set this option runtime (set
> profile_output=/tmp/impala_profile_log)
> - allow place holders in the file name to create a new file for each query
> (e.g. date or queryid)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
