[
https://issues.apache.org/jira/browse/IMPALA-14673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Csaba Ringhofer updated IMPALA-14673:
-------------------------------------
Description:
Setting the format is already supported Impala's HS2 interface:
https://github.com/apache/impala/blob/45051a27672c3a8a5be304ab2c71fc5c02946788/common/thrift/ImpalaService.thrift#L1216
This would be mainly useful together with IMPALA-572 that would allow writing
profiles to files as printing the binary format to stdout is not too helpful.
E.g.
impala-shell --profile_format=thrift --profile_output=/tmp/impala_profile_log
A reason to do this is to get all counters if aggregated profiles are used, as
the default text format is "lossy" in this case.
Using the same format as Impala's profile log would allow processing these
files with impala-profile-tool.
A few more ideas that could improve this:
- supporting json format
- allowing to set this option runtime (set
profile_output=/tmp/impala_profile_log)
- allow place holders in the file name to create a new file for each query
(e.g. {date} or {queryid} )
was:
Setting the format is already supported Impala's HS2 interface:
https://github.com/apache/impala/blob/45051a27672c3a8a5be304ab2c71fc5c02946788/common/thrift/ImpalaService.thrift#L1216
This would be mainly useful together with IMPALA-572 that would allow writing
profiles to files as printing the binary format to stdout is not too helpful.
E.g.
impala-shell --profile_format=thrift --profile_output=/tmp/impala_profile_log
A reason to do this is to get all counters if aggregated profiles are used, as
the default text format is "lossy" in this case.
Using the same format as Impala's profile log would allow processing these
files with impala-profile-tool.
A few more ideas that could improve this:
- supporting json format
- allowing to set this option runtime (set
profile_output=/tmp/impala_profile_log)
- allow place holders in the file name to create a new file for each query
(e.g. {date} or {queryid})
> Allow downloading Thrift profiles in impala-shell
> -------------------------------------------------
>
> Key: IMPALA-14673
> URL: https://issues.apache.org/jira/browse/IMPALA-14673
> Project: IMPALA
> Issue Type: New Feature
> Components: Clients
> Reporter: Csaba Ringhofer
> Priority: Major
> Labels: ramp-up
>
> Setting the format is already supported Impala's HS2 interface:
> https://github.com/apache/impala/blob/45051a27672c3a8a5be304ab2c71fc5c02946788/common/thrift/ImpalaService.thrift#L1216
> This would be mainly useful together with IMPALA-572 that would allow writing
> profiles to files as printing the binary format to stdout is not too
> helpful. E.g.
> impala-shell --profile_format=thrift --profile_output=/tmp/impala_profile_log
> A reason to do this is to get all counters if aggregated profiles are used,
> as the default text format is "lossy" in this case.
> Using the same format as Impala's profile log would allow processing these
> files with impala-profile-tool.
> A few more ideas that could improve this:
> - supporting json format
> - allowing to set this option runtime (set
> profile_output=/tmp/impala_profile_log)
> - allow place holders in the file name to create a new file for each query
> (e.g. {date} or {queryid} )
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
