[
https://issues.apache.org/jira/browse/IMPALA-13795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933454#comment-17933454
]
Surya Hebbar commented on IMPALA-13795:
---------------------------------------
h2. Bandwidth throttled (8mbps approx)-*
No compression - 8 seconds
!8mbps_throttled_plan_TPCDS14_no_compression.png|height=720!
With compression - 2 seconds
!8mbps_throttled_plan_TPCDS14_compression.png|height=720!
h2. No throttling / Local -
!no_throttle_plan_TPCDS14_compression.png|height=720!
!no_throttle_plan_TPCDS14_no_compression.png|height=720!
h2. Approximate improvements for a TPC-DS 14 query ran locally with 3 nodes
with defaults
h2. -> JSON profile : 4.53MB to 428.94KB
h2. 8mbps throttled network: 8s to 2s
h2. Without throttling / Raw local: 421ms to 421ms
h2. -> Text profile : 1.24MB to 219KB
h2. 8mbps throttled network: 1.3s to 281ms
h2. Without throttling / Raw local: 281ms to 281ms
> Support serving webUI metadata with gzip compression
> ----------------------------------------------------
>
> Key: IMPALA-13795
> URL: https://issues.apache.org/jira/browse/IMPALA-13795
> Project: IMPALA
> Issue Type: New Feature
> Reporter: Surya Hebbar
> Assignee: Surya Hebbar
> Priority: Major
> Attachments: 8mbps_throttled_plan_TPCDS14_compression.png,
> 8mbps_throttled_plan_TPCDS14_no_compression.png,
> no_throttle_plan_TPCDS14_compression.png,
> no_throttle_plan_TPCDS14_no_compression.png
>
>
> For large JSONs and text profiles, Impala can support serving text metadata
> with gzip content encoding for query plan, query timeline and the text
> profile. This results in faster load times, as the browser's native gzip
> decompression is very fast 300-400MB/s.
> This would result in an average compression of 60-70%, resulting in profile
> sizes of 400MB becoming 40MB or less.
> In many cases, the bandwidth hinders faster webUI renderings. This would
> result in significant increases on speed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
