Surya Hebbar has uploaded this change for review. ( http://gerrit.cloudera.org:8080/21463
Change subject: IMPALA-13106: Support larger imported query profile sizes through compression ...................................................................... IMPALA-13106: Support larger imported query profile sizes through compression Imported query profiles are currently being stored in IndexedDB. Although IndexedDB does not have storage limitations like other browser storage APIs, there is a storage limit for a single attribute / field. For supporting larger query profiles, 'pako' compression library has been added along with its associated license. Before adding query profile JSON to indexedDB, it undergoes compression using this library. As compression is a long running process that can block the main thread, this has been delegated to a worker script running in the background. The worker script returns all input data sent to it in compressed form. The process of compression consumes time; hence, an alert message is displayed on the queries page warning user to refrain from closing or reloading the page. When multiple profiles are chosen, after each query profile insertion, the subsequent one is not triggered until compression and insertion are finished. The inserted query profile field is decompressed before parsing on the query plan, query profile, query statement, and query timeline page. Change-Id: I8c4f31beb9cac89051460bf764b6d50c3933bd03 --- M .gitattributes M LICENSE.txt M bin/rat_exclude_files.txt A www/pako.min.js M www/queries.tmpl M www/query_plan_text.tmpl M www/query_profile.tmpl M www/query_stmt.tmpl M www/query_timeline.tmpl A www/scripts/queries/compressionWorker.js 10 files changed, 129 insertions(+), 72 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/63/21463/1 -- To view, visit http://gerrit.cloudera.org:8080/21463 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I8c4f31beb9cac89051460bf764b6d50c3933bd03 Gerrit-Change-Number: 21463 Gerrit-PatchSet: 1 Gerrit-Owner: Surya Hebbar <[email protected]>
