Daniel Becker has uploaded a new patch set (#6). ( http://gerrit.cloudera.org:8080/14735 )
Change subject: POC: Remote codegen (Milestone 1) ...................................................................... POC: Remote codegen (Milestone 1) Optional remote codegen, set by a query option. Can be used together with async. The Impala executor does everything as usual until the point when it would optimize and compile the LLVM module. Instead, it sends the LLVM bitcode to the compile server which optimizes it and sends back an object file (handled in memory, not written to disk). The executor blocks (in synchronous mode) until it receives the compiled object file. Note that the customization of the LLVM module (replacing function calls) is still done by the executor. The server is a python script that calls llc to compile the code. It will later be replaced probably by a special impalad that uses the LLVM API to compile the code. Communication is not secure. TODO: Now both async and remote are switched ON for testing, these should be disabled by default. Change-Id: I375d969ceb31b3ee234d6ca56a77d508ae43bb0f --- A be/src/codegen/LLVMSmallVectorMemoryBuffer.h M be/src/codegen/llvm-codegen.cc M be/src/codegen/llvm-codegen.h A be/src/codegen/simple_message.h M be/src/runtime/fragment-state.cc M be/src/service/fe-support.cc M be/src/service/query-options.cc M be/src/service/query-options.h M common/thrift/ImpalaInternalService.thrift M common/thrift/ImpalaService.thrift M testdata/bin/kill-all.sh M testdata/bin/run-all.sh A testdata/bin/server.py 13 files changed, 617 insertions(+), 62 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/35/14735/6 -- To view, visit http://gerrit.cloudera.org:8080/14735 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I375d969ceb31b3ee234d6ca56a77d508ae43bb0f Gerrit-Change-Number: 14735 Gerrit-PatchSet: 6 Gerrit-Owner: Daniel Becker <[email protected]> Gerrit-Reviewer: Bikramjeet Vig <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Daniel Becker <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
