Shannon Ladymon commented on HIVE-7926:

[~sershe], thanks for clarifying that!

I had a few other things I'd like to reword but am not quite sure how. I'd 
appreciate any light you can shed on them:
* In the sentence: “The initial stage of the query is pushed into #LLAP, large 
shuffle is performed in their own containers” - What does "their own 
containers" refer to? Is there only one large shuffle, or multiple shuffles?
* In the sentence: "The node allows parallel execution for multiple query 
fragments from different queries and sessions” - what does "the node" refer to? 
A single LLAP node? 

[~asears], I noticed that the last link on the page, titled ["Try Hive LLAP" | 
http://www.lewuathe.com/blog/2015/08/12/try-hive-llap/] is a broken link. 
Should I delete that link from the page, or is there an updated link you'd like 
to add? Also, the Web Services section is currently blank. Should this section 
be deleted, or is there content you intend to add?

> long-lived daemons for query fragment execution, I/O and caching
> ----------------------------------------------------------------
>                 Key: HIVE-7926
>                 URL: https://issues.apache.org/jira/browse/HIVE-7926
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>              Labels: TODOC2.0
>             Fix For: 2.0.0
>         Attachments: LLAPdesigndocument.pdf
> We are proposing a new execution model for Hive that is a combination of 
> existing process-based tasks and long-lived daemons running on worker nodes. 
> These nodes can take care of efficient I/O, caching and query fragment 
> execution, while heavy lifting like most joins, ordering, etc. can be handled 
> by tasks.
> The proposed model is not a 2-system solution for small and large queries; 
> neither it is a separate execution engine like MR or Tez. It can be used by 
> any Hive execution engine, if support is added; in future even external 
> products (e.g. Pig) can use it.
> The document with high-level design we are proposing will be attached shortly.

This message was sent by Atlassian JIRA

Reply via email to