runzhiwang created LIVY-667:
-------------------------------

             Summary: Don't support query big partition
                 Key: LIVY-667
                 URL: https://issues.apache.org/jira/browse/LIVY-667
             Project: Livy
          Issue Type: Bug
          Components: Thriftserver
    Affects Versions: 0.6.0
            Reporter: runzhiwang


When enable livy.server.thrift.incrementalCollect, thrift use toLocalIterator 
to load one partition at each time instead of the whole rdd to avoid 
OutOfMemory. However, if the largest partition is too big, the OutOfMemory 
still occurs.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to