Reynold Xin created SPARK-9404:
----------------------------------

             Summary: UnsafeArrayData
                 Key: SPARK-9404
                 URL: https://issues.apache.org/jira/browse/SPARK-9404
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
            Reporter: Reynold Xin
            Assignee: Wenchen Fan


An Unsafe-based ArrayData implementation. To begin with, we can encode data 
this way:

first 4 bytes is the # elements
then each 4 byte is the start offset of the element, unless it is negative, in 
which case the element is null.
followed by the elements themselves

For example, [10, 11, 12, 13, null, 14], internally should be represented as 
(each 4 bytes)

5, 28, 32, 36, 40, -44, 48, 10, 11, 12, 13, 0, 14




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to