[
https://issues.apache.org/jira/browse/ASTERIXDB-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wail Y. Alkowaileet updated ASTERIXDB-3029:
-------------------------------------------
Description:
Currently, AsterixDB uses IVisitablePointable to allow functions (e.g.,
IPrintVisitor) to traverse and process (print for IPrintVisitor) nested values.
The problem is that IVisitablePointable eagerly materializes all nested values
into temporary buffers before a nested value could be processed, which is
expensive.
For the columnar format, AsterixDB needs to infer the schema and columnize the
rows during data ingestion, which requires traversing nested values. Using
IVisitablePointable in this case could hinder the ingestion rate drastically.
was:
Currently, AsterixDB's uses IVisitablePointable to allow functions (e.g.,
IPrintVisitor) to traverse and process (print for IPrintVisitor) nested values.
The problem is that IVisitablePointable eagerly materializes all nested values
into temporary buffers before a nested value could be processed, which is
expensive.
For the columnar format, AsterixDB needs to infer the schema and columnize the
rows during data ingestion, which requires traversing nested values. Using
IVisitablePointable in this case could hinder the ingestion rate drastically.
> Allow single-pass nested values traversal
> -----------------------------------------
>
> Key: ASTERIXDB-3029
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-3029
> Project: Apache AsterixDB
> Issue Type: Improvement
> Components: RT - Runtime
> Affects Versions: 0.9.7
> Reporter: Wail Y. Alkowaileet
> Assignee: Wail Y. Alkowaileet
> Priority: Major
> Fix For: 0.9.8
>
>
> Currently, AsterixDB uses IVisitablePointable to allow functions (e.g.,
> IPrintVisitor) to traverse and process (print for IPrintVisitor) nested
> values. The problem is that IVisitablePointable eagerly materializes all
> nested values into temporary buffers before a nested value could be
> processed, which is expensive.
> For the columnar format, AsterixDB needs to infer the schema and columnize
> the rows during data ingestion, which requires traversing nested values.
> Using IVisitablePointable in this case could hinder the ingestion rate
> drastically.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
