SimpleRowSource is already a "streaming interface"
The trick would be to teach the higher-layer machinery to make use of it
where possible.
On 2012-03-20 00:27, Dallan wrote:
I'd like to extend the H2 source to read csv files from S3.
Specifically, I'd like to implement a streaming interface (as
SimpleRowSource?) so that a query could process the csv file one row
at a time without needing to read the entire file into memory.
Ideally, I'd like to have something like
select small.X, sum(big.Y)
from CSVREAD('s3:/bucket/path/filename.csv') as big, small
where big.foreign-key = small.key
group by small.X
where csv file would be streamed in so it wouldn't have to fit
entirely in memory, joined with the small table already resident in
memory, and the results aggregated and returned.
Is this feasible? If so, could someone recommend where I should make
the changes?
Thanks,
Dallan
--
You received this message because you are subscribed to the Google Groups "H2
Database" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/h2-database?hl=en.
