[Perldl] Loading large data from database into a piddle

[kmx]

Hi,

I want to ask what others use when need to load data from database into a 
piddle.

Of course I know about simple approach like this:

  use PDL;
  use DBI;
  my $dbh = DBI->connect($dsn);
  my $pdl = pdl($dbh->selectall_arrayref($sql_query));

But it does not scale well for very large data (millions of rows).

I have turned my solution into a "maybe module" that you can find here 
https://gist.github.com/kmx/6f1234478828e7960fbd (see pod doc at the end)

Any suggestions, improvements or alternative solutions are welcome.

--
kmx
_______________________________________________
Perldl mailing list
Perldl@jach.hawaii.edu
http://mailman.jach.hawaii.edu/mailman/listinfo/perldl