On Thursday, 21 January 2016 at 17:17:52 UTC, Saurabh Das wrote:
On Thursday, 21 January 2016 at 17:10:39 UTC, data pulverizer
wrote:
On Thursday, 21 January 2016 at 16:01:33 UTC, wobbles wrote:
Interesting that reading a file is so slow.
Your timings from R, is that including reading the file also?
Yes, its just insane isn't it?
It is insane. Earlier in the thread we were tackling the wrong
problem clearly. Hence the adage, "measure first" :-/.
As suggested by Edwin van Leeuwen, can you give us a timing of:
auto records = File("Acquisition_2009Q2.txt",
"r").byLine.map!(a => a.split("|").array).array;
Thanks,
Saurabh
Good news and bad new. I was going for something similar to what
you have above and both slash the time alot:
Time (s): 1.024
But now the output is a little garbled. For some reason the
splitter isn't splitting correctly - or we are not applying it
properly. Line 0:
["100001703051", "RETAIL", "BANK OF AMERICA,
N.A.|4.875|207000|3", "0", "03/200", "|05", "2009|75", "75|1|26",
"80", "|N", "|", "O ", "ASH", "OU", " REFINANCE|PUD|1|INVE",
"TOR", "C", "|801||FRM", "\n\n", "863", "", "FRM"]
